L3Fnet

L3Fnet restores low-light light field (LF) images using a deep neural network that enhances visual quality while preserving epipolar geometry for refocusing and depth estimation.


Key Features:

  • Two-Stage Architecture: Stage-I encodes geometric information across all LF views and Stage-II reconstructs individual LF views using the encoded geometry.
  • Epipolar Geometry Preservation: Maintains epipolar geometry across LF views to ensure coherent multi-view reconstruction and consistent depth cues.
  • Adaptability to Low-Light Conditions: A pre-processing block adjusts the network response based on scene light level to handle lighting from moderately dim to near-zero lux.
  • LF Dataset: Training data include four LF captures per scene (one optimal exposure and three progressively lower light levels) plus an L3F-wild subset of night-time captures with near-zero lux and no ground truth.
  • Single-Frame Enhancement: Converts single-frame images into a pseudo-LF format to enable LF-based restoration for non-light-field inputs.

Scientific Applications:

  • Computational Photography: Improves LF-based refocusing and denoising under low-light scenarios.
  • Computer Vision: Provides enhanced multi-view inputs that preserve geometric consistency for downstream vision tasks.
  • Depth Estimation and Refocusing: Preserves and enhances depth cues across views to support precise depth estimation and post-capture refocusing.
  • Low-Light and Night-time Imaging Research: Enables analysis of LF data captured at near-zero lux for research without available ground truth.

Methodology:

Training uses a diverse LF dataset captured at multiple exposure levels; a pre-processing block adjusts for scene light level, Stage-I encodes geometric cues across views, and Stage-II reconstructs enhanced LF views.

Topics

Details

Tool Type:
command-line tool
Added:
1/18/2021
Last Updated:
2/12/2021

Operations

Publications

Lamba M, Rachavarapu KK, Mitra K. Harnessing Multi-View Perspective of Light Fields for Low-Light Imaging. IEEE Transactions on Image Processing. 2021;30:1501-1513. doi:10.1109/tip.2020.3045617. PMID:33360991.