DRPL

DRPL performs multi-focus image fusion using a deep learning pair-learning framework that processes entire images to generate binary focus masks distinguishing focused and defocused regions and produce all-in-focus fused images for image processing and bioinformatics applications.


Key Features:

  • Whole-image processing: Processes entire source images directly without dividing them into small patches to determine focus status.
  • Pair learning strategy: Uses pairs of complementary source images as inputs to learn corresponding focus masks for each image in the pair.
  • Binary mask generation: Produces binary masks that distinguish focused from defocused regions for each input image.
  • Complementary constraint: Imposes a complementary constraint on paired images to ensure fused output maintains focus coverage across regions.
  • Gradient loss: Incorporates a gradient loss function that leverages edges and gradients present in focused areas while accounting for their absence in defocused regions.
  • Structural Similarity Index (SSIM): Employs SSIM to balance fidelity between reference images and the final fused output.
  • All-in-focus fusion: Produces fused images intended to be visually all-in-focus by combining complementary focused regions.

Scientific Applications:

  • Multi-focus image fusion: Applied to fuse complementary images with varying focus into a single all-in-focus image.
  • Image processing and bioinformatics: Used where all-in-focus reconstructions are required for downstream image analysis in image processing and bioinformatics contexts.
  • Benchmarking on datasets: Evaluated on synthetic and real-world datasets, demonstrating effectiveness relative to existing methods.

Methodology:

Processes entire image pairs with a deep learning pair-learning approach to generate complementary binary focus masks, enforces a complementary constraint, and optimizes model parameters using a gradient loss that emphasizes edges together with SSIM to balance reference and fused outputs.

Topics

Details

Tool Type:
command-line tool
Programming Languages:
Python
Added:
1/18/2021
Last Updated:
3/3/2021

Operations

Publications

Li J, Guo X, Lu G, Zhang B, Xu Y, Wu F, Zhang D. DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion. IEEE Transactions on Image Processing. 2020;29:4816-4831. doi:10.1109/tip.2020.2976190. PMID:32142440.

PMID: 32142440
Funding: - National Natural Science Foundation of China: 61906162 - China Postdoctoral Science Foundation: 2019M662198, 2019TQ0316 - Science, Technology and Innovation Commission of Shenzhen Municipality: ZDSYS20190902093015527