CMDSR

CMDSR implements a conditional meta-network for single-image super-resolution (SISR) to adapt SR models to multiple simultaneous degradations and improve reconstruction across varying degradation distributions.


Key Features:

  • Conditional Hyper-Network Framework: CMDSR employs a conditional meta-network that dynamically adjusts super-resolution model parameters according to input degradation characteristics.
  • ConditionNet and BaseNet Integration: ConditionNet extracts task-level degradation priors from a support set of degraded image patches which are used to adaptively modify BaseNet parameters.
  • Task Contrastive Loss: Training uses a task contrastive loss that minimizes inner-task feature distances and maximizes cross-task feature distances to separate degradation priors.
  • Blind Framework with Single Parameter Update: CMDSR operates as a blind framework that does not require predefined degradation maps and performs adaptation with a single parameter update.
  • General Applicability: The flexible BaseNet structure enables application across a range of SISR models and degradation scenarios.

Scientific Applications:

  • SISR under multiple degradations: Adaptation of super-resolution models to inputs affected by multiple simultaneous degradations.
  • Medical Imaging: Improve reconstruction quality in medical images subject to complex degradations.
  • Remote Sensing: Enhance resolution and reconstruction of remotely sensed imagery with heterogeneous degradations.
  • Digital Forensics: Support image enhancement for forensic analysis where images suffer varied degradation patterns.

Methodology:

CMDSR uses a conditional meta-network where ConditionNet extracts task-level degradation priors from a support set of degraded image patches to modulate BaseNet parameters, and training employs a task contrastive loss (minimizing inner-task and maximizing cross-task distances); adaptation is performed blind via a single parameter update.

Topics

Details

License:
MIT
Cost:
Free of charge
Tool Type:
workflow
Programming Languages:
Python
Added:
9/7/2022
Last Updated:
11/24/2024

Operations

Publications

Yin G, Wang W, Yuan Z, Ji W, Yu D, Sun S, Chua T, Wang C. Conditional Hyper-Network for Blind Super-Resolution With Multiple Degradations. IEEE Transactions on Image Processing. 2022;31:3949-3960. doi:10.1109/tip.2022.3176526. PMID:35635814.