RFormer
RFormer restores real clinical fundus images using a Transformer-based generative adversarial network to improve image clarity and support downstream ophthalmic analyses.
Key Features:
- Clinical Dataset (Real Fundus, RF): A benchmark comprising 120 pairs of low- and high-quality (LQ/HQ) fundus images for evaluating real fundus image restoration methods.
- Transformer-based Generative Adversarial Network: A GAN architecture built with Transformer components specifically to restore degradation in clinical fundus images.
- Window-based Self-Attention Block (WSAB): WSAB captures non-local self-similarity and long-range dependencies within fundus images to enhance restoration performance.
- Transformer-based Discriminator: A Transformer-based discriminator enforces visual fidelity and realistic appearance in the restored images.
Scientific Applications:
- Real fundus image restoration: Demonstrated improvements over state-of-the-art (SOTA) methods in restoring real fundus images.
- Benchmark evaluation: Validated and benchmarked on the Real Fundus (RF) dataset of 120 LQ–HQ image pairs.
- Vessel segmentation: Improves performance of vessel segmentation by providing higher-quality input images.
- Optic disc and cup detection: Enhances optic disc and cup detection accuracy through improved image clarity.
Methodology:
Employs a Transformer-based GAN incorporating a Window-based Self-Attention Block (WSAB) and a Transformer-based discriminator, evaluated on the Real Fundus (RF) dataset of 120 low- and high-quality image pairs.
Topics
Details
- License:
- Not licensed
- Cost:
- Free of charge
- Tool Type:
- command-line tool
- Operating Systems:
- Mac, Linux, Windows
- Programming Languages:
- Python
- Added:
- 9/3/2022
- Last Updated:
- 11/24/2024
Operations
Publications
Deng Z, Cai Y, Chen L, Gong Z, Bao Q, Yao X, Fang D, Yang W, Zhang S, Ma L. RFormer: Transformer-Based Generative Adversarial Network for Real Fundus Image Restoration on a New Clinical Benchmark. IEEE Journal of Biomedical and Health Informatics. 2022;26(9):4645-4655. doi:10.1109/jbhi.2022.3187103. PMID:35767498.
PMID: 35767498
Funding: - Shenzhen Bay Laboratory and the Shenzhen International Science and Technology Information Center: KCXFZ20211020163813019