GAN
GAN implements fixed-point image-to-image translation to remove artifacts and enable weakly-supervised disease detection and localization in medical images.
Key Features:
- Fixed-Point Translation: Identifies and manipulates the minimal subset of target pixels required for domain translation, enabling "virtual healing" by transforming images to a healthy state and revealing diseased regions via image subtraction.
- Training Methodology: Supervises same-domain translation with a conditional identity loss and regularizes cross-domain translation with revised adversarial, domain classification, and cycle consistency losses.
- Disease Detection Framework: Derives a weakly-supervised framework for disease detection and localization that uses only image-level annotations to localize pathology without pixel-level labels.
- Multi-domain Object Removal and Integrity Preservation: Performs multi-domain image-to-image translation and object removal while preserving image integrity and reducing artifacts.
Scientific Applications:
- Medical Imaging : Artifact removal and highlighting of diseased regions through virtual healing and image subtraction to support diagnostic interpretation.
- Weakly-Supervised Localization: Disease localization using only image-level annotations, demonstrating improved accuracy and efficiency compared to existing methods.
- Multi-Domain Translation Research: Development and evaluation of multi-domain image-to-image translation approaches for tasks requiring minimal pixel interventions.
Methodology:
Implements fixed-point translation to minimize the subset of target pixels for transformation; supervises same-domain translation with a conditional identity loss; regularizes cross-domain translation with revised adversarial, domain classification, and cycle consistency losses; and uses virtual healing plus image subtraction to derive weakly-supervised disease localization from image-level annotations.
Topics
Details
- License:
- MIT
- Tool Type:
- command-line tool
- Programming Languages:
- Python
- Added:
- 1/20/2021
- Last Updated:
- 5/17/2021
Operations
Publications
Siddiquee MMR, Zhou Z, Tajbakhsh N, Feng R, Gotway M, Bengio Y, Liang J. Learning Fixed Points in Generative Adversarial Networks: From Image-to-Image Translation to Disease Detection and Localization. 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 2019. doi:10.1109/iccv.2019.00028. PMID:32612486. PMCID:PMC7329240.