DiRA
DiRA integrates discriminative, restorative, and adversarial learning to improve self-supervised representation learning from unlabeled medical images for enhanced deep semantic feature extraction.
Key Features:
- Unified Learning Framework: DiRA is the first framework that combines discriminative, restorative, and adversarial learning in a cohesive manner to extract complementary visual information.
- Generalizable Representation: Collaborative learning among the three components produces representations that generalize across organs, diseases, and imaging modalities.
- Performance Superiority: DiRA outperforms fully supervised models trained on ImageNet, achieving superior performance with limited annotated data.
- Fine-Grained Semantic Representation: The framework learns fine-grained semantic features that enable lesion localization using only image-level annotations.
- Enhancement of Restorative Approaches: DiRA enhances state-of-the-art restorative methods as a general mechanism for unified representation learning in medical imaging.
Scientific Applications:
- Organ segmentation: Enables organ segmentation across different imaging modalities using self-supervised representations.
- Disease classification: Supports disease classification from medical images via learned deep semantic features.
- Lesion detection and localization: Facilitates lesion detection and localization using image-level annotations and fine-grained representations.
Methodology:
Integration of discriminative learning (distinguishing features), restorative learning (input reconstruction), and adversarial learning (adversarial networks to refine representations).
Topics
Details
- License:
- Other
- Cost:
- Free of charge
- Tool Type:
- command-line tool
- Operating Systems:
- Mac, Linux, Windows
- Programming Languages:
- Python
- Added:
- 1/9/2023
- Last Updated:
- 11/24/2024
Operations
Data Inputs & Outputs
Backbone modelling
Inputs
Outputs
Publications
Haghighi F, Taher MRH, Gotway MB, Liang J. DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2022. doi:10.1109/cvpr52688.2022.02016. PMID:36313959. PMCID:PMC9615927.
PMID: 36313959
PMCID: PMC9615927
Funding: - NIH: R01HL128785
- National Science Foundation (NSF): ACI-1548562