DiRA

DiRA integrates discriminative, restorative, and adversarial learning to improve self-supervised representation learning from unlabeled medical images for enhanced deep semantic feature extraction.


Key Features:

  • Unified Learning Framework: DiRA is the first framework that combines discriminative, restorative, and adversarial learning in a cohesive manner to extract complementary visual information.
  • Generalizable Representation: Collaborative learning among the three components produces representations that generalize across organs, diseases, and imaging modalities.
  • Performance Superiority: DiRA outperforms fully supervised models trained on ImageNet, achieving superior performance with limited annotated data.
  • Fine-Grained Semantic Representation: The framework learns fine-grained semantic features that enable lesion localization using only image-level annotations.
  • Enhancement of Restorative Approaches: DiRA enhances state-of-the-art restorative methods as a general mechanism for unified representation learning in medical imaging.

Scientific Applications:

  • Organ segmentation: Enables organ segmentation across different imaging modalities using self-supervised representations.
  • Disease classification: Supports disease classification from medical images via learned deep semantic features.
  • Lesion detection and localization: Facilitates lesion detection and localization using image-level annotations and fine-grained representations.

Methodology:

Integration of discriminative learning (distinguishing features), restorative learning (input reconstruction), and adversarial learning (adversarial networks to refine representations).

Topics

Details

License:
Other
Cost:
Free of charge
Tool Type:
command-line tool
Operating Systems:
Mac, Linux, Windows
Programming Languages:
Python
Added:
1/9/2023
Last Updated:
11/24/2024

Operations

Data Inputs & Outputs

Backbone modelling

Outputs

    Publications

    Haghighi F, Taher MRH, Gotway MB, Liang J. DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2022. doi:10.1109/cvpr52688.2022.02016. PMID:36313959. PMCID:PMC9615927.

    PMID: 36313959
    PMCID: PMC9615927
    Funding: - NIH: R01HL128785 - National Science Foundation (NSF): ACI-1548562