DLTTA

DLTTA implements dynamic learning-rate modulation for test-time adaptation to mitigate cross-domain distribution shifts in medical image analysis.


Key Features:

  • Dynamic Learning Rate Adjustment: Modulates the learning rate for each test image individually to accommodate distribution shifts in sequential test data during Test-time Adaptation (TTA).
  • Memory Bank-Based Estimation: Implements a memory bank-based estimation scheme that quantifies the distribution discrepancy of each test sample relative to the training data.
  • Adaptive Weight Updates: Dynamically adjusts learning rates based on estimated discrepancies to determine the appropriate degree of weight updates for each test sample.

Scientific Applications:

  • Retinal Optical Coherence Tomography (OCT) Segmentation: Applied to retinal OCT segmentation to adapt segmentation models to domain-specific variations.
  • Histopathological Image Classification: Applied to histopathological image classification to adapt classifiers across data from different sources.
  • Prostate 3D MRI Segmentation: Applied to prostate 3D MRI segmentation to manage cross-domain discrepancies in volumetric MRI data.

Methodology:

Per-image dynamic learning-rate modulation during test-time adaptation; memory bank-based estimation of sample-to-training distribution discrepancy; adaptive adjustment of learning rates to control weight updates.

Topics

Details

License:
Not licensed
Tool Type:
library
Programming Languages:
Python
Added:
10/4/2022
Last Updated:
11/24/2024

Operations

Publications

Yang H, Chen C, Jiang M, Liu Q, Cao J, Heng PA, Dou Q. DLTTA: Dynamic Learning Rate for Test-Time Adaptation on Cross-Domain Medical Images. IEEE Transactions on Medical Imaging. 2022;41(12):3575-3586. doi:10.1109/tmi.2022.3191535. PMID:35839185.

PMID: 35839185
Funding: - Hong Kong Innovation and Technology Fund: GHP/110/19SZ, ITS/170/20, ITS/238/21 - The Chinese University of Hong Kong Shun Hing Institute of Advanced Engineering: MMT-p5-20