GraphRegNet

GraphRegNet predicts displacement vectors on a sparse irregular grid of keypoints to achieve dense registration of 3D lung CT images and to handle large 3D deformations for accurate medical image registration.


Key Features:

  • Deep graph regularization network: Combines convolutional neural network layers with graph neural network layers within a unified architecture for displacement regularization.
  • Sparse keypoint formulation: Predicts displacement vectors on a sparse irregular grid of distinctive keypoints rather than dense voxel-wise displacement maps.
  • Dense deformation field reconstruction: Produces well-regularized dense registration fields for 3D lung CT volumes from sparse keypoint predictions.
  • Memory efficiency: Reduces memory requirements compared to traditional dense displacement maps used in 3D medical volumes.
  • Large-deformation handling: Targets large 3D deformations such as inhale-to-exhale lung CT and interpatient abdominal MRI registration.
  • Learning-based registration: Supports both supervised and unsupervised medical image registration approaches.
  • Fast inference: Enables near real-time applications through learning-based fast inference.
  • Performance metric: Demonstrated target registration error (TRE) below 1.4 mm on exhale-to-inhale lung CT experiments.
  • Optical flow inspiration: Adapts concepts from FlowNet and PWC-Net, including the use of discrete dense displacement maps, to 3D medical imaging.

Scientific Applications:

  • Exhale-to-inhale lung CT registration: Registration of inhale–exhale lung CT pairs with sub-1.4 mm TRE for tracking anatomical correspondence.
  • Interpatient abdominal MRI registration: Alignment of abdominal MRI volumes across patients to accommodate large intersubject anatomical variability.
  • General 3D medical image registration: Supervised and unsupervised registration tasks requiring accurate dense deformation fields and large-deformation handling.

Methodology:

Formulates registration as prediction of displacement vectors on a sparse irregular grid of keypoints and regularizes these displacements via a unified CNN+GNN architecture; adapts discrete dense displacement map concepts from FlowNet and PWC-Net to 3D medical imaging and supports supervised and unsupervised learning-based training.

Topics

Details

License:
MIT
Tool Type:
command-line tool
Programming Languages:
Python
Added:
9/20/2021
Last Updated:
9/20/2021

Operations

Publications

Hansen L, Heinrich MP. GraphRegNet: Deep Graph Regularisation Networks on Sparse Keypoints for Dense Registration of 3D Lung CTs. IEEE Transactions on Medical Imaging. 2021;40(9):2246-2257. doi:10.1109/tmi.2021.3073986. PMID:33872144.

PMID: 33872144
Funding: - German Research Foundation: 320997906 (HE 7364/2-1) - German Federal Ministry for Economic Affairs and Energy as part of the AI Space for Intelligence Healthcare Systems (KI SIGS) Consortium: 01MK20012B

Links