HTD
HTD decouples classification and regression tasks in two-stage object detectors to mitigate task-misalignment and improve detection accuracy and localization.
Key Features:
- Task-Specific Decoupling: HTD decouples the sibling heads for classification and regression, enabling task-tailored feature processing to mitigate semantic inconsistency and task-misalignment.
- Progressive Graph (PGraph) Module: Employs progressive graph reasoning with local spatial aggregation and global semantic interaction to enhance semantic representations of region proposals and improve classification.
- Border-Aware Adaptation (BA) Module: Integrates multi-level features adaptively with emphasis on low-level border activation to enhance spatial and border perception for regression-based localization.
- Semantic Feature Aggregation (SFA) Module: Aggregates global semantics using image-level supervision to provide shared semantic knowledge across decoupled branches.
- Instance-Level Semantic Consistency (ISC): Maintains instance-level semantic consistency by utilizing aggregated knowledge from the SFA module to prevent inconsistencies between branches.
Scientific Applications:
- Medical imaging: Improves accuracy and consistency of two-stage detectors for object identification and classification in medical images.
- Biological data analysis: Enhances detection and classification of objects in biological datasets requiring precise localization and semantic discrimination.
- Automated microscopy: Facilitates reliable object detection in microscopy images by improving classification and border-aware localization.
Methodology:
Systematic decoupling of tasks with specialized modules including semantic aggregation, progressive graph reasoning (local spatial aggregation and global semantic interaction), and adaptive multi-level feature integration focused on low-level border activation.
Details
- License:
- Apache-2.0
- Cost:
- Free of charge
- Tool Type:
- command-line tool
- Operating Systems:
- Mac, Linux
- Programming Languages:
- Python
- Added:
- 4/30/2022
- Last Updated:
- 4/30/2022
Operations
Publications
Li W, Chen Z, Li B, Zhang D, Yuan Y. HTD: Heterogeneous Task Decoupling for Two-Stage Object Detection. IEEE Transactions on Image Processing. 2021;30:9456-9469. doi:10.1109/tip.2021.3126423. PMID:34780326.
PMID: 34780326
Funding: - National Natural Science Foundation of China: 62001410
- Hong Kong Research Grants Council (RGC) Collaborative Research Fund: C4063-18G (CityU 8739029)