IFeaLiD
IFeaLiD visualizes localization of features in convolutional neural networks by producing similarity-based heat maps to interpret how different layers process image regions for computer vision tasks.
Key Features:
- Interactive Visualization: Enables interactive exploration of high-resolution feature maps with GPU acceleration via WebGL 2 for on-the-fly updates.
- Feature Map Interpretation: Represents neural network layers as multivariate feature maps and visualizes similarity between feature vectors of individual pixels to generate heat maps.
- Layer-Specific Insights: Compares perception of specific image regions to the entire image across network layers to reveal hierarchical feature extraction.
- Real-Time Processing: Processes high-resolution data in real time to support analysis of large-scale computer vision datasets.
Scientific Applications:
- Classification: Interprets convolutional neural network internal representations for image classification tasks.
- Object Detection: Analyzes how network layers encode region-level features relevant to object detection.
- Instance Segmentation: Examines layer-wise feature localization relevant to instance segmentation.
Methodology:
Visualizes feature maps from pre-trained networks such as ResNet101 across computer vision datasets and computes similarity heat maps from pixel-level feature vectors to reveal perceptual differences between regions and layers.
Topics
Details
- License:
- GPL-3.0
- Tool Type:
- web application
- Programming Languages:
- PHP
- Added:
- 9/27/2021
- Last Updated:
- 9/27/2021
Operations
Publications
Zurowietz M, Nattkemper TW. An Interactive Visualization for Feature Localization in Deep Neural Networks. Frontiers in Artificial Intelligence. 2020;3. doi:10.3389/frai.2020.00049. PMID:33733166. PMCID:PMC7861262.
PMID: 33733166
PMCID: PMC7861262
Funding: - Bundesministerium für Bildung und Forschung: 031A532B, 031A533A, 031A533B, 031A534A, 031A535A, 031A537B, 031A537C, 031A538A, 03F0812C