IFeaLiD

IFeaLiD visualizes localization of features in convolutional neural networks by producing similarity-based heat maps to interpret how different layers process image regions for computer vision tasks.


Key Features:

  • Interactive Visualization: Enables interactive exploration of high-resolution feature maps with GPU acceleration via WebGL 2 for on-the-fly updates.
  • Feature Map Interpretation: Represents neural network layers as multivariate feature maps and visualizes similarity between feature vectors of individual pixels to generate heat maps.
  • Layer-Specific Insights: Compares perception of specific image regions to the entire image across network layers to reveal hierarchical feature extraction.
  • Real-Time Processing: Processes high-resolution data in real time to support analysis of large-scale computer vision datasets.

Scientific Applications:

  • Classification: Interprets convolutional neural network internal representations for image classification tasks.
  • Object Detection: Analyzes how network layers encode region-level features relevant to object detection.
  • Instance Segmentation: Examines layer-wise feature localization relevant to instance segmentation.

Methodology:

Visualizes feature maps from pre-trained networks such as ResNet101 across computer vision datasets and computes similarity heat maps from pixel-level feature vectors to reveal perceptual differences between regions and layers.

Topics

Details

License:
GPL-3.0
Tool Type:
web application
Programming Languages:
PHP
Added:
9/27/2021
Last Updated:
9/27/2021

Operations

Publications

Zurowietz M, Nattkemper TW. An Interactive Visualization for Feature Localization in Deep Neural Networks. Frontiers in Artificial Intelligence. 2020;3. doi:10.3389/frai.2020.00049. PMID:33733166. PMCID:PMC7861262.

PMID: 33733166
PMCID: PMC7861262
Funding: - Bundesministerium für Bildung und Forschung: 031A532B, 031A533A, 031A533B, 031A534A, 031A535A, 031A537B, 031A537C, 031A538A, 03F0812C

Links