BSNet

BSNet enhances few-shot learning for fine-grained image classification by applying a dual-similarity framework to generate compact and discriminative feature maps from convolutional embeddings.


Key Features:

  • Bi-similarity module: Processes embeddings using two distinct similarity measures to capture nuanced relationships and produce compact, discriminative feature maps.
  • Convolution-based embedding module: Transforms support and query images into high-dimensional feature representations via a convolutional embedding.
  • Dual-similarity framework: Leverages two separate similarity metrics to mitigate bias from single-measure metric-based methods and tighten same-class clustering in reduced feature space.
  • Few-shot learning support: Operates on small labeled support sets and query images to enable classification with limited examples.
  • Compatibility with metric/similarity-based networks: Implementable by slightly modifying established metric/similarity-based network architectures.
  • Empirical performance improvement: Demonstrated improved classification performance on fine-grained image benchmark datasets compared to traditional single-measure methods.
  • Enhanced generalization from limited data: Improves the model's ability to generalize from limited examples in complex, detailed images.

Scientific Applications:

  • Fine-grained image classification: Applied to tasks requiring discrimination of subtle visual differences between classes in few-shot settings.
  • Metric learning research: Serves as a framework for exploring multiple similarity measures in metric- or similarity-based networks.
  • Bioinformatics image analysis: Applicable to bioinformatics scenarios that require fine-grained image analysis with limited labeled data.
  • Generalization from limited data: Supports scientific domains that require improved model generalization with small training sets.

Methodology:

Support and query images pass through a convolution-based embedding module to produce high-dimensional feature representations, and a bi-similarity module applies two distinct similarity measures to those embeddings to generate compact, discriminative feature maps; the approach is achieved by slightly modifying established metric/similarity-based networks.

Topics

Details

Tool Type:
command-line tool
Added:
1/18/2021
Last Updated:
2/6/2021

Operations

Publications

Li X, Wu J, Sun Z, Ma Z, Cao J, Xue J. BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification. IEEE Transactions on Image Processing. 2021;30:1318-1331. doi:10.1109/tip.2020.3043128. PMID:33315565.

PMID: 33315565
Funding: - National Key Research and Development Program of China: 2019YFF0303300, 2019YFF0303302 - National Natural Science Foundation of China: 61763028, 61773071, 61906080, 61922015, U19B2036 - Beijing Natural Science Foundation under Project: Z200002 - Beijing Academy of Artificial Intelligence: BAAI2020ZJ0204 - Beijing Nova Programme Interdisciplinary Cooperation Project: Z191100001119140 - Engineering and Physical Sciences Research Council (EPSRC), U.K.: EP/R513143/1