CFBI
CFBI performs semi-supervised video object segmentation by integrating foreground and background feature representations through contrastive embedding and multi-scale matching mechanisms.
Key Features:
- Foreground–Background Feature Integration: Separates and embeds foreground and background regions to enhance contrastive representation for accurate segmentation.
- Multi-Scale Matching Structure: Implements multi-scale feature matching to detect and segment objects across varying spatial scales.
- Atrous Matching Strategy: Uses an atrous matching approach to improve segmentation efficiency and robustness without simulated data pre-training.
- Pixel-Level and Instance-Level Attention: Performs pixel-level matching and instance-level attention between reference frames and predicted sequences.
Scientific Applications:
- Video Object Segmentation: Segments foreground objects in video sequences using semi-supervised learning.
- Dynamic Scene Analysis: Analyzes moving objects in video data for computer vision and robotics research.
Methodology:
CFBI learns contrastive feature embeddings for foreground and background regions and performs multi-scale pixel-level matching and instance-level attention between reference and predicted frames to segment objects in video sequences.
Topics
Details
- License:
- BSD-3-Clause
- Tool Type:
- command-line tool
- Programming Languages:
- Python
- Added:
- 6/14/2021
- Last Updated:
- 8/20/2021
Operations
Publications
Yang Z, Wei Y, Yang Y. Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2021. doi:10.1109/tpami.2021.3081597. PMID:34003746.
PMID: 34003746
Links
Issue tracker
https://github.com/z-x-yang/CFBI/issues