UOVOS
UOVOS performs unsupervised online video object segmentation by leveraging motion property understanding to automatically segment moving objects in unconstrained videos without user annotations.
Key Features:
- Unsupervised Online Segmentation: Processes video frames sequentially in an online manner without access to future frames to segment moving objects.
- Motion Property Understanding: Introduces a motion property defined as movement that coincides with a generic object within segmented regions to distinguish relevant moving objects from other dynamics.
- Salient Motion Detection and Object Proposal Integration: Integrates salient motion detection with object proposal techniques to reduce noise from dynamic backgrounds and stationary objects.
- Pixel-wise Fusion Strategy: Employs a pixel-wise fusion strategy to refine segmentation and eliminate false positives arising from motion detection errors.
- Forward Propagation Algorithm: Utilizes segmentation results from immediately preceding frames via a forward propagation algorithm to address unreliable detections and enforce temporal continuity.
Scientific Applications:
- Surveillance: Real-time detection and segmentation of moving objects in surveillance video streams.
- Autonomous Vehicle Navigation: Detection and segmentation of moving objects in dynamic scenes to support navigation and safety functions.
- Dynamic Scene Understanding: Unsupervised analysis of object movement in unconstrained videos without manual annotations, reducing reliance on labeled datasets.
Methodology:
Initial motion detection, object proposal generation, pixel-wise fusion for noise reduction, and temporal consistency enforcement via forward propagation using segmentation results from previous frames.
Topics
Details
- Programming Languages:
- MATLAB, C++, Python
- Added:
- 11/14/2019
- Last Updated:
- 1/2/2021
Operations
Publications
Zhuo T, Cheng Z, Zhang P, Wong Y, Kankanhalli M. Unsupervised Online Video Object Segmentation With Motion Property Understanding. IEEE Transactions on Image Processing. 2020;29:237-249. doi:10.1109/tip.2019.2930152. PMID:31369377.
PMID: 31369377
Funding: - National Natural Science Foundation of China: 2018JM6015, 61571362
- Natural Science Basic Research Plan in Shaanxi Province of China, as well as the Fundamental Research Funds for the Central Universities: 3102019ZY1004