RecapNet
RecapNet: Action Proposal Generation in Untrimmed Video Sequences
RecapNet generates temporal action proposals from untrimmed video sequences by modeling short-term contextual dependencies and ranking candidate segments based on actionness probability.
Key Features:
- Residual Causal Convolution Module: Constructs short-term memory of past events using residual causal convolutions to preserve temporal context.
- Joint Probability Actionness Density Ranking: Computes and ranks candidate action segments using joint probability estimates of actionness density.
- Single-Pass Processing: Processes full-length video sequences in a single forward pass to generate comprehensive action proposals.
Scientific Applications:
- Action Detection: Improves temporal localization performance in untrimmed video analysis.
- Video Analytics: Supports surveillance, sports analytics, and human–computer interaction through automated action proposal generation.
Methodology:
Integrates residual causal convolution–based temporal memory with probabilistic actionness density ranking to identify and prioritize relevant action segments. Performance validated on benchmark datasets including THUMOS14 and ActivityNet-1.3.
Topics
Details
- Programming Languages:
- Python
- Added:
- 1/18/2021
- Last Updated:
- 2/4/2021
Operations
Publications
Wang T, Chen Y, Lin Z, Zhu A, Li Y, Snoussi H, Wang H. RecapNet: Action Proposal Generation Mimicking Human Cognitive Process. IEEE Transactions on Cybernetics. 2021;51(12):6017-6028. doi:10.1109/tcyb.2020.2965196. PMID:32011279.