RecapNet

RecapNet: Action Proposal Generation in Untrimmed Video Sequences

RecapNet generates temporal action proposals from untrimmed video sequences by modeling short-term contextual dependencies and ranking candidate segments based on actionness probability.


Key Features:

  • Residual Causal Convolution Module: Constructs short-term memory of past events using residual causal convolutions to preserve temporal context.
  • Joint Probability Actionness Density Ranking: Computes and ranks candidate action segments using joint probability estimates of actionness density.
  • Single-Pass Processing: Processes full-length video sequences in a single forward pass to generate comprehensive action proposals.

Scientific Applications:

  • Action Detection: Improves temporal localization performance in untrimmed video analysis.
  • Video Analytics: Supports surveillance, sports analytics, and human–computer interaction through automated action proposal generation.

Methodology:

Integrates residual causal convolution–based temporal memory with probabilistic actionness density ranking to identify and prioritize relevant action segments. Performance validated on benchmark datasets including THUMOS14 and ActivityNet-1.3.

Topics

Details

Programming Languages:
Python
Added:
1/18/2021
Last Updated:
2/4/2021

Operations

Publications

Wang T, Chen Y, Lin Z, Zhu A, Li Y, Snoussi H, Wang H. RecapNet: Action Proposal Generation Mimicking Human Cognitive Process. IEEE Transactions on Cybernetics. 2021;51(12):6017-6028. doi:10.1109/tcyb.2020.2965196. PMID:32011279.

PMID: 32011279
Funding: - National Natural Science Foundation of China: 61972016 - Fundamental Research Funds for the Central Universities: YWF-19-BJ-J-237