RRDnCNN

RRDnCNN applies a degradation-aware deep neural network to jointly restore and reconstruct compressed, down-sampled video by removing compression artifacts and performing super-resolution.


Key Features:

  • Integration of Deep Learning: Leverages deep learning methods to enhance the quality of videos produced by down-sampling-based compression frameworks.
  • Artifact Removal and Super-Resolution: Performs simultaneous artifact removal and super-resolution to address degradation introduced by compression and sub-sampling.
  • Degradation-Aware Technique: Mitigates adverse effects of compression and sub-sampling across configurations including Random Access, Low Delay P, and All Intra.
  • End-to-End Network Architecture: Uses a u-shaped design with up-sampling skip connections to improve learning, enable reconstruction to use restoration features, and alleviate gradient vanishing in deep networks.
  • Performance Improvements: RR-DnCNN v2.0 achieves a 17.02% BD-rate reduction on UHD resolution videos anchored by the H.265/HEVC codec.

Scientific Applications:

  • Medical imaging: Enhances resolution and reduces compression artifacts in medical video data.
  • Surveillance: Improves visual quality of surveillance video for analysis and monitoring.
  • Remote sensing: Enhances compressed remote sensing video by restoring details and reducing artifacts.
  • Visual data integrity domains: Supports any domain where maintaining high visual data integrity after compression is crucial.

Methodology:

Uses a degradation-aware deep learning approach with a joint restoration-reconstruction end-to-end network; employs a u-shaped architecture with up-sampling skip connections to address gradient vanishing and targets down-sampling-based video compression frameworks with super-resolution as post-processing.

Topics

Details

Tool Type:
command-line tool, library
Added:
3/19/2021
Last Updated:
4/3/2021

Operations

Publications

Ho MM, Zhou J, He G. RR-DnCNN v2.0: Enhanced Restoration-Reconstruction Deep Neural Network for Down-Sampling-Based Video Coding. IEEE Transactions on Image Processing. 2021;30:1702-1715. doi:10.1109/tip.2020.3046872. PMID:33417543.

PMID: 33417543
Funding: - JST, PRESTO: JPMJPR1757 Japan