CVID
CVID performs image deraining using Conditional Variational Auto-Encoders (CVAEs) to generate probabilistic, diverse reconstructions that improve visual clarity in images affected by rain.
Key Features:
- Conditional Variational Auto-Encoders (CVAEs): Employs CVAEs for probabilistic inference and to produce diverse derained predictions.
- Spatial Density Estimation (SDE) module: Estimates a rain density map per image to enable spatially adaptive deraining.
- Channel-Wise (CW) deraining: Processes each color channel individually to account for channel-specific rain density variations.
- Diversity of predictions: Produces multiple plausible reconstructions to address variability in rain intensity across space and color channels.
- Empirical performance: Reports superior deraining performance compared to deterministic image deraining methods on benchmark datasets.
- Ablation validation: Uses ablation studies to confirm the contributions of the SDE module and CW scheme.
Scientific Applications:
- Remote sensing: Enhances clarity of satellite and aerial imagery captured under rainy conditions to improve downstream analysis.
- Autonomous driving: Improves visibility in vehicle-captured images to support perception and decision-making in rainy environments.
- Surveillance systems: Restores visual quality of security footage affected by rain for more reliable monitoring and analysis.
Methodology:
Integrates probabilistic inference via CVAEs, uses an SDE module to estimate per-image rain density maps, applies a channel-wise deraining scheme processing individual color channels, and evaluates results on synthesized and real-world datasets with ablation studies.
Topics
Details
- Tool Type:
- command-line tool
- Programming Languages:
- Python
- Added:
- 1/18/2021
- Last Updated:
- 2/18/2021
Operations
Publications
Du Y, Xu J, Zhen X, Cheng M, Shao L. Conditional Variational Image Deraining. IEEE Transactions on Image Processing. 2020;29:6288-6301. doi:10.1109/tip.2020.2990606. PMID:32365032.
PMID: 32365032
Funding: - Natural Science Foundation of China: 61871016, 61922046, 61976060
- Tianjin Natural Science Foundation: 17JCJQJC43700, 18ZXZNGX00110