NDNet

NDNet performs lossless multiscale spatial modeling to enable real-time semantic segmentation and high-resolution scene parsing for autonomous driving.


Key Features:

  • Reversible ND and NC operations: Implements reversible ND and NC operations to alter channelwise information representation without information loss.
  • Lossless resolution conversion: Preserves information integrity during resolution transformations through reversible operations.
  • Complementary thumbnail sampling and collation: Uses complementary thumbnail sampling and collation to enhance spatial modeling capabilities.
  • Local Capturer and Global Dependence Builder (LCGB): Performs initial processing for large-scale inputs with fast, lossless resolution reduction while extracting features enriched with global context.
  • Spacewise Multiscale Feature Extractor (SMFE): Conducts dense multiscale spatial feature extraction efficiently with minimal computational overhead.
  • High-Resolution Semantic Generator (HSG): Reconstructs high-resolution outputs and adaptively amends semantic confusions to produce precise segmentation.

Scientific Applications:

  • Autonomous driving scene parsing: Applied to real-time semantic segmentation in autonomous driving to support safety-critical perception tasks.
  • Benchmark evaluation on Cityscapes: Demonstrates performance on the Cityscapes dataset with reported 76.47% mean Intersection over Union (mIoU) at over 240 frames per second and 78.8% mIoU at over 150 frames per second.

Methodology:

NDNet leverages reversible ND and NC operations for lossless resolution transformations; LCGB preprocesses inputs with fast lossless reduction and global-context feature extraction; SMFE performs efficient multiscale dense feature extraction; HSG reconstructs high-resolution outputs and refines semantic details.

Topics

Details

License:
MIT
Cost:
Free of charge
Tool Type:
command-line tool
Operating Systems:
Mac, Linux, Windows
Programming Languages:
Python, C++
Added:
2/4/2023
Last Updated:
2/4/2023

Operations

Publications

Li S, Yan Q, Zhou X, Wang D, Liu C, Chen Q. NDNet: Spacewise Multiscale Representation Learning via Neighbor Decoupling for Real-Time Driving Scene Parsing. IEEE Transactions on Neural Networks and Learning Systems. 2024;35(6):7884-7898. doi:10.1109/tnnls.2022.3221745. PMID:36409808.

PMID: 36409808
Funding: - National Key Research and Development Program of China: 2020AAA0108100 - National Natural Science Foundation of China: 61733013