DN3

DN3 provides deep learning tools for analysis of encephalographic data, particularly electroencephalography (EEG), to develop and validate neural-network–based models such as T-Vectors for classification, regression, and subject identification.


Key Features:

  • Deep learning for EEG: Implements deep neural network methods for analysis of encephalographic data with emphasis on electroencephalography (EEG).
  • Support for classification and regression: Supports development and validation of models for both classification and regression tasks on EEG data.
  • T-Vectors: Produces single-vector embeddings called T-Vectors, inspired by speech-recognition approaches, to represent individuals from EEG recordings.
  • Short-sequence embedding: Generates T-Vectors from short EEG sequences, in some cases as brief as one second.
  • Generalization to unseen users: Demonstrates that T-Vectors can generalize to identify users who were not included in the training set, including across sessions separated by days.
  • Dataset integration: Facilitates integration of public and private EEG datasets for training and evaluation.
  • Validation on motor imagery datasets: Validated methods on two motor imagery task datasets known for intra- and inter-subject signal variability.
  • Nearest-neighbor identification: Uses nearest-neighbor labeling of T-Vectors for subject identification, achieving reported accuracy up to 97.7%.
  • Visualization and clustering analysis: Includes visualization analyses showing distinct clustering of T-Vectors without subject conflation between datasets.
  • Large-cohort evaluation: Demonstrated performance in an experiment involving nearly 1,000 participants.

Scientific Applications:

  • Brain–computer interfaces (BCI): Development and benchmarking of neural-network models for BCI research using EEG data.
  • Biometrics and user identification: EEG-based biometric identification using T-Vectors and nearest-neighbor matching.
  • Neuroscience research: Representation learning and embedding analysis of EEG signals for neuroscientific studies.
  • Cross-session and cross-task generalization: Evaluation of subject identification and model generalization across recording sessions and task variations.

Methodology:

Uses deep neural networks to learn embeddings (T-Vectors) from short EEG sequences inspired by speech-recognition methods, applies nearest-neighbor labeling for identification, and employs visualization/clustering analyses; validation was performed on two motor imagery datasets and an experiment with nearly 1,000 participants.

Topics

Details

License:
BSD-3-Clause
Tool Type:
library
Programming Languages:
Python
Added:
1/18/2021
Last Updated:
3/1/2021

Operations

Publications

Kostas D, Rudzicz F. DN3: An open-source Python library for large-scale raw neurophysiology data assimilation for more flexible and standardized deep learning. Unknown Journal. 2020. doi:10.1101/2020.12.17.423197.

Documentation