inestedcv

inestedcv implements nested cross-validation workflows to provide unbiased model evaluation, hyperparameter tuning, and embedded feature selection for high-dimensional biomedical datasets such as transcriptomics.


Key Features:

  • Nested Cross-Validation: Implements a fully nested k × l-fold cross-validation framework with inner loops for hyperparameter tuning and outer loops for unbiased performance assessment to prevent information leakage.
  • Embedded Feature Selection: Integrates fast filter functions for feature selection that are nested within the outer CV loop to avoid biasing test-set performance.
  • Support for Multiple Models: Uses glmnet to fit lasso and elastic-net regularized linear models and integrates with the caret framework to support additional machine learning algorithms.
  • Bayesian Regression Models: Provides Bayesian linear and logistic regression using the horseshoe prior to encourage sparsity in high-dimensional settings.
  • High-dimensional Data Handling: Targets P ≫ n scenarios common in transcriptomics and other biomedical research where the number of predictors greatly exceeds sample size.

Scientific Applications:

  • Transcriptomics: Handles transcriptomic datasets with a large number of features relative to samples (P ≫ n) for predictive modeling and feature discovery.
  • Biomedical Data Analysis: Applies to biomedical research problems requiring robust model evaluation and feature selection when sample size is limited relative to predictors.

Methodology:

Employs a fully nested k × l-fold cross-validation scheme with inner loops for hyperparameter tuning, outer loops for unbiased model evaluation, and filter-based feature selection nested inside the outer CV; supports glmnet-based lasso/elastic-net models and Bayesian linear/logistic regression with a horseshoe prior.

Topics

Details

License:
MIT
Cost:
Free of charge
Tool Type:
library
Operating Systems:
Mac, Linux, Windows
Programming Languages:
R
Added:
11/10/2023
Last Updated:
11/10/2023

Operations

Data Inputs & Outputs

Feature selection

Publications

Lewis MJ, Spiliopoulou A, Goldmann K, Pitzalis C, McKeigue P, Barnes MR. nestedcv: an R package for fast implementation of nested cross-validation with embedded feature selection designed for transcriptomics and high-dimensional data. Bioinformatics Advances. 2023;3(1). doi:10.1093/bioadv/vbad048. PMID:37113250. PMCID:PMC10125905.

PMID: 37113250
Funding: - NIHR: 131575

Documentation

Links