doepipeline
doepipeline optimizes bioinformatics processing pipelines using statistical Design of Experiments (DoE) methodologies to select and tune software parameters that affect analytical outcomes.
Key Features:
- Design of Experiments (DoE): Applies statistical DoE principles for systematic and efficient parameter selection.
- Subset designs for screening: Uses subset designs to span the entire parameter search space during an initial screening phase.
- Response surface and OLS modeling: Employs response surface designs and fits Ordinary Least Squares (OLS) models for parameter optimization.
- Multi-tool pipeline optimization: Optimizes parameters for single tools and multiple sequential tools within a pipeline while accounting for parameter interactions.
- Python implementation: Implemented in Python as the computational framework.
- Empirical performance gains: Identified parameter settings that outperformed default values in measured outcomes across tested scenarios.
Scientific Applications:
- De-novo assembly: Parameter optimization for de-novo genome assembly with demonstrated improvements over default settings.
- Scaffolding of fragmented genome assemblies: Optimization of scaffolding parameters for fragmented genome assemblies.
- K-mer taxonomic classification of Oxford Nanopore Technologies MinION reads: Tuning parameters for k-mer–based taxonomic classification of ONT MinION sequencing reads.
- Genetic variant calling: Optimization of parameters in genetic variant calling workflows.
Methodology:
Performs a screening phase using subset designs to explore the parameter space followed by an optimization phase using response surface methodologies and Ordinary Least Squares (OLS) modeling to fine-tune parameters.
Topics
Details
- License:
- MIT
- Tool Type:
- library
- Programming Languages:
- Python
- Added:
- 1/9/2020
- Last Updated:
- 12/22/2020
Operations
Publications
Svensson D, Sjögren R, Sundell D, Sjödin A, Trygg J. doepipeline: a systematic approach to optimizing multi-level and multi-step data processing workflows. BMC Bioinformatics. 2019;20(1). doi:10.1186/s12859-019-3091-z. PMID:31615395. PMCID:PMC6794737.
PMID: 31615395
PMCID: PMC6794737
Funding: - Knut och Alice Wallenbergs Stiftelse: 2011.0042
- Vetenskapsrådet: 2016‐04376
- Myndigheten för Samhällsskydd och Beredskap: B4662
Links
Issue tracker
https://github.com/clicumu/doepipeline/issuesRepository
https://pypi.org/project/doepipeline/