JUDI

JUDI manages parameter configurations and execution of multi-stage bioinformatics pipelines to enable reproducible large-scale data analysis.

Key Features:

• Parameter Management: Encapsulates each task's parameters in a per-stage database module and associates parameter databases with tasks and files to systematically handle parameter settings across pipeline stages.
• Efficiency in Scripting: Applies principles from database management systems to reduce scripting complexity and can reduce the number of lines of scripting by a factor of O(n) for a pipeline with n parameters.
• Reproducibility and Exploration: Supports reproduction of analyses using published parameter values while enabling exploration through alternative parameter configurations.
• Plug-and-Play Modularity: Employs a modular design that allows integration and modification of pipeline stages via parameter/database modules.

Scientific Applications:

• High-throughput sequencing and omics: Applicable to genomic sequencing, transcriptomics, proteomics, and other high-throughput biological data analyses that require complex, parameterized multi-stage pipelines.

Methodology:

Builds on DoIt (a Python-based workflow management system) and leverages database management system principles by associating a parameter database with each task and file and encapsulating parameters in per-stage database modules.