RepeatFS
RepeatFS records file and I/O provenance at the file-system level to enable replication and verification of bioinformatics computational workflows.
Key Features:
- Provenance Recording: Records file and I/O operations and stores provenance metadata required to trace and reproduce analyses.
- Workflow Replication and Verification: Verifies software versions, command-line parameters, and other execution attributes against original runs and reports deviations.
- FUSE-based Filesystem Operation: Implements a FUSE (Filesystem in Userspace) filesystem to capture I/O for Linux command-line software at the file-system layer.
- Provenance Visualization and Task Automation: Provides provenance visualization and task automation capabilities to aid interpretation of workflow history and automate repetitive processes.
Scientific Applications:
- Bioinformatics Workflow Replication: Replicates bioinformatics analyses involving large numbers of operations (reported over one million operations) without altering original methods.
- Identification of Software-induced Variability: Identifies software inconsistencies that lead to replication differences by comparing versions and parameters.
- Cross-environment Reproducibility Verification: Enables verification of analysis integrity across different computational environments (Linux-based).
Methodology:
Implemented in Python 3 as a FUSE (Filesystem in Userspace) module, RepeatFS captures file and I/O operations, records provenance metadata, verifies software versions and command-line parameters, reports deviations, and provides provenance visualization and task automation.
Topics
Details
- License:
- GPL-3.0
- Programming Languages:
- Python
- Added:
- 1/18/2021
- Last Updated:
- 2/6/2021
Operations
Publications
Westbrook A, Varki E, Thomas WK. RepeatFS: a file system providing reproducibility through provenance and automation. Bioinformatics. 2020;37(9):1292-1296. doi:10.1093/bioinformatics/btaa950. PMID:33230554. PMCID:PMC8189677.
PMID: 33230554
Funding: - New Hampshire-INBRE through an Institutional Development Award: P20GM103506