PMLB
PMLB provides a repository of curated supervised machine learning benchmark datasets for standardized evaluation and comparison of algorithms.
Key Features:
- Curated benchmark datasets: Aggregates curated, well-studied public datasets intended for supervised machine learning evaluation.
- Supervised learning focus: Concentrates on datasets formatted for supervised tasks used in classification and regression benchmarking.
- Standardization for comparison: Presents datasets in a standardized form to support consistent evaluation and comparison of algorithms and statistical models.
- Large, diverse aggregation: Includes a broad collection of diverse public benchmark datasets consolidated in a single repository.
- Programmatic language interfaces: Provides programmatic access via Python and R interfaces for integration with analysis workflows.
Scientific Applications:
- Algorithm benchmarking: Enables systematic evaluation and comparison of supervised machine learning algorithms across multiple datasets.
- Method development and validation: Supports development, validation, and performance assessment of novel machine learning and statistical modeling methods.
- Comparative studies: Facilitates comparative studies that require standardized datasets to quantify algorithm performance differences.
Methodology:
Aggregates and curates public supervised learning datasets and exposes them via programmatic Python and R interfaces.
Topics
Details
- License:
- MIT
- Cost:
- Free of charge
- Tool Type:
- library
- Operating Systems:
- Mac, Linux, Windows
- Programming Languages:
- Python, R
- Added:
- 4/3/2022
- Last Updated:
- 4/3/2022
Operations
Publications
Romano JD, Le TT, La Cava W, Gregg JT, Goldberg DJ, Chakraborty P, Ray NL, Himmelstein D, Fu W, Moore JH. PMLB v1.0: an open-source dataset collection for benchmarking machine learning methods. Bioinformatics. 2021;38(3):878-880. doi:10.1093/bioinformatics/btab727. PMID:34677586. PMCID:PMC8756190.
PMID: 34677586
PMCID: PMC8756190
Funding: - National Institutes of Health: K99-LM012646, K99-LM012926, R01-AI116794, R01-LM010098, R01-LM012601, T32-ES019851