LEMMI

LEMMI performs continuous benchmarking of metagenomics classifiers to evaluate read-classification methods for metagenome composition assessment in microbiome and microbial genomics research.

Key Features:

• Continuous Benchmarking: Performs ongoing evaluations that integrate newly published and previously assessed metagenomics classification methods for up-to-date comparative results.
• Centralized Integration: Integrates submitted methods into an independent benchmarking framework for direct comparative evaluation across tools.
• Community-Driven Evaluation: Accepts community submissions of novel methods to enable unbiased comparative benchmarking.
• Software Containerization: Requires distribution of evaluated methods as software containers to ensure reproducibility and preservation of evaluation artifacts.
• Read-Classification Focus: Targets read-classification methods specifically for metagenome composition assessments.
• Benchmark Outcome Recording: Documents evaluation results to support comparative analysis and method selection.

Scientific Applications:

• Benchmarking Metagenomics Classifiers: Provides comparative performance data for metagenomics classifiers used in microbiome studies.
• Method Validation and Selection: Supports validation and selection of read-classification methods for metagenome composition analyses.
• Microbial Genomics Research Support: Aids microbial genomics research by enabling comparison of computational methods that interpret sequencing-derived microbial genotypic data.
• Evaluation of New Methods: Facilitates assessment of newly developed classifiers against established tools.

Methodology:

LEMMI evaluates both previously assessed and newly submitted tools, focuses on read-classification methods for metagenome composition assessment, enforces distribution of methods as software containers, and records the outcomes of these evaluations.