AssessORF

The software tool "AssessORF" addresses the challenge of benchmarking prokaryotic gene predictions, a fundamental task in genomics where identifying the boundaries of protein-coding genes is essential. Existing gene-finding programs need a universal benchmark, leading to uncertainty about their performance and accuracy due to varied benchmarking strategies employed by developers.
AssessORF introduces a novel approach to benchmark prokaryotic gene predictions, utilizing evidence from proteomics data and considering the evolutionary conservation of start and stop codons. The tool compares predictions from GenBank, GeneMarkS-2, Glimmer, and Prodigal across diverse genomes in the prokaryotic tree of life. Results indicate that predictions from these programs exhibit 88-95% agreement with available evidence, with Glimmer performing less effectively but no clear winner among the programs. Notably, all programs are biased towards selecting start codons upstream of the actual start, highlighting a need for improvement, particularly in detecting correct start sites.