Genozip

Genozip compresses genomic and associated bioinformatics file formats losslessly to reduce storage footprint and enable efficient archival and transfer of sequencing and variant data.

Key Features:

• Lossless Compression: Performs lossless compression to preserve exact nucleotide sequences, metadata, and annotations.
• Field-Specific Algorithms: Applies algorithms tailored to individual fields within genomic files to improve compression ratios.
• High-Speed Performance: Employs multi-threaded processing for high-speed compression and decompression.
• Supported Formats: Supports common genomic file formats including FASTQ, SAM, BAM, CRAM, VCF, GVF, FASTA, PHYLIP, and 23andMe format.
• Modularity and Extensibility: Separates a Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs to allow addition of new formats and codecs.
• Implementation Language: Implemented in C.
• Cross-Platform Compatibility: Tested on Linux, Mac, and Windows.

Scientific Applications:

• Storage and Archival: Reduces storage requirements for large sequencing datasets and enables long-term archival of raw and processed data.
• Data Transfer and Sharing: Facilitates efficient transfer and sharing of sequencing reads, alignments, and variant call files.
• Sequencing Data Analysis: Integrates with workflows that process FASTQ, SAM/BAM/CRAM, and FASTA files for read processing and alignment analyses.
• Variant Calling: Preserves VCF and related metadata for downstream variant-calling pipelines.
• Phylogenetic Studies: Compresses alignment formats such as FASTA and PHYLIP to support phylogenetic and comparative analyses.

Methodology:

Uses field-specific algorithms to maximize compression ratios while maintaining high-speed, multi-threaded performance; employs a modular architecture that separates a central Genozip Framework from file-format-specific Segmenters and data-type-specific Codecs to enable addition of new codecs and formats.