CRAFT

CRAFT generates compact alignment-free embeddings from k-mer co-occurrence statistics to enable efficient storage, retrieval, and fast comparison of large-scale genomic and metagenomic high-throughput sequencing (HTS) datasets.


Key Features:

  • Compact representation: Transforms HTS and genomic data into a reduced embedding space by counting co-occurrences of adjacent k-mer pairs and learning compact embeddings.
  • Dimensionality reduction and storage: Reduces sequence data dimensionality by 10^2–10^4-fold, decreasing memory and storage requirements for large datasets.
  • Embedding-based sequence comparison: Performs fast sequence comparisons by calculating dissimilarities between learned embeddings of input and archived sequences.
  • Benchmark performance: Has been benchmarked against six state-of-the-art alignment-free measures and shows comparable speed and accuracy.

Scientific Applications:

  • Genome browsing: Locating best-matching genomes within massive sequence repositories using embedding-based similarity search.
  • Metagenomics studies: Comparing metagenomic sequencing data against archived databases to analyze complex microbial communities.
  • Comparative genomics: Rapidly comparing genomic sequences to identify similarities and differences across genomes.

Methodology:

Parse input genomic/metagenomic sequences to extract k-mers; count co-occurrences of adjacent k-mer pairs; learn compact embeddings from k-mer frequencies; compute dissimilarities between embeddings for sequence comparison; report best matches.

Topics

Details

Tool Type:
desktop application
Operating Systems:
Linux, Windows
Programming Languages:
C++, C
Added:
1/18/2021
Last Updated:
2/18/2021

Operations

Publications

Lu YY, Bai J, Wang Y, Wang Y, Sun F. CRAFT: Compact genome Representation toward large-scale Alignment-Free daTabase. Bioinformatics. 2020;37(2):155-161. doi:10.1093/bioinformatics/btaa699. PMID:32766810. PMCID:PMC9431648.

Funding: - National Natural Science Foundation of China: 61673324 - National Key Research and Development Program of China: 2018YFD0901401 - U.S. National Science Foundation: DMS-1518001 - Natural Science Foundation of Fujian: 2018J01097 - Open Fund of Engineering Research Center for Medical Data Mining and Application of Fujian Province: MDM2018002

Lu YY, Bai J, Wang Y, Wang Y, Sun F. CRAFT: Compact genome Representation towards large-scale Alignment-Free daTabase. Unknown Journal. 2020. doi:10.1101/2020.07.10.196741.