SORA

SORA implements scalable string-graph reduction algorithms to perform parallel reduction of large overlap graphs for de novo genome assembly.


Key Features:

  • Scalability: Implements Apache Spark–based processing to handle massive as well as mid-to-small overlap graphs with linear-scaling behavior as computational resources increase.
  • Graph Reduction Efficiency: Uses graph reduction to compact overlap/string graphs by reducing the number of edges in large graph paths to lower computational overhead.
  • Graph Processing Libraries: Employs Spark graph processing libraries such as GraphX and GraphFrames for scalable graph computations.
  • Computational Environments: Operates on both single machines and distributed cloud clusters leveraging parallel computation.
  • Performance on Large Datasets: Demonstrated capability on human genome samples, including processing nearly one billion-edge graphs in a distributed cloud environment while also handling mid-to-small graphs on individual workstations.
  • Sequencing Data Compatibility: Targets memory-intensive datasets from next-generation sequencing and third-generation long reads by optimizing graph processing.

Scientific Applications:

  • De novo genome assembly: Enables reconstruction of genomes from overlapping genomic fragments without relying on reference sequences by improving overlap-graph reduction scalability and efficiency.

Methodology:

SORA leverages Apache Spark and Spark graph libraries (GraphX, GraphFrames) to implement scalable string-graph reduction algorithms, optimizing parallel graph processing to mitigate memory-intensive challenges from next-generation sequencing and third-generation long reads.

Topics

Details

License:
GPL-3.0
Programming Languages:
Shell, Scala, Python
Added:
1/9/2020
Last Updated:
12/21/2020

Operations

Publications

Paul AJ, Lawrence D, Song M, Lim S, Pan C, Ahn T. Using Apache Spark on genome assembly for scalable overlap-graph reduction. Human Genomics. 2019;13(S1). doi:10.1186/s40246-019-0227-1. PMID:31639049. PMCID:PMC6805285.

Documentation