SORA
SORA implements scalable string-graph reduction algorithms to perform parallel reduction of large overlap graphs for de novo genome assembly.
Key Features:
- Scalability: Implements Apache Spark–based processing to handle massive as well as mid-to-small overlap graphs with linear-scaling behavior as computational resources increase.
- Graph Reduction Efficiency: Uses graph reduction to compact overlap/string graphs by reducing the number of edges in large graph paths to lower computational overhead.
- Graph Processing Libraries: Employs Spark graph processing libraries such as GraphX and GraphFrames for scalable graph computations.
- Computational Environments: Operates on both single machines and distributed cloud clusters leveraging parallel computation.
- Performance on Large Datasets: Demonstrated capability on human genome samples, including processing nearly one billion-edge graphs in a distributed cloud environment while also handling mid-to-small graphs on individual workstations.
- Sequencing Data Compatibility: Targets memory-intensive datasets from next-generation sequencing and third-generation long reads by optimizing graph processing.
Scientific Applications:
- De novo genome assembly: Enables reconstruction of genomes from overlapping genomic fragments without relying on reference sequences by improving overlap-graph reduction scalability and efficiency.
Methodology:
SORA leverages Apache Spark and Spark graph libraries (GraphX, GraphFrames) to implement scalable string-graph reduction algorithms, optimizing parallel graph processing to mitigate memory-intensive challenges from next-generation sequencing and third-generation long reads.
Topics
Details
- License:
- GPL-3.0
- Programming Languages:
- Shell, Scala, Python
- Added:
- 1/9/2020
- Last Updated:
- 12/21/2020
Operations
Publications
Paul AJ, Lawrence D, Song M, Lim S, Pan C, Ahn T. Using Apache Spark on genome assembly for scalable overlap-graph reduction. Human Genomics. 2019;13(S1). doi:10.1186/s40246-019-0227-1. PMID:31639049. PMCID:PMC6805285.