mrdp
mrdp implements a design pattern that enables secure, high-performance access and transfer of large scientific datasets for networked, data-intensive research.
Key Features:
- Disaggregation of Monolithic Structures: Breaks monolithic portal architectures into modular components to improve scalability and flexibility for large-volume scientific data.
- High-Performance Data Enclaves: Provides high-performance data enclaves that deliver secure, rapid dataset access and controlled data transactions.
- Cloud-Based Data Management Services: Integrates cloud-based data management services to decouple control logic from data storage and support new deployment architectures.
- Cost Efficiency: Reduces development and operational costs for research data portals used at experimental facilities and supercomputer sites.
- Python APIs for Enhanced Functionality: Offers Python APIs for authentication, authorization, data transfer, and sharing.
Scientific Applications:
- Research laboratories and universities: Supports secure high-throughput data access and sharing in research laboratories and universities handling large datasets.
- Experimental facilities: Enables rapid transfer and controlled access for experimental facilities that generate high-volume data.
- Supercomputer sites: Facilitates data movement and management for supercomputer sites conducting large-scale data analyses.
- Big data analytics across disciplines: Supports big data analytics workflows across scientific disciplines by improving data access and transfer performance.
Methodology:
Implements a modular design that captures best practices in research data portal design and uses high-performance enclaves and cloud services to optimize data handling.
Topics
Details
- Tool Type:
- command-line tool
- Programming Languages:
- Python
- Added:
- 1/9/2020
- Last Updated:
- 11/24/2024
Operations
Publications
Chard K, Dart E, Foster I, Shifflett D, Tuecke S, Williams J. The Modern Research Data Portal: a design pattern for networked, data-intensive science. PeerJ Computer Science. 2018;4:e144. doi:10.7717/peerj-cs.144. PMID:33816800. PMCID:PMC7924693.
DOI: 10.7717/peerj-cs.144
PMID: 33816800
PMCID: PMC7924693
Funding: - United States National Science Foundation: ACI-1148484
- Department of Energy’s Office of Advanced Scientific Computing Research: DE-AC02-06CH11357
Links
Other
http://rda.ucar.edu