mrdp

mrdp implements a design pattern that enables secure, high-performance access and transfer of large scientific datasets for networked, data-intensive research.


Key Features:

  • Disaggregation of Monolithic Structures: Breaks monolithic portal architectures into modular components to improve scalability and flexibility for large-volume scientific data.
  • High-Performance Data Enclaves: Provides high-performance data enclaves that deliver secure, rapid dataset access and controlled data transactions.
  • Cloud-Based Data Management Services: Integrates cloud-based data management services to decouple control logic from data storage and support new deployment architectures.
  • Cost Efficiency: Reduces development and operational costs for research data portals used at experimental facilities and supercomputer sites.
  • Python APIs for Enhanced Functionality: Offers Python APIs for authentication, authorization, data transfer, and sharing.

Scientific Applications:

  • Research laboratories and universities: Supports secure high-throughput data access and sharing in research laboratories and universities handling large datasets.
  • Experimental facilities: Enables rapid transfer and controlled access for experimental facilities that generate high-volume data.
  • Supercomputer sites: Facilitates data movement and management for supercomputer sites conducting large-scale data analyses.
  • Big data analytics across disciplines: Supports big data analytics workflows across scientific disciplines by improving data access and transfer performance.

Methodology:

Implements a modular design that captures best practices in research data portal design and uses high-performance enclaves and cloud services to optimize data handling.

Topics

Details

Tool Type:
command-line tool
Programming Languages:
Python
Added:
1/9/2020
Last Updated:
11/24/2024

Operations

Publications

Chard K, Dart E, Foster I, Shifflett D, Tuecke S, Williams J. The Modern Research Data Portal: a design pattern for networked, data-intensive science. PeerJ Computer Science. 2018;4:e144. doi:10.7717/peerj-cs.144. PMID:33816800. PMCID:PMC7924693.

PMID: 33816800
PMCID: PMC7924693
Funding: - United States National Science Foundation: ACI-1148484 - Department of Energy’s Office of Advanced Scientific Computing Research: DE-AC02-06CH11357

Links