pmparser

pmparser converts PubMed/MEDLINE XML data into a relational database to enable large-scale, reproducible analyses of biomedical literature.


Key Features:

  • PubMed XML parsing: Downloads publicly available PubMed XML files and parses PubMed/MEDLINE records into a relational database schema.
  • Automated updates: Incorporates regular updates from PubMed to keep the database current.
  • NIH Open Citation Collection integration: Combines PubMed data with the NIH Open Citation Collection to enrich citation data.
  • PMDB relational implementation: Provides PMDB, a relational database populated with parsed PubMed records containing over 31 million PMIDs.
  • PostgreSQL backend: Implements PMDB using PostgreSQL 12 for database storage and scalability.
  • Reproducibility: Stores bibliographic data in structured tables to support reproducible and transparent analyses.

Scientific Applications:

  • Meta-analysis and systematic reviews: Enables large-scale retrieval and aggregation of PubMed records for systematic literature synthesis.
  • Citation network and trend analysis: Supports construction and analysis of citation networks and temporal research-trend investigations using integrated citation data.
  • Machine learning model development: Supplies extensive bibliographic and citation features for training and evaluating machine learning models on biomedical literature tasks.

Methodology:

Downloads PubMed XML files, parses PubMed/MEDLINE records into relational database tables, merges parsed data with the NIH Open Citation Collection, stores the PMDB implementation in PostgreSQL 12, and applies regular updates from PubMed.

Topics

Details

License:
GPL-2.0
Programming Languages:
R, SQL
Added:
1/18/2021
Last Updated:
1/24/2021

Operations

Publications

Schoenbachler JL, Hughey JJ. pmparser and PMDB: resources for large-scale, open studies of the biomedical literature. Unknown Journal. 2020. doi:10.1101/2020.09.07.285924.

Links