EHRtemporalVariability
EHRtemporalVariability analyzes temporal variability in Electronic Health Records (EHR) datasets to identify shifts in data distributions over time and assess data quality and consistency across multisite biomedical repositories.
Key Features:
- Information-theoretic and geometric methods: Employs probabilistic methods rooted in information theory and geometry to assess distributional changes over time.
- Temporal Data Analysis: Estimates statistical distributions of EHR variables over time and projects them onto non-parametric statistical manifolds using Information Geometric Temporal (IGT) plots for visualization of latent temporal variability.
- Kinematic Modeling: Characterizes data probability distributions as continuous trajectories in IGT space and estimates velocity and acceleration to quantify gradual trends and abrupt shifts.
- Seasonal and Systematic Variability Detection: Applies the Auto-Parallelism of Velocity Vectors (APVV) method and APVVmap visualization to identify oriented seasonal patterns and systematic variability, including periodic components beyond traditional Fourier analysis.
- Exploratory Visual Analytics: Provides Data Temporal heatmaps and IGT plots to detect punctual anomalies, outlying clusters, and systematic data quality issues.
Scientific Applications:
- Data quality assessment: Identifies temporal and multisite variability that can compromise reuse and harmonization of large-scale EHR datasets.
- Multimodal and multivariate analysis: Supports analysis of multi-modal and multivariate biomedical data where distributional shifts affect downstream inference.
- Seasonality and coding-change detection: Detects seasonal effects and abrupt changes in coding practices that impact longitudinal studies and surveillance.
- Consistency evaluation across sites: Assesses consistency and systematic differences across multisite biomedical repositories to inform pooling and comparative analyses.
Methodology:
Partition data into temporal subgroups, estimate statistical distributions and project them onto non-parametric statistical manifolds, represent distributions as continuous trajectories on Information Geometric Temporal (IGT) plots, analyze trajectories with a kinematic model to obtain velocity and acceleration, apply APVV and APVVmap to detect oriented seasonal/systematic variability, and visualize shifts using Data Temporal heatmaps and IGT plots while correlating trajectory components with known temporal factors.
Topics
Details
- License:
- Apache-2.0
- Maturity:
- Mature
- Tool Type:
- library, web application, workflow
- Operating Systems:
- Linux, Windows, Mac
- Programming Languages:
- R
- Added:
- 5/27/2020
- Last Updated:
- 11/24/2024
Operations
Data Inputs & Outputs
Database comparison
Publications
Sáez C, Zurriaga O, Pérez-Panadés J, Melchor I, Robles M, García-Gómez JM. Applying probabilistic temporal and multisite data quality control methods to a public health mortality registry in Spain: a systematic approach to quality control of repositories. Journal of the American Medical Informatics Association. 2016;23(6):1085-1095. doi:10.1093/jamia/ocw010. PMID:27107447. PMCID:PMC11741068.
Sáez C, Gutiérrez-Sacristán A, Kohane I, García-Gómez JM, Avillach P. EHRtemporalVariability: delineating temporal dataset shifts in electronic health records. Unknown Journal. 2020. doi:10.1101/2020.04.07.20056564.
Sáez C, Rodrigues PP, Gama J, Robles M, García-Gómez JM. Probabilistic change detection and visualization methods for the assessment of temporal stability in biomedical data quality. Data Mining and Knowledge Discovery. 2014;29(4):950-975. doi:10.1007/s10618-014-0378-6.
Sáez C, García-Gómez JM. Kinematics of Big Biomedical Data to characterize temporal variability and seasonality of data repositories: Functional Data Analysis of data temporal evolution over non-parametric statistical manifolds. International Journal of Medical Informatics. 2018;119:109-124. doi:10.1016/j.ijmedinf.2018.09.015. PMID:30342679.
Documentation
Downloads
- Downloads pagehttps://CRAN.R-project.org/package=EHRtemporalVariability
- Downloads pagehttps://github.com/hms-dbmi/EHRtemporalVariability