medical relation extraction

medical relation extraction extracts relations between biomedical entities from literature and clinical records using a pre-trained BERT model and 1D-CNN fine-tuning for deep learning–based relation extraction.


Key Features:

  • Pre-trained Model Utilization: Leverages Bidirectional Encoder Representations from Transformers (BERT) pre-training on large-scale unstructured text to capture complex language patterns in biomedical texts.
  • Fine-tuning with 1D-CNN: Applies a one-dimensional convolutional neural network (1d-CNN) to fine-tune the pre-trained model specifically for relation extraction tasks.
  • Dataset Versatility: Evaluated on multiple corpora: BioCreative V Chemical Disease Relation Corpus;
    Traditional Chinese Medicine Literature Corpus;
    i2b2 2012 Temporal Relation Challenge Corpus.
  • Mitigation of labeled-data scarcity: Combines pre-training and fine-tuning to reduce dependence on large-scale labeled datasets in the biomedical domain.
  • Reported Performance Improvements: Demonstrated improvements in F1 scores: BioCreative V Corpus: 22.2% improvement; Traditional Chinese Medicine Corpus: 7.77% improvement; i2b2 Temporal Relation Corpus: 38.5% improvement.

Scientific Applications:

  • Automated relation extraction: Extracts chemical–disease and temporal relations from biomedical literature and clinical records for downstream analysis.
  • Drug discovery and disease research: Supports identification of compound–disease associations and literature-derived hypotheses relevant to drug discovery and disease mechanism studies.
  • Personalized medicine and clinical decision support: Provides structured relation data that can inform patient-specific insights and clinical research.

Methodology:

Pre-training with BERT on large-scale unstructured text followed by fine-tuning using a 1d-CNN architecture for relation extraction.

Topics

Details

License:
MIT
Tool Type:
command-line tool
Programming Languages:
Python
Added:
1/14/2020
Last Updated:
12/23/2020

Operations

Publications

Chen T, Wu M, Li H. A general approach for improving deep learning-based medical relation extraction using a pre-trained model and fine-tuning. Database. 2019;2019. doi:10.1093/database/baz116. PMID:31800044. PMCID:PMC6892305.

PMID: 31800044
PMCID: PMC6892305
Funding: - Guangdong Provincial Education Department: 2014KZDXM055 - Guangdong Natural Science Foundation: 2016A030313003, 2016A070708002 - Graduate Education Innovation: 2016SFKC_42, YJS-PYJD-17-03, YJS-SFKC-14-05 - Integration of cloud computing and big data innovation project: 2017B02101 - Jiangmen foundation and theoretical science research project: 2018JC01003