medical relation extraction
medical relation extraction extracts relations between biomedical entities from literature and clinical records using a pre-trained BERT model and 1D-CNN fine-tuning for deep learning–based relation extraction.
Key Features:
- Pre-trained Model Utilization: Leverages Bidirectional Encoder Representations from Transformers (BERT) pre-training on large-scale unstructured text to capture complex language patterns in biomedical texts.
- Fine-tuning with 1D-CNN: Applies a one-dimensional convolutional neural network (1d-CNN) to fine-tune the pre-trained model specifically for relation extraction tasks.
- Dataset Versatility: Evaluated on multiple corpora: BioCreative V Chemical Disease Relation Corpus;
Traditional Chinese Medicine Literature Corpus;
i2b2 2012 Temporal Relation Challenge Corpus. - Mitigation of labeled-data scarcity: Combines pre-training and fine-tuning to reduce dependence on large-scale labeled datasets in the biomedical domain.
- Reported Performance Improvements: Demonstrated improvements in F1 scores: BioCreative V Corpus: 22.2% improvement; Traditional Chinese Medicine Corpus: 7.77% improvement; i2b2 Temporal Relation Corpus: 38.5% improvement.
Scientific Applications:
- Automated relation extraction: Extracts chemical–disease and temporal relations from biomedical literature and clinical records for downstream analysis.
- Drug discovery and disease research: Supports identification of compound–disease associations and literature-derived hypotheses relevant to drug discovery and disease mechanism studies.
- Personalized medicine and clinical decision support: Provides structured relation data that can inform patient-specific insights and clinical research.
Methodology:
Pre-training with BERT on large-scale unstructured text followed by fine-tuning using a 1d-CNN architecture for relation extraction.
Topics
Details
- License:
- MIT
- Tool Type:
- command-line tool
- Programming Languages:
- Python
- Added:
- 1/14/2020
- Last Updated:
- 12/23/2020
Operations
Publications
Chen T, Wu M, Li H. A general approach for improving deep learning-based medical relation extraction using a pre-trained model and fine-tuning. Database. 2019;2019. doi:10.1093/database/baz116. PMID:31800044. PMCID:PMC6892305.
PMID: 31800044
PMCID: PMC6892305
Funding: - Guangdong Provincial Education Department: 2014KZDXM055
- Guangdong Natural Science Foundation: 2016A030313003, 2016A070708002
- Graduate Education Innovation: 2016SFKC_42, YJS-PYJD-17-03, YJS-SFKC-14-05
- Integration of cloud computing and big data innovation project: 2017B02101
- Jiangmen foundation and theoretical science research project: 2018JC01003