Marky

Marky manages collaborative, iterative document annotation and annotation tracking to produce high-quality annotated corpora for biomedical text mining.

Key Features:

• Multi-User and Iterative Project Management: Supports collaborative annotation across multiple users and iterative rounds of document analysis to refine annotations over time.
• Annotation Tracking System: Records all user annotations, enabling agreement analysis and allowing annotators to review, reject, or modify previous annotations.
• Quality Control and Consistency Evaluation: Provides tools for assessing inter-annotator consistency and tracking changes across annotation rounds.
• Resource Efficiency: Reduces annotation overhead by minimizing resource and time consumption through its tracking and management features.

Scientific Applications:

• Biomedical Corpus Annotation: Facilitates creation of high-quality annotated corpora for biomedical text mining, including annotation of diseases, symptoms, and treatments.
• Annotation Quality Assessment: Enables inter-annotator agreement analysis and iterative refinement to improve corpus reliability for downstream text mining applications.

Methodology:

Operates a backend infrastructure that supports iterative project management, systematic tracking of all annotation activities, and tools for quality control and inter-annotator agreement analysis.