Conference Proceedings

Task 1: ShARe/CLEF eHealth evaluation lab 2013

S Pradhan, N Elhadad, BR South, D Martinez, L Christensen, A Vogel, H Suominen, WW Chapman, G Savova

CEUR Workshop Proceedings | Published : 2013

Abstract

This report outlines the Task 1 of the ShARe/CLEF eHealth evaluation lab pilot. This task focused on identification (1a) and normalization (1b) of diseases and disorders in clinical reports. It used annotations from the ShARe corpus. A total of 22 teams competed in Task 1a and 17 of them also participated Task 1b. The best systems had an F1 score of 0.75 (0.80 Precision, 0.71 Recall) in Task 1a and an accuracy of 0.59 in Task 1b. The organizers have made the text corpora, annotations, and evaluation tools available for future research and development.

Citation metrics