Conference Proceedings
Task 2: ShARe/CLEF eHealth evaluation lab 2014
DL Mowery, S Velupillai, BR South, L Christensen, D Martinez, L Kelly, L Goeuriot, N Elhadad, S Pradhan, G Savova, WW Chapman
Ceur Workshop Proceedings | Published : 2014
Abstract
This paper reports on Task 2 of the 2014 ShARe/CLEF eHealth evaluation lab which extended Task 1 of the 2013 ShARe/CLEF eHealth evaluation lab by focusing on template filling of disorder attributes. The task was comprised of two subtasks: attribute normalization (task 2a) and cue identification (task 2b). We instructed participants to develop a system which either kept or updated a default attribute value for each task. Participant systems were evaluated against a blind reference standard of 133 discharge summaries using Accuracy (task 2a) and F-score (task 2b). In total, ten teams participated in task 2a, and three teams in task 2b. For task 2a and 2b, the HITACHI team systems (run 2) had t..
View full abstract