Final Evaluation Results
on Theme-Localization events by Strict matching
- Among 12 submissions in total, the table below shows 10 submissions for which the authors have agreed to publish the results.
--------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
--------------------------------------------------------------------------------------------------
[TEES-2.1 ] Theme-Localization 99 ( 50) 59 ( 50) 50.51 84.75 63.29
[ EVEX ] Theme-Localization 99 ( 47) 56 ( 47) 47.47 83.93 60.65
[ HDS4NLP ] Theme-Localization 99 ( 50) 66 ( 50) 50.51 75.76 60.61
[ BioSEM ] Theme-Localization 99 ( 42) 47 ( 42) 42.42 89.36 57.53
[ NCBI ] Theme-Localization 99 ( 39) 47 ( 39) 39.39 82.98 53.42
[ DlutNLP ] Theme-Localization 99 ( 35) 39 ( 35) 35.35 89.74 50.72
[ UZH ] Theme-Localization 99 ( 34) 39 ( 34) 34.34 87.18 49.28
[NICTANLM ] Theme-Localization 99 ( 31) 52 ( 31) 31.31 59.62 41.06
[ HCMUS ] Theme-Localization 99 ( 32) 61 ( 32) 32.32 52.46 40.00
[ USheff ] Theme-Localization 99 ( 23) 27 ( 23) 23.23 85.19 36.51