Final Evaluation Results
on Theme-Transcription events by Strict matching
- Among 12 submissions in total, the table below shows 10 submissions for which the authors have agreed to publish the results.
--------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
--------------------------------------------------------------------------------------------------
[ HDS4NLP ] Theme-Transcription 101 ( 58) 113 ( 58) 57.43 51.33 54.21
[ NCBI ] Theme-Transcription 101 ( 61) 132 ( 61) 60.40 46.21 52.36
[NICTANLM ] Theme-Transcription 101 ( 66) 231 ( 66) 65.35 28.57 39.76
[ BioSEM ] Theme-Transcription 101 ( 33) 68 ( 33) 32.67 48.53 39.05
[ USheff ] Theme-Transcription 101 ( 34) 75 ( 34) 33.66 45.33 38.64
[ DlutNLP ] Theme-Transcription 101 ( 28) 76 ( 28) 27.72 36.84 31.64
[TEES-2.1 ] Theme-Transcription 101 ( 30) 99 ( 30) 29.70 30.30 30.00
[ EVEX ] Theme-Transcription 101 ( 30) 99 ( 30) 29.70 30.30 30.00
[ UZH ] Theme-Transcription 101 ( 26) 100 ( 26) 25.74 26.00 25.87
[ HCMUS ] Theme-Transcription 101 ( 10) 65 ( 10) 9.90 15.38 12.05