National ICT Australia/US National Library of Medicine NCBI
Task 1
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 470) 769 ( 470) 75.93 61.12 67.72
Transcription 101 ( 66) 231 ( 66) 65.35 28.57 39.76
Protein_catabolism 14 ( 9) 20 ( 9) 64.29 45.00 52.94
Localization 99 ( 31) 52 ( 31) 31.31 59.62 41.06
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 576) 1072 ( 576) 69.15 53.73 60.47
------------------------------------------------------------------------------------
Binding 333 ( 107) 344 ( 107) 32.13 31.10 31.61
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 81) 111 ( 81) 50.62 72.97 59.78
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 81) 111 ( 81) 42.41 72.97 53.64
------------------------------------------------------------------------------------
Regulation 288 ( 27) 109 ( 27) 9.38 24.77 13.60
Positive_regulation 1130 ( 235) 533 ( 235) 20.80 44.09 28.26
Negative_regulation 526 ( 127) 249 ( 127) 24.14 51.00 32.77
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 389) 891 ( 389) 20.01 43.66 27.44
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1153) 2418 ( 1153) 34.93 47.68 40.32
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 506) 761 ( 506) 81.74 66.49 73.33
Transcription 101 ( 67) 230 ( 67) 66.34 29.13 40.48
Protein_catabolism 14 ( 9) 20 ( 9) 64.29 45.00 52.94
Localization 99 ( 31) 52 ( 31) 31.31 59.62 41.06
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 613) 1063 ( 613) 73.59 57.67 64.66
------------------------------------------------------------------------------------
Binding 333 ( 107) 344 ( 107) 32.13 31.10 31.61
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 81) 111 ( 81) 50.62 72.97 59.78
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 81) 111 ( 81) 42.41 72.97 53.64
------------------------------------------------------------------------------------
Regulation 288 ( 33) 109 ( 33) 11.46 30.28 16.62
Positive_regulation 1130 ( 257) 533 ( 257) 22.74 48.22 30.91
Negative_regulation 526 ( 130) 249 ( 130) 24.71 52.21 33.55
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 420) 891 ( 420) 21.60 47.14 29.63
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1221) 2409 ( 1221) 36.99 50.68 42.77
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 516) 747 ( 511) 83.36 68.41 75.15
Transcription 101 ( 73) 215 ( 73) 72.28 33.95 46.20
Protein_catabolism 14 ( 9) 19 ( 9) 64.29 47.37 54.55
Localization 99 ( 33) 51 ( 31) 33.33 60.78 43.06
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 631) 1032 ( 624) 75.75 60.47 67.25
------------------------------------------------------------------------------------
Binding 333 ( 122) 343 ( 120) 36.64 34.99 35.79
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 81) 111 ( 81) 50.62 72.97 59.78
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 81) 111 ( 81) 42.41 72.97 53.64
------------------------------------------------------------------------------------
Regulation 288 ( 35) 107 ( 34) 12.15 31.78 17.58
Positive_regulation 1130 ( 266) 531 ( 264) 23.54 49.72 31.95
Negative_regulation 526 ( 135) 249 ( 132) 25.67 53.01 34.59
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 436) 887 ( 430) 22.43 48.48 30.67
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1270) 2373 ( 1255) 38.47 52.89 44.54
------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 470) 769 ( 470) 75.93 61.12 67.72
Theme-Transcription 101 ( 66) 231 ( 66) 65.35 28.57 39.76
Theme-Protein_catabolism 14 ( 9) 20 ( 9) 64.29 45.00 52.94
Theme-Binding 418 ( 212) 408 ( 212) 50.72 51.96 51.33
Theme-Localization 99 ( 31) 52 ( 31) 31.31 59.62 41.06
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 85) 111 ( 85) 53.12 76.58 62.73
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 36) 109 ( 36) 14.01 33.03 19.67
Theme-Positive_regulation 1068 ( 291) 539 ( 291) 27.25 53.99 36.22
Theme-Negative_regulation 490 ( 154) 248 ( 154) 31.43 62.10 41.73
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1354) 2487 ( 1354) 41.64 54.44 47.19
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 5) 10 ( 5) 4.85 50.00 8.85
Cause-Positive_regulation 337 ( 43) 67 ( 43) 12.76 64.18 21.29
Cause-Negative_regulation 122 ( 10) 16 ( 10) 8.20 62.50 14.49
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 58) 93 ( 58) 10.14 62.37 17.44
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1412) 2580 ( 1412) 36.92 54.73 44.10
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 506) 761 ( 506) 81.74 66.49 73.33
Theme-Transcription 101 ( 67) 230 ( 67) 66.34 29.13 40.48
Theme-Protein_catabolism 14 ( 9) 20 ( 9) 64.29 45.00 52.94
Theme-Binding 418 ( 215) 403 ( 215) 51.44 53.35 52.38
Theme-Localization 99 ( 31) 52 ( 31) 31.31 59.62 41.06
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 85) 111 ( 85) 53.12 76.58 62.73
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 42) 109 ( 42) 16.34 38.53 22.95
Theme-Positive_regulation 1068 ( 312) 539 ( 312) 29.21 57.88 38.83
Theme-Negative_regulation 490 ( 158) 248 ( 158) 32.24 63.71 42.82
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1425) 2473 ( 1425) 43.82 57.62 49.78
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 5) 10 ( 5) 4.85 50.00 8.85
Cause-Positive_regulation 337 ( 44) 67 ( 44) 13.06 65.67 21.78
Cause-Negative_regulation 122 ( 10) 16 ( 10) 8.20 62.50 14.49
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 59) 93 ( 59) 10.31 63.44 17.74
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1484) 2566 ( 1484) 38.81 57.83 46.45
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 516) 747 ( 511) 83.36 68.41 75.15
Theme-Transcription 101 ( 73) 215 ( 73) 72.28 33.95 46.20
Theme-Protein_catabolism 14 ( 9) 19 ( 9) 64.29 47.37 54.55
Theme-Binding 418 ( 244) 403 ( 237) 58.37 58.81 58.59
Theme-Localization 99 ( 33) 51 ( 31) 33.33 60.78 43.06
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 85) 111 ( 85) 53.12 76.58 62.73
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 46) 107 ( 44) 17.90 41.12 24.94
Theme-Positive_regulation 1068 ( 327) 535 ( 322) 30.62 60.19 40.59
Theme-Negative_regulation 490 ( 163) 248 ( 159) 33.27 64.11 43.80
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1496) 2436 ( 1471) 46.00 60.39 52.22
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 5) 10 ( 5) 4.85 50.00 8.85
Cause-Positive_regulation 337 ( 53) 66 ( 53) 15.73 80.30 26.30
Cause-Negative_regulation 122 ( 11) 16 ( 11) 9.02 68.75 15.94
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 69) 92 ( 69) 12.06 75.00 20.78
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1565) 2528 ( 1540) 40.93 60.92 48.96
---------------------------------------------------------------------------------------
Task 2
N/A
N/A
N/A
Task 3
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 17) 58 ( 17) 11.89 29.31 16.92
Speculation 195 ( 21) 82 ( 21) 10.77 25.61 15.16
==[MOD TOTAL]== 338 ( 38) 140 ( 38) 11.24 27.14 15.90
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 22) 58 ( 19) 15.38 32.76 20.94
Speculation 195 ( 28) 82 ( 28) 14.36 34.15 20.22
==[MOD TOTAL]== 338 ( 50) 140 ( 47) 14.79 33.57 20.54
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 22) 58 ( 19) 15.38 32.76 20.94
Speculation 195 ( 30) 82 ( 30) 15.38 36.59 21.66
==[MOD TOTAL]== 338 ( 52) 140 ( 49) 15.38 35.00 21.37
------------------------------------------------------------------------------------
Thank you for your participation!!