EVEX team
Task 1
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 497) 600 ( 497) 80.29 82.83 81.54
Transcription 101 ( 30) 99 ( 30) 29.70 30.30 30.00
Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Localization 99 ( 47) 56 ( 47) 47.47 83.93 60.65
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 583) 773 ( 583) 69.99 75.42 72.60
------------------------------------------------------------------------------------
Binding 333 ( 137) 306 ( 137) 41.14 44.77 42.88
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 118) 170 ( 118) 73.75 69.41 71.52
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 118) 170 ( 118) 61.78 69.41 65.37
------------------------------------------------------------------------------------
Regulation 288 ( 51) 156 ( 51) 17.71 32.69 22.97
Positive_regulation 1130 ( 331) 744 ( 331) 29.29 44.49 35.33
Negative_regulation 526 ( 199) 436 ( 199) 37.83 45.64 41.37
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 581) 1336 ( 581) 29.89 43.49 35.43
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1419) 2585 ( 1419) 42.99 54.89 48.22
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 504) 600 ( 504) 81.42 84.00 82.69
Transcription 101 ( 55) 99 ( 55) 54.46 55.56 55.00
Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Localization 99 ( 47) 56 ( 47) 47.47 83.93 60.65
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 615) 773 ( 615) 73.83 79.56 76.59
------------------------------------------------------------------------------------
Binding 333 ( 137) 306 ( 137) 41.14 44.77 42.88
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 118) 170 ( 118) 73.75 69.41 71.52
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 118) 170 ( 118) 61.78 69.41 65.37
------------------------------------------------------------------------------------
Regulation 288 ( 52) 156 ( 52) 18.06 33.33 23.42
Positive_regulation 1130 ( 367) 744 ( 367) 32.48 49.33 39.17
Negative_regulation 526 ( 211) 436 ( 211) 40.11 48.39 43.87
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 630) 1336 ( 630) 32.41 47.16 38.41
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1500) 2585 ( 1500) 45.44 58.03 50.97
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 509) 598 ( 505) 82.23 84.45 83.32
Transcription 101 ( 56) 99 ( 56) 55.45 56.57 56.00
Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Localization 99 ( 50) 55 ( 47) 50.51 85.45 63.49
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 624) 770 ( 617) 74.91 80.13 77.43
------------------------------------------------------------------------------------
Binding 333 ( 141) 297 ( 140) 42.34 47.14 44.61
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 127) 170 ( 123) 79.38 72.35 75.70
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 127) 170 ( 123) 66.49 72.35 69.30
------------------------------------------------------------------------------------
Regulation 288 ( 53) 156 ( 52) 18.40 33.33 23.71
Positive_regulation 1130 ( 382) 737 ( 380) 33.81 51.56 40.84
Negative_regulation 526 ( 224) 435 ( 219) 42.59 50.34 46.14
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 659) 1328 ( 651) 33.90 49.02 40.08
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1551) 2565 ( 1531) 46.99 59.69 52.58
------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 497) 600 ( 497) 80.29 82.83 81.54
Theme-Transcription 101 ( 30) 99 ( 30) 29.70 30.30 30.00
Theme-Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Theme-Binding 418 ( 235) 389 ( 235) 56.22 60.41 58.24
Theme-Localization 99 ( 47) 56 ( 47) 47.47 83.93 60.65
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 125) 167 ( 125) 78.12 74.85 76.45
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 63) 151 ( 63) 24.51 41.72 30.88
Theme-Positive_regulation 1068 ( 382) 747 ( 382) 35.77 51.14 42.09
Theme-Negative_regulation 490 ( 241) 427 ( 241) 49.18 56.44 52.56
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1629) 2654 ( 1629) 50.09 61.38 55.16
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 20) 42 ( 20) 19.42 47.62 27.59
Cause-Positive_regulation 337 ( 87) 128 ( 87) 25.82 67.97 37.42
Cause-Negative_regulation 122 ( 29) 57 ( 29) 23.77 50.88 32.40
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 4 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 136) 231 ( 136) 23.78 58.87 33.87
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1765) 2885 ( 1765) 46.16 61.18 52.62
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 504) 600 ( 504) 81.42 84.00 82.69
Theme-Transcription 101 ( 55) 99 ( 55) 54.46 55.56 55.00
Theme-Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Theme-Binding 418 ( 238) 389 ( 238) 56.94 61.18 58.98
Theme-Localization 99 ( 47) 56 ( 47) 47.47 83.93 60.65
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 125) 167 ( 125) 78.12 74.85 76.45
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 64) 151 ( 64) 24.90 42.38 31.37
Theme-Positive_regulation 1068 ( 417) 747 ( 417) 39.04 55.82 45.95
Theme-Negative_regulation 490 ( 257) 427 ( 257) 52.45 60.19 56.05
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1716) 2654 ( 1716) 52.77 64.66 58.11
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 21) 42 ( 21) 20.39 50.00 28.97
Cause-Positive_regulation 337 ( 88) 128 ( 88) 26.11 68.75 37.85
Cause-Negative_regulation 122 ( 30) 57 ( 30) 24.59 52.63 33.52
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 4 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 139) 231 ( 139) 24.30 60.17 34.62
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1855) 2885 ( 1855) 48.51 64.30 55.30
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 509) 598 ( 505) 82.23 84.45 83.32
Theme-Transcription 101 ( 56) 99 ( 56) 55.45 56.57 56.00
Theme-Protein_catabolism 14 ( 9) 18 ( 9) 64.29 50.00 56.25
Theme-Binding 418 ( 266) 382 ( 254) 63.64 66.49 65.03
Theme-Localization 99 ( 50) 55 ( 47) 50.51 85.45 63.49
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 134) 167 ( 130) 83.75 77.84 80.69
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 65) 151 ( 64) 25.29 42.38 31.68
Theme-Positive_regulation 1068 ( 448) 733 ( 437) 41.95 59.62 49.25
Theme-Negative_regulation 490 ( 269) 423 ( 263) 54.90 62.17 58.31
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1806) 2626 ( 1765) 55.54 67.21 60.82
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 25) 42 ( 22) 24.27 52.38 33.17
Cause-Positive_regulation 337 ( 91) 128 ( 90) 27.00 70.31 39.02
Cause-Negative_regulation 122 ( 31) 57 ( 31) 25.41 54.39 34.64
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 4 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 147) 231 ( 143) 25.70 61.90 36.32
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1953) 2857 ( 1908) 51.07 66.78 57.88
---------------------------------------------------------------------------------------
Task 2
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Site-Binding 102 ( 20) 57 ( 20) 19.61 35.09 25.16
Site-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Phosphorylation 86 ( 26) 35 ( 26) 30.23 74.29 42.98
Site-Ubiquitination 7 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Regulation 28 ( 1) 3 ( 1) 3.57 33.33 6.45
Site-Positive_regulation 18 ( 0) 2 ( 0) 0.00 0.00 0.00
Site-Negative_regulation 34 ( 2) 9 ( 2) 5.88 22.22 9.30
CSite-Regulation 12 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Positive_regulation 35 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Negative_regulation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[SITE ALL]= 324 ( 49) 106 ( 49) 15.12 46.23 22.79
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Loc-Localization 30 ( 11) 14 ( 11) 36.67 78.57 50.00
---------------------------------------------------------------------------------------
==[SECONDARY ARG TOTAL]== 354 ( 60) 120 ( 60) 16.95 50.00 25.32
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Site-Binding 102 ( 32) 57 ( 32) 31.37 56.14 40.25
Site-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Phosphorylation 86 ( 28) 35 ( 28) 32.56 80.00 46.28
Site-Ubiquitination 7 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Regulation 28 ( 1) 3 ( 1) 3.57 33.33 6.45
Site-Positive_regulation 18 ( 0) 2 ( 0) 0.00 0.00 0.00
Site-Negative_regulation 34 ( 2) 9 ( 2) 5.88 22.22 9.30
CSite-Regulation 12 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Positive_regulation 35 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Negative_regulation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[SITE ALL]= 324 ( 63) 106 ( 63) 19.44 59.43 29.30
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Loc-Localization 30 ( 11) 14 ( 11) 36.67 78.57 50.00
---------------------------------------------------------------------------------------
==[SECONDARY ARG TOTAL]== 354 ( 74) 120 ( 74) 20.90 61.67 31.22
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Site-Binding 102 ( 35) 57 ( 35) 34.31 61.40 44.03
Site-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Phosphorylation 86 ( 29) 35 ( 29) 33.72 82.86 47.93
Site-Ubiquitination 7 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Site-Regulation 28 ( 1) 3 ( 1) 3.57 33.33 6.45
Site-Positive_regulation 18 ( 1) 2 ( 1) 5.56 50.00 10.00
Site-Negative_regulation 34 ( 2) 9 ( 2) 5.88 22.22 9.30
CSite-Regulation 12 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Positive_regulation 35 ( 0) 0 ( 0) 0.00 0.00 0.00
CSite-Negative_regulation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[SITE ALL]= 324 ( 68) 106 ( 68) 20.99 64.15 31.63
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Loc-Localization 30 ( 11) 14 ( 11) 36.67 78.57 50.00
---------------------------------------------------------------------------------------
==[SECONDARY ARG TOTAL]== 354 ( 79) 120 ( 79) 22.32 65.83 33.33
---------------------------------------------------------------------------------------
Task 3
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 23) 71 ( 23) 16.08 32.39 21.50
Speculation 195 ( 22) 106 ( 22) 11.28 20.75 14.62
==[MOD TOTAL]== 338 ( 45) 177 ( 45) 13.31 25.42 17.48
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 30) 71 ( 27) 20.98 38.03 27.04
Speculation 195 ( 36) 106 ( 36) 18.46 33.96 23.92
==[MOD TOTAL]== 338 ( 66) 177 ( 63) 19.53 35.59 25.22
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Negation 143 ( 30) 71 ( 27) 20.98 38.03 27.04
Speculation 195 ( 36) 106 ( 36) 18.46 33.96 23.92
==[MOD TOTAL]== 338 ( 66) 177 ( 63) 19.53 35.59 25.22
------------------------------------------------------------------------------------
Thank you for your participation!!