Natural language processing at Dalian University of Technology
Task 1
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 474) 580 ( 474) 76.58 81.72 79.07
Transcription 101 ( 28) 76 ( 28) 27.72 36.84 31.64
Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Localization 99 ( 35) 39 ( 35) 35.35 89.74 50.72
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 548) 715 ( 548) 65.79 76.64 70.80
------------------------------------------------------------------------------------
Binding 333 ( 133) 308 ( 133) 39.94 43.18 41.50
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 120) 155 ( 120) 75.00 77.42 76.19
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 120) 155 ( 120) 62.83 77.42 69.36
------------------------------------------------------------------------------------
Regulation 288 ( 43) 103 ( 43) 14.93 41.75 21.99
Positive_regulation 1130 ( 269) 742 ( 269) 23.81 36.25 28.74
Negative_regulation 526 ( 133) 340 ( 133) 25.29 39.12 30.72
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 445) 1185 ( 445) 22.89 37.55 28.44
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1246) 2363 ( 1246) 37.75 52.73 44.00
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 480) 580 ( 480) 77.54 82.76 80.07
Transcription 101 ( 50) 76 ( 50) 49.50 65.79 56.50
Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Localization 99 ( 35) 39 ( 35) 35.35 89.74 50.72
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 576) 715 ( 576) 69.15 80.56 74.42
------------------------------------------------------------------------------------
Binding 333 ( 136) 308 ( 136) 40.84 44.16 42.43
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 120) 155 ( 120) 75.00 77.42 76.19
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 120) 155 ( 120) 62.83 77.42 69.36
------------------------------------------------------------------------------------
Regulation 288 ( 44) 103 ( 44) 15.28 42.72 22.51
Positive_regulation 1130 ( 330) 742 ( 330) 29.20 44.47 35.26
Negative_regulation 526 ( 141) 340 ( 141) 26.81 41.47 32.56
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 515) 1185 ( 515) 26.49 43.46 32.92
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1347) 2363 ( 1347) 40.81 57.00 47.56
------------------------------------------------------------------------------------
------------------------------------------------------------------------------------
Event Class gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------
Gene_expression 619 ( 488) 578 ( 480) 78.84 83.04 80.89
Transcription 101 ( 50) 76 ( 50) 49.50 65.79 56.50
Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Localization 99 ( 39) 39 ( 36) 39.39 92.31 55.22
------------------------------------------------------------------------------------
=[SIMPLE ALL]= 833 ( 588) 713 ( 577) 70.59 80.93 75.40
------------------------------------------------------------------------------------
Binding 333 ( 140) 308 ( 140) 42.04 45.45 43.68
------------------------------------------------------------------------------------
Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Phosphorylation 160 ( 125) 154 ( 124) 78.12 80.52 79.30
Ubiquitination 30 ( 0) 0 ( 0) 0.00 0.00 0.00
Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
------------------------------------------------------------------------------------
=[PROT-MOD ALL]= 191 ( 125) 154 ( 124) 65.45 80.52 72.20
------------------------------------------------------------------------------------
Regulation 288 ( 45) 103 ( 44) 15.62 42.72 22.88
Positive_regulation 1130 ( 348) 723 ( 347) 30.80 47.99 37.52
Negative_regulation 526 ( 148) 340 ( 145) 28.14 42.65 33.90
------------------------------------------------------------------------------------
=[REGULATION ALL]= 1944 ( 541) 1166 ( 536) 27.83 45.97 34.67
------------------------------------------------------------------------------------
==[EVENT TOTAL]== 3301 ( 1394) 2341 ( 1377) 42.23 58.82 49.16
------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 474) 580 ( 474) 76.58 81.72 79.07
Theme-Transcription 101 ( 28) 76 ( 28) 27.72 36.84 31.64
Theme-Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Theme-Binding 418 ( 234) 354 ( 234) 55.98 66.10 60.62
Theme-Localization 99 ( 35) 39 ( 35) 35.35 89.74 50.72
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 122) 155 ( 122) 76.25 78.71 77.46
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 55) 99 ( 55) 21.40 55.56 30.90
Theme-Positive_regulation 1068 ( 315) 718 ( 315) 29.49 43.87 35.27
Theme-Negative_regulation 490 ( 183) 333 ( 183) 37.35 54.95 44.47
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1457) 2374 ( 1457) 44.80 61.37 51.80
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 13) 20 ( 13) 12.62 65.00 21.14
Cause-Positive_regulation 337 ( 70) 101 ( 70) 20.77 69.31 31.96
Cause-Negative_regulation 122 ( 17) 42 ( 17) 13.93 40.48 20.73
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 100) 163 ( 100) 17.48 61.35 27.21
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1557) 2537 ( 1557) 40.72 61.37 48.95
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 480) 580 ( 480) 77.54 82.76 80.07
Theme-Transcription 101 ( 50) 76 ( 50) 49.50 65.79 56.50
Theme-Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Theme-Binding 418 ( 236) 352 ( 236) 56.46 67.05 61.30
Theme-Localization 99 ( 35) 39 ( 35) 35.35 89.74 50.72
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 122) 155 ( 122) 76.25 78.71 77.46
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 56) 99 ( 56) 21.79 56.57 31.46
Theme-Positive_regulation 1068 ( 381) 718 ( 381) 35.67 53.06 42.67
Theme-Negative_regulation 490 ( 196) 333 ( 196) 40.00 58.86 47.63
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1567) 2372 ( 1567) 48.19 66.06 55.73
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 13) 20 ( 13) 12.62 65.00 21.14
Cause-Positive_regulation 337 ( 70) 101 ( 70) 20.77 69.31 31.96
Cause-Negative_regulation 122 ( 18) 42 ( 18) 14.75 42.86 21.95
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 101) 163 ( 101) 17.66 61.96 27.48
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1668) 2535 ( 1668) 43.62 65.80 52.46
---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------
Event-Arg Type gold (match) answer (match) recall prec. fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression 619 ( 488) 578 ( 480) 78.84 83.04 80.89
Theme-Transcription 101 ( 50) 76 ( 50) 49.50 65.79 56.50
Theme-Protein_catabolism 14 ( 11) 20 ( 11) 78.57 55.00 64.71
Theme-Binding 418 ( 267) 349 ( 255) 63.88 73.07 68.16
Theme-Localization 99 ( 39) 39 ( 36) 39.39 92.31 55.22
Theme-Protein_modification 1 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Phosphorylation 160 ( 127) 154 ( 126) 79.38 81.82 80.58
Theme-Ubiquitination 25 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Theme-Regulation 257 ( 57) 99 ( 56) 22.18 56.57 31.86
Theme-Positive_regulation 1068 ( 419) 697 ( 411) 39.23 58.97 47.12
Theme-Negative_regulation 490 ( 205) 332 ( 201) 41.84 60.54 49.48
---------------------------------------------------------------------------------------
=[THEME ALL]= 3252 ( 1663) 2344 ( 1626) 51.14 69.37 58.87
---------------------------------------------------------------------------------------
Cause-Regulation 103 ( 14) 20 ( 13) 13.59 65.00 22.48
Cause-Positive_regulation 337 ( 75) 101 ( 75) 22.26 74.26 34.25
Cause-Negative_regulation 122 ( 18) 42 ( 18) 14.75 42.86 21.95
Cause-Protein_modification 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Phosphorylation 2 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Ubiquitination 8 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Acetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
Cause-Deacetylation 0 ( 0) 0 ( 0) 0.00 0.00 0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]= 572 ( 107) 163 ( 106) 18.71 65.03 29.05
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]== 3824 ( 1770) 2507 ( 1732) 46.29 69.09 55.43
---------------------------------------------------------------------------------------
Task 2
N/A
N/A
N/A
Task 3
N/A
N/A
N/A
Thank you for your participation!!