University of Zurich

Task 1

Strict Matching

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  400)      497 (  400)    64.62    80.48    71.68
      Transcription          101 (   26)      100 (   26)    25.74    26.00    25.87
   Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
      Localization            99 (   34)       39 (   34)    34.34    87.18    49.28
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  470)      651 (  470)    56.42    72.20    63.34
------------------------------------------------------------------------------------
         Binding             333 (   74)      264 (   74)    22.22    28.03    24.79
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  119)      168 (  119)    74.38    70.83    72.56
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  119)      168 (  119)    62.30    70.83    66.30
------------------------------------------------------------------------------------
       Regulation            288 (   23)       84 (   23)     7.99    27.38    12.37
   Positive_regulation      1130 (  129)      444 (  129)    11.42    29.05    16.39
   Negative_regulation       526 (   54)      166 (   54)    10.27    32.53    15.61
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  206)      694 (  206)    10.60    29.68    15.62
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 (  869)     1777 (  869)    26.33    48.90    34.23
------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  406)      497 (  406)    65.59    81.69    72.76
      Transcription          101 (   52)       97 (   52)    51.49    53.61    52.53
   Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
      Localization            99 (   34)       39 (   34)    34.34    87.18    49.28
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  502)      648 (  502)    60.26    77.47    67.79
------------------------------------------------------------------------------------
         Binding             333 (   74)      264 (   74)    22.22    28.03    24.79
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  119)      168 (  119)    74.38    70.83    72.56
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  119)      168 (  119)    62.30    70.83    66.30
------------------------------------------------------------------------------------
       Regulation            288 (   23)       84 (   23)     7.99    27.38    12.37
   Positive_regulation      1130 (  136)      444 (  136)    12.04    30.63    17.28
   Negative_regulation       526 (   56)      165 (   56)    10.65    33.94    16.21
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  215)      693 (  215)    11.06    31.02    16.31
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 (  910)     1773 (  910)    27.57    51.33    35.87
------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  414)      493 (  409)    66.88    82.96    74.06
      Transcription          101 (   54)       97 (   54)    53.47    55.67    54.55
   Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
      Localization            99 (   37)       39 (   34)    37.37    87.18    52.32
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  515)      644 (  507)    61.82    78.73    69.26
------------------------------------------------------------------------------------
         Binding             333 (   82)      263 (   80)    24.62    30.42    27.22
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  119)      164 (  119)    74.38    72.56    73.46
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  119)      164 (  119)    62.30    72.56    67.04
------------------------------------------------------------------------------------
       Regulation            288 (   25)       82 (   25)     8.68    30.49    13.51
   Positive_regulation      1130 (  157)      437 (  155)    13.89    35.47    19.97
   Negative_regulation       526 (   57)      163 (   57)    10.84    34.97    16.55
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  239)      682 (  237)    12.29    34.75    18.16
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 (  955)     1753 (  943)    28.93    53.79    37.63
------------------------------------------------------------------------------------

Strict Matching/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  400)      497 (  400)    64.62    80.48    71.68
Theme-Transcription             101 (   26)      100 (   26)    25.74    26.00    25.87
Theme-Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
Theme-Binding                   418 (  161)      264 (  161)    38.52    60.98    47.21
Theme-Localization               99 (   34)       39 (   34)    34.34    87.18    49.28
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  123)      168 (  123)    76.88    73.21    75.00
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   36)       84 (   36)    14.01    42.86    21.11
Theme-Positive_regulation      1068 (  170)      441 (  170)    15.92    38.55    22.53
Theme-Negative_regulation       490 (   83)      166 (   83)    16.94    50.00    25.30
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1043)     1774 ( 1043)    32.07    58.79    41.50
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Positive_regulation       337 (    6)       22 (    6)     1.78    27.27     3.34
Cause-Negative_regulation       122 (    0)        1 (    0)     0.00     0.00     0.00
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (    6)       23 (    6)     1.05    26.09     2.02
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1049)     1797 ( 1049)    27.43    58.38    37.32
---------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  406)      497 (  406)    65.59    81.69    72.76
Theme-Transcription             101 (   52)       97 (   52)    51.49    53.61    52.53
Theme-Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
Theme-Binding                   418 (  161)      263 (  161)    38.52    61.22    47.28
Theme-Localization               99 (   34)       39 (   34)    34.34    87.18    49.28
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  123)      168 (  123)    76.88    73.21    75.00
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   36)       84 (   36)    14.01    42.86    21.11
Theme-Positive_regulation      1068 (  178)      441 (  178)    16.67    40.36    23.59
Theme-Negative_regulation       490 (   88)      165 (   88)    17.96    53.33    26.87
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1088)     1769 ( 1088)    33.46    61.50    43.34
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Positive_regulation       337 (    6)       22 (    6)     1.78    27.27     3.34
Cause-Negative_regulation       122 (    0)        1 (    0)     0.00     0.00     0.00
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (    6)       23 (    6)     1.05    26.09     2.02
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1094)     1792 ( 1094)    28.61    61.05    38.96
---------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  414)      493 (  409)    66.88    82.96    74.06
Theme-Transcription             101 (   54)       97 (   54)    53.47    55.67    54.55
Theme-Protein_catabolism         14 (   10)       15 (   10)    71.43    66.67    68.97
Theme-Binding                   418 (  182)      259 (  174)    43.54    67.18    52.84
Theme-Localization               99 (   37)       39 (   34)    37.37    87.18    52.32
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  123)      164 (  123)    76.88    75.00    75.93
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   38)       82 (   38)    14.79    46.34    22.42
Theme-Positive_regulation      1068 (  202)      428 (  197)    18.91    46.03    26.81
Theme-Negative_regulation       490 (   89)      163 (   89)    18.16    54.60    27.26
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1149)     1740 ( 1128)    35.33    64.83    45.74
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Positive_regulation       337 (    9)       22 (    8)     2.67    36.36     4.98
Cause-Negative_regulation       122 (    0)        1 (    0)     0.00     0.00     0.00
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (    9)       23 (    8)     1.57    34.78     3.01
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1158)     1763 ( 1136)    30.28    64.44    41.20
---------------------------------------------------------------------------------------

Task 2

Strict Matching/Decomposition

N/A

Approximate Span/Approximate Recursive/Decomposition

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

N/A

Task 3

Strict Matching

N/A

Approximate Span/Approximate Recursive

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive

N/A

Thank you for your participation!!