University of Sheffield

Task 1

Strict Matching

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  385)      451 (  385)    62.20    85.37    71.96
      Transcription          101 (   34)       75 (   34)    33.66    45.33    38.64
   Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
      Localization            99 (   23)       27 (   23)    23.23    85.19    36.51
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  450)      568 (  450)    54.02    79.23    64.24
------------------------------------------------------------------------------------
         Binding             333 (  105)      224 (  105)    31.53    46.88    37.70
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (   76)       82 (   76)    47.50    92.68    62.81
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (   76)       82 (   76)    39.79    92.68    55.68
------------------------------------------------------------------------------------
       Regulation            288 (   33)       77 (   33)    11.46    42.86    18.08
   Positive_regulation      1130 (  268)      500 (  268)    23.72    53.60    32.88
   Negative_regulation       526 (  110)      203 (  110)    20.91    54.19    30.18
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  411)      780 (  411)    21.14    52.69    30.18
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1042)     1654 ( 1042)    31.57    63.00    42.06
------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  386)      450 (  386)    62.36    85.78    72.22
      Transcription          101 (   37)       75 (   37)    36.63    49.33    42.05
   Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
      Localization            99 (   23)       27 (   23)    23.23    85.19    36.51
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  454)      567 (  454)    54.50    80.07    64.86
------------------------------------------------------------------------------------
         Binding             333 (  105)      224 (  105)    31.53    46.88    37.70
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (   76)       82 (   76)    47.50    92.68    62.81
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (   76)       82 (   76)    39.79    92.68    55.68
------------------------------------------------------------------------------------
       Regulation            288 (   33)       77 (   33)    11.46    42.86    18.08
   Positive_regulation      1130 (  268)      500 (  268)    23.72    53.60    32.88
   Negative_regulation       526 (  110)      203 (  110)    20.91    54.19    30.18
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  411)      780 (  411)    21.14    52.69    30.18
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1046)     1653 ( 1046)    31.69    63.28    42.23
------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  396)      450 (  389)    63.97    86.44    73.53
      Transcription          101 (   38)       71 (   38)    37.62    53.52    44.19
   Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
      Localization            99 (   24)       26 (   23)    24.24    88.46    38.06
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  466)      562 (  458)    55.94    81.49    66.34
------------------------------------------------------------------------------------
         Binding             333 (  108)      224 (  107)    32.43    47.77    38.63
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (   76)       82 (   76)    47.50    92.68    62.81
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (   76)       82 (   76)    39.79    92.68    55.68
------------------------------------------------------------------------------------
       Regulation            288 (   35)       77 (   34)    12.15    44.16    19.06
   Positive_regulation      1130 (  280)      500 (  278)    24.78    55.60    34.28
   Negative_regulation       526 (  115)      203 (  113)    21.86    55.67    31.40
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  430)      780 (  425)    22.12    54.49    31.47
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1080)     1648 ( 1066)    32.72    64.68    43.46
------------------------------------------------------------------------------------

Strict Matching/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  385)      451 (  385)    62.20    85.37    71.96
Theme-Transcription             101 (   34)       75 (   34)    33.66    45.33    38.64
Theme-Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
Theme-Binding                   418 (  185)      262 (  185)    44.26    70.61    54.41
Theme-Localization               99 (   23)       27 (   23)    23.23    85.19    36.51
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (   78)       82 (   78)    48.75    95.12    64.46
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   41)       77 (   41)    15.95    53.25    24.55
Theme-Positive_regulation      1068 (  321)      501 (  321)    30.06    64.07    40.92
Theme-Negative_regulation       490 (  143)      204 (  143)    29.18    70.10    41.21
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1218)     1694 ( 1218)    37.45    71.90    49.25
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)       13 (    7)     6.80    53.85    12.07
Cause-Positive_regulation       337 (   18)       35 (   18)     5.34    51.43     9.68
Cause-Negative_regulation       122 (    9)       17 (    9)     7.38    52.94    12.95
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   34)       65 (   34)     5.94    52.31    10.68
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1252)     1759 ( 1252)    32.74    71.18    44.85
---------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  386)      450 (  386)    62.36    85.78    72.22
Theme-Transcription             101 (   37)       75 (   37)    36.63    49.33    42.05
Theme-Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
Theme-Binding                   418 (  186)      261 (  186)    44.50    71.26    54.79
Theme-Localization               99 (   23)       27 (   23)    23.23    85.19    36.51
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (   78)       82 (   78)    48.75    95.12    64.46
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   41)       77 (   41)    15.95    53.25    24.55
Theme-Positive_regulation      1068 (  321)      501 (  321)    30.06    64.07    40.92
Theme-Negative_regulation       490 (  144)      204 (  144)    29.39    70.59    41.50
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1224)     1692 ( 1224)    37.64    72.34    49.51
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)       13 (    7)     6.80    53.85    12.07
Cause-Positive_regulation       337 (   18)       35 (   18)     5.34    51.43     9.68
Cause-Negative_regulation       122 (    9)       17 (    9)     7.38    52.94    12.95
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   34)       65 (   34)     5.94    52.31    10.68
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1258)     1757 ( 1258)    32.90    71.60    45.08
---------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  396)      450 (  389)    63.97    86.44    73.53
Theme-Transcription             101 (   38)       71 (   38)    37.62    53.52    44.19
Theme-Protein_catabolism         14 (    8)       15 (    8)    57.14    53.33    55.17
Theme-Binding                   418 (  205)      254 (  192)    49.04    75.59    59.49
Theme-Localization               99 (   24)       26 (   23)    24.24    88.46    38.06
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (   78)       82 (   78)    48.75    95.12    64.46
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   43)       77 (   42)    16.73    54.55    25.61
Theme-Positive_regulation      1068 (  340)      498 (  332)    31.84    66.67    43.09
Theme-Negative_regulation       490 (  149)      204 (  146)    30.41    71.57    42.68
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1281)     1677 ( 1248)    39.39    74.42    51.51
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)       13 (    7)     6.80    53.85    12.07
Cause-Positive_regulation       337 (   21)       35 (   21)     6.23    60.00    11.29
Cause-Negative_regulation       122 (    9)       17 (    9)     7.38    52.94    12.95
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   37)       65 (   37)     6.47    56.92    11.62
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1318)     1742 ( 1285)    34.47    73.77    46.98
---------------------------------------------------------------------------------------

Task 2

Strict Matching/Decomposition

N/A

Approximate Span/Approximate Recursive/Decomposition

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

N/A

Task 3

Strict Matching

N/A

Approximate Span/Approximate Recursive

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive

N/A

Thank you for your participation!!