Erasmus Medical Center Rotterdam and University of Aveiro

Task 1

Strict Matching

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  451)      526 (  451)    72.86    85.74    78.78
      Transcription          101 (   33)       68 (   33)    32.67    48.53    39.05
   Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
      Localization            99 (   42)       47 (   42)    42.42    89.36    57.53
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  532)      649 (  532)    63.87    81.97    71.79
------------------------------------------------------------------------------------
         Binding             333 (  158)      302 (  158)    47.45    52.32    49.76
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  132)      164 (  132)    82.50    80.49    81.48
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  132)      164 (  132)    69.11    80.49    74.37
------------------------------------------------------------------------------------
       Regulation            288 (   36)      119 (   36)    12.50    30.25    17.69
   Positive_regulation      1130 (  346)      693 (  346)    30.62    49.93    37.96
   Negative_regulation       526 (  149)      303 (  149)    28.33    49.17    35.95
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  531)     1115 (  531)    27.31    47.62    34.72
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1353)     2230 ( 1353)    40.99    60.67    48.92
------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  457)      526 (  457)    73.83    86.88    79.83
      Transcription          101 (   59)       68 (   59)    58.42    86.76    69.82
   Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
      Localization            99 (   42)       47 (   42)    42.42    89.36    57.53
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  564)      649 (  564)    67.71    86.90    76.11
------------------------------------------------------------------------------------
         Binding             333 (  158)      302 (  158)    47.45    52.32    49.76
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  132)      164 (  132)    82.50    80.49    81.48
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  132)      164 (  132)    69.11    80.49    74.37
------------------------------------------------------------------------------------
       Regulation            288 (   38)      119 (   37)    13.19    31.09    18.53
   Positive_regulation      1130 (  358)      693 (  358)    31.68    51.66    39.28
   Negative_regulation       526 (  152)      303 (  152)    28.90    50.17    36.67
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  548)     1115 (  547)    28.19    49.06    35.80
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1402)     2230 ( 1401)    42.47    62.83    50.68
------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  463)      526 (  459)    74.80    87.26    80.55
      Transcription          101 (   60)       68 (   60)    59.41    88.24    71.01
   Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
      Localization            99 (   47)       47 (   43)    47.47    91.49    62.51
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  576)      649 (  568)    69.15    87.52    77.26
------------------------------------------------------------------------------------
         Binding             333 (  159)      302 (  159)    47.75    52.65    50.08
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  133)      162 (  132)    83.12    81.48    82.30
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  133)      162 (  132)    69.63    81.48    75.09
------------------------------------------------------------------------------------
       Regulation            288 (   39)      119 (   37)    13.54    31.09    18.87
   Positive_regulation      1130 (  374)      690 (  369)    33.10    53.48    40.89
   Negative_regulation       526 (  159)      303 (  159)    30.23    52.48    38.36
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  572)     1112 (  565)    29.42    50.81    37.27
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1440)     2225 ( 1424)    43.62    64.00    51.88
------------------------------------------------------------------------------------

Strict Matching/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  451)      526 (  451)    72.86    85.74    78.78
Theme-Transcription             101 (   33)       68 (   33)    32.67    48.53    39.05
Theme-Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
Theme-Binding                   418 (  241)      344 (  241)    57.66    70.06    63.25
Theme-Localization               99 (   42)       47 (   42)    42.42    89.36    57.53
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  136)      164 (  136)    85.00    82.93    83.95
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   48)      117 (   48)    18.68    41.03    25.67
Theme-Positive_regulation      1068 (  422)      661 (  422)    39.51    63.84    48.81
Theme-Negative_regulation       490 (  186)      302 (  186)    37.96    61.59    46.97
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1565)     2237 ( 1565)    48.12    69.96    57.02
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    8)       22 (    8)     7.77    36.36    12.80
Cause-Positive_regulation       337 (   68)      109 (   68)    20.18    62.39    30.49
Cause-Negative_regulation       122 (   13)       29 (   13)    10.66    44.83    17.22
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   89)      160 (   89)    15.56    55.62    24.32
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1654)     2397 ( 1654)    43.25    69.00    53.17
---------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  457)      526 (  457)    73.83    86.88    79.83
Theme-Transcription             101 (   59)       68 (   59)    58.42    86.76    69.82
Theme-Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
Theme-Binding                   418 (  241)      344 (  241)    57.66    70.06    63.25
Theme-Localization               99 (   42)       47 (   42)    42.42    89.36    57.53
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  136)      164 (  136)    85.00    82.93    83.95
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   48)      117 (   48)    18.68    41.03    25.67
Theme-Positive_regulation      1068 (  434)      661 (  434)    40.64    65.66    50.20
Theme-Negative_regulation       490 (  190)      302 (  190)    38.78    62.91    47.98
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1613)     2237 ( 1613)    49.60    72.11    58.77
---------------------------------------------------------------------------------------
Cause-Regulation                103 (   10)       22 (   10)     9.71    45.45    16.00
Cause-Positive_regulation       337 (   68)      109 (   68)    20.18    62.39    30.49
Cause-Negative_regulation       122 (   13)       29 (   13)    10.66    44.83    17.22
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   91)      160 (   91)    15.91    56.88    24.86
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1704)     2397 ( 1704)    44.56    71.09    54.78
---------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  463)      526 (  459)    74.80    87.26    80.55
Theme-Transcription             101 (   60)       68 (   60)    59.41    88.24    71.01
Theme-Protein_catabolism         14 (    6)        8 (    6)    42.86    75.00    54.55
Theme-Binding                   418 (  259)      344 (  249)    61.96    72.38    66.77
Theme-Localization               99 (   47)       47 (   43)    47.47    91.49    62.51
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  137)      162 (  136)    85.62    83.95    84.78
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   50)      117 (   49)    19.46    41.88    26.57
Theme-Positive_regulation      1068 (  456)      657 (  445)    42.70    67.73    52.38
Theme-Negative_regulation       490 (  197)      302 (  195)    40.20    64.57    49.55
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1675)     2231 ( 1642)    51.51    73.60    60.60
---------------------------------------------------------------------------------------
Cause-Regulation                103 (   10)       22 (   10)     9.71    45.45    16.00
Cause-Positive_regulation       337 (   76)      109 (   75)    22.55    68.81    33.97
Cause-Negative_regulation       122 (   14)       29 (   14)    11.48    48.28    18.54
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (  100)      160 (   99)    17.48    61.88    27.26
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1775)     2391 ( 1741)    46.42    72.81    56.69
---------------------------------------------------------------------------------------

Task 2

Strict Matching/Decomposition

N/A

Approximate Span/Approximate Recursive/Decomposition

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

N/A

Task 3

Strict Matching

N/A

Approximate Span/Approximate Recursive

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive

N/A

Thank you for your participation!!