NCBI

Task 1

Strict Matching

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  473)      644 (  473)    76.41    73.45    74.90
      Transcription          101 (   61)      132 (   61)    60.40    46.21    52.36
   Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
      Localization            99 (   39)       47 (   39)    39.39    82.98    53.42
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  584)      847 (  584)    70.11    68.95    69.52
------------------------------------------------------------------------------------
         Binding             333 (  123)      299 (  123)    36.94    41.14    38.92
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  120)      156 (  120)    75.00    76.92    75.95
     Ubiquitination           30 (    4)        5 (    4)    13.33    80.00    22.86
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  124)      161 (  124)    64.92    77.02    70.45
------------------------------------------------------------------------------------
       Regulation            288 (   39)       84 (   39)    13.54    46.43    20.97
   Positive_regulation      1130 (  251)      518 (  251)    22.21    48.46    30.46
   Negative_regulation       526 (  112)      265 (  112)    21.29    42.26    28.32
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  402)      867 (  402)    20.68    46.37    28.60
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1233)     2174 ( 1233)    37.35    56.72    45.04
------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  495)      641 (  495)    79.97    77.22    78.57
      Transcription          101 (   63)      131 (   63)    62.38    48.09    54.31
   Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
      Localization            99 (   39)       47 (   39)    39.39    82.98    53.42
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  608)      843 (  608)    72.99    72.12    72.55
------------------------------------------------------------------------------------
         Binding             333 (  125)      299 (  125)    37.54    41.81    39.56
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  120)      156 (  120)    75.00    76.92    75.95
     Ubiquitination           30 (    4)        5 (    4)    13.33    80.00    22.86
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  124)      161 (  124)    64.92    77.02    70.45
------------------------------------------------------------------------------------
       Regulation            288 (   40)       84 (   40)    13.89    47.62    21.51
   Positive_regulation      1130 (  297)      516 (  297)    26.28    57.56    36.09
   Negative_regulation       526 (  144)      265 (  144)    27.38    54.34    36.41
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  481)      865 (  481)    24.74    55.61    34.25
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1338)     2168 ( 1338)    40.53    61.72    48.93
------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  504)      638 (  497)    81.42    77.90    79.62
      Transcription          101 (   65)      128 (   65)    64.36    50.78    56.77
   Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
      Localization            99 (   42)       46 (   39)    42.42    84.78    56.55
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  622)      836 (  612)    74.67    73.21    73.93
------------------------------------------------------------------------------------
         Binding             333 (  131)      298 (  130)    39.34    43.62    41.37
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  122)      156 (  121)    76.25    77.56    76.90
     Ubiquitination           30 (    4)        5 (    4)    13.33    80.00    22.86
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  126)      161 (  125)    65.97    77.64    71.33
------------------------------------------------------------------------------------
       Regulation            288 (   42)       84 (   41)    14.58    48.81    22.46
   Positive_regulation      1130 (  302)      514 (  300)    26.73    58.37    36.66
   Negative_regulation       526 (  149)      264 (  146)    28.33    55.30    37.46
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  493)      862 (  487)    25.36    56.50    35.01
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1372)     2157 ( 1354)    41.56    62.77    50.01
------------------------------------------------------------------------------------

Strict Matching/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  473)      644 (  473)    76.41    73.45    74.90
Theme-Transcription             101 (   61)      132 (   61)    60.40    46.21    52.36
Theme-Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
Theme-Binding                   418 (  207)      321 (  207)    49.52    64.49    56.02
Theme-Localization               99 (   39)       47 (   39)    39.39    82.98    53.42
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  128)      156 (  128)    80.00    82.05    81.01
Theme-Ubiquitination             25 (    5)        5 (    5)    20.00   100.00    33.33
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   48)       83 (   48)    18.68    57.83    28.24
Theme-Positive_regulation      1068 (  307)      508 (  307)    28.75    60.43    38.96
Theme-Negative_regulation       490 (  144)      266 (  144)    29.39    54.14    38.10
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1423)     2186 ( 1423)    43.76    65.10    52.34
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)        9 (    7)     6.80    77.78    12.50
Cause-Positive_regulation       337 (   21)       66 (   21)     6.23    31.82    10.42
Cause-Negative_regulation       122 (    9)       20 (    9)     7.38    45.00    12.68
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        4 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   37)       99 (   37)     6.47    37.37    11.03
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1460)     2285 ( 1460)    38.18    63.89    47.80
---------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  495)      641 (  495)    79.97    77.22    78.57
Theme-Transcription             101 (   63)      131 (   63)    62.38    48.09    54.31
Theme-Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
Theme-Binding                   418 (  211)      316 (  211)    50.48    66.77    57.49
Theme-Localization               99 (   39)       47 (   39)    39.39    82.98    53.42
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  128)      156 (  128)    80.00    82.05    81.01
Theme-Ubiquitination             25 (    5)        5 (    5)    20.00   100.00    33.33
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   49)       83 (   49)    19.07    59.04    28.82
Theme-Positive_regulation      1068 (  349)      508 (  349)    32.68    68.70    44.29
Theme-Negative_regulation       490 (  177)      266 (  177)    36.12    66.54    46.83
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1527)     2177 ( 1527)    46.96    70.14    56.25
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)        9 (    7)     6.80    77.78    12.50
Cause-Positive_regulation       337 (   47)       66 (   47)    13.95    71.21    23.33
Cause-Negative_regulation       122 (   12)       20 (   12)     9.84    60.00    16.90
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        4 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   66)       99 (   66)    11.54    66.67    19.67
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1593)     2276 ( 1593)    41.66    69.99    52.23
---------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  504)      638 (  497)    81.42    77.90    79.62
Theme-Transcription             101 (   65)      128 (   65)    64.36    50.78    56.77
Theme-Protein_catabolism         14 (   11)       24 (   11)    78.57    45.83    57.89
Theme-Binding                   418 (  236)      314 (  224)    56.46    71.34    63.03
Theme-Localization               99 (   42)       46 (   39)    42.42    84.78    56.55
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  130)      156 (  129)    81.25    82.69    81.96
Theme-Ubiquitination             25 (    5)        5 (    5)    20.00   100.00    33.33
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   51)       83 (   50)    19.84    60.24    29.85
Theme-Positive_regulation      1068 (  360)      504 (  356)    33.71    70.63    45.64
Theme-Negative_regulation       490 (  182)      265 (  178)    37.14    67.17    47.83
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1586)     2163 ( 1554)    48.77    71.84    58.10
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    7)        9 (    7)     6.80    77.78    12.50
Cause-Positive_regulation       337 (   47)       64 (   47)    13.95    73.44    23.44
Cause-Negative_regulation       122 (   12)       20 (   12)     9.84    60.00    16.90
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        4 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   66)       97 (   66)    11.54    68.04    19.73
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1652)     2260 ( 1620)    43.20    71.68    53.91
---------------------------------------------------------------------------------------

Task 2

Strict Matching/Decomposition

N/A

Approximate Span/Approximate Recursive/Decomposition

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

N/A

Task 3

Strict Matching

N/A

Approximate Span/Approximate Recursive

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive

N/A

Thank you for your participation!!