Ho Chi Minh City University of Science

Task 1

Strict Matching

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  483)      790 (  483)    78.03    61.14    68.56
      Transcription          101 (   10)       65 (   10)     9.90    15.38    12.05
   Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
      Localization            99 (   32)       61 (   32)    32.32    52.46    40.00
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  534)      933 (  534)    64.11    57.23    60.48
------------------------------------------------------------------------------------
         Binding             333 (  129)      478 (  129)    38.74    26.99    31.81
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  124)      215 (  124)    77.50    57.67    66.13
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  124)      215 (  124)    64.92    57.67    61.08
------------------------------------------------------------------------------------
       Regulation            288 (   28)      274 (   28)     9.72    10.22     9.96
   Positive_regulation      1130 (  216)     1149 (  216)    19.12    18.80    18.96
   Negative_regulation       526 (  126)      489 (  126)    23.95    25.77    24.83
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  370)     1912 (  370)    19.03    19.35    19.19
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1157)     3538 ( 1157)    35.05    32.70    33.84
------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  488)      790 (  488)    78.84    61.77    69.27
      Transcription          101 (   33)       65 (   33)    32.67    50.77    39.76
   Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
      Localization            99 (   32)       61 (   32)    32.32    52.46    40.00
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  562)      933 (  562)    67.47    60.24    63.65
------------------------------------------------------------------------------------
         Binding             333 (  129)      478 (  129)    38.74    26.99    31.81
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  124)      215 (  124)    77.50    57.67    66.13
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  124)      215 (  124)    64.92    57.67    61.08
------------------------------------------------------------------------------------
       Regulation            288 (   28)      274 (   28)     9.72    10.22     9.96
   Positive_regulation      1130 (  225)     1149 (  225)    19.91    19.58    19.75
   Negative_regulation       526 (  128)      489 (  128)    24.33    26.18    25.22
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  381)     1912 (  381)    19.60    19.93    19.76
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1196)     3538 ( 1196)    36.23    33.80    34.98
------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive

------------------------------------------------------------------------------------
       Event Class          gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------
     Gene_expression         619 (  495)      767 (  491)    79.97    64.02    71.11
      Transcription          101 (   33)       65 (   33)    32.67    50.77    39.76
   Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
      Localization            99 (   33)       60 (   32)    33.33    53.33    41.03
------------------------------------------------------------------------------------
     =[SIMPLE ALL]=          833 (  570)      909 (  565)    68.43    62.16    65.14
------------------------------------------------------------------------------------
         Binding             333 (  137)      469 (  137)    41.14    29.21    34.16
------------------------------------------------------------------------------------
  Protein_modification         1 (    0)        0 (    0)     0.00     0.00     0.00
     Phosphorylation         160 (  127)      207 (  125)    79.38    60.39    68.59
     Ubiquitination           30 (    0)        0 (    0)     0.00     0.00     0.00
       Acetylation             0 (    0)        0 (    0)     0.00     0.00     0.00
      Deacetylation            0 (    0)        0 (    0)     0.00     0.00     0.00
------------------------------------------------------------------------------------
    =[PROT-MOD ALL]=         191 (  127)      207 (  125)    66.49    60.39    63.29
------------------------------------------------------------------------------------
       Regulation            288 (   29)      274 (   28)    10.07    10.22    10.14
   Positive_regulation      1130 (  255)     1134 (  253)    22.57    22.31    22.44
   Negative_regulation       526 (  143)      484 (  141)    27.19    29.13    28.13
------------------------------------------------------------------------------------
   =[REGULATION ALL]=       1944 (  427)     1892 (  422)    21.97    22.30    22.13
------------------------------------------------------------------------------------
    ==[EVENT TOTAL]==       3301 ( 1261)     3477 ( 1249)    38.20    35.92    37.03
------------------------------------------------------------------------------------

Strict Matching/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  483)      790 (  483)    78.03    61.14    68.56
Theme-Transcription             101 (   10)       65 (   10)     9.90    15.38    12.05
Theme-Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
Theme-Binding                   418 (  255)      542 (  255)    61.00    47.05    53.12
Theme-Localization               99 (   32)       61 (   32)    32.32    52.46    40.00
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  128)      215 (  128)    80.00    59.53    68.27
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   46)      276 (   46)    17.90    16.67    17.26
Theme-Positive_regulation      1068 (  274)     1157 (  274)    25.66    23.68    24.63
Theme-Negative_regulation       490 (  163)      484 (  163)    33.27    33.68    33.47
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1400)     3607 ( 1400)    43.05    38.81    40.82
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    4)       19 (    4)     3.88    21.05     6.56
Cause-Positive_regulation       337 (   26)      110 (   26)     7.72    23.64    11.63
Cause-Negative_regulation       122 (   10)       67 (   10)     8.20    14.93    10.58
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   40)      196 (   40)     6.99    20.41    10.42
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1440)     3803 ( 1440)    37.66    37.86    37.76
---------------------------------------------------------------------------------------

Approximate Span/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  488)      790 (  488)    78.84    61.77    69.27
Theme-Transcription             101 (   33)       65 (   33)    32.67    50.77    39.76
Theme-Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
Theme-Binding                   418 (  255)      542 (  255)    61.00    47.05    53.12
Theme-Localization               99 (   32)       61 (   32)    32.32    52.46    40.00
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  128)      215 (  128)    80.00    59.53    68.27
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   46)      276 (   46)    17.90    16.67    17.26
Theme-Positive_regulation      1068 (  284)     1157 (  284)    26.59    24.55    25.53
Theme-Negative_regulation       490 (  169)      484 (  169)    34.49    34.92    34.70
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1444)     3607 ( 1444)    44.40    40.03    42.11
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    5)       19 (    5)     4.85    26.32     8.20
Cause-Positive_regulation       337 (   27)      110 (   27)     8.01    24.55    12.08
Cause-Negative_regulation       122 (   10)       67 (   10)     8.20    14.93    10.58
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   42)      196 (   42)     7.34    21.43    10.94
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1486)     3803 ( 1486)    38.86    39.07    38.97
---------------------------------------------------------------------------------------

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

---------------------------------------------------------------------------------------
     Event-Arg Type            gold (match)   answer (match)   recall    prec.   fscore
---------------------------------------------------------------------------------------
Theme-Gene_expression           619 (  495)      767 (  491)    79.97    64.02    71.11
Theme-Transcription             101 (   33)       65 (   33)    32.67    50.77    39.76
Theme-Protein_catabolism         14 (    9)       17 (    9)    64.29    52.94    58.06
Theme-Binding                   418 (  280)      523 (  272)    66.99    52.01    58.55
Theme-Localization               99 (   33)       60 (   32)    33.33    53.33    41.03
Theme-Protein_modification        1 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Phosphorylation           160 (  131)      207 (  129)    81.88    62.32    70.77
Theme-Ubiquitination             25 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
Theme-Regulation                257 (   47)      276 (   46)    18.29    16.67    17.44
Theme-Positive_regulation      1068 (  337)     1138 (  330)    31.55    29.00    30.22
Theme-Negative_regulation       490 (  187)      477 (  185)    38.16    38.78    38.47
---------------------------------------------------------------------------------------
=[THEME ALL]=                  3252 ( 1552)     3530 ( 1527)    47.72    43.26    45.38
---------------------------------------------------------------------------------------
Cause-Regulation                103 (    5)       19 (    5)     4.85    26.32     8.20
Cause-Positive_regulation       337 (   28)      110 (   28)     8.31    25.45    12.53
Cause-Negative_regulation       122 (   11)       67 (   11)     9.02    16.42    11.64
Cause-Protein_modification        0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Phosphorylation             2 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Ubiquitination              8 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Acetylation                 0 (    0)        0 (    0)     0.00     0.00     0.00
Cause-Deacetylation               0 (    0)        0 (    0)     0.00     0.00     0.00
---------------------------------------------------------------------------------------
=[CAUSE ALL]=                   572 (   44)      196 (   44)     7.69    22.45    11.46
---------------------------------------------------------------------------------------
==[PRIMARY ARG TOTAL]==        3824 ( 1596)     3726 ( 1571)    41.74    42.16    41.95
---------------------------------------------------------------------------------------

Task 2

Strict Matching/Decomposition

N/A

Approximate Span/Approximate Recursive/Decomposition

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive/Decomposition

N/A

Task 3

Strict Matching

N/A

Approximate Span/Approximate Recursive

N/A

Approximate Span without Event Trigger Matching/Approximate Recursive

N/A

Thank you for your participation!!