Development set online evaluation

This service is available at any time for the convenience of system development.

Be careful not to overfit your model to the development data set.

Step 1. Provide your registered e-mail address

E-mail address:

To have your e-mail address registered, subscribe to the bionlp-st list.
- E-mail to majordomo (at) bionlp-st (dot) org with "subscribe bionlp-st" in the body of the message.

Step 2. Upload the tarball file including your predicted .a2 files

File to Upload:

Tar and gzip all your predicted .a2 files, and submit the tarball file, e.g., filename.tar.gz.
There is a compatibility issue between BSD tar and GNU tar. Please use GNU tar to avoid a problem.

Step 3. Choose to get error analysis

Error analysis:

You can optionally choose to get an error analysis.
It will take more time, but you can get a comprehensive list of false positive and false negatives.
Caution: the list may be very long.

Step 4. Submit and wait for the evaluation results

Evaluation may take time. Please wait for a while after submission.