Draft version of the 2005 ACE evaluation plan

[Mark Przybocki <mark.przybocki@nist.gov>]

Folks,

NIST is releasing a *draft* version of the 2005 ACE evaluation plan.  It
is labeled as a draft b/c:
 * there are a few diagnostic tasks that are not defined (Relation and
Event Mention Detection).
 * the amount of Arabic training and test data may be adjusted downward.

http://www.nist.gov/speech/tests/ace/ace05/doc/index.htm

NIST is releasing an updated version of the scoring script that is in-
line with the draft evaluation plan.  Changes include modifications to
the default scoring parameter settings.  (This script does not score the
undefined mention detection tasks.)

http://www.nist.gov/speech/tests/ace/ace05/software.htm

A reminder, to OFFICIALLY register for participation in the ACE-05
evaluation, sites must fill out the registration form and submit it to
NIST by November 1st, 2005.

http://www.nist.gov/speech/tests/ace/ace05/doc/index.htm

-mark

-- 
Mark Przybocki   PH: (301) 975-3347   FAX: (301) 670-0939