Feature extraction submissions - new size, evaluation details

[Paul Over <over@nist.gov>]

Hi,

Please note that the maximum size of the result set for a given
feature has been increased from 200 to 1000 to accommodate
some of more frequently occuring features.  More detail about
the procedure and measure to be used - average precision - has 
been added to the webpage ( see sections 6.2,6.3). 

You can submit less than 1000. The measure will handle comparison 
of different sized result sets. However, just increasing the size 
of your submission will never penalize you in terms of average 
precision.

The format for the feature extraction task submisison will
be available sometime Monday. Basically we think it will be
one XML file per run (i.e., system variant) containing the sys/run 
ID, a section (with feature id) for each feature's results and
within the feature section up to 1000 result set item elements
(each with a rank and common shot id).  

- Paul
-- 
Paul Over - Retrieval Group
	    Information Access Division
	    Information Technology Laboratory
	    National Institute of Standards and Technology
	    Bldg. 225  Rm. A211  (Mailstop 8940)
	    Gaithersburg, MD  20899-8940   USA
	    Voice: 301 975-6784    Fax: 301 975-5287