Workshop follow-up - additions to results directories; overview slides

[Paul Over x6784 <over@nist.gov>]

Hi,

I've added a few things to the results sections of the guidelines
on the track website.

- The complete judgments are there for the search task, although
I will not be sending out revised results based on those. The 
differences are not worth having everyone redo their analysis for 
in the final proceedings papers.

- You'll also find all the submissions for search and feature
extraction in two formats. One is the xml format you submitted. 
The other is the format that the evaluation program trec_eval 
expects. So you can run trec_eval on the those submissions and 
the judgments. 

  <ftp://ftp.cs.cornell.edu/pub/smart/> trec_eval.7.0beta.tar.gz

You can also run beadplot, a little Java tool (alpha-version!) for 
low-level visual comparison of several result sets.

  <http://www-nlpir.nist.gov/projects/beadplot/>

Once the final proceedings papers are in, we'll move the submisions,
judgments, etc. to the past results area.

- Also, the track overview slides are now posted as part of the 
workshop notebook in the active participants' area of the TREC 
website.

Paul
-- 
Paul Over - Retrieval Group
	    Information Access Division
	    Information Technology Laboratory
	    National Institute of Standards and Technology
	    Bldg. 225  Rm. A211  (Mailstop 8940)
	    Gaithersburg, MD  20899-8940   USA
	    Voice: 301 975-6784    Fax: 301 975-5287