interactive A vs B

[Paul Over <over@nist.gov>]

Giri -

Clearly interactive runs normally make use of knowledge of the search test
collection, So I understand you're expectation that all interactive runs
should be predictably/redundantly labeled A, given that the guidelines talk 
about A vs B in terms of system development AND  p r o c e s s i n g.

I suspect some groups may have ignored the "processing" part, and used the A/B
distinction just to tell us about system development. Then an interactive run
could make use of an A or B system. This actually seems like an improvement on 
the guidelines since the use of search test collection info during the query 
processing is covered by the manual vs interactive distinction.

But let's let those who labeled their interactive runs B (or A for that matter), 
tell us what they meant.

- Paul
-- 
Paul Over - Retrieval Group
	    Information Access Division
	    Information Technology Laboratory
	    National Institute of Standards and Technology
	    Bldg. 225  Rm. A211  (Mailstop 8940)
	    Gaithersburg, MD  20899-8940   USA
	    Voice: 301 975-6784    Fax: 301 975-5287