trecvid - varying frame numbering



Hi,

Yufei raised the following problem:

> We found that the frame numbers obtained from different MPGE decoder are
> slightly different from each other, which will make the boundary of CUT
> meaningless. 

> So we want to know how the evaluation ground truth will be defined at
> NIST.  In addition, if our ground truth is different from NIST's, will
> our results be still valid? Thanks.

We will try to find a way to correctly score cuts inspite of the differences
in frame numbers you have encountered. Arnon Amir has suggested a solution.

But I would like to have more information from Yufei and anyone else who has 
seen this phenonmenon:

- what specific files did it happen on?
- what codecs gave different results
- were the differences consistent throughout the files?
- how large were the differences - mean, max

This sort of information will help us understand the size of this problem and
craft a more precise solution.

Thanks,
Paul
-- 
Paul Over - Retrieval Group
	    Information Access Division
	    Information Technology Laboratory
	    National Institute of Standards and Technology
	    Bldg. 225  Rm. A211  (Mailstop 8940)
	    Gaithersburg, MD  20899-8940   USA
	    Voice: 301 975-6784    Fax: 301 975-5287



Date Index | Thread Index | Problems or questions? Contact list-master@nist.gov