There is one way to evaluate IR algorithm, it is "TREC"(Text Retrieval Competion), which uses relevant documents, queries, etc, to judge whether the system ranks high based on the precision recall on the corpus of queries.
Shu Wang
--
Best wishes,
Shu Wang
Computer Science Department
Arizona State University
Arizona State University