Appeared in: Proceedings of the 34th Text REtrieval Conference (TREC 2025)
Abstract:
The principal goal of the RAG TREC Instrument for Multilingual Evaluation (RAGTIME) track at TREC is to study report generation from multilingual source documents. The track has created a document collection containing Arabic, Chinese, English, and Russian news stories. RAGTIME includes three task types: Multilingual Report Generation, English Report Generation, and Multilingual Information Retrieval (MLIR). A total of 125 runs were submitted by 13 participating teams (and as baselines by the track coordinators) for three tasks. This overview describes these three tasks and presents the available results.
BibTeX @inproceedings{lawrie:trec2025-ragtime, author = {Lawrie, Dawn and MacAvaney, Sean and Mayfield, James and Soldaini, Luca and Yang, Eugene and Yates, Andrew}, title = {Overview of the TREC 2025 RAGTIME Track}, booktitle = {Proceedings of the 34th Text REtrieval Conference}, year = {2025}, url = {https://arxiv.org/abs/2602.10024} }