Search the World's Largest Database of Information Science & Technology Terms & Definitions
InfInfoScipedia LogoScipedia
A Free Service of IGI Global Publishing House
Below please find a list of definitions for the term that
you selected from multiple scholarly research resources.

What is TRR

Chapter 388
Encyclopedia of Information Science and Technology, Fourth Edition
Total Reciprocal Rank (TRR) is useful for evaluating the existence of several correct responses offered by a system to the same query. In these cases, it is not sufficient to consider only the first correct response in the evaluations, and thus TRR takes all of them into account and assigns a weight to each answer according to it position in the list of results retrieved. Thus, if the second and fourth answers on the list of results are correct for a question, the TRR value would be ½ + ¼ = ¾.
Published in Chapter:
Analysis and Assessment of Cross-Language Question Answering Systems
Juncal Gutiérrez-Artacho (University of Granada, Spain) and María-Dolores Olvera-Lobo (CSIC, Unidad Asociada Grupo SCImago and University of Granada, Spain)
Copyright: © 2018 |Pages: 9
DOI: 10.4018/978-1-5225-2255-3.ch388
Abstract
Within the sphere of the Web, the overload of information is more notable than in other contexts. Question answering systems (QAS) are presented as an alternative to the traditional Information Retrieval (IR) systems, seeking to offer precise and understandable answers to factual questions instead of showing the user a list of documents related to a given search . Given that the QAS is presented as a substantial advance in the improvement of IR, it becomes necessary to determine its effectiveness for the final user. With this aim, 7 studies were undertaken to evaluate: a) in the first two, the linguistic resources and tools used in these systems for multilingual retrieval (Research 1; Research 2); and b) the performance and quality of the answers of the main monolingual and multilingual QA of general domain and specialized domain in the Web in response to different types of questions and subjects, so that different evaluation means can be applied (Research 3, Research 4, Research 5, Research 6, Research 7).
Full Text Chapter Download: US $37.50 Add to Cart
eContent Pro Discount Banner
InfoSci OnDemandECP Editorial ServicesAGOSR