Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs

dc.creatorRadlinski, Filip
dc.creatorJoachims, Thorsten
dc.date2006-05-09
dc.date.accessioned2026-07-07T07:09:29Z
dc.date.available2026-07-07T07:09:29Z
dc.descriptionClickthrough data is a particularly inexpensive and plentiful resource to obtain implicit relevance feedback for improving and personalizing search engines. However, it is well known that the probability of a user clicking on a result is strongly biased toward documents presented higher in the result set irrespective of relevance. We introduce a simple method to modify the presentation of search results that provably gives relevance judgments that are unaffected by presentation bias under reasonable assumptions. We validate this property of the training data in interactive real world experiments. Finally, we show that using these unbiased relevance judgments learning methods can be guaranteed to converge to an ideal ranking given sufficient data.
dc.description7 pages. Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), 2006
dc.identifierhttps://arxiv.org/abs/cs/0605037
dc.identifierhttp://arxiv.org/abs/cs/0605037
dc.identifier.urihttp://salesiana.dossiersoluciones.com/handle/123456789/111083
dc.subjectInformation Retrieval
dc.subjectMachine Learning
dc.subjectH.3.3
dc.titleMinimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs
dc.typetext

Files

Collections