Improving retrieval relevance using users’ explicit feedback

Abstract

Purpose

The purpose of this paper is to improve users’ search results relevancy by manipulating their explicit feedback.

Design/methodology/approach

CoRRe – an explicit feedback model integrating three popular feedback, namely, Comment-Rating-Referral is proposed in this study. The model is further enhanced using case-based reasoning in retrieving the top-5 results. A search engine prototype was developed using Text REtrieval Conference as the document collection, and results were evaluated at three levels (i.e. top-5, 10 and 15). A user evaluation involving 28 students was administered, focussing on 20 queries.

Findings

Both Mean Average Precision and Normalized Discounted Cumulative Gain results indicate CoRRe to have the highest retrieval precisions at all the three levels compared to the other feedback models. Furthermore, independent t-tests showed the precision differences to be significant. Rating was found to be the most popular technique among the participants, producing the best precision compared to referral and comments.

Research limitations/implications

The findings suggest that search retrieval relevance can be significantly improved when users’ explicit feedback are integrated, therefore web-based systems should find ways to manipulate users’ feedback to provide better recommendations or search results to the users.

Originality/value

The study is novel in the sense that users’ comment, rating and referral were taken into consideration to improve their overall search experience.

Citation

Balakrishnan, V., Ahmadi, K. and Ravana, S.D. (2015), "Improving retrieval relevance using users’ explicit feedback", Aslib Journal of Information Management, Vol. 68 No. 1, pp. 76-98. https://doi.org/10.1108/AJIM-07-2015-0106