A factual and perceptional framework for assessing diversity effects of online recommender systems
ISSN: 1066-2243
Article publication date: 24 June 2019
Issue publication date: 14 November 2019
Abstract
Purpose
The purpose of this paper is to explore the effects of online recommender systems (RS) on three types of diversity: algorithmic recommendation diversity, perceived recommendation diversity and sales diversity. The analysis distinguishes different recommendation algorithms and shows whether user perceptions match the actual effects of RS on sales.
Design/methodology/approach
An online experiment was conducted using a realistic shop design, various recommendation algorithms and a representative consumer sample to ensure the generalizability of the findings.
Findings
Recommendation algorithms show a differential impact on sales diversity, but only collaborative filtering can lead to higher sales diversity. However, some of these effects are subject to how much information firms have about users’ preferences. The level of recommendation diversity perceived by users does not always reflect the factual diversity effects.
Research limitations/implications
Recommendation and consumption patterns might differ for other types of products; future studies should replicate the study with search or credence goods. The authors also recommend that future research should move from taking a unidimensional measure for the assessment of diversity and employ multidimensional measures instead.
Practical implications
Online shops need to conduct a more comprehensive assessment of their RS’ effect on diversity, taking into account not only the effects on their sales distribution, but also on users’ perceptions and faith in the recommendation algorithm.
Originality/value
This study offers a framework for assessing different forms of diversity in online RS. It employs various recommendation algorithms and compares their impact using not just one but three different types of diversity measures. This helps explaining some of the contradictious findings from the previous literature.
Keywords
Acknowledgements
A previous version of the paper was presented at ICIS 2013 (Matt et al., 2013), and it has substantially profited from the feedback of conference participants as well as from the anonymous reviewers of internet research, who the authors would like to thank for their constructive feedback.
Citation
Matt, C., Hess, T. and Weiß, C. (2019), "A factual and perceptional framework for assessing diversity effects of online recommender systems", Internet Research, Vol. 29 No. 6, pp. 1526-1550. https://doi.org/10.1108/INTR-06-2018-0274
Publisher
:Emerald Publishing Limited
Copyright © 2019, Emerald Publishing Limited