Making omnichannel an augmented reality: the current and future state of the art

Tim Hilken (Department of Marketing and Supply Chain Management, Maastricht University School of Business and Economics, Maastricht, The Netherlands)
Jonas Heller (School of Marketing, UNSW Business School, Sydney, Australia)
Mathew Chylinski (School of Marketing, UNSW Business School, Sydney, Australia)
Debbie Isobel Keeling (Marketing Group, University of Sussex School of Business Management and Economics, Brighton, UK)
Dominik Mahr (Department of Marketing and Supply Chain Management, Maastricht University School of Business and Economics, Maastricht, The Netherlands and Maastricht University, Service Science Factory, Maastricht, The Netherlands)
Ko de Ruyter (Faculty of Management, Cass Business School, London, UK and School of Marketing, UNSW Business School, Sydney, Australia)

Journal of Research in Interactive Marketing

ISSN: 2040-7122

Article publication date: 2 August 2018

Issue publication date: 13 November 2018

26711

Abstract

Purpose

This paper aims to explore the current and future roles of augmented reality (AR) as an enabler of omnichannel experiences across the customer journey. To advance the conceptual understanding and managerial exploitation of AR, the paper aims to synthesise current research, illustrating how a variety of current applications merge online and offline experiences, and provides a future research agenda to help advance the state of the art in AR.

Design/methodology/approach

Drawing on situated cognition theorising as a guiding framework, the paper reviews previously published research and currently deployed applications to provide a roadmap for future research efforts on AR-enabled omnichannel experiences across the customer journey.

Findings

AR offers myriad opportunities to provide customers with a seamless omnichannel journey, smoothing current obstacles, through a unique combination of embedded, embodied and extended customer experiences. These three principles constitute the overarching value drivers of AR and offer coherent, theory-driven organising principles for managers and researchers alike.

Originality/value

Current research has yet to provide a relevant, conceptually robust understanding of AR-enabled customer experiences. In light of the rapid development and widespread deployment of the technology, this paper provides an urgently needed framework for guiding the development of AR in an omnichannel context.

Keywords

Citation

Hilken, T., Heller, J., Chylinski, M., Keeling, D.I., Mahr, D. and de Ruyter, K. (2018), "Making omnichannel an augmented reality: the current and future state of the art", Journal of Research in Interactive Marketing, Vol. 12 No. 4, pp. 509-523. https://doi.org/10.1108/JRIM-01-2018-0023

Publisher

:

Emerald Publishing Limited

Copyright © 2018, Tim Hilken, Jonas Heller, Mathew Chylinski, Debbie Isobel Keeling, Dominik Mahr and Ko de Ruyter.

License

Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


Firms are increasingly challenged to provide compelling customer experiences across online and offline touch points (Lemon and Verhoef, 2016). As customers no longer complete their journey exclusively in one channel (Wolny and Charoensuksai, 2014), they expect firms to integrate online and offline experiences into a seamless omnichannel experience (Cummins et al., 2016). However, despite firms’ channel integration efforts, recent market reports show that 54 per cent of UK customers are disappointed with their most recent experiences (Temkin Group, 2017). For instance, many customers find it difficult to envision how online offerings physically fit their personal environments, leading to dissatisfaction when they discover that a sofa that looked good online does not fit the actual décor of their homes. In a similar vein, many customers miss the online world’s abundance of digital product information, customisability and social media connectivity in their physical store experiences. Further, a persistent managerial challenge is to counteract customers’ showrooming or webrooming behaviours and thus prevent churn when customers switch between channels (Accenture, 2014). To address these challenges, a growing number of firms (including L’Oreal, IKEA, Akzo Nobel and Nike) leverage augmented reality (AR) applications to enable omnichannel experiences (Brynjolfsson et al., 2013). Uniquely, AR embeds digital content (such as product information, images and animations) into the customer’s physical environment, interactively and in real time (Azuma et al., 2001). For instance, L’Oreal’s AR-based virtual mirror allows customers to virtually try on makeup, thus integrating the “fit and feel” sensory richness of trying on a physical product into customers’ online experience. In similar fashion, Nike’s in-store customizer lets customers virtually design a pair of sneakers, thus bringing the customisability and social connectivity inherent to the online channel into customers’ offline experience. According to Apple CEO Tim Cook, AR is “changing the whole experience of how [customers] shop” (Bloomberg, 2017), leading Apple to refer to AR as a core technology and pursue an AR-driven acquisition strategy. The promise of AR is a uniquely persuasive set of “smart” technologies (Marinova et al., 2017) set to seamlessly merge online and offline customer experiences through an intuitive, context-sensitive and socially connected interface.

However, despite these developments, it seems that customers remain underwhelmed by current AR experiences. A recent survey by DigitalBridge (2017) reveals that although customers indicate they would be more likely to purchase when firms offer AR applications, more than half (51 per cent) believe that firms are currently failing to take full advantage of the technology. One main reason for such disappointing performance may lie in the fact that firms are not yet able to successfully integrate digital online and offline customer experiences (Accenture, 2016). According to Gartner (2017), inflated expectations have lead initial AR platforms to fail (e.g. Google Glass) and the technology is only expected to deliver value if firms are able to prioritise actual customer needs, such as more efficient and enjoyable shopping experiences that reduce decision-making uncertainty (Dacko, 2016).

Existing research into AR offers little guidance to managers on how to successfully deploy AR as an enabler of omnichannel experiences across the customer journey. Previous studies suggest AR’s potential to deliver compelling customer experiences (Poushneh and Vasquez-Parraga, 2017). However, in doing so, the literature has predominantly focused on technology acceptance modelling (Rese et al., 2014), or the investigation of AR media characteristics (Javornik, 2016a). Identification of AR’s overarching value drivers in the context of customer experience, and how these ultimately benefit customers’ decision making, has been neglected to date. A coherent, theory-based research agenda that accounts for how AR can address current obstacles and uniquely integrate online and offline experiences would enable managers to deliver integrated, real-time and contextual customer experiences. That is, fulfil the right customer need at the right moment in the customer journey (Marketing Science Institute, 2016).

To guide both the conceptual and managerial development of AR-enabled omnichannel experiences, we draw on contemporary theorising of situated cognition (Robbins and Aydede, 2009; Semin and Smith, 2013). Situated cognition implies that customer experiences seem most realistic when they integrate information about products and services in real-time within the immediate decision context (i.e. are embedded), allow for physical interaction with a product or service (i.e. are embodied), and provide opportunities for communication with other customers (i.e. are extended). We posit that AR is unique because it satisfies all three criteria. AR’s integration of interactive, real-time virtual content into the customer’s view of the physical environment enables embedded, embodied and extended customer experiences. This combination allows linking of customer experience across channels where behaviours traditionally reserved for offline business can be expressed into the online world and vice versa. The three principles of embedding, embodiment and extension provide a much needed and strong conceptual foundation for future research efforts on AR. In turn, this foundation will benefit management through engendering development of AR as a novel form of digital customer experience that facilitates omnichannel behaviour throughout the customer’s journey.

Following a brief introduction to situated cognition theory and a discussion of its suitability for guiding the research agenda, we take stock of current AR literature and identify key research themes and gaps. To paint a more vivid picture of AR-enabled omnichannel experiences, we then illustrate how a variety of currently deployed AR applications enhance key steps in the customer journey. We conclude by providing a range of relevant, conceptually robust research directions to inform future inquiry into AR.

Grounding augmented reality in situated cognition theory

The seamless integration of the online and offline worlds lies at the heart of omnichannel experience (Brynjolfsson et al., 2013). A marketing imperative is, thus, to provide customers with an authentic omnichannel experience. For customers, a sense of authenticity and realism arises when they can naturally interact with – and make purchase decisions about – firms’ products and services. Yet achieving this in both online and offline settings is a key challenge for managers. Emerging theories of situated cognition (Robbins and Aydede, 2009; Semin and Smith, 2013) help explain how people naturally engage in information processing, preference formation and decision making. Increasingly, situated cognition has been applied to explain customer experience and behaviour (Krishna and Schwarz, 2014). In particular, situated cognition suggests that customer experiences are most realistic and compelling when they are:

Embedded: Customers often find it difficult to imagine how firms’ products and services fit them personally or fit with their environment. Customers therefore use their immediate surroundings as a real-life ‘drawing board’, which they can alter in ways that facilitate the evaluation of products or services (Wilson 2002). For instance, some customers may lay out placeholders in their home to assess the placement of furniture vis-à-vis the current décor; others will mix and match pieces of clothing in a department store to find the best look.

Embodied: Customers draw on their own physical experiences and actions to learn more about products and services. Research has shown that physical interaction such as touching, rotating or moving around a product, but also the simulation of physical interaction, via touchscreens or 360-degree product rotations for example, may evoke affective reactions and improve customers’ ability to evaluate an offering (Brasel and Gips, 2014; Grohmann et al., 2007; Rosa and Malter, 2003). To illustrate, customers will often physically move furniture, or sit in different positions on a new couch, before they decide where to position it. Similarly, an online 360-degree product view may simulate physical interaction with a piece of clothing. Rotating it provides an experience of not just how the product looks, but may even suggest how it feels to wear the look.

Extended: Customers rely on others to support them in product or service evaluation. Because people have a natural tendency to share their experiences with peers (Echterhoff et al., 2009), customers commonly consult peer reviews, go shopping together, and increasingly share their shopping in real-time through highly visual social media such as Snapchat. Asking family and friends to rearrange placeholders around a home provides customers with new perspectives, and getting others to comment on a mix of clothing may change how customers see themselves in those clothes.

In contrast to other emerging technologies, which immerse customers into a fully synthetic environment (e.g. virtual reality), AR supplements reality rather than replaces it. As such, it is the perfect lynchpin between the online and offline world and provides a natural application for a situated cognition perspective. AR contextualises products and services by embedding digital content into the customer’s physical environment, interactively and in real-time (Azuma et al., 2001) and increasingly allows customers to share their enhanced view of reality with others (Scholz and Smith, 2016). We contend that AR blurs the boundaries between online and offline channels by providing a unique combination of embedded, embodied and extended experiences.

In online settings, a multitude of virtual try-on or try-out tools have emerged to provide customers with vivid contextual information (e.g. L’Oreal’s makeup or Mister Spex’s new pair of sunglasses on one’s face) that has traditionally been reserved for offline experiences (Yim et al., 2017). In contrast, in offline settings, AR provides customers with customised and interactive information (e.g. Siemens’ product use animations or Nike’s product customisation options) previously absent from the physical point-of-sale (Olsson et al., 2013). By virtually tagging online product ratings on the physical product packaging, apps like the “Vivino” wine scanner also empower customers with immediate access to social communication. The value proposition of AR is thus to enhance the customer experience by merging the touch-and-feel of the physical world with highly vivid, customised and connected digital content. This naturally blends online and offline experiences to overcome limitations of any individual distribution channel. Initial evidence on the performance of deployed AR applications is promising. For example, the online marketplace Apollo Box has experienced a 25 per cent increase in conversion rates and greater customer engagement with their offerings (Techcrunch, 2017); the French eyewear retailer Direct Optic reports 41 per cent higher conversion rates and 12.5 per cent larger basket sizes for customers using their AR try-on tool (Total Immersion, 2012). For managers, AR thus addresses the concerns of showrooming and webrooming, and maintains customers as they switch between channels during their journey.

Explicating augmented reality-enabled omnichannel experiences

To comprehensively describe AR’s omnichannel potential, we review selected relevant literature and consider how AR links offline with online, and online with offline experiences. In Figure 1, we summarise the specific conceptualizations and measurements of AR’s unique features in current research according to the situated cognition principles of embedding, embodiment and extension. Furthermore, we provide an overview of their effects on customer experience-relevant downstream consequences and identify a number of contingency factors. This research synthesis reveals several common themes, as well as research gaps, which we discuss in greater detail in the following sections.

Integrating offline experiences into the online experience

AR offers myriad opportunities to enable omnichannel experiences by integrating elements into the online environment that traditionally have been reserved for in-store experiences. An acknowledged obstacle for customers starting their journey online is the absence of direct product trial, which, in turn, may lead to virtual shopping cart abandonment, product returns and webrooming behaviour. Many AR applications are thus aimed at empowering customers to try on (e.g. Ray-Ban sunglasses, Gap clothing or L’Oreal makeup in a virtual mirror) or try out products (e.g. an IKEA sofa in a real-time view of one’s living room), as they would in a physical offline experience.

In line with our conceptual perspective, these AR applications create an authentic omnichannel experience across the customer journey. Because they provide customers with an embedded offering virtually present in a personally relevant environment, AR applications close the gap between online and offline shopping. Combined with a sense of embodiment resulting from a natural interactivity and simulation of physical control over virtual offerings, which often goes beyond what is possible in physical environments, AR-enabled experiences may not only surpass traditional online shopping but also offer many advantages over offline experiences. For instance, the largest European online retailer for eyewear, Mister Spex, provides its customers with a wholly new experience in the online pre-purchase stage; with the help of an AR virtual mirror, customers can virtually try on any pair of sunglasses from their vast online assortment and assess the resulting look from all sides through natural head movements.

Early research explicated AR effects in terms of generic media characteristics (see also Figure 1). Authors noted providing customers with interactivity and a more vivid, richer or highly personalised presentation format as key characteristics of AR (Javornik, 2016b; Parise et al., 2016; Poushneh and Vasquez-Parraga, 2017; Yim et al., 2017). This approach, however, has difficulty explaining the value creation within AR-enabled experiences in online contexts where interactivity and enhanced presentation formats are common. In response, a recent work by Hilken et al. (2017) investigated the utilitarian and hedonic value of AR by suggesting a fit with the situated mode of cognition, which customers preferentially use in everyday shopping situations. From this perspective, the value of AR-enabled experiences is explained by the conjunction of environmental embedding and sense of embodiment. Focusing on these conceptual dimensions highlights AR’s uniqueness in the online channel – that is, providing customers with the means for direct examination of offerings within a personally relevant context.

Because customer-to-customer connectivity is increasingly important in delivering omnichannel customer experiences (Verhoef et al., 2017), the early absence of AR social features has been a limiting factor in the technology’s proliferation (Javornik, 2016a). However, recent applications have begun to address this limitation by enabling extended AR experiences. Akzo Nobel’s “Visualiser” application is one example of this. Customers using this application can virtually redesign the wall colour in their home, and they can then share an image or video with peers. By inviting peers to directly modify the shared images or videos with their colour recommendations, a shared model of AR is co-created through iterative feedback between customers. This highly visual, context-sensitive form of communication enables peer customers, who in current online interactions are oftentimes limited to “liking” or commenting, to become active contributors to a shared customer experience (Scholz and Smith, 2016). Research has yet to conceptualise and empirically assess the ability of AR to provide such extended customer experiences. However, our strong conjecture is that shared visualisation and manipulation of AR objects is critical to its success, and likely leads to enhanced perceptions of embedded and embodied experiences that may be explained along the theories of socially situated cognition (Semin and Smith, 2013).

Because current AR applications vary in the extent to which they provide embedding, embodiment and extension, the resulting customer experiences likely vary accordingly. The literature shares a common view that a compelling AR experience provides customers with a balance of utilitarian and hedonic value, enhanced decision making and positive behavioural intentions such as purchase and word-of-mouth intentions (Hilken et al., 2017; Poushneh and Vasquez-Parraga, 2017; Yim et al., 2017). Research has also revealed that measures of the realism of the experience constitute the process variables underlying these effects (see also Figure 1). Several studies have shown that general sensations of flow and immersion in the experience may help to explain the benefits of AR use (Javornik, 2016b; Parise et al., 2016; Yim et al., 2017). Most recently, Hilken et al. (2017) emphasised an AR-specific process by which customers gain a feeling of spatial presence of virtual objects; that is, when using AR, customers suspend disbelief and become convinced that they are really trying on and interacting with an actual pair of sunglasses, a new makeup look or clothing from next season’s fashion line. However, there is limited insight into relevant boundary conditions of AR omnichannel experiences, such as customer preference for visual or verbal information processing, or privacy concerns about using new technology (Hilken et al., 2017; Poushneh and Vasquez-Parraga, 2017).

Integrating online experiences into the offline experience

In offline settings, AR provides an opportunity for novel in-store experiences and increased engagement by providing seamless access to digital content that is traditionally available only to online shoppers. A variety of AR applications digitally animate products or their packaging (e.g. Lego’s product visualiser) and provide contextualised product or service information, such as online reviews (e.g. the Yelp “monocle” overlays online ratings on physical restaurant locations). At Walgreens, customers can use the “Aisle411” application to receive digital way-finding support that helps them locate products in the supermarket aisle. Similar to the filter functionalities of online shops, recent AR applications also let customers visually highlight or de-saturate products in the physical assortment to personalise their choice set. AR, thus, offers firms a powerful tool to create memorable in-store experiences, increase fun and the time spent in-store. It also delivers on digital customer experience imperatives for offline retail (Deloitte, 2014): offering better price comparisons, facilitating product browsing and assortment navigation, and providing enhanced information about product features, variations and availability. From an omnichannel perspective, augmentation of the in-store experience promises to promote store loyalty, while counteracting the loss of customers to online shops, reduced in-store traffic and showrooming behaviour.

Following the line of argumentation on situated cognition, the focus of augmenting a product or service has largely been on the firm’s own brand to increase perceived information (Park et al., 2008), reduce risk (Alimamy et al., 2018), and promote a positively perceived shoping experience by embedding virtual information into the physical environment of the customer (Poncin and Mimoun, 2014). Enhancing the product at the point-of-sale with context-relevant information by displaying a link to the firm’s Web page, a product-video or nutrient information on the customer’s devices at the point-of-sale (Olsson and Salo, 2011) creates a brand-centric approach to AR. Firms often conceive of AR as a way to enhance the brand or a service. Hyundai’s AR application “X-ray”, for example, provides information about a car’s engine for easier maintenance and decreased maintenance costs owing to lower customer service enquiries. In turn, this may change the consumption experience as we currently know it (Farkhatdinov and Ryu, 2009). Similar applications can be found in virtual travel agents, for example, by National Geographic, in which the AR application displays historical information to the customer when the camera of a mobile device is pointed at a specific monument or historic place or building (Han et al., 2013). Managers, however, should be mindful of AR enhancements not only in how they affect a brand but also the customer’s perception of the brand in relation to its competitors on the retail floor.

Embodied digital information in an offline retail setting is another important consideration. By uniquely adapting to a customer’s location, motion and self-controlled interaction with the product, AR offers enhanced experiences as well as a wealth of information about customer behaviour in the store. Enhancements of the service consumption experience such as the Digital Binocular Station Canterbury Museum (NZ) in which exhibition pieces become virtually alive (Neuhofer et al., 2014) not only make the experience fun but also can record how individuals respond and react to these enhancements in real time.

Peer-to-peer communication, while still not being fully modelled by marketing literature (Mulhern, 2009), can significantly impact a customer’s attitude and purchase intention towards a product (Wang et al., 2012) as well as increase customer loyalty (Rapp et al., 2013). Recent applications, such as the social AR application “Mirage”, enable customers to view, react to, create and co-create augmented content in physical environments by attaching virtual information (e.g. text, pictures, emoji and videos) to physical objects, disrupting how customers leave feedback about locations or products and services consumed in certain areas. Virtual tags can range from customer rating about a certain retail store to opinions or recommendations about a product, or even a virtual representation of the walking-path a peer took along a series of monuments. These offline experiences are extended by socially co-created information that can be accessed on demand. Similar applications in retail environments create numerous strategic implications for managers looking to communicate with customers at the point-of-sale. AR will likely also disrupt the dominance of product packaging and in-store promotions, which will compete with socially generated content that exists on the retail floor, and in relation to specific products and brands.

Comparable to the previously mentioned applications of AR in online environments, there are multiple situations in which AR enables omnichannel experiences and current applications vary in their degree of embedding, embodiment and extension. As illustrated in Figure 1, scholarly research has yet to explore the effects of AR on the offline channel experience, as prevailing literature on AR applications in offline environments focuses on technology acceptance, user evaluations and affective customer reactions (Dieck et al., 2015; Olsson et al., 2013; Rese et al., 2014). Limited research is available to explain which attributes AR needs to provide to enhance customer’s experiences (Poushneh and Vasquez-Parraga, 2017), in which contexts customers are willing to use AR (Rauschnabel and Krey, 2017), and how AR enables customer satisfaction and value (Ross and Labrecque, 2017).

Mapping augmented reality-enabled omnichannel experiences across the customer journey

The key premise of this paper is that AR provides customers with a seamless omnichannel experience by closing the channel gap at various online and offline touch points. A customer journey sequences these touch points into steps that customers go through when making a purchase. At each step, customers have distinct feelings, thoughts and behaviours that jointly produce the customer experience (Wolny and Charoensuksai, 2014). Table I presents the expanded customer journey model by Batra and Keller (2016). In contrast to traditional purchase funnel models, this more detailed view of the customer journey accounts for the complex and omnichannel paths to purchase that customers increasingly follow. For each step in the journey, we illustrate how current AR applications enable an embedded, embodied and/or extended experience, and how this enables firms to integrate offline into online experience, and vice versa.

Setting the research agenda for realising the promise of augmented reality

Digital and mobile channels have advanced the necessity of developing omnichannel strategies as various customer contact points are used interchangeably. Within this context, AR applications hold the promise of playing a prominent role in shaping the customer’s experience across the customer journey. To sustain such a role, research is needed that extends the depth of our understanding of AR in the omnichannel context. By formulating a future research agenda, we propose a number of directions that may advance scholarly knowledge and guide firms in shaping their omnichannel strategies:

  • Mapping journey complexity: To begin with, we feel that more research such as that of Wolny and Charoensuksai (2014) is needed that takes a number of trajectory configurations customers follow in their omnichannel journey into account. By deploying longitudinal designs, insights can be developed with regards to how and when AR technology can most optimally be deployed to enhance the customer experience across various touch points. The categorisation provided in Table 1 may provide a valuable guiding structure for such research efforts.

  • Unpicking decision complexity: Current research has largely focused on assessing AR’s impact in terms of perceived value, satisfaction and purchase and recommendation intentions (see also Figure 1). Future research should incorporate a wider array of variables beyond these commonly used evaluative judgments. As customers are using a mix of channels for purchase decisions it seems pertinent to gauge the impact of AR on both elements of the customer decision-making process (e.g. gathering and assimilating information), reflections thereof (e.g. decision confidence or comfort), and actual choice behaviour.

  • Seamless integration of modalities and channels: Because the embedding of digital information into the customer’s physical environment is a key feature of AR, there is a need for further insights as to which modalities of information (e.g. text, image or video) and combinations thereof work best for enhancing the customer experience across various channels.

  • Equivalence of augmentation across channels: Perhaps fundamentally, there is a need to identify what factors are pivotal to translating specific AR attributes and affordances (such as those illustrated in Table 1) into positive customer experience evaluations. Recent research on embodied cognition (Elder and Krishna, 2012) reveals that when customers’ perceptions between physical control and certain types of products (e.g. a bottle of soda) align, this underscores the expectation of a sense of movement. It remains unclear whether such effects come into play in relation to virtual products and how AR could be configured to simulate congruence between perceived control and virtual depictions of products. Additionally, as firms design AR-based customer experience offerings, research needs to uncover whether suspending disbelief plays a key role in creating added value in the eyes of the customer. Issues related to the suspension of disbelief as a central explanatory mechanism relate to how long it takes for customers to accept virtual depictions as real across multiple channels, what design parameters are pertinent to eliciting this phenomenon (e.g. processing power, graphics, display or consistency and richness of narratives), and whether these vary with the use of different information modalities.

  • Non-equivalence of customers across channels: Relatedly, we need additional theorising and empirical assessment of relevant customer traits to account for heterogeneity in AR-based customer evaluations. Figure 1 illustrates the relative paucity of knowledge about such influences. Additional personality characteristics, such as need-for-touch, mental imagery abilities and product use experience and familiarity may exert an influence on the way customers evaluate their omnichannel journey.

  • Advanced scope of AR: Finally, situational contingencies or the context of use, such as the function or purpose of AR in relation to products (e.g. a Shazam-like approach to furniture or clothing) and extending AR-based experiences through social networks (e.g. allowing the incorporation of fellow customers and shard decision making) will not only determine whether customers find the technology valuable but also acceptable. Also, a relatively underdeveloped direction is whether AR can be effectively used to enrich the delivery experience of intangible and co-produced services (as opposed to physical products).

As firms are strategizing to stimulate conversions through online and mobile channels, the use of AR is primarily geared towards creating a more engaging customer’s journey across all channels. Addressing the aforementioned issues, among others, through future research will be crucial in moving AR technology beyond the hype of Pokémon Go and determine whether AR-based customer experiences will be key in transforming firm’s omnichannel strategies.

Figures

Synthesis of current research on AR-enabled customer experiences

Figure 1.

Synthesis of current research on AR-enabled customer experiences

Overview of AR-enabled omnichannel experiences at different customer journey steps

Customer journey step Practical AR application Nature of the AR-enabled experience Omnichannel Link
Embedded Embodied Extended Online →
Offline
Offline →
Online
Needs/Wants AMC Theatres AR
make movie posters come alive
Point phone camera at movie posters and get trailers and ticket sales information
Awareness/Knowledge The Kapaq AR menu
visualize your restaurant order
Point phone camera at menu item and get realistic 3D image of a meal in front of you Rotate and inspect the 3D image of a meal from all sides
Considers/Examines Sipp AR Wine Club
enhance your wine expertise
Scan label of a wine bottle to discover occasions and food pairing suggestions
Searches/Learns Aisle411 and Tango AR shopping at Walgreens
learn about and navigate to product location
Highlight sales promotion and provide rewards while browsing in a retail environment Pre-select products online then search and navigate to product locations in the physical store
Likes/Trusts The IKEA AR app
place virtual furniture in your home
Place 3D images of items from an online catalogue in a customer’s room Move and rotate 3D images of furniture to find the best fit in a room Save and share photos of “favourite” compositions of own spaces supplemented with virtual furniture pieces
Sees Value/Is Willing to Pay The L’Oreal Make-up Genius
virtual mirror for makeup – try, share and buy
Scan a physical product or select from online catalogue and view how make-up looks on your face Move the head to inspect the look from different angles; ability to immediately buy the look you are “wearing” Save the look and share it with friends via seamless link to social media
Commits/Plans The Hyundai Virtual Guide
select features of your new car
See how features described online change the look of a car’s interior or exterior Schedule test drive in a car with the chosen features at a dealership
Consumes Augmented GeoTravel
learn about the places you are visiting
Scan city landmarks to get historical facts, accommodation tips and reviews shared by other customers Access reviews and suggestions of other customers at the point of consumption
Is Satisfied The WallaMe App
share messages and ratings of the real world using AR
Point a phone at an object and leave or view an AR text, picture or video Messages viewed by others who rate it includes “like” button allows others to assessing the created visuals
Is Loyal/Repeat Buyer Dulux Visualiser app
colour your rooms
Scan physical room as picture or video and change look and return to earlier saved preferences Move the point of view through a redesigned room Share and co-create a design with friends for shared decision making
Is Engaged/Interacts Pokemon Go
find and catch virtual creatures
Find AR creatures by pointing phone at physical landmarks and locations Team play and gamification enhance engagement
Actively Advocates Mister Spex app
try glasses and share
Try on glasses in a virtual mirror Move head to view glasses from various sides Share an augmented picture with your friends on social media to obtain likes or comments

References

Accenture (2014), “Omni-channel Commerce. Think like the customer”, available at: www.accenture.com/t20160526T010756Z__w__/us-en/_acnmedia/Accenture/Conversion-Assets/DotCom/Documents/Global/PDF/Technology_7/Accenture-Omni-Channel-Commerce-Pov.pdfla=en (accessed 15 November 2017).

Accenture (2016), “Expectations vs experience: the good, the bad, the opportunity”, available at: www.accenture.com/us-en/insight-expectations-vs-experience-good-bad-opportunity (accessed 15 November 2017).

Alimamy, S., Deans, K. and Gnoth, J. (2018), “An empirical investigation of augmented reality to reduce customer perceived risk”, in Rossi, P. and Krey, N. (Eds), Proceedings of the Academy of Marketing Science and Marketing Transformation: Marketing Practice in an Ever Changing World AMSWMC 2017 Developments in Marketing Science, Springer, Cham, pp. 127-135.

Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S. and MacIntyre, B. (2001), “Recent advances in augmented reality”, IEEE Computer Graphics and Applications, Vol. 21 No. 6, pp. 34-47.

Bloomberg (2017), “Tim cook on Donald trump, the HomePod, and the legacy of Steve jobs”, available at: www.bloomberg.com/news/features/2017-06-15/apple-s-tim-cook-on-donald-trump-the-homepod-and-the-legacy-of-steve-jobs (accessed 21 November 2017).

Batra, R. and Keller, K.L. (2016), “Integrating marketing communications: new findings, new lessons, and new ideas”, Journal of Marketing, Vol. 80 No. 6, pp. 122-145.

Brasel, S.A. and Gips, J. (2014), “Tablets, touchscreens, and touchpads: how varying touch interfaces trigger psychological ownership and endowment”, Journal of Consumer Psychology, Vol. 24 No. 2, pp. 226-233.

Brynjolfsson, E., Hu, Y.J. and Rahman, M.S. (2013), “Competing in the age of omnichannel retailing”, MIT Sloan Management Review, Vol. 54 No. 4, pp. 23-29.

Cummins, S., Peltier, J.W. and Dixon, A. (2016), “Omni-channel research framework in the context of personal selling and sales management: a review and research extensions”, Journal of Research in Interactive Marketing, Vol. 10 No. 1, pp. 2-16.

Dacko, S.G. (2016), “Enabling smart retail settings via mobile augmented reality shopping apps”, Technological Forecasting and Social Change, Vol. 124, pp. 243-256.

Deloitte (2014), “The new digital divide”, available at: www2.deloitte.com/us/en/pages/consumer-business/articles/the-new-digital-divide-retail-sales-influence.html (accessed 12 December 2017).

Dieck, T., Claudia, M. and Jung, T. (2015), “A theoretical model of mobile augmented reality acceptance in urban heritage tourism”, Current Issues in Tourism, Vol. 21 No. 2, pp. 154-174.

DigitalBridge (2017), “Augmented reality – changing the face of retail”, available at: http://digitalbridge.eu/download-our-new-report-augmented-reality-changing-the-face-of-retail/ (accessed 11 November 2017).

Echterhoff, G., Higgins, E.T. and Levine, J.M. (2009), “Shared reality: experiencing commonality with others’ inner states about the world”, Perspectives on Psychological Science, Vol. 4 No. 5, pp. 496-521.

Elder, R. and Krishna, A. (2012), “The visual depiction effect: inducing embodied mental simulation that evokes motor responses”, Journal of Consumer Research, Vol. 38 No. 6, pp. 988-1003.

Farkhatdinov, I. and Ryu, J.H. (2009), “Development of educational system for automotive engineering based on augmented reality”, Proceedings of the ICEE and ICEER 2009 International conference on engineering education in Seoul, South Korea 2009, pp. 23-28.

Gartner (2017), “Top trends in the Gartner hype cycle for emerging technologies”, available at: www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/ (accessed 6 January 2018).

Grohmann, B., Spangenberg, E.R. and Sprott, D.E. (2007), “The influence of tactile input on the evaluation of retail product offerings”, Journal of Retailing, Vol. 83 No. 2, pp. 237-245.

Han, D.I., Jung, T. and Gibson, A. (2013), “Dublin AR: implementing augmented reality in tourism”, in Xiang, Z. and Tussyadiah, I. (Eds), Information and Communication Technologies in Tourism 2014, Springer, Cham, pp. 511-523.

Hilken, T., de Ruyter, K., Chylinski, M., Mahr, D. and Keeling, D. (2017), “Augmenting the eye of the beholder: exploring the strategic potential of augmented reality to enhance online service experiences”, Journal of the Academy of Marketing Science, Vol. 45 No. 6, pp. 884-905.

Javornik, A. (2016a), “Augmented reality: research agenda for studying the impact of its media characteristics on consumer behaviour”, Journal of Retailing and Consumer Services, Vol. 30, pp. 252-261.

Javornik, A. (2016b), “It’s an illusion, but it looks real!’ Consumer affective, cognitive and behavioural responses to augmented reality applications”, Journal of Marketing Management, Vol. 32 Nos 9/10, pp. 987-1011.

Krishna, A. and Schwarz, N. (2014), “Sensory marketing, embodiment, and grounded cognition: a review and introduction”, Journal of Consumer Psychology, Vol. 24 No. 2, pp. 159-168.

Marinova, D., de Ruyter, K., Huang, M.H., Meuter, M.L. and Challagalla, G. (2017), “Getting smart: learning from technology-empowered frontline interactions”, Journal of Service Research, Vol. 20 No. 1, pp. 29-42.

Marketing Science Institute (2016), “2016-2018 research priorities”, available at: www.msi.org/research/2016-2018-research-priorities/ (accessed 10 November 2017).

Mulhern, F. (2009), “Integrated marketing communications: from media channels to digital connectivity”, Journal of Marketing Communications, Vol. 15 Nos 2/3, pp. 85-101.

Neuhofer, B., Buhalis, D. and Ladkin, A. (2014), “A typology of technology-enhanced tourism experiences”, International Journal of Tourism Research, Vol. 16 No. 4, pp. 340-350.

Lemon, K.N. and Verhoef, P.C. (2016), “Understanding customer experience throughout the customer journey”, Journal of Marketing, Vol. 80 No. 6, pp. 69-96.

Olsson, T. and Salo, M. (2011), “Online user survey on current mobile augmented reality applications”, 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR) in Basel, Switzerland, IEEE, New York, NY, pp. 75-84.

Olsson, T., Lagerstam, E., Kärkkäinen, T. and Väänänen-Vainio-Mattila, K. (2013), “Expected user experience of mobile augmented reality services: a user study in the context of shopping centres”, Personal and Ubiquitous Computing, Vol. 17 No. 2, pp. 287-304.

Parise, S., Guinan, P.J. and Kafka, R. (2016), “Solving the crisis of immediacy: how digital technology can transform the customer experience”, Business Horizons, Vol. 59 No. 4, pp. 411-420.

Park, J., Stoel, L. and Lennon, S.J. (2008), “Cognitive, affective and conative responses to visual simulation: the effects of rotation in online product presentation”, Journal of Consumer Behaviour, Vol. 7 No. 1, pp. 72-87.

Poncin, I. and Mimoun, M.S.B. (2014), “The impact of ‘e-atmospherics’ on physical stores”, Journal of Retailing and Consumer Services, Vol. 21 No. 5, pp. 851-859.

Poushneh, A. and Vasquez-Parraga, A.Z. (2017), “Discernible impact of augmented reality on retail customer’s experience, satisfaction and willingness to buy”, Journal of Retailing and Consumer Services, Vol. 34, pp. 229-234.

Rapp, A., Beitelspacher, L.S., Grewal, D. and Hughes, D.E. (2013), “Understanding social media effects across seller, retailer, and consumer interactions”, Journal of the Academy of Marketing Science, Vol. 41 No. 5, pp. 547-566.

Rauschnabel, P.A. and Krey, N. (2017), “Virtually enhancing the real world with augmented reality holograms: use and gratification perspective: an abstract”, in Krey, N. and Rossi, P. (Eds) Proceedings of the Academy of Marketing Science and Back to the Future: Using Marketing Basics to Provide Customer Value. AMSAC 2017, Developments in Marketing Science, Springer, Cham, pp. 623-623.

Rese, A., Schreiber, S. and Baier, D. (2014), “Technology acceptance modeling of augmented reality at the point of sale: can surveys be replaced by an analysis of online reviews?”, Journal of Retailing and Consumer Services, Vol. 21 No. 5, pp. 869-876.

Robbins, P. and Aydede, M. (2009), “A short primer on situated cognition”, in Robbins, P. and Aydede, M. (Eds), The Cambridge Handbook of Situated ′Cognition, Cambridge University Press, New York, NY, pp. 3-10.

Rosa, J.A. and Malter, A.J. (2003), “E-(embodied) knowledge and e-commerce: how physiological factors affect online sales of experiential products”, Journal of Consumer Psychology, Vol. 13 Nos 1/2, pp. 63-73.

Ross, S.M. and Labrecque, L.I. (2017), “Does a Hologram give an Encore? Authenticity in mixed reality: an abstract”, paper presented at the Academy of Marketing Science Annual Conference.

Scholz, J. and Smith, A.N. (2016), “Augmented reality: designing immersive experiences that maximize consumer engagement”, Business Horizons, Vol. 59 No. 2, pp. 149-161.

Semin, G.R. and Smith, E.R. (2013), “Socially situated cognition in perspective”, Social Cognition, Vol. 31 No. 2, pp. 125-146.

Techcrunch (2017), “Apollo box is applying AR to drive lifestyle e-commerce”, available at: https://techcrunch.com/2017/03/18/apollo-box-is-applying-ar-to-drive-lifestyle-ecommerce/ (accessed 23 March 2018).

Total Immersion (2012), “Direct optic sells more glasses online with TryLive”, available at: www.t-immersion.com/blog/oct-02-2012/direct-optic-sells-more-glasses-online-trylive (accessed 23 March 2018).

Temkin Group (2017), “The ultimate CX Infographic”, available at: https://experiencematters.blog/2017/10/03/the-ultimate-cx-infographic-2017/ (accessed 21 November 2017).

Verhoef, P.C., Stephen, A.T., Kannan, P.K., Luo, X., Abhishek, V., Andrews, M. and Zhang, Y. (2017), “Consumer connectivity in a complex, technology-enabled, and mobile-oriented world with smart products”, Journal of Interactive Marketing, Vol. 40, pp. 1-8.

Wang, X., Yu, C. and Wei, Y. (2012), “Social media peer communication and impacts on purchase intentions: a consumer socialization framework”, Journal of Interactive Marketing, Vol. 26 No. 4, pp. 198-208.

Wilson, M. (2002), “Six views of embodied cognition”, Psychonomic Bulletin & Review, Vol. 9 No. 4, pp. 625-636.

Wolny, J. and Charoensuksai, N. (2014), “Mapping customer journeys in multichannel decision-making”, Journal of Direct, Data and Digital Marketing Practice, Vol. 15 No. 4, pp. 317-326.

Yim, M.Y.C., Chu, S.C. and Sauer, P.L. (2017), “Is augmented reality technology an effective tool for e-commerce? An interactivity and vividness perspective”, Journal of Interactive Marketing, Vol. 39, pp. 89-103.

Further reading

White, D. Robertson, R. and Compernolle, T. (2018), “How much is that virtual doggie in the virtual window? Virtual and augmented reality – a guide for Australian retailers”, available at: www2.deloitte.com/au/en/pages/consumer-industrial-products/articles/vr-ar-retail.html (accessed 30 January 2018).

Corresponding author

Tim Hilken can be contacted at: t.hilken@maastrichtuniversity.nl

Related articles