- [Home page](https://www.brimit.com/) - [Blog](https://www.brimit.com/blog) # Sitecore and Augmented Reality: Connecting the Offline and Online Customer Experience with a Virtual Try-on [#How-to](https://www.brimit.com/blog?categories=#How-to) [DXP](https://www.brimit.com/blog?platforms=DXP) [Alexei Vershalovich](https://www.brimit.com/blog/author?authors=Alexei%20Vershalovich) on November 1, 2019 Brimit’s Sitecore team developed a virtual try-on for headwear and similar accessories which is based on Sitecore and uses AI-powered computer vision technology. #### Highlights: - A smooth transition from offline to online - A high-precision computer vision framework for augmented reality - Multiple scenarios for customer engagement and marketing automation: retargeting, upselling, sending traffic to brick-and-mortar shops - Integration with Salesforce, Dynamics 365, Outlook The solution features a smooth transition from offline to online user behavior, which helps to automate marketing and increase the sales of both online and brick-and-mortar shops. Keep reading to learn about how to implement this product, as well as the technology behind it. [https://www.youtube.com/watch?v=XeaxhUm2nGw](https://www.youtube.com/watch?v=XeaxhUm2nGw) #### Set up: - A TV screen or a touch screen - An HD webcam - A computer connected to the internet - A gesture-tracking device The solution enables apparel retailers with online and brick-and-mortar stores to apply multiple scenarios for engaging customers and increasing sales. A few of them are listed below. #### Take Advantage of New Features through Software Integration How we integrate software[Take Advantage of New Features through Software Integration](https://www.brimit.com/services/system-integration-and-automation) ![Sitecore_logo_RGB_white](https://www.brimit.com/-/jssmedia/project/brimit/home-page-and-global-images/related-to-sitecore/sitecore_logo_rgb_white.png?h=47&iar=0&w=219&hash=31CC86C2C1147AF873F8602FEE327A28) What we do with Sitecore[What we do with Sitecore](https://www.brimit.com/technologies/sitecore) ## Scenario #1. Engaging customers offline, retargeting them online - A mall visitor tries on a few pairs of sunglasses. - A new session is created together with an anonymous contact in Sitecore. - The app collects analytics data and attaches it to the Sitecore contact. *It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.* - The app offers to add the model to a cart with a discount. - The visitor scans a QR code with their smartphone camera and is directed to an e-commerce website. *The URL where the user lands is unique and loads all the analytics data from the Sitecore contact profile.* - In order to complete the order or save their choice for later, the visitor needs to sign up. - When a Sitecore profile is created, offline and online contact behavior profiles are merged by Sitecore for cross-channel insights and future optimizations. ## Scenario #2. Adding AR experience to Sitecore commerce A virtual try-on is integrated into an online store and adds the benefits of a real try-on to online shopping. The user can make sure a piece of headwear fits their body and head type, hairstyle, and matches their clothes. ## Scenario #3. Engaging customers offline, increasing brick-and-mortar store traffic - A mall visitor tries on a few pairs of sunglasses. - A new session is created together with an anonymous contact in Sitecore. - The app collects analytics data and attaches it to the Sitecore contact. - The app collects analytics data and attaches it to the Sitecore contact. *It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.* - The app offers the shopper a discount and to pick up the model at a store nearby. - The visitor scans the QR code with their smartphone camera and is directed to a web page where they receive a unique order number and instructions for where to go. *The contact profile is synced with a custom entity in CRM or integrated into POS software. Brimit’s Experience Add-in can be opened to show the Sitecore contact profile.* - The visitor tells the order number to a store associate. The associate can see the model ordered as well as the other accessories the visitor tried on. The store associate browses through a custom CRM dashboard displaying the visitor’s profile and the model ordered. Brimit’s Experience Add-in integrated with CRM can be opened to get additional contact insights. ## Under the hood ![Sitecore Virtual Try-on Augmented Reality](https://www.brimit.com/-/media/images/blog/sitecore-virtual-try-on-scheme.jpg) ### Banuba Augmented Reality SDK [Banuba](https://banuba.com/%20target=) is a groundbreaking start-up specializing in computer vision and shaping a future beyond cameras. Their innovative Face AR platform creates immersive augmented reality web and cross-platform mobile apps. Banuba's Face AR SDK combines Face Filters, AR Beauty and Avatar components to enable real-time 3D masks, face animation and virtual try ons experiences on mobile, web and in-store. Banuba Web SDK is connected to our Sitecore commerce website, loads 3D models of sunglasses from it, and creates a virtual scene out of a live camera stream. The SDK includes face-tracking technology, image segmentation (animated subtracted backgrounds), a rendering engine for realistic effects, a default beautification filter, sound effects, and a scripting engine, as well as background segmentation. ### Sitecore Message Bus Sitecore Experience Platform contains a built-in Message Bus technology, a hidden gem; however, it is hardly ever used due to a lack of[documentation](https://doc.sitecore.net/developers/architecture-and-roles/roles/xp/storage-roles/message-bus.html) and, regretfully, very[few posts](https://www.pintle.dk/insights/using-sitecore-service-bus/). The Message Bus is a message transport mechanism that allows Sitecore application roles to communicate across boundaries. ### Experience Add-in Brimit developed an add-in that seamlessly integrates with CRM software and enables marketing, sales, service, and support teams to get real-time insights and manage the Sitecore contact experience profile, thereby increasing efficiency and maturing the overall customer experience (visit [add-in.brimit.com](https://add-in.brimit.com/%20target=) for details). Brimit will be demonstrating an augmented reality try-on for sunglasses based on Sitecore and AI-backed computer vision technology at Sitecore Symposium November 4–7, 2019. ###### Author ![Alexei Vershalovich](https://www.brimit.com/-/jssmedia/feature/blogs/authors/alexei-vershalovich-brimit---500.png?h=1098&iar=0&w=1042&hash=7551A887E43E4DDE95E9C95102DBDF1B) Alexei Vershalovich Principal Consultant, digital experience and e-commerce [Alexei Vershalovich](https://www.brimit.com/blog/author?authors=Alexei%20Vershalovich) ###### More by category [#Events](https://www.brimit.com/blog?categories=#Events) [#How-to](https://www.brimit.com/blog?categories=#How-to) [#News](https://www.brimit.com/blog?categories=#News) [#Guides](https://www.brimit.com/blog?categories=#Guides) ###### More by platform [DXP](https://www.brimit.com/blog?platforms=DXP) [Sales and marketing automation](https://www.brimit.com/blog?platforms=Sales%20and%20marketing%20automation) [Application innovation](https://www.brimit.com/blog?platforms=Application%20innovation) #### More on Sitecore ![How Vercel Will Help You Save Effort When Deploying Sophisticated Sitecore Projects](https://www.brimit.com/-/jssmedia/project/brimit/blog/2024/vercel_cover-image.png) #Guides #How-to DXP E-commerce ##### How Vercel Will Help You Save Effort When Deploying Sophisticated Sitecore Projects Optimize and accelerate the development and deployment of complex multisite Sitecore projects. Alexei Vershalovich on July 17, 2024 [How Vercel Will Help You Save Effort When Deploying Sophisticated Sitecore Projects](https://www.brimit.com/blog/how-vercel-will-help-you-save-effort-when-deploying-sophisticated-sitecore-projects) ![Training Up Tomorrow's Sitecore MVPs: a Mentoring Success Story](https://www.brimit.com/-/jssmedia/project/brimit/blog/2023/sitecore-mentoring---cover-image.png) #How-to DXP ##### Training Up Tomorrow's Sitecore MVPs: a Mentoring Success Story How to participate in the Sitecore Mentor program and help younger colleagues jump-start a career in Sitecore development. Sergey Baranov on October 2, 2023 [Training Up Tomorrow's Sitecore MVPs: a Mentoring Success Story](https://www.brimit.com/blog/training-up-tomorrows-sitecore-mvps) ![Going Headless. Part 2: When a Headless CMS Is Your Best Bet (if you have Sitecore)](https://www.brimit.com/-/jssmedia/project/brimit/blog/2022/headless/adobestock_456986731.jpg) #How-to DXP E-commerce ##### Going Headless. Part 2: When a Headless CMS Is Your Best Bet (if you have Sitecore) Discover how a headless CMS can benefit organizations that use Sitecore. Daniil Raschupkin, Palina Trokhautsava on September 15, 2022 [Going Headless. Part 2: When a Headless CMS Is Your Best Bet (if you have Sitecore)](https://www.brimit.com/blog/going-headless-part-2-when-a-headless-cms-is-your-best-bet-if-you-have-sitecore)