#### 

Brimit’s Sitecore team developed a virtual try-on for headwear and similar accessories which is based on Sitecore and uses AI-powered computer vision technology.

#### Highlights:

- A smooth transition from offline to online
- A high-precision computer vision framework for augmented reality
- Multiple scenarios for customer engagement and marketing automation: retargeting, upselling, sending traffic to brick-and-mortar shops
- Integration with Salesforce, Dynamics 365, Outlook

The solution features a smooth transition from offline to online user behavior, which helps to automate marketing and increase the sales of both online and brick-and-mortar shops. Keep reading to learn about how to implement this product, as well as the technology behind it.

#### Set up:

- A TV screen or a touch screen
- An HD webcam
- A computer connected to the internet
- A gesture-tracking device

The solution enables apparel retailers with online and brick-and-mortar stores to apply multiple scenarios for engaging customers and increasing sales. A few of them are listed below.
[#### Take Advantage of New Features through Software Integration
How we integrate software](https://www.brimit.com/services/system-integration-and-automation)[!\[Sitecore_logo_RGB_white\](https://www.brimit.com/-/jssmedia/project/brimit/home-page-and-global-images/related-to-sitecore/sitecore_logo_rgb_white.png?h=47&iar=0&w=219&hash=31CC86C2C1147AF873F8602FEE327A28)
What we do with Sitecore](https://www.brimit.com/technologies/sitecore)
#### 

## Scenario #1. Engaging customers offline, retargeting them online

- A mall visitor tries on a few pairs of sunglasses.
- A new session is created together with an anonymous contact in Sitecore.
- The app collects analytics data and attaches it to the Sitecore contact.

    *It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.*
- The app offers to add the model to a cart with a discount.
- The visitor scans a QR code with their smartphone camera and is directed to an e-commerce website.

    *The URL where the user lands is unique and loads all the analytics data from the Sitecore contact profile.*
- In order to complete the order or save their choice for later, the visitor needs to sign up.
- When a Sitecore profile is created, offline and online contact behavior profiles are merged by Sitecore for cross-channel insights and future optimizations.

## Scenario #2. Adding AR experience to Sitecore commerce

A virtual try-on is integrated into an online store and adds the benefits of a real try-on to online shopping. The user can make sure a piece of headwear fits their body and head type, hairstyle, and matches their clothes.

## Scenario #3. Engaging customers offline, increasing brick-and-mortar store traffic

- A mall visitor tries on a few pairs of sunglasses.
- A new session is created together with an anonymous contact in Sitecore.
- The app collects analytics data and attaches it to the Sitecore contact.
- The app collects analytics data and attaches it to the Sitecore contact.

    *It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.*
- The app offers the shopper a discount and to pick up the model at a store nearby.
- The visitor scans the QR code with their smartphone camera and is directed to a web page where they receive a unique order number and instructions for where to go. *The contact profile is synced with a custom entity in CRM or integrated into POS software.    Brimit’s Experience Add-in can be opened to show the Sitecore contact profile.*
- The visitor tells the order number to a store associate. The associate can see the model ordered as well as the other accessories the visitor tried on.

The store associate browses through a custom CRM dashboard displaying the visitor’s profile and the model ordered. Brimit’s Experience Add-in integrated with CRM can be opened to get additional contact insights.

## Under the hood

![Sitecore Virtual Try-on Augmented Reality](https://www.brimit.com/-/media/images/blog/sitecore-virtual-try-on-scheme.jpg)

### Banuba Augmented Reality SDK

[Banuba](https://banuba.com/%20target=) is a groundbreaking start-up specializing in computer vision and shaping a future beyond cameras. Their innovative Face AR platform creates immersive augmented reality web and cross-platform mobile apps.

Banuba's Face AR SDK combines Face Filters, AR Beauty and Avatar components to enable real-time 3D masks, face animation and virtual try ons experiences on mobile, web and in-store.

Banuba Web SDK is connected to our Sitecore commerce website, loads 3D models of sunglasses from it, and creates a virtual scene out of a live camera stream. The SDK includes face-tracking technology, image segmentation (animated subtracted backgrounds), a rendering engine for realistic effects, a default beautification filter, sound effects, and a scripting engine, as well as background segmentation.

### Sitecore Message Bus

Sitecore Experience Platform contains a built-in Message Bus technology, a hidden gem; however, it is hardly ever used due to a lack of[documentation](https://doc.sitecore.net/developers/architecture-and-roles/roles/xp/storage-roles/message-bus.html) and, regretfully, very[few posts](https://www.pintle.dk/insights/using-sitecore-service-bus). The Message Bus is a message transport mechanism that allows Sitecore application roles to communicate across boundaries.

### Experience Add-in

Brimit developed an add-in that seamlessly integrates with CRM software and enables marketing, sales, service, and support teams to get real-time insights and manage the Sitecore contact experience profile, thereby increasing efficiency and maturing the overall customer experience (visit [add-in.brimit.com](https://add-in.brimit.com/%20target=) for details).

Brimit will be demonstrating an augmented reality try-on for sunglasses based on Sitecore and AI-backed computer vision technology at Sitecore Symposium November 4–7, 2019.

###### Author

[!\[Alexei Vershalovich\](https://www.brimit.com/-/jssmedia/feature/blogs/authors/alexei-vershalovich-brimit---500.png?h=1098&iar=0&w=1042&hash=7551A887E43E4DDE95E9C95102DBDF1B)
Alexei Vershalovich
Principal Consultant, digital experience and e-commerce](https://www.brimit.com/blog/author?authors=Alexei%20Vershalovich)

###### More by category

[#Events](https://www.brimit.com/blog?categories=#Events)[#How-to](https://www.brimit.com/blog?categories=#How-to)[#News](https://www.brimit.com/blog?categories=#News)[#Guides](https://www.brimit.com/blog?categories=#Guides)

###### More by platform

[DXP](https://www.brimit.com/blog?platforms=DXP)[Sales and marketing automation](https://www.brimit.com/blog?platforms=Sales%20and%20marketing%20automation)[Application innovation](https://www.brimit.com/blog?platforms=Application%20innovation)

#### More on Sitecore

[!\[How Vercel Will Help You Save Effort When Deploying Sophisticated Sitecore Projects\](https://www.brimit.com/-/jssmedia/project/brimit/blog/2024/vercel_cover-image.png)
#Guides#How-toDXPE-commerce
##### How Vercel Will Help You Save Effort When Deploying Sophisticated Sitecore Projects
Optimize and accelerate the development and deployment of complex multisite Sitecore projects.
Alexei Vershalovich on July 17, 2024](https://www.brimit.com/blog/how-vercel-will-help-you-save-effort-when-deploying-sophisticated-sitecore-projects)

[!\[Training Up Tomorrow's Sitecore MVPs: a Mentoring Success Story\](https://www.brimit.com/-/jssmedia/project/brimit/blog/2023/sitecore-mentoring---cover-image.png)
#How-toDXP
##### Training Up Tomorrow's Sitecore MVPs: a Mentoring Success Story
How to participate in the Sitecore Mentor program and help younger colleagues jump-start a career in Sitecore development.
Sergey Baranov on October 2, 2023](https://www.brimit.com/blog/training-up-tomorrows-sitecore-mvps)

[!\[Going Headless. Part 2: When a Headless CMS Is Your Best Bet (if you have Sitecore)\](https://www.brimit.com/-/jssmedia/project/brimit/blog/2022/headless/adobestock_456986731.jpg)
#How-toDXPE-commerce
##### Going Headless. Part 2: When a Headless CMS Is Your Best Bet (if you have Sitecore)
Discover how a headless CMS can benefit organizations that use Sitecore.
Daniil Raschupkin, Palina Trokhautsava on September 15, 2022](https://www.brimit.com/blog/going-headless-part-2-when-a-headless-cms-is-your-best-bet-if-you-have-sitecore)

![](https://bat.bing.net/action/0?ti=187017043&tm=gtm002&Ver=2&mid=aab2585d-c778-4fd7-8470-8a2d2f1ab1d7&bo=2&gtm_tag_source=1&pi=0&lg=en-US&sw=800&sh=600&sc=24&nwd=1&tl=Sitecore%20and%20Augmented%20Reality%3A%20Connecting%20the%20Offline%20and%20Online%20Customer%20Experience%20with%20a%20Virtual%20Try-On&p=https%3A%2F%2Fwww.brimit.com%2Fblog%2Fsitecore-augmented-reality-virtual-try-on&r=&lt=337&evt=pageLoad&sv=2&asc=D&cdb=AQAY&rn=892058)