#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Cleveland
October 19th, 2021
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Delivering personalized
user experiences with
Azure Personalizer
Luis Beltrán
Microsoft MVP
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
luis@luisbeltran.mx
@darkicebeam
Luis Beltrán
• Researcher at Tomas Bata
University in Zlín, Czech Republic
• Lecturer at Tecnológico Nacional de
México in Celaya, Mexico
• Xamarin, Azure, AI
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Case Study
Artwork Personalization at Netflix
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Have you ever noticed…?
Same series, but different artwork?
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
• By using Machine Learning, Netflix studies their users’ behavior and
viewing history in order to recommend the “right” artwork for them.
• If the artwork representing a title captures something compelling to
users, then it acts as a gateway into that title and gives subscribers
some visual “evidence” for why the title might be good for them.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Motivation
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Proven ROI
Customer
Experience
Transformation
Pays Off
Source: McKinsey, Microsoft Services
Before After
Increase Customer
Satisfaction by up to
20 %
Before After
Increase Revenue
Growth by
10-15 %
Before After
Lower Cost To
Serve by
15 a 20 %
Brands that excel at personalization deliver 5-8 times the marketing ROI
and boost their sales by more than 10% over companies that don’t
personalize
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Microsoft Experience and Results
Xbox Home
RESULTS
+40% lift in engagement for items
+2.5% increase in mixer engagements
MSN News
RESULTS
+25% improvement in News clickthrough
Personalized: News content on
top of page in MSN.com
Reward: Click on content on the
first slot
Model updated every 5 minutes
Personalized: Type
of content in hero
position, item in
secondary place.
Reward: Click and
engagement
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Personalization across experiences
Email Campaigns Content Creative
Content Layout
Suggesting from a menu
Alerts, Playlists, Content
Items
(articles, tips, blog posts, etc)
Content Suggestions
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Reinforcement Learning
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Reinforcement Learning
• RL refers to a branch of AI / ML, which is aimed
at goal-oriented problems.
• RL algorithms can achieve complex goals by
maximizing a reward function in many steps,
for example, points won in a multi-step game.
• The reward function works in a similar way to
incentivizing a child with sweets and
punishments, with the algorithm penalizing
itself when it makes a wrong decision and
rewarding itself when it makes the right one;
this is a reinforcement.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Reinforcement Learning in Recommendation
systems
• Recommenders: given a user profile and
categorized content, a system makes a
recommendation based on popularity,
interests, demographics, frequency, and other
features.
• RL's boost aspect allows it to more quickly
adapt to real-time changes in the user's
sentiment and profile, without the need for
explicit (re) training.
Enterprise adoption also appears to be
gaining momentum with the recent
availability of cloud APIs such as Azure
Personalizer and Google's RecSim.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Reinforcement Learning
• Reward (𝑟): refers to the feedback by
which we measure the success or
failure of the action recommended by
an agent.
• Policy (𝜋): is the strategy used by the
agent to select the next best action.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
An example of Reinforcement Learning app
architecture
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Another example
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Cognitive Services
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Azure Cognitive Services
Computer Vision
Face API
Custom Vision
Text-to-Speech
Speech-to-Text
Speech Translator
Speaker Recognition
Language Understanding
Text Translator
Text Analytics
QnA Maker
Anomaly Detector
Content Moderator
Personalizer
microsoft.com/cognitive
Vision Speech Language Decision
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Azure Applied AI Services
• Go live with AI solutions in days—not
months.
• Generate tangible value for your
organization quickly with AI services for
common business processes.
• Azure Applied AI Services bring together
Azure Cognitive Services, task-specific AI,
and business logic to offer you turnkey AI
services for common business processes.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Azure Personalizer
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Azure Personalizer
Personalizer is an AI service that delivers the right user experience at
the right time.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Azure Personalizer
• Microsoft is the first company to offer reinforcement learning for the
enterprise thanks to Personalizer service.
• The model’s learning cycle runs at digital speed and it learns from a simple
compensation score that is optimized to meet business goals.
• It allows to offer smarter experiences for each user that improve over time.
• Unlike recommendation engines that adopt some features and suggest items
from a large catalog, Personalizer takes some items with sophisticated features
and predicts the best result for the specific user on that device at the same time.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Sample scenario
Have Fun!
…
We think you’ll like
?
Watch
Play
Join
Personalizer
Watch Action 2 Info
Action 3 Info
User & Context
Info
Action 1 info
Your Users
Your business
logic observing &
evaluating user
behavior
Reward Score
Reward (r)
Personalizer
Service
Rank (..)
Join
Play
Join
Watch
Play
Join
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Discovering Patterns & Casuality
Exploit vs Explore
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Typical training now has new patterns
Ranking
Leverage existing recommendation engine data,
approved user profiles, or context data sources
Feedback
Discover new patterns and retrain on existing models,
improve frameworks over time
Product /
Media Catalog
e.g. 500,000 items
User
30 Items
Personalizer
Top contextual &
personalized
products
Recommendation Engine
Existing Personalization
Existing Segmentation,
Collaborative Filtering, Etc.
Editorial Team
Editorial Team creates content
Typical training now has new patterns
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
For Developers
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
• Send information (features) about your users and the content (actions) to
personalize.
• Personalizer responds with the top action.
• Send feedback to Personalizer about how well the ranking worked as a
number typically between 0 and 1.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Create Personalizer resource in Azure
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Crea el recurso
Copia los siguientes datos:
- Llave 1
- Ubicación
- Endpoint
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Personalizer SDK
• Microsoft.Azure.CognitiveServices.Personalizer (Nuget Package)
• APIs:
• Rank API – Choose the best item (from actions) based on real-time
information, providing content and context.
• Reward API – Determine the score based on your business needs and send
this feedback to Personalizer (1 - good, 0 - bad)
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Get User’s Context
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Create Actions
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Create Personalizer Client
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Get a recommendation (Rank API)
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Send Feedback (Reward API)
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Update / Export the model
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Demo
https://github.com/icebeam7/PersonalizerDemo
https://github.com/icebeam7/PersonalizerMobileDemo
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
https://github.com/icebeam7/PersonalizerDemo
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
https://github.com/icebeam7/PersonalizerMobileDemo
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Before we go
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Where to use Personalizer?
• Build individual experiences: which article(s) are featured on a news
website for a user.
• Determine which recommended product should appear to each
customer in an online store.
• Suggest UI elements, such as filters, to apply to a photo.
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Pricing
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Personalizer is included in the Azure Free Tier
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Do you want to learn more?
What is Personalizer?
https://azure.microsoft.com/en-us/services/cognitive-
services/personalizer/
Some Demos
https://personalizationdemo.azurewebsites.net/
https://personalizercontentdemo.azurewebsites.net
Quickstart
https://docs.microsoft.com/en-us/azure/cognitive-
services/personalizer/quickstart-personalizer-sdk
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Do you want to learn more?
Configure Personalizer learning loop
https://docs.microsoft.com/en-us/azure/cognitive-services/personalizer/how-to-settings
Tutorial: Add Personalizer to a .NET web app
https://docs.microsoft.com/en-us/azure/cognitive-services/personalizer/tutorial-use-
personalizer-web-app
Personalizer on Microsoft Learn
https://docs.microsoft.com/en-us/learn/modules/intro-to-personalizer/
Pluralsight
https://www.pluralsight.com/courses/microsoft-azure-cognitive-services-personalizer
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Q & A
#GlobalAICommun
ity
#GlobalAIBackTogeth
er
Delivering personalized
user experiences with
Azure Personalizer
Luis Beltrán
Microsoft MVP
Thank you for your attention!
about.me/luis-beltran

GAIBT Cleveland - Personalizer.pptx