Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart - Sam's Club Conversational AI

Rasa Technologies
Rasa TechnologiesRasa Technologies
Sam’s Club Conversational AI
Praneeth Gubbala
NLP Engineer, Sam's Club at Walmart
Rasa Developer Summit - 2019
Rasa Developer Summit
September, 2019
Sam’s Club Confidential
Praneeth Gubbala
NLP Applied Scientist
Walmart Inc.
“What is the phone
number for the Sam’s
Club in Concord?”
“Do we have chicken bites in
stock?”
“Who is working the
bakery tomorrow?”
Sam’s Club’s 90K club associates need thousands of answers every day to
run our $60 billion business
“How many rotisserie chickens
do I need to make right now?”
“Where is the popcorn oil
located?”
“Who called in sick
today?”
“What is the item number
for avocado salsa?” “Are we open on
Thanksgiving?”
“When is Maria
coming to work in
tonight?”
“How do I cut a ribeye
steak?”
“What were my club
sales yesterday?”
“Print a price sign for
plumcots”
“Do we carry Diet Dr.
Pepper?”
Sam’s Club Confidential3
Kevin Malone
Robert Vance
Robert California
Gabriel Lewis
David Wallace
“Ask Sam” makes getting answers is as easy as asking a question
Sam’s Club Confidential4
“Ask Sam” makes getting answers is as easy as asking a question
Sam’s Club Confidential5
“Ask Sam” has been a game changer for Sam’s Club
4M
questions
answered
94%
repeat usage
weekly
Developer Console Interface to Label the utterances Intent
and entities in it
Sam’s Club Confidential 6
Developer Console has built-in 26 entities and training
manager
Sam’s Club Confidential 7
Models training: Developer Console Training Manager
Sam’s Club Confidential 8
Serving Models : Ensemble of Machine Learning Models
Sam’s Club Confidential 9
IC
Model 1
IC
Model 2
IC
Ensemble
Model
Active Learning: selects informative training data from logs
Sam’s Club Confidential 10
.11
.13
.14
.19
Score Label
Future Plans
Sam’s Club Confidential 11
• Question and Answering
• Complex query understanding
• Deep personalization to users
• Seamless (dynamic) context switching.
Thank you! Questions?
Sam’s Club Confidential12
1 of 13

Recommended

Mika power by
Mika powerMika power
Mika powerJames Ketty
114 views4 slides
Six Steps to Conversation Driven Development by
Six Steps to Conversation Driven DevelopmentSix Steps to Conversation Driven Development
Six Steps to Conversation Driven DevelopmentRasa Technologies
355 views37 slides
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu... by
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Rasa Technologies
250 views22 slides
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ... by
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...Rasa Technologies
178 views20 slides
How to Effectively Test Your Chatbot | Rasa Summit by
How to Effectively Test Your Chatbot  | Rasa SummitHow to Effectively Test Your Chatbot  | Rasa Summit
How to Effectively Test Your Chatbot | Rasa SummitRasa Technologies
142 views8 slides
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa... by
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...Rasa Technologies
194 views17 slides

More Related Content

More from Rasa Technologies

Boss - Bringing More Diversity to Tech | Rasa Summit by
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitRasa Technologies
116 views25 slides
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit by
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitHow Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitRasa Technologies
136 views27 slides
Applying Conversational AI in the Enterprise by
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseRasa Technologies
118 views15 slides
Ai = your data | Rasa Summit 2021 by
Ai = your data | Rasa Summit 2021Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Rasa Technologies
99 views28 slides
Supercharging User Interfaces with Rasa | Rasa Summit 2021 by
Supercharging User Interfaces with Rasa | Rasa Summit 2021Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021Rasa Technologies
95 views22 slides
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 by
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 Rasa Technologies
215 views54 slides

More from Rasa Technologies(20)

Boss - Bringing More Diversity to Tech | Rasa Summit by Rasa Technologies
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa Summit
Rasa Technologies116 views
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit by Rasa Technologies
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitHow Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
Rasa Technologies136 views
Applying Conversational AI in the Enterprise by Rasa Technologies
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the Enterprise
Rasa Technologies118 views
Supercharging User Interfaces with Rasa | Rasa Summit 2021 by Rasa Technologies
Supercharging User Interfaces with Rasa | Rasa Summit 2021Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 by Rasa Technologies
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
Rasa Technologies215 views
Continuous Improvement of Conversational AI in Production | Rasa Summit by Rasa Technologies
Continuous Improvement of Conversational AI in Production | Rasa SummitContinuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa Summit
Rasa Technologies130 views
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ... by Rasa Technologies
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
The State of Conversation Design - Designing for the Conversational Future by Rasa Technologies
The State of Conversation Design - Designing for the Conversational FutureThe State of Conversation Design - Designing for the Conversational Future
The State of Conversation Design - Designing for the Conversational Future
Rasa Technologies349 views
Building an AI Assistant Factory - Rasa Summit 2021 by Rasa Technologies
Building an AI Assistant Factory - Rasa Summit 2021Building an AI Assistant Factory - Rasa Summit 2021
Building an AI Assistant Factory - Rasa Summit 2021
Rasa Technologies119 views
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ... by Rasa Technologies
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Rasa Technologies156 views
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021 by Rasa Technologies
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Rasa Technologies184 views
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021 by Rasa Technologies
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
Rasa Technologies170 views
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021 by Rasa Technologies
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Rasa Technologies173 views
Research Updates from Rasa: Transformers in NLU and Dialogue by Rasa Technologies
Research Updates from Rasa: Transformers in NLU and DialogueResearch Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and Dialogue
Rasa Technologies712 views
Webinar: How to Use Integrated Version Control in Rasa X by Rasa Technologies
Webinar: How to Use Integrated Version Control in Rasa XWebinar: How to Use Integrated Version Control in Rasa X
Webinar: How to Use Integrated Version Control in Rasa X
Rasa Technologies247 views
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial... by Rasa Technologies
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Technologies770 views
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H... by Rasa Technologies
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa by Rasa Technologies
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from RasaRasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Technologies669 views

Recently uploaded

Business Analyst Series 2023 - Week 3 Session 5 by
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5DianaGray10
300 views20 slides
Serverless computing with Google Cloud (2023-24) by
Serverless computing with Google Cloud (2023-24)Serverless computing with Google Cloud (2023-24)
Serverless computing with Google Cloud (2023-24)wesley chun
11 views33 slides
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensorssugiuralab
21 views15 slides
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc
11 views29 slides
Mini-Track: Challenges to Network Automation Adoption by
Mini-Track: Challenges to Network Automation AdoptionMini-Track: Challenges to Network Automation Adoption
Mini-Track: Challenges to Network Automation AdoptionNetwork Automation Forum
13 views27 slides
Voice Logger - Telephony Integration Solution at Aegis by
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at AegisNirmal Sharma
39 views1 slide

Recently uploaded(20)

Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10300 views
Serverless computing with Google Cloud (2023-24) by wesley chun
Serverless computing with Google Cloud (2023-24)Serverless computing with Google Cloud (2023-24)
Serverless computing with Google Cloud (2023-24)
wesley chun11 views
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors by sugiuralab
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab21 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc11 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma39 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely25 views
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn22 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker40 views
Piloting & Scaling Successfully With Microsoft Viva by Richard Harbridge
Piloting & Scaling Successfully With Microsoft VivaPiloting & Scaling Successfully With Microsoft Viva
Piloting & Scaling Successfully With Microsoft Viva
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf by Dr. Jimmy Schwarzkopf
STKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdfSTKI Israeli Market Study 2023   corrected forecast 2023_24 v3.pdf
STKI Israeli Market Study 2023 corrected forecast 2023_24 v3.pdf
Five Things You SHOULD Know About Postman by Postman
Five Things You SHOULD Know About PostmanFive Things You SHOULD Know About Postman
Five Things You SHOULD Know About Postman
Postman36 views
SAP Automation Using Bar Code and FIORI.pdf by Virendra Rai, PMP
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdf

Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart - Sam's Club Conversational AI

  • 1. Sam’s Club Conversational AI Praneeth Gubbala NLP Engineer, Sam's Club at Walmart Rasa Developer Summit - 2019
  • 2. Rasa Developer Summit September, 2019 Sam’s Club Confidential Praneeth Gubbala NLP Applied Scientist Walmart Inc.
  • 3. “What is the phone number for the Sam’s Club in Concord?” “Do we have chicken bites in stock?” “Who is working the bakery tomorrow?” Sam’s Club’s 90K club associates need thousands of answers every day to run our $60 billion business “How many rotisserie chickens do I need to make right now?” “Where is the popcorn oil located?” “Who called in sick today?” “What is the item number for avocado salsa?” “Are we open on Thanksgiving?” “When is Maria coming to work in tonight?” “How do I cut a ribeye steak?” “What were my club sales yesterday?” “Print a price sign for plumcots” “Do we carry Diet Dr. Pepper?”
  • 4. Sam’s Club Confidential3 Kevin Malone Robert Vance Robert California Gabriel Lewis David Wallace “Ask Sam” makes getting answers is as easy as asking a question
  • 5. Sam’s Club Confidential4 “Ask Sam” makes getting answers is as easy as asking a question
  • 6. Sam’s Club Confidential5 “Ask Sam” has been a game changer for Sam’s Club 4M questions answered 94% repeat usage weekly
  • 7. Developer Console Interface to Label the utterances Intent and entities in it Sam’s Club Confidential 6
  • 8. Developer Console has built-in 26 entities and training manager Sam’s Club Confidential 7
  • 9. Models training: Developer Console Training Manager Sam’s Club Confidential 8
  • 10. Serving Models : Ensemble of Machine Learning Models Sam’s Club Confidential 9 IC Model 1 IC Model 2 IC Ensemble Model
  • 11. Active Learning: selects informative training data from logs Sam’s Club Confidential 10 .11 .13 .14 .19 Score Label
  • 12. Future Plans Sam’s Club Confidential 11 • Question and Answering • Complex query understanding • Deep personalization to users • Seamless (dynamic) context switching.
  • 13. Thank you! Questions? Sam’s Club Confidential12