SlideShare a Scribd company logo
1 of 11
Download to read offline
Intent Clashes +
Selective Confidence
while tightening CDD loop
Context is key
Customer Agnostic Industry Agnostic Steep Learning Curve
Conversational AI for the future of business
Notify Engage Empower Support
Iris warms up your audience and customers so that your team can have the
conversations that matter.
Intent clashes + Selective confidence
● What to do when you hit intent clashes?
● More data will only get you so far
● The “refund” problem, want one or just information about it?
● How do you achieve accuracy and consistency?
● How can this be solved through selective confidence?
Dialogue Design
● We have always called it Dialogue Design but essentially it’s CDD
● It’s an approach / methodology / practice for success
● At the core it’s customer centric development
● Human-in-the-loop Conversational product development
Building for CX
● Thousands of customer interactions
● Three customer segments
● Organic and paid traffic
● Integration into their existing systems
● Complex business rules
● Over 10 different scenarios
How...
Human-in-the-loop Tighten the CDD Loop
CDD by design and practice
Dialogue Designer
● Rapid prototyping
● Copy editor
● Low level programming
● Integration interfaces
● Conversation flow
● Encode business logic
Launch Pad / Insights & Metrics
● Design
● Staging
● Production
● Review
● Assess
● Rapid development workflow
Conversation Engine
● Various services + functionality
● Rasa service
● Rasa for Traversal or Article Search
● Various training models
● Processed at different levels
● User profile, settings and context
Natural Language Interface
● Intent training
● Text input and keyboards
● Set the confidence thresholds
● Simulation + load testing
● Capture failed NLU
● Retrain or discard
Visual programmatic design
Traversal Article Search
Key takeaways
● Select intents based on context to reduce clashes
● Leverage context to adjust confidence threshold
● How can you tighten the CDD workflow
● Set an order of operations on your NLU
Q&A
@spedavoli
Sebastian Pedavoli
CEO & Co-founder, Proxima

More Related Content

What's hot

Rsqrd AI: Making Conversational AI Work for Everybody
Rsqrd AI: Making Conversational AI Work for EverybodyRsqrd AI: Making Conversational AI Work for Everybody
Rsqrd AI: Making Conversational AI Work for EverybodySanjana Chowdhury
 
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setup
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setupBest Practices - chapter #4 - Web UI development and Bonita infrastructure setup
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setupBonitasoft
 
Agile and the Business Analyst, Presentation to the IIBA, June 2010
Agile and the Business Analyst, Presentation to the IIBA, June 2010Agile and the Business Analyst, Presentation to the IIBA, June 2010
Agile and the Business Analyst, Presentation to the IIBA, June 2010bennw
 
Best Practices in Process Automation - Chapter 1
Best Practices in Process Automation - Chapter 1Best Practices in Process Automation - Chapter 1
Best Practices in Process Automation - Chapter 1Bonitasoft
 
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)Tech in Asia ID
 
Enhancing Desirability: Five Considerations for Winning Digital Initiatives
Enhancing Desirability: Five Considerations for Winning Digital InitiativesEnhancing Desirability: Five Considerations for Winning Digital Initiatives
Enhancing Desirability: Five Considerations for Winning Digital InitiativesRaja Bavani
 
Agile Fixed Price - XP Days 2015
Agile Fixed Price - XP Days 2015Agile Fixed Price - XP Days 2015
Agile Fixed Price - XP Days 2015Giulio Roggero
 
Tagging beyond your website - Agility2013
Tagging beyond your website - Agility2013 Tagging beyond your website - Agility2013
Tagging beyond your website - Agility2013 Ensighten
 
The magic ingredient for successful automation - Chapter 2
The magic ingredient for successful automation - Chapter 2The magic ingredient for successful automation - Chapter 2
The magic ingredient for successful automation - Chapter 2Bonitasoft
 
Improving developer documentation
Improving developer documentationImproving developer documentation
Improving developer documentationPronovix
 
WordPress in een Continuous Delivery omgeving
WordPress in een Continuous Delivery omgevingWordPress in een Continuous Delivery omgeving
WordPress in een Continuous Delivery omgevingDenver Sessink
 
Accessible conversational UI's CSUN ‘22
Accessible conversational UI's   CSUN ‘22Accessible conversational UI's   CSUN ‘22
Accessible conversational UI's CSUN ‘22Poonam Tathavadkar
 
Unexpected benefits of .net development outsourcing. 2
Unexpected benefits of .net development outsourcing. 2Unexpected benefits of .net development outsourcing. 2
Unexpected benefits of .net development outsourcing. 2AnupamSingh211
 
BOTS TESTING BOTS: From manual to automated testing for conversational AI
BOTS TESTING BOTS: From manual to automated testing for conversational AIBOTS TESTING BOTS: From manual to automated testing for conversational AI
BOTS TESTING BOTS: From manual to automated testing for conversational AIDatabricks
 
Devportal Information Architecture: A 4-step Method
Devportal Information Architecture: A 4-step MethodDevportal Information Architecture: A 4-step Method
Devportal Information Architecture: A 4-step MethodPronovix
 
RADS - Rapid Application Design Sprint
RADS - Rapid Application Design SprintRADS - Rapid Application Design Sprint
RADS - Rapid Application Design SprintOutSystems
 

What's hot (20)

Rsqrd AI: Making Conversational AI Work for Everybody
Rsqrd AI: Making Conversational AI Work for EverybodyRsqrd AI: Making Conversational AI Work for Everybody
Rsqrd AI: Making Conversational AI Work for Everybody
 
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setup
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setupBest Practices - chapter #4 - Web UI development and Bonita infrastructure setup
Best Practices - chapter #4 - Web UI development and Bonita infrastructure setup
 
Agile and the Business Analyst, Presentation to the IIBA, June 2010
Agile and the Business Analyst, Presentation to the IIBA, June 2010Agile and the Business Analyst, Presentation to the IIBA, June 2010
Agile and the Business Analyst, Presentation to the IIBA, June 2010
 
Best Practices in Process Automation - Chapter 1
Best Practices in Process Automation - Chapter 1Best Practices in Process Automation - Chapter 1
Best Practices in Process Automation - Chapter 1
 
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)
"How we make Agile and CI/CD works" by Rendra Toro (OLX Indonesia)
 
Enhancing Desirability: Five Considerations for Winning Digital Initiatives
Enhancing Desirability: Five Considerations for Winning Digital InitiativesEnhancing Desirability: Five Considerations for Winning Digital Initiatives
Enhancing Desirability: Five Considerations for Winning Digital Initiatives
 
Agile Fixed Price - XP Days 2015
Agile Fixed Price - XP Days 2015Agile Fixed Price - XP Days 2015
Agile Fixed Price - XP Days 2015
 
Tagging beyond your website - Agility2013
Tagging beyond your website - Agility2013 Tagging beyond your website - Agility2013
Tagging beyond your website - Agility2013
 
The magic ingredient for successful automation - Chapter 2
The magic ingredient for successful automation - Chapter 2The magic ingredient for successful automation - Chapter 2
The magic ingredient for successful automation - Chapter 2
 
Improving developer documentation
Improving developer documentationImproving developer documentation
Improving developer documentation
 
WordPress in een Continuous Delivery omgeving
WordPress in een Continuous Delivery omgevingWordPress in een Continuous Delivery omgeving
WordPress in een Continuous Delivery omgeving
 
Accessible conversational UI's CSUN ‘22
Accessible conversational UI's   CSUN ‘22Accessible conversational UI's   CSUN ‘22
Accessible conversational UI's CSUN ‘22
 
Unexpected benefits of .net development outsourcing. 2
Unexpected benefits of .net development outsourcing. 2Unexpected benefits of .net development outsourcing. 2
Unexpected benefits of .net development outsourcing. 2
 
A11y agile
A11y agileA11y agile
A11y agile
 
BOTS TESTING BOTS: From manual to automated testing for conversational AI
BOTS TESTING BOTS: From manual to automated testing for conversational AIBOTS TESTING BOTS: From manual to automated testing for conversational AI
BOTS TESTING BOTS: From manual to automated testing for conversational AI
 
Devportal Information Architecture: A 4-step Method
Devportal Information Architecture: A 4-step MethodDevportal Information Architecture: A 4-step Method
Devportal Information Architecture: A 4-step Method
 
aboutme
aboutmeaboutme
aboutme
 
RADS - Rapid Application Design Sprint
RADS - Rapid Application Design SprintRADS - Rapid Application Design Sprint
RADS - Rapid Application Design Sprint
 
Lakshmi Ravinuthala
Lakshmi RavinuthalaLakshmi Ravinuthala
Lakshmi Ravinuthala
 
Scrum + bdd + ddd
Scrum + bdd + dddScrum + bdd + ddd
Scrum + bdd + ddd
 

Similar to Tighten CDD Loop with Selective Confidence

Agile Methods and Data Warehousing (2016 update)
Agile Methods and Data Warehousing (2016 update)Agile Methods and Data Warehousing (2016 update)
Agile Methods and Data Warehousing (2016 update)Kent Graziano
 
Agile methods and dw mha
Agile methods and dw mhaAgile methods and dw mha
Agile methods and dw mhaAgileDenver
 
How to Manage a Mixed Portfolio of Products by Salesforce PM
How to Manage a Mixed Portfolio of Products by Salesforce PMHow to Manage a Mixed Portfolio of Products by Salesforce PM
How to Manage a Mixed Portfolio of Products by Salesforce PMProduct School
 
Aligning Feature Delivery with OKRs by Gtmhub CPO
Aligning Feature Delivery with OKRs by Gtmhub CPOAligning Feature Delivery with OKRs by Gtmhub CPO
Aligning Feature Delivery with OKRs by Gtmhub CPOProduct School
 
Pyptug atdd agile_ci_uploaded
Pyptug atdd agile_ci_uploadedPyptug atdd agile_ci_uploaded
Pyptug atdd agile_ci_uploadedMacharla Pradeep
 
Taking Control of Your Document's Lifecycle from Creation to Completion.pptx
Taking Control of Your Document's Lifecycle from Creation to Completion.pptxTaking Control of Your Document's Lifecycle from Creation to Completion.pptx
Taking Control of Your Document's Lifecycle from Creation to Completion.pptxBrainSell Technologies
 
Lead AI incubations as a Product manager
Lead AI incubations as a Product manager Lead AI incubations as a Product manager
Lead AI incubations as a Product manager Debapriya Basu
 
Moving to tdd bdd
Moving to tdd bddMoving to tdd bdd
Moving to tdd bddKim Carter
 
Six Steps to Conversation Driven Development
Six Steps to Conversation Driven DevelopmentSix Steps to Conversation Driven Development
Six Steps to Conversation Driven DevelopmentRasa Technologies
 
Agile Methods and Data Warehousing
Agile Methods and Data WarehousingAgile Methods and Data Warehousing
Agile Methods and Data WarehousingKent Graziano
 
Business analysis: Get people to tell you what they need
Business analysis: Get people to tell you what they needBusiness analysis: Get people to tell you what they need
Business analysis: Get people to tell you what they needTodd Kovalsky
 
Customer segmentation for business success with knime
Customer segmentation for business success with knimeCustomer segmentation for business success with knime
Customer segmentation for business success with knimeKnoldus Inc.
 
Smarter Experimentation with Fully Integrated Data
Smarter Experimentation with Fully Integrated DataSmarter Experimentation with Fully Integrated Data
Smarter Experimentation with Fully Integrated DataOptimizely
 
A Day in the Life of a Product Manager by Oracle Director of PM
A Day in the Life of a Product Manager by Oracle Director of PMA Day in the Life of a Product Manager by Oracle Director of PM
A Day in the Life of a Product Manager by Oracle Director of PMProduct School
 
Scaling Your Service-Based Business with Software
Scaling Your Service-Based Business with SoftwareScaling Your Service-Based Business with Software
Scaling Your Service-Based Business with SoftwareElyse Ash
 
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...Overview of intelligent customer service with Dynamics 365 Customer Engagemen...
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...Ali Sharifi
 
Integration Magic: SugarCRM and JD Edwards
Integration Magic: SugarCRM and JD EdwardsIntegration Magic: SugarCRM and JD Edwards
Integration Magic: SugarCRM and JD EdwardsBrainSell Technologies
 
Create, Approve, Send & eSign Documents within Salesforce
Create, Approve, Send & eSign Documents within SalesforceCreate, Approve, Send & eSign Documents within Salesforce
Create, Approve, Send & eSign Documents within SalesforceXfilesPro
 

Similar to Tighten CDD Loop with Selective Confidence (20)

Agile Methods and Data Warehousing (2016 update)
Agile Methods and Data Warehousing (2016 update)Agile Methods and Data Warehousing (2016 update)
Agile Methods and Data Warehousing (2016 update)
 
Introduction to TDD and BDD
Introduction to TDD and BDDIntroduction to TDD and BDD
Introduction to TDD and BDD
 
Agile methods and dw mha
Agile methods and dw mhaAgile methods and dw mha
Agile methods and dw mha
 
How to Manage a Mixed Portfolio of Products by Salesforce PM
How to Manage a Mixed Portfolio of Products by Salesforce PMHow to Manage a Mixed Portfolio of Products by Salesforce PM
How to Manage a Mixed Portfolio of Products by Salesforce PM
 
Aligning Feature Delivery with OKRs by Gtmhub CPO
Aligning Feature Delivery with OKRs by Gtmhub CPOAligning Feature Delivery with OKRs by Gtmhub CPO
Aligning Feature Delivery with OKRs by Gtmhub CPO
 
Pyptug atdd agile_ci_uploaded
Pyptug atdd agile_ci_uploadedPyptug atdd agile_ci_uploaded
Pyptug atdd agile_ci_uploaded
 
Taking Control of Your Document's Lifecycle from Creation to Completion.pptx
Taking Control of Your Document's Lifecycle from Creation to Completion.pptxTaking Control of Your Document's Lifecycle from Creation to Completion.pptx
Taking Control of Your Document's Lifecycle from Creation to Completion.pptx
 
Lead AI incubations as a Product manager
Lead AI incubations as a Product manager Lead AI incubations as a Product manager
Lead AI incubations as a Product manager
 
Moving to tdd bdd
Moving to tdd bddMoving to tdd bdd
Moving to tdd bdd
 
Six Steps to Conversation Driven Development
Six Steps to Conversation Driven DevelopmentSix Steps to Conversation Driven Development
Six Steps to Conversation Driven Development
 
Agile Methods and Data Warehousing
Agile Methods and Data WarehousingAgile Methods and Data Warehousing
Agile Methods and Data Warehousing
 
Technical Debt.pptx
Technical Debt.pptxTechnical Debt.pptx
Technical Debt.pptx
 
Business analysis: Get people to tell you what they need
Business analysis: Get people to tell you what they needBusiness analysis: Get people to tell you what they need
Business analysis: Get people to tell you what they need
 
Customer segmentation for business success with knime
Customer segmentation for business success with knimeCustomer segmentation for business success with knime
Customer segmentation for business success with knime
 
Smarter Experimentation with Fully Integrated Data
Smarter Experimentation with Fully Integrated DataSmarter Experimentation with Fully Integrated Data
Smarter Experimentation with Fully Integrated Data
 
A Day in the Life of a Product Manager by Oracle Director of PM
A Day in the Life of a Product Manager by Oracle Director of PMA Day in the Life of a Product Manager by Oracle Director of PM
A Day in the Life of a Product Manager by Oracle Director of PM
 
Scaling Your Service-Based Business with Software
Scaling Your Service-Based Business with SoftwareScaling Your Service-Based Business with Software
Scaling Your Service-Based Business with Software
 
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...Overview of intelligent customer service with Dynamics 365 Customer Engagemen...
Overview of intelligent customer service with Dynamics 365 Customer Engagemen...
 
Integration Magic: SugarCRM and JD Edwards
Integration Magic: SugarCRM and JD EdwardsIntegration Magic: SugarCRM and JD Edwards
Integration Magic: SugarCRM and JD Edwards
 
Create, Approve, Send & eSign Documents within Salesforce
Create, Approve, Send & eSign Documents within SalesforceCreate, Approve, Send & eSign Documents within Salesforce
Create, Approve, Send & eSign Documents within Salesforce
 

More from Rasa Technologies

Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Rasa Technologies
 
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...Rasa Technologies
 
How to Effectively Test Your Chatbot | Rasa Summit
How to Effectively Test Your Chatbot  | Rasa SummitHow to Effectively Test Your Chatbot  | Rasa Summit
How to Effectively Test Your Chatbot | Rasa SummitRasa Technologies
 
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...Rasa Technologies
 
The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...Rasa Technologies
 
Boss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitRasa Technologies
 
Applying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseRasa Technologies
 
Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Rasa Technologies
 
Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021Rasa Technologies
 
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 Rasa Technologies
 
Continuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitContinuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitRasa Technologies
 
Rasa Open Source - What's next?
Rasa Open Source - What's next?Rasa Open Source - What's next?
Rasa Open Source - What's next?Rasa Technologies
 
Building an AI Assistant Factory - Rasa Summit 2021
Building an AI Assistant Factory - Rasa Summit 2021Building an AI Assistant Factory - Rasa Summit 2021
Building an AI Assistant Factory - Rasa Summit 2021Rasa Technologies
 
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Rasa Technologies
 
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021Rasa Technologies
 
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021Rasa Technologies
 
Research Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueResearch Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueRasa Technologies
 
Webinar: How to Use Integrated Version Control in Rasa X
Webinar: How to Use Integrated Version Control in Rasa XWebinar: How to Use Integrated Version Control in Rasa X
Webinar: How to Use Integrated Version Control in Rasa XRasa Technologies
 
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Technologies
 
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Technologies
 

More from Rasa Technologies (20)

Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
 
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
Using Rasa to Power an Immersive Multimedia Conversational Experience | Rasa ...
 
How to Effectively Test Your Chatbot | Rasa Summit
How to Effectively Test Your Chatbot  | Rasa SummitHow to Effectively Test Your Chatbot  | Rasa Summit
How to Effectively Test Your Chatbot | Rasa Summit
 
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
 
The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...
 
Boss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa Summit
 
Applying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the Enterprise
 
Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021
 
Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021Supercharging User Interfaces with Rasa | Rasa Summit 2021
Supercharging User Interfaces with Rasa | Rasa Summit 2021
 
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
 
Continuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitContinuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa Summit
 
Rasa Open Source - What's next?
Rasa Open Source - What's next?Rasa Open Source - What's next?
Rasa Open Source - What's next?
 
Building an AI Assistant Factory - Rasa Summit 2021
Building an AI Assistant Factory - Rasa Summit 2021Building an AI Assistant Factory - Rasa Summit 2021
Building an AI Assistant Factory - Rasa Summit 2021
 
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
 
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
Deploy your Rasa Chatbots like a Boss with DevOps | Rasa Summit 2021
 
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
Conversational Teams: Moving Fast at Scale | Rasa Summit 2021
 
Research Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueResearch Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and Dialogue
 
Webinar: How to Use Integrated Version Control in Rasa X
Webinar: How to Use Integrated Version Control in Rasa XWebinar: How to Use Integrated Version Control in Rasa X
Webinar: How to Use Integrated Version Control in Rasa X
 
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
 
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
 

Recently uploaded

SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 

Recently uploaded (20)

SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 

Tighten CDD Loop with Selective Confidence

  • 1. Intent Clashes + Selective Confidence while tightening CDD loop
  • 2. Context is key Customer Agnostic Industry Agnostic Steep Learning Curve
  • 3. Conversational AI for the future of business Notify Engage Empower Support Iris warms up your audience and customers so that your team can have the conversations that matter.
  • 4. Intent clashes + Selective confidence ● What to do when you hit intent clashes? ● More data will only get you so far ● The “refund” problem, want one or just information about it? ● How do you achieve accuracy and consistency? ● How can this be solved through selective confidence?
  • 5. Dialogue Design ● We have always called it Dialogue Design but essentially it’s CDD ● It’s an approach / methodology / practice for success ● At the core it’s customer centric development ● Human-in-the-loop Conversational product development
  • 6. Building for CX ● Thousands of customer interactions ● Three customer segments ● Organic and paid traffic ● Integration into their existing systems ● Complex business rules ● Over 10 different scenarios
  • 8. CDD by design and practice Dialogue Designer ● Rapid prototyping ● Copy editor ● Low level programming ● Integration interfaces ● Conversation flow ● Encode business logic Launch Pad / Insights & Metrics ● Design ● Staging ● Production ● Review ● Assess ● Rapid development workflow Conversation Engine ● Various services + functionality ● Rasa service ● Rasa for Traversal or Article Search ● Various training models ● Processed at different levels ● User profile, settings and context Natural Language Interface ● Intent training ● Text input and keyboards ● Set the confidence thresholds ● Simulation + load testing ● Capture failed NLU ● Retrain or discard
  • 10. Key takeaways ● Select intents based on context to reduce clashes ● Leverage context to adjust confidence threshold ● How can you tighten the CDD workflow ● Set an order of operations on your NLU