SlideShare a Scribd company logo
1 of 26
Download to read offline
Rasa Open Source - What’s next?
Rasa Summit 2021
Tom Bocklisch, Director of Engineering @ Rasa
February 2021
Rasa Open Source
New Training Data Format
Rule Policy
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
YAML Training Data Format
Rasa Open Source 2.0
https://rasa.com/docs/rasa/training-data-format
YAML Training Data Format
Rasa Open Source 2.0
Why did we do this?
● Well-known standard
● Good editor support
● Unified extensible format
● Composable
money_transfer:
- I want to transfer money
- I want to make a transfer
Financial bot
loan_queries:
- I need a loan
- I want to take out a loan
https://rasa.com/docs/rasa/training-data-format
Rasa Open Source
New Training Data Format
Rule Policy
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
New Documentation
New Documentation including
a brand new Playground
Rasa Open Source 2.0
Why did we do this?
● Better structure
● Completeness
● No-install quick start
https://rasa.com/docs/rasa/playground
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
New Documentation
Incremental Training
Rasa Open Source 2.2
https://blog.rasa.com/rasa-new-incremental-training/
Why did we do this?
● Iterate quickly
● On-the-spot retraining
● Composability
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
New Documentation
Automated Testing
Automated Testing of Assistants
Rasa Open Source 2.2
Why did we do this?
● Ship with confidence
● Easy to set up
● Follow SE best practices
https://github.com/marketplace?query=rasahq
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
New Documentation
Automated Testing
Machine Learning Model Inspection
Rasa Open Source 2.3
Why did we do this?
● Customization
● Research
● Debuggability
https://github.com/rasahq/rasalit
Future of Rasa Open Source
So, what is next then?
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
New Documentation
Automated Testing
Where do users drop off? Why do users drop off? What can I do to fix that?
Identifying Unsuccessful Conversations at Scale
FEATURE PREVIEW
More powerful, proactive filters
(e.g. notifications to review new conversations where a
fallback action was triggered, free text search, etc.)
Incorporate emerging research (IntentTED)
(e.g. detect where an unexpected intent was expressed at a point
in the conversation)
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
Continuous Model
Evaluation
New Documentation
Automated Testing
Continuous Model Evaluation methodology for CDD
FEATURE PREVIEW
What do we want to achieve?
● The ability to compare versions of
a bot despite the fact that they
participated in different
conversations.
● Providing a quantifiable measure
of progress.
● Estimating and evaluating the
impact of a new
feature/model/model component.
Second Bot
Version
First Bot
Version
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
Continuous Model
Evaluation
Breaking free
from Intents
New Documentation
Automated Testing
Adaptive Assistants will never come if everyone
sticks with designing and implementing
hypothetical conversations, training on synthetic
data, etc.
To get to level 3 and beyond we have to reinvent how conversational AI works.
LEVEL 3 AND BEYOND
What you expect: What users also do:
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
Continuous Model
Evaluation
Breaking free
from Intents
Experimental
e2e Training
New Documentation
Automated Testing
Get end-to-end ready for prime time. Breaking free of intents is just the start.
FEATURE PREVIEW
All of these changes will make it easier to modify models or integrate research ideas.
We are aiming to make end-to-end
part of every assistant.
Still some heavy lifting ahead:
● Refactor Structure of
Dialogue Events
● Refactor Tracker Store
Persistence
● Refactor Agent / Processor /
Tracker Store
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
Continuous Model
Evaluation
Breaking free
from Intents
Experimental
e2e Training
Controllable NLG
New Documentation
Automated Testing
Controllable Natural Language Generation (NLG)
FEATURE PREVIEW
What do we want to achieve?
● Adapt responses to their context →
currently possible with custom logic in
an action → does not scale
● NLG model that learns from examples
but guarantees transparent control
for conversational designers and
developers (longer term)
What does this look like?
1. Mirror users word choices
● If user uses “sneakers” assistant uses “sneakers”
● If user uses “runners” assistant uses “runners”
● If user uses “kicks” assistant uses “kicks”
2. Adjusting response based on previous responses
● First time: “I’m sorry. I don’t understand. Could you
try rephrasing?”
● Second time: “I’m very sorry. I don’t quite get what
you mean. Would you like to speak to customer
service?”
● Third time: “My apologies. Let’s hand you over to a
customer service agent, ...”
Rasa Open Source
New Training Data Format
Rule Policy
Incremental Training
Last Major Release
2.0
Current Version
2.3
Upcoming
Releases
Machine Learning
Model Inspection
Identifying Unsuccessful
Conversations at Scale
Continuous Model
Evaluation
Breaking free
from Intents
Experimental
e2e Training
Controllable NLG
New Documentation
Automated Testing
Tom Bocklisch
Director of Engineering
tom@rasa.com
@tombocklisch
Excited? Help us make
these ideas become reality!
rasa.com/jobs
👩‍💻 👨‍🚀 🚀

More Related Content

What's hot

Conversational AI with Rasa - PyData Workshop
Conversational AI with Rasa - PyData WorkshopConversational AI with Rasa - PyData Workshop
Conversational AI with Rasa - PyData WorkshopTom Bocklisch
 
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Technologies
 
Mengenal Software Development Life Cycle - Gilang Ramadhan
Mengenal Software Development Life Cycle - Gilang RamadhanMengenal Software Development Life Cycle - Gilang Ramadhan
Mengenal Software Development Life Cycle - Gilang RamadhanDicodingEvent
 
How to Effectively Test Your Chatbot | Rasa Summit
How to Effectively Test Your Chatbot  | Rasa SummitHow to Effectively Test Your Chatbot  | Rasa Summit
How to Effectively Test Your Chatbot | Rasa SummitRasa Technologies
 
Conversational interfaces for chatbots and artificial intelligence final
Conversational interfaces for chatbots and artificial intelligence   finalConversational interfaces for chatbots and artificial intelligence   final
Conversational interfaces for chatbots and artificial intelligence finalDon Holloway
 
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...Rasa Technologies
 
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021Rasa Technologies
 
Testing stage. being ahead business with cucumber
Testing stage. being ahead business with cucumberTesting stage. being ahead business with cucumber
Testing stage. being ahead business with cucumberAlex Mikitenko
 
Choosing a career goal as an IT graduate
Choosing a career goal as an IT graduateChoosing a career goal as an IT graduate
Choosing a career goal as an IT graduateTahsin Abrar
 
BDD WITH CUCUMBER AND JAVA
BDD WITH CUCUMBER AND JAVABDD WITH CUCUMBER AND JAVA
BDD WITH CUCUMBER AND JAVASrinivas Katakam
 
How to Build a Dialogflow App by using Actions on Google.
How to Build a Dialogflow App by using Actions on Google.How to Build a Dialogflow App by using Actions on Google.
How to Build a Dialogflow App by using Actions on Google.Yuting Liu
 
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...MongoDB
 
Deprecating the state machine: building conversational AI with the Rasa stack
Deprecating the state machine: building conversational AI with the Rasa stackDeprecating the state machine: building conversational AI with the Rasa stack
Deprecating the state machine: building conversational AI with the Rasa stackJustina Petraitytė
 
Toronto Virtual Meetup #8 - Tips for Reusability
Toronto Virtual Meetup #8 - Tips for ReusabilityToronto Virtual Meetup #8 - Tips for Reusability
Toronto Virtual Meetup #8 - Tips for ReusabilityAlexandra N. Martinez
 

What's hot (20)

Conversational AI with Rasa - PyData Workshop
Conversational AI with Rasa - PyData WorkshopConversational AI with Rasa - PyData Workshop
Conversational AI with Rasa - PyData Workshop
 
Ai chatbot
Ai chatbotAi chatbot
Ai chatbot
 
BDD with Cucumber
BDD with CucumberBDD with Cucumber
BDD with Cucumber
 
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
Rasa Developer Summit - Josh Converse, Dynamic Offset - Three Part Harmony: H...
 
Mengenal Software Development Life Cycle - Gilang Ramadhan
Mengenal Software Development Life Cycle - Gilang RamadhanMengenal Software Development Life Cycle - Gilang Ramadhan
Mengenal Software Development Life Cycle - Gilang Ramadhan
 
How to Effectively Test Your Chatbot | Rasa Summit
How to Effectively Test Your Chatbot  | Rasa SummitHow to Effectively Test Your Chatbot  | Rasa Summit
How to Effectively Test Your Chatbot | Rasa Summit
 
Conversational interfaces for chatbots and artificial intelligence final
Conversational interfaces for chatbots and artificial intelligence   finalConversational interfaces for chatbots and artificial intelligence   final
Conversational interfaces for chatbots and artificial intelligence final
 
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
Voice First: Ready Your Content to Serve 50% of Global Searches | Rasa Summit...
 
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
What’s next in CDD: Intent Clashes and Selective Confidence | Rasa Summit 2021
 
Testing stage. being ahead business with cucumber
Testing stage. being ahead business with cucumberTesting stage. being ahead business with cucumber
Testing stage. being ahead business with cucumber
 
To SDK or not to SDK?
To SDK or not to SDK?To SDK or not to SDK?
To SDK or not to SDK?
 
Choosing a career goal as an IT graduate
Choosing a career goal as an IT graduateChoosing a career goal as an IT graduate
Choosing a career goal as an IT graduate
 
BDD WITH CUCUMBER AND JAVA
BDD WITH CUCUMBER AND JAVABDD WITH CUCUMBER AND JAVA
BDD WITH CUCUMBER AND JAVA
 
Dialogflow
DialogflowDialogflow
Dialogflow
 
How to Build a Dialogflow App by using Actions on Google.
How to Build a Dialogflow App by using Actions on Google.How to Build a Dialogflow App by using Actions on Google.
How to Build a Dialogflow App by using Actions on Google.
 
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...
MongoDB World 2019: Look, Ma, No Servers! Serverless Application Development ...
 
Deprecating the state machine: building conversational AI with the Rasa stack
Deprecating the state machine: building conversational AI with the Rasa stackDeprecating the state machine: building conversational AI with the Rasa stack
Deprecating the state machine: building conversational AI with the Rasa stack
 
MEAN (DevFM)
MEAN (DevFM)MEAN (DevFM)
MEAN (DevFM)
 
Surbhi gupta
Surbhi guptaSurbhi gupta
Surbhi gupta
 
Toronto Virtual Meetup #8 - Tips for Reusability
Toronto Virtual Meetup #8 - Tips for ReusabilityToronto Virtual Meetup #8 - Tips for Reusability
Toronto Virtual Meetup #8 - Tips for Reusability
 

Similar to Rasa Open Source - What's next?

Agile paris 2022 sharing
Agile paris 2022   sharingAgile paris 2022   sharing
Agile paris 2022 sharingJas Chong
 
Ssw forte-agile-seminar
Ssw forte-agile-seminarSsw forte-agile-seminar
Ssw forte-agile-seminarSSW
 
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated Workflow
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated WorkflowCleaning Up the Mess: Modernizing Your Dev Team’s Outdated Workflow
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated WorkflowBohyun Kim
 
Team workspaces; Cat Rayburn
Team workspaces; Cat RayburnTeam workspaces; Cat Rayburn
Team workspaces; Cat RayburnPuppet
 
Automation test lead
Automation test leadAutomation test lead
Automation test leadsenthil kumar
 
Integrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentIntegrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentJulia Borkenhagen
 
Agile Engineering
Agile EngineeringAgile Engineering
Agile EngineeringJohn Lewis
 
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...AgileNetwork
 
Software design.edited (1)
Software design.edited (1)Software design.edited (1)
Software design.edited (1)FarjanaAhmed3
 
Rsqrd AI: ML Tooling at an AI-first Startup
Rsqrd AI: ML Tooling at an AI-first StartupRsqrd AI: ML Tooling at an AI-first Startup
Rsqrd AI: ML Tooling at an AI-first StartupSanjana Chowdhury
 
Slides from "Taking an Holistic Approach to Product Quality"
Slides from "Taking an Holistic Approach to Product Quality"Slides from "Taking an Holistic Approach to Product Quality"
Slides from "Taking an Holistic Approach to Product Quality"Peter Marshall
 
Hybrid model for software development
Hybrid model for software developmentHybrid model for software development
Hybrid model for software developmenteSAT Journals
 

Similar to Rasa Open Source - What's next? (20)

Resume_Sameer Parihar
Resume_Sameer PariharResume_Sameer Parihar
Resume_Sameer Parihar
 
software-dev-life.pptx
software-dev-life.pptxsoftware-dev-life.pptx
software-dev-life.pptx
 
F - CoR
F - CoRF - CoR
F - CoR
 
Agile paris 2022 sharing
Agile paris 2022   sharingAgile paris 2022   sharing
Agile paris 2022 sharing
 
Ssw forte-agile-seminar
Ssw forte-agile-seminarSsw forte-agile-seminar
Ssw forte-agile-seminar
 
Scrum introduc.ppt
Scrum introduc.pptScrum introduc.ppt
Scrum introduc.ppt
 
Ch17
Ch17Ch17
Ch17
 
Ravikumar
Ravikumar Ravikumar
Ravikumar
 
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated Workflow
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated WorkflowCleaning Up the Mess: Modernizing Your Dev Team’s Outdated Workflow
Cleaning Up the Mess: Modernizing Your Dev Team’s Outdated Workflow
 
GSOC 2016 mifos
GSOC 2016 mifosGSOC 2016 mifos
GSOC 2016 mifos
 
Team workspaces; Cat Rayburn
Team workspaces; Cat RayburnTeam workspaces; Cat Rayburn
Team workspaces; Cat Rayburn
 
Automation test lead
Automation test leadAutomation test lead
Automation test lead
 
Integrating User Centered Design with Agile Development
Integrating User Centered Design with Agile DevelopmentIntegrating User Centered Design with Agile Development
Integrating User Centered Design with Agile Development
 
Agile Engineering
Agile EngineeringAgile Engineering
Agile Engineering
 
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...
Agile Mumbai 2022 - Rohit Handa | Combining Human and Artificial Intelligence...
 
Agile scrum induction
Agile scrum inductionAgile scrum induction
Agile scrum induction
 
Software design.edited (1)
Software design.edited (1)Software design.edited (1)
Software design.edited (1)
 
Rsqrd AI: ML Tooling at an AI-first Startup
Rsqrd AI: ML Tooling at an AI-first StartupRsqrd AI: ML Tooling at an AI-first Startup
Rsqrd AI: ML Tooling at an AI-first Startup
 
Slides from "Taking an Holistic Approach to Product Quality"
Slides from "Taking an Holistic Approach to Product Quality"Slides from "Taking an Holistic Approach to Product Quality"
Slides from "Taking an Holistic Approach to Product Quality"
 
Hybrid model for software development
Hybrid model for software developmentHybrid model for software development
Hybrid model for software development
 

More from Rasa Technologies

Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Rasa Technologies
 
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...Rasa Technologies
 
The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...Rasa Technologies
 
Boss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitRasa Technologies
 
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitHow Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitRasa Technologies
 
Applying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseRasa Technologies
 
Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Rasa Technologies
 
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 Rasa Technologies
 
Continuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitContinuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitRasa Technologies
 
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...Rasa Technologies
 
The State of Conversation Design - Designing for the Conversational Future
The State of Conversation Design - Designing for the Conversational FutureThe State of Conversation Design - Designing for the Conversational Future
The State of Conversation Design - Designing for the Conversational FutureRasa Technologies
 
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Rasa Technologies
 
Research Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueResearch Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueRasa Technologies
 
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Technologies
 
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...Rasa Technologies
 
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from RasaRasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from RasaRasa Technologies
 
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & Intro
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & IntroRasa Developer Summit - Alan Nichol, Rasa - Welcome & Intro
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & IntroRasa Technologies
 
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...Rasa Technologies
 
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for Dinner
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for DinnerRasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for Dinner
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for DinnerRasa Technologies
 

More from Rasa Technologies (19)

Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
 
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
End-to-end dialogue systems, or a feature which wasn’t meant to happen | Rasa...
 
The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...The missing link: How AI can help create a safer society and better businesse...
The missing link: How AI can help create a safer society and better businesse...
 
Boss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa SummitBoss - Bringing More Diversity to Tech | Rasa Summit
Boss - Bringing More Diversity to Tech | Rasa Summit
 
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa SummitHow Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
How Our Team Uses Rasa to Learn from Real Conversations | Rasa Summit
 
Applying Conversational AI in the Enterprise
Applying Conversational AI in the EnterpriseApplying Conversational AI in the Enterprise
Applying Conversational AI in the Enterprise
 
Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021Ai = your data | Rasa Summit 2021
Ai = your data | Rasa Summit 2021
 
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021 STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
STAR: A Schema-Guided Dialog Dataset for Transfer Learning | Rasa Summit 2021
 
Continuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa SummitContinuous Improvement of Conversational AI in Production | Rasa Summit
Continuous Improvement of Conversational AI in Production | Rasa Summit
 
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
Ethnobots: Reimagining Chatbots as Ethnographic Research Tools | Rasa Summit ...
 
The State of Conversation Design - Designing for the Conversational Future
The State of Conversation Design - Designing for the Conversational FutureThe State of Conversation Design - Designing for the Conversational Future
The State of Conversation Design - Designing for the Conversational Future
 
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
Building an End-to-End Test Automation Pipeline for Conversational AI | Rasa ...
 
Research Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and DialogueResearch Updates from Rasa: Transformers in NLU and Dialogue
Research Updates from Rasa: Transformers in NLU and Dialogue
 
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
Rasa Developer Summit - Bing Liu - Interactive Learning of Task-Oriented Dial...
 
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...
Rasa Developer Summit - Praneeth Gubbala, NLP Engineer, Sam's Club at Walmart...
 
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from RasaRasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
Rasa Developer Summit - Tom Bocklisch, Rasa - Product Updates from Rasa
 
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & Intro
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & IntroRasa Developer Summit - Alan Nichol, Rasa - Welcome & Intro
Rasa Developer Summit - Alan Nichol, Rasa - Welcome & Intro
 
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...
Rasa Developer Summit - Juste Petraityte, Rasa - Rasa Community Updates & Out...
 
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for Dinner
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for DinnerRasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for Dinner
Rasa Developer Summit - William Galindez Ariaz, Octesoft - Dial Rasa for Dinner
 

Recently uploaded

Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
full stack practical assignment msc cs.pdf
full stack practical assignment msc cs.pdffull stack practical assignment msc cs.pdf
full stack practical assignment msc cs.pdfHulkTheDevil
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
The work to make the piecework work: An ethnographic study of food delivery w...
The work to make the piecework work: An ethnographic study of food delivery w...The work to make the piecework work: An ethnographic study of food delivery w...
The work to make the piecework work: An ethnographic study of food delivery w...stockholm university
 
Software Security in the Real World w/Kelsey Hightower
Software Security in the Real World w/Kelsey HightowerSoftware Security in the Real World w/Kelsey Hightower
Software Security in the Real World w/Kelsey HightowerAnchore
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceOpsTree solutions
 
Dublin_mulesoft_meetup_API_specifications.pptx
Dublin_mulesoft_meetup_API_specifications.pptxDublin_mulesoft_meetup_API_specifications.pptx
Dublin_mulesoft_meetup_API_specifications.pptxKunal Gupta
 
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...amber724300
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentMahmoud Rabie
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Jeffrey Haguewood
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough
 
Automation Ops Series: Session 3 - Solutions management
Automation Ops Series: Session 3 - Solutions managementAutomation Ops Series: Session 3 - Solutions management
Automation Ops Series: Session 3 - Solutions managementDianaGray10
 
Women in Automation 2024: Career session - explore career paths in automation
Women in Automation 2024: Career session - explore career paths in automationWomen in Automation 2024: Career session - explore career paths in automation
Women in Automation 2024: Career session - explore career paths in automationDianaGray10
 
Dynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationDynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationBuild Intuit
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MIRomil Mishra
 

Recently uploaded (20)

Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
full stack practical assignment msc cs.pdf
full stack practical assignment msc cs.pdffull stack practical assignment msc cs.pdf
full stack practical assignment msc cs.pdf
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
The work to make the piecework work: An ethnographic study of food delivery w...
The work to make the piecework work: An ethnographic study of food delivery w...The work to make the piecework work: An ethnographic study of food delivery w...
The work to make the piecework work: An ethnographic study of food delivery w...
 
Software Security in the Real World w/Kelsey Hightower
Software Security in the Real World w/Kelsey HightowerSoftware Security in the Real World w/Kelsey Hightower
Software Security in the Real World w/Kelsey Hightower
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer Experience
 
Dublin_mulesoft_meetup_API_specifications.pptx
Dublin_mulesoft_meetup_API_specifications.pptxDublin_mulesoft_meetup_API_specifications.pptx
Dublin_mulesoft_meetup_API_specifications.pptx
 
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
JET Technology Labs White Paper for Virtualized Security and Encryption Techn...
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career Development
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDF
 
Automation Ops Series: Session 3 - Solutions management
Automation Ops Series: Session 3 - Solutions managementAutomation Ops Series: Session 3 - Solutions management
Automation Ops Series: Session 3 - Solutions management
 
Women in Automation 2024: Career session - explore career paths in automation
Women in Automation 2024: Career session - explore career paths in automationWomen in Automation 2024: Career session - explore career paths in automation
Women in Automation 2024: Career session - explore career paths in automation
 
BoSEU24 | Bill Thompson | Talk From Another Century
BoSEU24 | Bill Thompson | Talk From Another CenturyBoSEU24 | Bill Thompson | Talk From Another Century
BoSEU24 | Bill Thompson | Talk From Another Century
 
Dynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientationDynamical Context introduction word sensibility orientation
Dynamical Context introduction word sensibility orientation
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MI
 

Rasa Open Source - What's next?

  • 1. Rasa Open Source - What’s next? Rasa Summit 2021 Tom Bocklisch, Director of Engineering @ Rasa February 2021
  • 2. Rasa Open Source New Training Data Format Rule Policy Last Major Release 2.0 Current Version 2.3 Upcoming Releases
  • 3. YAML Training Data Format Rasa Open Source 2.0 https://rasa.com/docs/rasa/training-data-format
  • 4. YAML Training Data Format Rasa Open Source 2.0 Why did we do this? ● Well-known standard ● Good editor support ● Unified extensible format ● Composable money_transfer: - I want to transfer money - I want to make a transfer Financial bot loan_queries: - I need a loan - I want to take out a loan https://rasa.com/docs/rasa/training-data-format
  • 5. Rasa Open Source New Training Data Format Rule Policy Last Major Release 2.0 Current Version 2.3 Upcoming Releases New Documentation
  • 6. New Documentation including a brand new Playground Rasa Open Source 2.0 Why did we do this? ● Better structure ● Completeness ● No-install quick start https://rasa.com/docs/rasa/playground
  • 7. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases New Documentation
  • 8. Incremental Training Rasa Open Source 2.2 https://blog.rasa.com/rasa-new-incremental-training/ Why did we do this? ● Iterate quickly ● On-the-spot retraining ● Composability
  • 9. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases New Documentation Automated Testing
  • 10. Automated Testing of Assistants Rasa Open Source 2.2 Why did we do this? ● Ship with confidence ● Easy to set up ● Follow SE best practices https://github.com/marketplace?query=rasahq
  • 11. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection New Documentation Automated Testing
  • 12. Machine Learning Model Inspection Rasa Open Source 2.3 Why did we do this? ● Customization ● Research ● Debuggability https://github.com/rasahq/rasalit
  • 13. Future of Rasa Open Source So, what is next then?
  • 14. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale New Documentation Automated Testing
  • 15. Where do users drop off? Why do users drop off? What can I do to fix that? Identifying Unsuccessful Conversations at Scale FEATURE PREVIEW More powerful, proactive filters (e.g. notifications to review new conversations where a fallback action was triggered, free text search, etc.) Incorporate emerging research (IntentTED) (e.g. detect where an unexpected intent was expressed at a point in the conversation)
  • 16. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale Continuous Model Evaluation New Documentation Automated Testing
  • 17. Continuous Model Evaluation methodology for CDD FEATURE PREVIEW What do we want to achieve? ● The ability to compare versions of a bot despite the fact that they participated in different conversations. ● Providing a quantifiable measure of progress. ● Estimating and evaluating the impact of a new feature/model/model component. Second Bot Version First Bot Version
  • 18. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale Continuous Model Evaluation Breaking free from Intents New Documentation Automated Testing
  • 19. Adaptive Assistants will never come if everyone sticks with designing and implementing hypothetical conversations, training on synthetic data, etc.
  • 20. To get to level 3 and beyond we have to reinvent how conversational AI works. LEVEL 3 AND BEYOND What you expect: What users also do:
  • 21. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale Continuous Model Evaluation Breaking free from Intents Experimental e2e Training New Documentation Automated Testing
  • 22. Get end-to-end ready for prime time. Breaking free of intents is just the start. FEATURE PREVIEW All of these changes will make it easier to modify models or integrate research ideas. We are aiming to make end-to-end part of every assistant. Still some heavy lifting ahead: ● Refactor Structure of Dialogue Events ● Refactor Tracker Store Persistence ● Refactor Agent / Processor / Tracker Store
  • 23. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale Continuous Model Evaluation Breaking free from Intents Experimental e2e Training Controllable NLG New Documentation Automated Testing
  • 24. Controllable Natural Language Generation (NLG) FEATURE PREVIEW What do we want to achieve? ● Adapt responses to their context → currently possible with custom logic in an action → does not scale ● NLG model that learns from examples but guarantees transparent control for conversational designers and developers (longer term) What does this look like? 1. Mirror users word choices ● If user uses “sneakers” assistant uses “sneakers” ● If user uses “runners” assistant uses “runners” ● If user uses “kicks” assistant uses “kicks” 2. Adjusting response based on previous responses ● First time: “I’m sorry. I don’t understand. Could you try rephrasing?” ● Second time: “I’m very sorry. I don’t quite get what you mean. Would you like to speak to customer service?” ● Third time: “My apologies. Let’s hand you over to a customer service agent, ...”
  • 25. Rasa Open Source New Training Data Format Rule Policy Incremental Training Last Major Release 2.0 Current Version 2.3 Upcoming Releases Machine Learning Model Inspection Identifying Unsuccessful Conversations at Scale Continuous Model Evaluation Breaking free from Intents Experimental e2e Training Controllable NLG New Documentation Automated Testing
  • 26. Tom Bocklisch Director of Engineering tom@rasa.com @tombocklisch Excited? Help us make these ideas become reality! rasa.com/jobs 👩‍💻 👨‍🚀 🚀