Recommended
More Related Content
Similar to Going beyond “Sorry, I didn’t get that”: building AI assistants that scale using machine learning (PyData DC 2018)
Similar to Going beyond “Sorry, I didn’t get that”: building AI assistants that scale using machine learning (PyData DC 2018) (20)
Recently uploaded
Recently uploaded (20)
Going beyond “Sorry, I didn’t get that”: building AI assistants that scale using machine learning (PyData DC 2018)
- 1. Justina Petraityte, Developer Advocate @ Rasa Going beyond ‘Sorry, I didn’t get that’: building AI assistants that scale using machine learning
- 2. What are we focusing on during this workshop Introduction Goal: Build a machine learning - powered assistant Roadmap: 1. Natural Language Understanding i. Introduction and theory ii. Coding 2. Dialogue Handling i. Introduction and theory ii. Coding 3. Closing the feedback loop 4. Questions
- 3. Setup Introduction 1. Jupyter notebook in python 3.6 2. Download: Repository: https://github.com/RasaHQ/rasa-workshop-pydata-dc Alternative: 1. Google Colab: https://pydata.org/dc2018/proposals/43/
- 4. Conversational AI will dramatically change how your customers interact with you. Example of a live Skill: A customer can change her address via Facebook Messenger
- 5. MACHINE LEARNING-BASED DIALOGUE MANAGEMENT https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 6. Rasa the OSS to build conversational software with ML Introduction Backend, database, API, etc. Dialogue Management “Brain” Input Modules “Ears” NLU, GUI elements, context, personal info Output Modules “Mouth” NLG, GUI elements Connector Modules Connector to any conversational platforms “What’s the weather like tomorrow?” (User Request via text or voice) “It will be sunny and 20°C.” (AI response via text or voice) https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 7. Why Rasa? Introduction Runs Locally ● No Network Overhead ● Control QoS ● Deploy anywhere Hackable ● Tune models for your use case Own Your Data ● Don’t hand data over to big tech co’s ● Avoid vendor lock-in 7https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 8. Under the hood Natural Language Understanding
- 9. Rasa NLU: Natural Language Understanding Under the Hood Goal: create structured data I have a new address, it’s 709 King St, San Francisco https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 10. Natural Language Understanding Natural Language Understanding What’s the weather like tomorrow? Example Intent Classification Pipeline ”What’s the weather like tomorrow?” { “intent”: “request_weather” } Vectorization Intent Classification Under The Hood https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 11. Rasa NLU: Natural Language Understanding Under the Hood Bags are your friend Bag of words SVM greet goodbye thank_you request_weather confirm What’s the weather like tomorrow? https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 12. Rasa NLU: Natural Language Understanding Under the Hood Natural Language Understanding What’s the weather like tomorrow? Example Entity Extraction Pipeline ”What’s the weather like tomorrow?” { “date”: “tomorrow” } Tokenizer Part of Speech Tagger Chunker Named Entity Recognition Entity Extraction Example Intent Classification Pipeline ”What’s the weather like tomorrow?” { “intent”: “request_weather” } Vectorization Intent Classification https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 13. Rasa NLU: Entity Extraction Under the Hood Where can I get a burrito in the 2nd arrondissement ? cuisine location 1. Binary classifier is_entity & then entity_classifier 2. Direct structured prediction averaged perceptron https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 14. Limitation: Classifier with a single ‘correct’ label https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 15. Supervised Word Vectors (the new way) Text Classification beyond word2vec References: WSABIE (Weston, Bengio, Usunier) StarSpace (Wu et al) https://github.com/RasaHQ/rasa-workshop-pydata-dc
- 16. Let’s code!
- 17. Under the hood Dialogue Management
- 18. Why Dialogue Handling with Rasa Core? Under The Hood ● No more state machines! ● Reinforcement Learning: too much data, reward functions... ● Need a simple solution for everyone
- 19. Learn from real data instead of writing more rules
- 20. Rasa Core: Dialogue Handling Under The Hood “What’s the weather like tomorrow?” Intent Entities next ActionState previous Action “Thanks.” after next Action updated State “It will be sunny and 20°C.” SVM Recurrent NN ...
- 21. Rasa Core: Dialogue Handling Under The Hood “What’s the weather like tomorrow?” “It will be sunny and 20°C.” Entity Input Action Mask Renormal- ization Sample action Action type? Response API Call Recurrent NN API Call Entity Output Intent Classification Entity Extraction Similar to LSTM-dialogue prediction paper: https://arxiv.org/abs/1606.01269 21
- 22. Let’s code!
- 23. Rasa Core: Dialogue Training Under The Hood Issue: How to get started? Interactive Learning→ What’s the weather like tomorrow? How did you like it? Correct wrong behaviour Retrain model It will be sunny and 20°C.
- 25. Final Thoughts
- 26. Closing The Loop Final Thoughts “What’s the weather like tomorrow?” (User Request via text or voice) New Training Data Retrain ML Models Correct Training Data Relabel Collected Data Use Improved Model
- 27. Open challenges Final Thoughts ● Handling OOV words ● Multi language entity recognition ● Combination of dialogue models ● Negation We’re constantly working on improving our models! For those that are curious:
- 28. ● Techniques to handle small data sets are key to get started with conversational AI ● Deep ML techniques help advance state of the art NLU and conversational AI ● Combine ML with traditional Programming and Rules where appropriate ● Abandon flow charts Summary Final Thoughts 4 take home thoughts:
- 29. Get in touch! Justina Petraityte Developer Advocate juste@rasa.com @juste_petr Join Rasa Community!