Voice assistants and chatbots automation

•Download as PPTX, PDF•

0 likes•818 views

Sergey Korol

Selenium Camp 2019 talk's slides

Education

VOICE ASSISTANTS AND
CHATBOTS AUTOMATION

AQA Geek and Java fan.
Consultant, speaker and
open-source contributor.
• Technical QA Manager
• Consultant: http://sdclabs.com
• GitHub contributor: sskorol
Speaker’s info
• Email: serhii.s.korol@gmail.com
• Twitter: @ss_korol
Contacts
Sergey Korol
Waverley Software
‘‘
2
WHO AM I?

3
3
VOICE ASSISTANTS / CHATBOTS
No long talks No long messages
No AI

4
4
GOOGLE VS AWS
AoG
Dialogflow LambdaGFunction LEX
Alexa Skill

8
• Agent
• Intent
• Utterance
• Context
• Parameter
Terminology

9
• Local environment
• Functions’ debugging
• Agent sharing
• Service-specific restrictions
• Voice-specific issues
DEVELOPMENT CHALLENGES

11
• Local environment
• Repeatability
• Test data
• Voice flow
AUTOMATION CHALLENGES

13
• Bespoken
• Jovo
• Botium
• Platform-specific REST
clients
EXISTING TOOLS

14
SO WHAT WE CAN AUTOMATE?
• Individual intents
• REST API
• E2E chatbot flow

16
APPLICATION UNDER TEST
Hi, how can I
assist?
Hey Google

18
WEB CHATBOT TESTING
Dialogflow
Cloud
Dev account
Laptop
Docker images

19
19
Similar AQA
tools
Different TC format
Verification for
each step
Utterance-driven flow
WEB CHATBOT TESTING
Repeatability
challenges

21
21
VOICE FLOW E2E TESTING
Cloud
STT / TTS
Synthetize speech
Play speech
Record response
Transform speech to text
Laptop

22
22
Depends on cloud
services
Requires TTS / STT
wrapper creation
Requires noiseless
environment
Complicated flow
VOICE FLOW E2E TESTING

23
WHAT’S NEXT?
• Collect data and integrate ML
• Apply NLP to improve context
understanding logic
• Explore less restrictive tools for
building smart assistants
• Polish and release new AQA tools for
better voice flow coverage

24
CONCLUSION
• AI is farther than we expected
• Overall dialog-based projects’
complexity reflects the global
situation in the nearest future
• Test automation requires additional
skills and effort

What's hot

Serverless ArchitectureLena Barinova

CI/CD and Asset Serving for Single Page AppsMike North

From Heroku to Amazon AWSSebastian Schleicher

Practical Application of API-First in microservices developmentChavdar Baikov

Automating everything with Microsoft FlowJaap Brasser

Practical Continuous Deployment - Atlassian - London AUG 18 Feb 2014Matthew Cobby

GAB 2017 - Logic Apps and Azure FunctionsWagner Silveira

Automate it with Azure FunctionsJaap Brasser

SOA Latam 2015Domingo Suarez Torres

Serverless AzureMark Allan

Avoiding integration hellaaronbassett

User-percieved performanceMike North

Logic appsforbeginnersMandar Dharmadhikari

Automate everything with PowerShellJaap Brasser

Lessons learned: Choosing your documentation systemPronovix

Office Development Licensing, Deployment and ALMEric Shupps

Introduction to Azure Functions - TutorialBizTalk360

Developing SharePoint Framework Solutions for the Enterprise - SEF 2019Eric Shupps

How to audit Drupal Sites for performance, content and best practicesJon Peck

Redundant devopsSzabolcs Szabolcsi-Tóth

What's hot (20)

Serverless Architecture

CI/CD and Asset Serving for Single Page Apps

From Heroku to Amazon AWS

Practical Application of API-First in microservices development

Automating everything with Microsoft Flow

Practical Continuous Deployment - Atlassian - London AUG 18 Feb 2014

GAB 2017 - Logic Apps and Azure Functions

Automate it with Azure Functions

SOA Latam 2015

Serverless Azure

Avoiding integration hell

User-percieved performance

Logic appsforbeginners

Automate everything with PowerShell

Lessons learned: Choosing your documentation system

Office Development Licensing, Deployment and ALM

Introduction to Azure Functions - Tutorial

Developing SharePoint Framework Solutions for the Enterprise - SEF 2019

How to audit Drupal Sites for performance, content and best practices

Redundant devops

Similar to Voice assistants and chatbots automation

Scaling with swaggerTony Tam

How to run a global, cloud scale event for 10.000 peopleRobBos10

Delivering Developer Tools at ScaleOracle Developers

Swagger: Restful documentation that won't put you to sleepTobias Coetzee

Serialization and performance by Sergey MorenetsAlex Tumanoff

How does Java 8 exert hidden power on Test Automation?Sergey Korol

Planidoo & ZotonicDavid de Boer

Episode 9 - Building soap integrations in salesforceJitendra Zaa

Into The Box 2023 Keynote Day 1Ortus Solutions, Corp

Polyglot GrailsMarcin Gryszko

Dev ops lessons learned - Michael CollinsDevopsdays

APIs distribuidos con alta escalabilidadSoftware Guru

SGCE 2015 REST APIsDomingo Suarez Torres

Serverless Appsjoehack3r

Communication tool & Environment for Remote WorkerShotaro Sakamaki

Docker Hub Breakout Session at DockerCon by Ken CochraneDocker, Inc.

Clojurescript slideselliando dias

How and Why you can and should Participate in Open Source Projects (AMIS, Sof...Lucas Jellema

Java EE 7 Soup to Nuts at JavaOne 2014Arun Gupta

Have I Been Pwned and CloudflareStefnJkullSigurarson1

Similar to Voice assistants and chatbots automation (20)

Scaling with swagger

How to run a global, cloud scale event for 10.000 people

Delivering Developer Tools at Scale

Swagger: Restful documentation that won't put you to sleep

Serialization and performance by Sergey Morenets

How does Java 8 exert hidden power on Test Automation?

Planidoo & Zotonic

Episode 9 - Building soap integrations in salesforce

Into The Box 2023 Keynote Day 1

Polyglot Grails

Dev ops lessons learned - Michael Collins

APIs distribuidos con alta escalabilidad

SGCE 2015 REST APIs

Serverless Apps

Communication tool & Environment for Remote Worker

Docker Hub Breakout Session at DockerCon by Ken Cochrane

Clojurescript slides

How and Why you can and should Participate in Open Source Projects (AMIS, Sof...

Java EE 7 Soup to Nuts at JavaOne 2014

Have I Been Pwned and Cloudflare

Recently uploaded

The basics of sentences session 2pptx copy.pptxheathfieldcps1

Presiding Officer Training module 2024 lok sabha electionsanshu789521

Mastering the Unannounced Regulatory InspectionSafetyChain Software

Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle

Crayon Activity Handout For the Crayon AUnboundStockton

How to Configure Email Server in Odoo 17Celine George

Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy

Interactive Powerpoint_How to Master effective communicationnomboosow

“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr

call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR

Accessible design: Minimum effort, maximum impactdawncurless

Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝9953056974 Low Rate Call Girls In Saket, Delhi NCR

Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton

Código Creativo y Arte de Software | Unidad 1Maestría en Comunicación Digital Interactiva - UNR

18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a

_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon

KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...M56BOOKSTORE PRODUCT/SERVICE

9953330565 Low Rate Call Girls In Rohini Delhi NCR9953056974 Low Rate Call Girls In Saket, Delhi NCR

A Critique of the Proposed National Education Policy ReformChameera Dedduwage

Recently uploaded (20)

The basics of sentences session 2pptx copy.pptx

Presiding Officer Training module 2024 lok sabha elections

Mastering the Unannounced Regulatory Inspection

Hybridoma Technology ( Production , Purification , and Application )

Crayon Activity Handout For the Crayon A

How to Configure Email Server in Odoo 17

Call Girls in Dwarka Mor Delhi Contact Us 9654467111

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf

Interactive Powerpoint_How to Master effective communication

“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...

call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️

Accessible design: Minimum effort, maximum impact

Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝

Science 7 - LAND and SEA BREEZE and its Characteristics

Código Creativo y Arte de Software | Unidad 1

18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf

_Math 4-Q4 Week 5.pptx Steps in Collecting Data

KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...

9953330565 Low Rate Call Girls In Rohini Delhi NCR

A Critique of the Proposed National Education Policy Reform

Voice assistants and chatbots automation

1. VOICE ASSISTANTS AND CHATBOTS AUTOMATION

2. AQA Geek and Java fan. Consultant, speaker and open-source contributor. • Technical QA Manager • Consultant: http://sdclabs.com • GitHub contributor: sskorol Speaker’s info • Email: serhii.s.korol@gmail.com • Twitter: @ss_korol Contacts Sergey Korol Waverley Software ‘‘ 2 WHO AM I?

3. 3 3 VOICE ASSISTANTS / CHATBOTS No long talks No long messages No AI

4. 4 4 GOOGLE VS AWS AoG Dialogflow LambdaGFunction LEX Alexa Skill

5. 5 4

6. 6 6 THE DEVIL IS IN DETAILS

7. 7 7 REAL-TIME TRANSCRIPTION

8. 8 • Agent • Intent • Utterance • Context • Parameter Terminology

9. 9 • Local environment • Functions’ debugging • Agent sharing • Service-specific restrictions • Voice-specific issues DEVELOPMENT CHALLENGES

10. 11

11. 11 • Local environment • Repeatability • Test data • Voice flow AUTOMATION CHALLENGES

12. WTF SHOULD I DO WITH THAT? 12

13. 13 • Bespoken • Jovo • Botium • Platform-specific REST clients EXISTING TOOLS

14. 14 SO WHAT WE CAN AUTOMATE? • Individual intents • REST API • E2E chatbot flow

15. 15 WHAT ABOUT VOICE FLOW?

16. 16 APPLICATION UNDER TEST Hi, how can I assist? Hey Google

17. 17 WEB CHATBOT TESTING

18. 18 WEB CHATBOT TESTING Dialogflow Cloud Dev account Laptop Docker images

19. 19 19 Similar AQA tools Different TC format Verification for each step Utterance-driven flow WEB CHATBOT TESTING Repeatability challenges

20. 20 20 VOICE FLOW E2E TESTING

21. 21 21 VOICE FLOW E2E TESTING Cloud STT / TTS Synthetize speech Play speech Record response Transform speech to text Laptop

22. 22 22 Depends on cloud services Requires TTS / STT wrapper creation Requires noiseless environment Complicated flow VOICE FLOW E2E TESTING

23. 23 WHAT’S NEXT? • Collect data and integrate ML • Apply NLP to improve context understanding logic • Explore less restrictive tools for building smart assistants • Polish and release new AQA tools for better voice flow coverage

24. 24 CONCLUSION • AI is farther than we expected • Overall dialog-based projects’ complexity reflects the global situation in the nearest future • Test automation requires additional skills and effort

25. FIND OUT MORE LinksAuthor 25

Voice assistants and chatbots automation

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Voice assistants and chatbots automation

Similar to Voice assistants and chatbots automation (20)

Recently uploaded

Recently uploaded (20)

Voice assistants and chatbots automation