SlideShare a Scribd company logo
1 of 10
Download to read offline
Empowering Conversational Agents with Situated Natural Language
Communication Skills by Exploiting Deep Reinforcement Learning
Techniques
Alessandro Suglia
Heriot-Watt University, Edinburgh Centre for
Robotics, Edinburgh, Scotland, UK
D o c t o ra l C o n s o r t i u m A I * I A 2 0 1 7 , B a r i
Supervisor: Prof. Oliver Lemon
Director of the Interaction Lab,
Heriot-Watt University
Dynamic Temporal Contextualized
The answer provided
by one of the
interlocutor affects
the state of the
dialogue
What is dialogue?
The interpretation of
each utterance
depends incredibly on
different environment
conditions
Different topics are
discussed in a given
conversation without
a specific order
[1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology
for dialogue management and natural language generation. Springer Science & Business Media, 2011.
Goal-directed learning from interaction with an
environment by learning to map situations to actions
by exploiting Deep Neural Networks models
Deep Reinforcement Learning
Deep Reinforcement Learning
Successfully applied to different games such as Go [2] or Poker [3]
Incrementally abstract representations learned from training data
Learning to behave by interacting with the environment
Learning in an incremental and online fashion
Inability to generalise due to the domain specific design
Handsome quantity of data required to effectively learn a policy
[2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I.,
Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature
529(7587) (2016) 484–489
[3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv:
1701.01724 (2017).
RQ1 : Is it possible to train a conversational agent to interact
within real world contexts consisting of embodied agents and
situated objects?
RQ2: Is it possible to train a conversational agent to generate
accurate contextualized responses for the user?
RQ3: Is the system able to adapt seemly to different domains by
exploiting what it has previously learned?
Natural Language
interaction
Multi-modal
interaction
Agent
embodiment
Thanks!
You can find me at the poster session
@ale_suglia
as247@hw.ac.uk
Any questions?
References
[1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven
methodology for dialogue management and natural language generation. Springer Science &
Business Media, 2011.
[2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J.,
Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural
networks and tree search. Nature 529(7587) (2016) 484–489
[3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv
preprint arXiv:1701.01724 (2017).

More Related Content

Similar to Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques

Engineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsEngineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsMichael Vallance
 
No.257 miaomiao ding-erc poster
No.257  miaomiao ding-erc posterNo.257  miaomiao ding-erc poster
No.257 miaomiao ding-erc poster苗苗 丁
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processingpunedevscom
 
11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...Alexander Decker
 
Language and Intelligence
Language and IntelligenceLanguage and Intelligence
Language and Intelligencebutest
 
Rise of AI through DL
Rise of AI through DLRise of AI through DL
Rise of AI through DLRehan Guha
 
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardDo We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardHumanity Plus
 
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela
 
An Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingAn Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingScott Faria
 
how humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languagehow humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languageEstefy Feijoo
 
David Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismDavid Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismPilar Torres
 
Russian english workshop world-call2013
Russian english workshop world-call2013Russian english workshop world-call2013
Russian english workshop world-call2013Konstantin Shestakov
 
Teoria suunnittelu a_otvt
Teoria suunnittelu a_otvtTeoria suunnittelu a_otvt
Teoria suunnittelu a_otvtJari Laru
 
A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...Scott Bou
 
A Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationA Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationIOSR Journals
 
Eurocall 2011, Nottingham
Eurocall 2011, NottinghamEurocall 2011, Nottingham
Eurocall 2011, Nottinghamelinatapio
 
CLaSIC 2016 presentation
CLaSIC 2016 presentationCLaSIC 2016 presentation
CLaSIC 2016 presentationTakeshi Sato
 
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...paperpublications3
 

Similar to Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques (20)

Engineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsEngineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worlds
 
No.257 miaomiao ding-erc poster
No.257  miaomiao ding-erc posterNo.257  miaomiao ding-erc poster
No.257 miaomiao ding-erc poster
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...
 
Language and Intelligence
Language and IntelligenceLanguage and Intelligence
Language and Intelligence
 
Rise of AI through DL
Rise of AI through DLRise of AI through DL
Rise of AI through DL
 
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardDo We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
 
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
 
An Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingAn Overview Of Natural Language Processing
An Overview Of Natural Language Processing
 
SLALS526_MUVEs
SLALS526_MUVEsSLALS526_MUVEs
SLALS526_MUVEs
 
how humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languagehow humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign language
 
David Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismDavid Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualism
 
Russian english workshop world-call2013
Russian english workshop world-call2013Russian english workshop world-call2013
Russian english workshop world-call2013
 
Teoria suunnittelu a_otvt
Teoria suunnittelu a_otvtTeoria suunnittelu a_otvt
Teoria suunnittelu a_otvt
 
A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...
 
A Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationA Survey on Word Sense Disambiguation
A Survey on Word Sense Disambiguation
 
Eurocall 2011, Nottingham
Eurocall 2011, NottinghamEurocall 2011, Nottingham
Eurocall 2011, Nottingham
 
CLaSIC 2016 presentation
CLaSIC 2016 presentationCLaSIC 2016 presentation
CLaSIC 2016 presentation
 
Using ontology for natural language processing
Using ontology for natural language processingUsing ontology for natural language processing
Using ontology for natural language processing
 
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
 

Recently uploaded

办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一F La
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理e4aez8ss
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...ThinkInnovation
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptx
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptxAmazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptx
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptxAbdelrhman abooda
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998YohFuh
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 

Recently uploaded (20)

办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptx
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptxAmazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptx
Amazon TQM (2) Amazon TQM (2)Amazon TQM (2).pptx
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 

Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques

  • 1. Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques Alessandro Suglia Heriot-Watt University, Edinburgh Centre for Robotics, Edinburgh, Scotland, UK D o c t o ra l C o n s o r t i u m A I * I A 2 0 1 7 , B a r i Supervisor: Prof. Oliver Lemon Director of the Interaction Lab, Heriot-Watt University
  • 2. Dynamic Temporal Contextualized The answer provided by one of the interlocutor affects the state of the dialogue What is dialogue? The interpretation of each utterance depends incredibly on different environment conditions Different topics are discussed in a given conversation without a specific order [1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology for dialogue management and natural language generation. Springer Science & Business Media, 2011.
  • 3. Goal-directed learning from interaction with an environment by learning to map situations to actions by exploiting Deep Neural Networks models Deep Reinforcement Learning
  • 4. Deep Reinforcement Learning Successfully applied to different games such as Go [2] or Poker [3] Incrementally abstract representations learned from training data Learning to behave by interacting with the environment Learning in an incremental and online fashion Inability to generalise due to the domain specific design Handsome quantity of data required to effectively learn a policy [2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature 529(7587) (2016) 484–489 [3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv: 1701.01724 (2017).
  • 5. RQ1 : Is it possible to train a conversational agent to interact within real world contexts consisting of embodied agents and situated objects?
  • 6. RQ2: Is it possible to train a conversational agent to generate accurate contextualized responses for the user?
  • 7. RQ3: Is the system able to adapt seemly to different domains by exploiting what it has previously learned?
  • 9. Thanks! You can find me at the poster session @ale_suglia as247@hw.ac.uk Any questions?
  • 10. References [1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology for dialogue management and natural language generation. Springer Science & Business Media, 2011. [2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature 529(7587) (2016) 484–489 [3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv:1701.01724 (2017).