Talk at Mailup Marketing Conference 2018 https://marketingconference.mailup.it

1. Giuseppe Rizzo @giusepperizzo
Understand, Answer and Argument:
Conversational Agents
30 NOVEMBRE 2018

2. #MMC18
CAN ROBOTS
INVENT THEIR
OWN
LANGUAGE?
“The Talking Heads
Experiment, conducted in
the years 1999-2001, was
the first large-scale
experiment in which open
populations of situated
embodied agents created
for the first time ever a new
shared vocabulary by
playing language games
about real world scenes in
front of them.”

3. https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html
TOWARDS
A REAL
CONVERSATION
#MMC18

4. ASSISTANT
ADVISOR
AGENT
“Turn on the lights in the living room”
“Breathe deeply and relax your diaphragm”
“Hi, I’m calling to book a haircut for a
client ...”
TAXONOMY
OF
INTELLIGENT
SYSTEMS
“I had a lot of coughs last night”
“Sure, lights are on”
“Hi, sure! day and time?
“...”
#MMC18

5. ● Understand our commands
● Perform actions
● Provide actionable answers or
filter the information we’re
looking for ASSISTANT
bicam
eral
self-interest
explain
&
im
provise
e.g. “Turning on the lights” or
“Increase the temperature in the kitchen” knowledge
#MMC18

6. UNDERSTANDING
AND
ESTABLISHING
INTERACTIONS IN
NATURAL
LANGUAGE
THROUGH
CLASSIFICATIONS
Will be looking for a restaurant reachable in 10 minutes
on foot from the Madison Square Garden
INTENT TIME EXPRESSION
PLACE
TRANSPORTATION MEAN
CONTEXTUAL KNOWLEDGE utilized
to train our algorithm (hybrid machine
learning and graph-based) to
recognize entities and classify intents
#MMC18

7. AND
RESOLVING
AMBIGUITIES
(IF ANY)
CONTEXTUAL KNOWLEDGE utilized to
train our algorithm (hybrid machine
learning and graph-based) to
disambiguate concepts #MMC18

8. ADVISOR
e.g. “Take a deep breath” or
“Take 15 minutes of meditations to
reduce the symptoms of your asthma”
● Recommend a set of actions
● Provide tailored information
knowing person and context
bicam
eral
self-interest
explain
&
im
provise
knowledge
#MMC18

9. RECOMMENDING
EXPERIENCES
BEING “AWARE”
OF PERSON’S
SCHEDULE AND
PLACE
“There is a nice Jazz concert next to
your hotel. The concert starts at 10PM,
you have time for dinner.”
“Cool! Find me a good spot.”
#MMC18
“...”

10. PERSONAL
AND
CONTEXTUAL
KNOWLEDGE
FEEL
CONTEXTUAL
KNOWLEDGE
IDENTIFY
INTERACT
PERSONAL
KNOWLEDGE
PERSONAL & CONTEXTUAL KNOWLEDGE
utilized to train our algorithms that generate
recommendations
#MMC18

11. FLOW OF
“REASONINGS”Giuseppe is an INTJ person and has liked cozy
restaurants and live jazz music in the past. He’s
tight time constraint, thus let’s recommend him
a restaurant where he wishes to go …
Morimoto japanese, that’s it!
#MMC18
“Cool! Find me a good spot.”
...

12. AGENT
● Decide autonomously taking
decisions that can make an
impact to people and agents
● Explain what they understand
● Go beyond what they have
already seen
e.g. “Reroute vehicles on different
highways” or
“Hold a debate” or
“Make us a surprise”
bicam
eral
self-interest
explain &
improvise
knowledge
#MMC18

13. HOLDING A
CONVERSATION
WITH A HUMAN
Google Duplex at Google IO 2018
#MMC18

14. EXPLAIN
UNDERSTANDING
“Get the dishes from the dining room”
INTENT OF TAKING MAPPED TO A VERB AND SALIENCY SCORE
WITH LEXICAL UNITS
#MMC18

15. GENERATING
TEXT NEVER
SEEN BEFORE
“cat”
“toilet”
“a black cat is
inside a white
toilet”
#MMC18

16. “TOWARDS THE MAKING OF
CONVERSATIONAL AGENTS ABLE TO
EXPLAIN AND IMPROVISE IN A
NATURAL FASHION”
Giuseppe Rizzo
@giusepperizzo
https://www.slideshare.net/giusepperizzo
Senior Data Scientist @ ISMB
Research Fellow @ LINKS Foundation
#MMC18