Hybrid Intelligence
The New Paradigm
in Artificial Intelligence
@clarecorthell
Clare Corthell
thinkingmachin.es/events
Luminant Data
is a Machine Intelligence Consultancy
building more intelligent businesses
with data science strategy and
artificial intelligence technology
clare@luminantdata.com
based in San Francisco
Clare Corthell, Founder
datasciencemasters.org
The Open Source Data Science Masters
The most popular curriculum for
learning data science
Artificial Intelligence, “AI”
has massive potential to change
how we live and work
@clarecorthell
Two visions of the future
@clarecorthell
The Vision of the Internet
a huge catalog
highly structured
standardized
firstly,
@clarecorthell
the data format
the dream
@clarecorthell
The Vision of the Internet
The Web was designed as an information space, with the
goal that it should be useful not only for human-human
communication, but also that machines would be able
to participate and help. One of the major obstacles to
this has been the fact that most information on the
Web is designed for human consumption, and even if
it was derived from a database with well defined meanings
(in at least some terms) for its columns, that the structure
of the data is not evident to a robot browsing the Web.
Tim Berners-Lee, 2001

On the “Semantic Web”
@clarecorthell
The Vision of the Internet
a huge catalog
highly structured
standardized
@clarecorthell
The Vision of the Internet
a huge catalog
highly structured
standardized
Reality
a mess
@clarecorthell
The Vision of a world with Machines
secondly,
1.Machines take over all tasks
2.Humans no longer required
3.Humans Prosper.
@clarecorthell
1.Machines take over all tasks
2.Humans no longer required
3.Humans Prosper
some
stuff
The Vision of a world with Machines
Reality
@clarecorthell
So in a world
where the internet is a mess
and machines can’t do everything for us
What do we do?
@clarecorthell
Artificial Intelligence is a collection of
technologies that emulate intelligence
two specific technologies
Machine Learning uses statistics to
make educated guesses
Natural Language Processing helps
computers understand human language
@clarecorthell
Broadly stated, Machine Learning lets us
take patterns from the past and project
them going forward, sometimes allowing
us to infer what might happen, including
guess what a human might think or do
@clarecorthell
The Computer’s Limits of Understanding
those r cats! where is the cat plz
computercomputer
@clarecorthell
Machine Learning is about 75% accurate,
or maybe 90% in certain circumstances.
That’s not good enough for most products.
@clarecorthell
Computers and Humans
have very different talents
Humans
Creativity
Intuition
Choosing arbitrarily
Learning new things
Being empathic
Computers
Math
Paring down options
Repeating forever
Being fast
@clarecorthell
Neither the Computer nor the Human
is objectively better —
they just have different strengths
@clarecorthell
Given this truth
about humans and computers,
@clarecorthell
In building businesses and technologies,
we must anticipate a different future.
@clarecorthell
A New Paradigm
@clarecorthell
The Hybrid Intelligence Paradigm
(not neural nets or the superintelligence)
@clarecorthell
Leverages what humans do best
and what computers do best.
Asks humans to make judgments when the
computer is less confident —
resulting in the most accurate, trustworthy system.
The Hybrid Intelligence Paradigm
@clarecorthell
Development:Training&Test
machinelearningalgorithm
new
input prediction
Active Learning Pattern Credit:
Lukas Biewald, Crowdflower
Hybrid Intelligence Design Pattern:
Active Learning
human prediction
confident
not confident
output
human labelled “feedback” data added back into training data
Production: Prediction Production: Active Learning
@clarecorthell
Where are we seeing Hybrid AI
in applications?
@clarecorthell
Consumer Applications ArtificialAssistant
@clarecorthell
It’s simple, right?
@clarecorthell
Development:Training&Test
decisiontree
algorithm
new
request
suggested response
Hybrid Intelligence Design Pattern:
Hybrid Interaction
human validation
send
response
human labelled “feedback” data added back into training data
send
response
don’t send
response
extractentities&captureintent
structured
data
compose
new response
“I want to take the
next flight to Cebu
this afternoon.”
“I have booked you
for the 5pm flight.
Have a nice trip!”
execute task
book flight
existing
context
current time
current location
credit card
@clarecorthell
wired.com
Hybrid Intelligent Agent Systems
Hybrid Distributed
Humans
Automated
urgencyofresponse
slowfrom fully automated to fully humanfast
“Hybrid Interaction”
“Active Learning”
Siri
Duer
Cortana
Customer
Service Centers
@clarecorthell
25%75%
Human AI
The Reality for Artificial Assistants
humans deal with
everything that isn’t
an easy, known case
@clarecorthell
90%10%
Human AI
The Dream for Artificial Assistants
humans deal with
contextually tough
or new cases
@clarecorthell
Artificial Assistants don’t work very well yet.
But there’s one important thing to pay
attention to —
and it has to do with design.
@clarecorthell
Hi ,
How are you?
@clarecorthell
Anthropomorph Design
chat interaction establishes an interaction paradigm
human language establishes empathy and trust
@clarecorthell
The Hybrid AI Paradigm will change everything —
it’s already happening.
In the next customer service revolution that
leverages Hybrid Interaction,
BPOs must be ready for the boom.
@clarecorthell
Business
Process
Outsourcing
Humans will never be irrelevant.
@clarecorthell
The Most Important Point Here:
Humans are the only part of the equation
endowed with empathy
and the creativity to imagine the future.
@clarecorthell
Clare Corthell
clare@luminantdata.com
twitter @clarecorthell
Thank You!

Hybrid Intelligence: The New Paradigm

  • 1.
    Hybrid Intelligence The NewParadigm in Artificial Intelligence @clarecorthell Clare Corthell thinkingmachin.es/events
  • 2.
    Luminant Data is aMachine Intelligence Consultancy building more intelligent businesses with data science strategy and artificial intelligence technology clare@luminantdata.com based in San Francisco Clare Corthell, Founder
  • 3.
    datasciencemasters.org The Open SourceData Science Masters The most popular curriculum for learning data science
  • 4.
    Artificial Intelligence, “AI” hasmassive potential to change how we live and work @clarecorthell
  • 6.
    Two visions ofthe future @clarecorthell
  • 7.
    The Vision ofthe Internet a huge catalog highly structured standardized firstly, @clarecorthell
  • 8.
    the data format thedream @clarecorthell
  • 9.
    The Vision ofthe Internet The Web was designed as an information space, with the goal that it should be useful not only for human-human communication, but also that machines would be able to participate and help. One of the major obstacles to this has been the fact that most information on the Web is designed for human consumption, and even if it was derived from a database with well defined meanings (in at least some terms) for its columns, that the structure of the data is not evident to a robot browsing the Web. Tim Berners-Lee, 2001
 On the “Semantic Web” @clarecorthell
  • 10.
    The Vision ofthe Internet a huge catalog highly structured standardized @clarecorthell
  • 11.
    The Vision ofthe Internet a huge catalog highly structured standardized Reality a mess @clarecorthell
  • 12.
    The Vision ofa world with Machines secondly, 1.Machines take over all tasks 2.Humans no longer required 3.Humans Prosper. @clarecorthell
  • 13.
    1.Machines take overall tasks 2.Humans no longer required 3.Humans Prosper some stuff The Vision of a world with Machines Reality @clarecorthell
  • 14.
    So in aworld where the internet is a mess and machines can’t do everything for us What do we do? @clarecorthell
  • 15.
    Artificial Intelligence isa collection of technologies that emulate intelligence two specific technologies Machine Learning uses statistics to make educated guesses Natural Language Processing helps computers understand human language @clarecorthell
  • 16.
    Broadly stated, MachineLearning lets us take patterns from the past and project them going forward, sometimes allowing us to infer what might happen, including guess what a human might think or do @clarecorthell
  • 17.
    The Computer’s Limitsof Understanding those r cats! where is the cat plz computercomputer @clarecorthell
  • 18.
    Machine Learning isabout 75% accurate, or maybe 90% in certain circumstances. That’s not good enough for most products. @clarecorthell
  • 19.
    Computers and Humans havevery different talents Humans Creativity Intuition Choosing arbitrarily Learning new things Being empathic Computers Math Paring down options Repeating forever Being fast @clarecorthell
  • 20.
    Neither the Computernor the Human is objectively better — they just have different strengths @clarecorthell
  • 21.
    Given this truth abouthumans and computers, @clarecorthell
  • 22.
    In building businessesand technologies, we must anticipate a different future. @clarecorthell
  • 23.
  • 24.
    The Hybrid IntelligenceParadigm (not neural nets or the superintelligence) @clarecorthell
  • 25.
    Leverages what humansdo best and what computers do best. Asks humans to make judgments when the computer is less confident — resulting in the most accurate, trustworthy system. The Hybrid Intelligence Paradigm @clarecorthell
  • 26.
    Development:Training&Test machinelearningalgorithm new input prediction Active LearningPattern Credit: Lukas Biewald, Crowdflower Hybrid Intelligence Design Pattern: Active Learning human prediction confident not confident output human labelled “feedback” data added back into training data Production: Prediction Production: Active Learning @clarecorthell
  • 27.
    Where are weseeing Hybrid AI in applications? @clarecorthell
  • 28.
  • 29.
  • 30.
    Development:Training&Test decisiontree algorithm new request suggested response Hybrid IntelligenceDesign Pattern: Hybrid Interaction human validation send response human labelled “feedback” data added back into training data send response don’t send response extractentities&captureintent structured data compose new response “I want to take the next flight to Cebu this afternoon.” “I have booked you for the 5pm flight. Have a nice trip!” execute task book flight existing context current time current location credit card @clarecorthell
  • 31.
  • 32.
    Hybrid Intelligent AgentSystems Hybrid Distributed Humans Automated urgencyofresponse slowfrom fully automated to fully humanfast “Hybrid Interaction” “Active Learning” Siri Duer Cortana Customer Service Centers @clarecorthell
  • 33.
    25%75% Human AI The Realityfor Artificial Assistants humans deal with everything that isn’t an easy, known case @clarecorthell
  • 34.
    90%10% Human AI The Dreamfor Artificial Assistants humans deal with contextually tough or new cases @clarecorthell
  • 35.
    Artificial Assistants don’twork very well yet. But there’s one important thing to pay attention to — and it has to do with design. @clarecorthell
  • 36.
    Hi , How areyou? @clarecorthell
  • 37.
    Anthropomorph Design chat interactionestablishes an interaction paradigm human language establishes empathy and trust @clarecorthell
  • 38.
    The Hybrid AIParadigm will change everything — it’s already happening. In the next customer service revolution that leverages Hybrid Interaction, BPOs must be ready for the boom. @clarecorthell Business Process Outsourcing
  • 39.
    Humans will neverbe irrelevant. @clarecorthell The Most Important Point Here:
  • 40.
    Humans are theonly part of the equation endowed with empathy and the creativity to imagine the future. @clarecorthell
  • 41.