SlideShare a Scribd company logo
The Interplay of Machines and Humans:
State of the Art and a Research Agenda for
Hybrid Intelligence
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Before we start…
… we should get to know each other
Please tell us about…
… who you are
… your background
… your research
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Hybrid Intelligence
Artificial Intelligence
DEFINITION
“Human intelligence
exhibited by machines”
SOME
EXAMPLES
OF AI
Machine Learning
DEFINITION
“A computer program is said to learn from
experience E with respect to some class of tasks T
and performance measure P if its performance at
tasks in T, as measured by P, improves with
experience E”
No Supervision is Dangerous…
No Supervision is Dangerous…
No Supervision is Dangerous…
HUMAN INTELLIGENCE
MACHINE INTELLIGENCE
Consistency
Speed and
Efficiency
Pattern
Recognition
Hard
Information
and
Analytical
Flexibility and
Transfer
Creativity and
Empathy
Various Data
Types and
Intuition
Bias and
Heuristics
HYBRID INTELLIGENCE SYSTEMS
Hybrid Intelligence
DEFINITION
“the ability to accomplish complex goals by
combining human and artificial intelligence to
collectively achieve superior results and
continuously improve by learning from each other..”
(Dellermann et al. forthcoming)
Tasks for Humans Augmenting AI
USING HUMANS IN THE LOOP
Feature Generation
Tasks for Humans Augmenting AI
USING HUMANS IN THE LOOP
Feature Generation
Teaching
Is this a lie?
Tasks for Humans Augmenting AI
USING HUMANS IN THE LOOP
Feature Generation
Teaching
Troubleshooting
OUR
LEARNING
SO FAR…
KNOWLEDGE
EXTRACTION AND
AGGREGATION
INCENTIVES AND
BUSINESS
INTEGRATION
INTERPRETABILITY/
TRANSPARENCY
TRUST
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
ANALYSING CULTURAL INFLUENCE IN THE
USAGE OF RECOMMENDATION AGENTS
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Platzhalter Vortrag 2
Break – 30min
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
INTERVENING INTERACTION - AN APPROACH
FOR THE EVOLUTION OF HIGHLY EFFICIENT
HYBRID SYSTEMS
MEASURING SOCIAL TOLERANCE AND SOCIAL
ACCEPTABILITY IN HYBRID TEAM
COLLABORATION
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 2
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
WHAT TYPES OF PROBLEMS CAN BE SOLVED
THROUGH HYBRID INTELLIGENCE?
COMPLEX PROBLEMS
Require Domain Knowledge
Require Empathy or Creativity
Dynamic
No Ground Truth
Require Gut Feeling Stochastic
Time Variant
INTUITION
„A nonconscious, holistic processing mode in which judgments are made
2 FORMS OF INTUITION
INTUITIVE
INSIGHT
INTUITIVE
JUDGEMENT
BAYES ERROR?
Human
Experienced
Doctor
Group of
Experienced
Doctors
~10% ~5% ~1%
$$$$
DESIGNING A HYBRID INTELLIGENCE
SYSTEM THAT HAS A BETTER
INTUITION THAN THE BEST GROUP OF
EXPERTS
HYBRID INTELLIGENCE
teaching intuition
teaching intuition
INTUITION MACHINE ARCHITECTURE
PREDICTION
EXPERT CROWD
LEARNER
GENERATIVE ENTITY
Reward
Generation Match for Labels
Weigh Labels
DESIGN PRINCIPLES
1. Cognitive Feedback on Consistency
2. Social Feedback from Peers
3. Interpretable Machine Feedback
4. Expertise Matching
5. Generative Aggregation
6. Heuristic and Judgement
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Platzhalter Vortrag 2
Break – 60min
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Towards a Research Agenda
on Hybrid Intelligence
Top 1 – Applications
Which technological applications will affect the interaction
between humans and AI in the near future?
Which technological applications will be most relevant for the
design of interactions between humans and AI in the near
future?
Top 2 - Research Questions
Which research questions do arise when examining human-
AI-interaction in the identified settings?
Top 3 - Research Streams
Is it possible to identify common research streams within the
identified research questions??
Agenda
Time Top
09:00 – 09:30 Get-together and Introduction
09:30 – 09:45 A short intro to Hybrid Intelligence
09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations
10:30 – 10:50 Coffee Break
11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations
12:30 – 13:00 Hybrid Intelligence in Practice
13:00 – 14:00 Lunch Break
14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda
15.15 – 15:30 Closing
15:30 – 16:00 Coffee/Tea
Announcement 1
-
WAIM Research Network
WAIM Research Network
• WAIM - Work in the Age of Intelligent Machines
• Funded by the US National Science Foundation to coordinate
research on the human-technology frontier (NSF 17–45463)
• Co-PIs Kevin Crowston, Ingrid Erickson and Jeffrey Nickerson
• Goal: Build a network of interested researchers to facilitate
“disciplinary convergence” to address the topic
• Disciplinary convergence (an NSF ”big idea”)
• Research driven by a specific and compelling problem (work and intelligent
machines)
• Deep integration across disciplines by developing common frameworks and
new scientific language
WAIM Research Network
• Activities
• Workshops at Academy of Management, HICSS, ECIS and others
• Annual conference (1st held at Michigan State University in May 2018)
• Infrastructure: https://waim.network/, listserv, @WAIMRCN on Twitter
• How we’ll know it’s a success
• The network facilitates joint projects that build convergence
• A network’s strength is its members, so join today!
• https://waim.network/join
• https://waim.network/listserv
The Interplay of Machines and Humans:
State of the Art and a Research Agenda for
Hybrid Intelligence

More Related Content

Similar to Hybrid Intelligence: Introducing a New Paradigm to Solve Complex Problems

LSN Triple Science workshop
LSN Triple Science workshopLSN Triple Science workshop
LSN Triple Science workshop
Dannno
 
2012 call to conference
2012 call to conference2012 call to conference
2012 call to conference
Wagener-Salley HS
 
Writing Scientific Research Papers
Writing Scientific Research PapersWriting Scientific Research Papers
Writing Scientific Research Papers
Jan Recker @ University of Hamburg
 
Paper presentations2
Paper presentations2Paper presentations2
Paper presentations2
Cristina Sarasua
 
Berlitz Online Live Seminars
Berlitz Online Live SeminarsBerlitz Online Live Seminars
Berlitz Online Live Seminars
berlitzpraha
 
2010 HR Florida Brochure
2010 HR Florida Brochure2010 HR Florida Brochure
2010 HR Florida Brochure
HR Florida State Council, Inc.
 
User Group Meeting Programme
User Group Meeting ProgrammeUser Group Meeting Programme
User Group Meeting Programmenix1
 
Accessible Elections Design Workshop
Accessible Elections Design WorkshopAccessible Elections Design Workshop
Accessible Elections Design Workshop
briandnewby
 
Agenda
AgendaAgenda
Agendancook
 
Next Generation of Government Summit - Official 2011 Program
Next Generation of Government Summit - Official 2011 ProgramNext Generation of Government Summit - Official 2011 Program
Next Generation of Government Summit - Official 2011 Program
GovLoop
 
SCASL 2011 Conference Program
SCASL 2011 Conference ProgramSCASL 2011 Conference Program
SCASL 2011 Conference ProgramWagener-Salley HS
 
Cccm 2010
Cccm 2010Cccm 2010
Cccm 2010mscs12
 
Design as a Change Agent in Care - 2021 presentation
Design as a Change Agent in Care - 2021 presentation Design as a Change Agent in Care - 2021 presentation
Design as a Change Agent in Care - 2021 presentation
QUT
 
IPC10 Presentation: Integral Permaculture Curriculum
IPC10 Presentation: Integral Permaculture CurriculumIPC10 Presentation: Integral Permaculture Curriculum
IPC10 Presentation: Integral Permaculture Curriculum
Academia de Permacultura Integral
 
110614 self management conf programme
110614   self management conf programme110614   self management conf programme
110614 self management conf programme
University of the Highlands and Islands
 

Similar to Hybrid Intelligence: Introducing a New Paradigm to Solve Complex Problems (20)

LSN Triple Science workshop
LSN Triple Science workshopLSN Triple Science workshop
LSN Triple Science workshop
 
QRCA 2011 Conference
QRCA 2011 ConferenceQRCA 2011 Conference
QRCA 2011 Conference
 
2012 call to conference
2012 call to conference2012 call to conference
2012 call to conference
 
Writing Scientific Research Papers
Writing Scientific Research PapersWriting Scientific Research Papers
Writing Scientific Research Papers
 
Blueprint for Organizing Foresight in Universities - Schedule
Blueprint for Organizing Foresight in Universities - ScheduleBlueprint for Organizing Foresight in Universities - Schedule
Blueprint for Organizing Foresight in Universities - Schedule
 
Paper presentations2
Paper presentations2Paper presentations2
Paper presentations2
 
Berlitz Online Live Seminars
Berlitz Online Live SeminarsBerlitz Online Live Seminars
Berlitz Online Live Seminars
 
2010 HR Florida Brochure
2010 HR Florida Brochure2010 HR Florida Brochure
2010 HR Florida Brochure
 
User Group Meeting Programme
User Group Meeting ProgrammeUser Group Meeting Programme
User Group Meeting Programme
 
Accessible Elections Design Workshop
Accessible Elections Design WorkshopAccessible Elections Design Workshop
Accessible Elections Design Workshop
 
Agenda
AgendaAgenda
Agenda
 
Women's Forum Global Meeting Program as of 12 March
Women's Forum Global Meeting Program as of 12 MarchWomen's Forum Global Meeting Program as of 12 March
Women's Forum Global Meeting Program as of 12 March
 
Next Generation of Government Summit - Official 2011 Program
Next Generation of Government Summit - Official 2011 ProgramNext Generation of Government Summit - Official 2011 Program
Next Generation of Government Summit - Official 2011 Program
 
SCASL 2011 Conference Program
SCASL 2011 Conference ProgramSCASL 2011 Conference Program
SCASL 2011 Conference Program
 
Collaborative Methods for Foresight - Agenda
Collaborative Methods for Foresight - AgendaCollaborative Methods for Foresight - Agenda
Collaborative Methods for Foresight - Agenda
 
Cccm 2010
Cccm 2010Cccm 2010
Cccm 2010
 
Thesis - E Papadopoulou
Thesis - E PapadopoulouThesis - E Papadopoulou
Thesis - E Papadopoulou
 
Design as a Change Agent in Care - 2021 presentation
Design as a Change Agent in Care - 2021 presentation Design as a Change Agent in Care - 2021 presentation
Design as a Change Agent in Care - 2021 presentation
 
IPC10 Presentation: Integral Permaculture Curriculum
IPC10 Presentation: Integral Permaculture CurriculumIPC10 Presentation: Integral Permaculture Curriculum
IPC10 Presentation: Integral Permaculture Curriculum
 
110614 self management conf programme
110614   self management conf programme110614   self management conf programme
110614 self management conf programme
 

Recently uploaded

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 

Recently uploaded (20)

How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 

Hybrid Intelligence: Introducing a New Paradigm to Solve Complex Problems

  • 1. The Interplay of Machines and Humans: State of the Art and a Research Agenda for Hybrid Intelligence
  • 2. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 3. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 4. Before we start… … we should get to know each other
  • 5. Please tell us about… … who you are … your background … your research
  • 6. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 10. Machine Learning DEFINITION “A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E”
  • 11. No Supervision is Dangerous…
  • 12. No Supervision is Dangerous…
  • 13. No Supervision is Dangerous…
  • 14. HUMAN INTELLIGENCE MACHINE INTELLIGENCE Consistency Speed and Efficiency Pattern Recognition Hard Information and Analytical Flexibility and Transfer Creativity and Empathy Various Data Types and Intuition Bias and Heuristics
  • 16. Hybrid Intelligence DEFINITION “the ability to accomplish complex goals by combining human and artificial intelligence to collectively achieve superior results and continuously improve by learning from each other..” (Dellermann et al. forthcoming)
  • 17. Tasks for Humans Augmenting AI USING HUMANS IN THE LOOP Feature Generation
  • 18. Tasks for Humans Augmenting AI USING HUMANS IN THE LOOP Feature Generation Teaching Is this a lie?
  • 19. Tasks for Humans Augmenting AI USING HUMANS IN THE LOOP Feature Generation Teaching Troubleshooting
  • 20. OUR LEARNING SO FAR… KNOWLEDGE EXTRACTION AND AGGREGATION INCENTIVES AND BUSINESS INTEGRATION INTERPRETABILITY/ TRANSPARENCY TRUST
  • 21. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 22. ANALYSING CULTURAL INFLUENCE IN THE USAGE OF RECOMMENDATION AGENTS
  • 23. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 25. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 26. INTERVENING INTERACTION - AN APPROACH FOR THE EVOLUTION OF HIGHLY EFFICIENT HYBRID SYSTEMS
  • 27. MEASURING SOCIAL TOLERANCE AND SOCIAL ACCEPTABILITY IN HYBRID TEAM COLLABORATION
  • 28. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 2 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 29. WHAT TYPES OF PROBLEMS CAN BE SOLVED THROUGH HYBRID INTELLIGENCE?
  • 30. COMPLEX PROBLEMS Require Domain Knowledge Require Empathy or Creativity Dynamic No Ground Truth Require Gut Feeling Stochastic Time Variant
  • 31. INTUITION „A nonconscious, holistic processing mode in which judgments are made
  • 32. 2 FORMS OF INTUITION INTUITIVE INSIGHT INTUITIVE JUDGEMENT
  • 34. DESIGNING A HYBRID INTELLIGENCE SYSTEM THAT HAS A BETTER INTUITION THAN THE BEST GROUP OF EXPERTS
  • 36. INTUITION MACHINE ARCHITECTURE PREDICTION EXPERT CROWD LEARNER GENERATIVE ENTITY Reward Generation Match for Labels Weigh Labels
  • 37. DESIGN PRINCIPLES 1. Cognitive Feedback on Consistency 2. Social Feedback from Peers 3. Interpretable Machine Feedback 4. Expertise Matching 5. Generative Aggregation 6. Heuristic and Judgement
  • 38. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 40. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 41. Towards a Research Agenda on Hybrid Intelligence
  • 42. Top 1 – Applications Which technological applications will affect the interaction between humans and AI in the near future? Which technological applications will be most relevant for the design of interactions between humans and AI in the near future?
  • 43. Top 2 - Research Questions Which research questions do arise when examining human- AI-interaction in the identified settings?
  • 44. Top 3 - Research Streams Is it possible to identify common research streams within the identified research questions??
  • 45. Agenda Time Top 09:00 – 09:30 Get-together and Introduction 09:30 – 09:45 A short intro to Hybrid Intelligence 09:45 – 10:30 Workshop Session 1a: Paper/Project Presentations 10:30 – 10:50 Coffee Break 11:00 – 12:30 Workshop Session 1b: Paper/Project Presentations 12:30 – 13:00 Hybrid Intelligence in Practice 13:00 – 14:00 Lunch Break 14:00 – 15:15 Workshop Session 3: Workshop on Hybrid Intelligence in IS Research Agenda 15.15 – 15:30 Closing 15:30 – 16:00 Coffee/Tea
  • 47. WAIM Research Network • WAIM - Work in the Age of Intelligent Machines • Funded by the US National Science Foundation to coordinate research on the human-technology frontier (NSF 17–45463) • Co-PIs Kevin Crowston, Ingrid Erickson and Jeffrey Nickerson • Goal: Build a network of interested researchers to facilitate “disciplinary convergence” to address the topic • Disciplinary convergence (an NSF ”big idea”) • Research driven by a specific and compelling problem (work and intelligent machines) • Deep integration across disciplines by developing common frameworks and new scientific language
  • 48. WAIM Research Network • Activities • Workshops at Academy of Management, HICSS, ECIS and others • Annual conference (1st held at Michigan State University in May 2018) • Infrastructure: https://waim.network/, listserv, @WAIMRCN on Twitter • How we’ll know it’s a success • The network facilitates joint projects that build convergence • A network’s strength is its members, so join today! • https://waim.network/join • https://waim.network/listserv
  • 49. The Interplay of Machines and Humans: State of the Art and a Research Agenda for Hybrid Intelligence

Editor's Notes

  1. Feedback Time 3-5 failure 7 success
  2. Feedback Time 3-5 failure 7 success
  3. Feedback Time 3-5 failure 7 success