How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
How IAs can shape
the future of
human/AI
collaboration
IA CONFERENCE 2021
Carol Smith
! @ddegler
! @carologic
Duane Degler
https://d4c.link/IAC21
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Existing data on a
relatively narrow topic
● Algorithms (math)
selected to reach
desired outcome
● Training of system
● Evaluation and
iteration
CREATING ARTIFICIAL INTELLIGENCE
Electric Motor Engineering: https://www.electricmotorengineering.com/amazon-acquiring-zoox-a-self-driving-startup/
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● “Emergent” in AI is more than building “machine intelligence”
● Co-evolution
Mutual learning
Mutual enabling
● Mutual agency: Humans and Machines
● Goal: Machines augmenting Human abilities
EMERGENT PROPERTIES IN AI
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Dynamic IA: at the point of human interaction, the human experience
is not with static structures
IAs must allow many contextual forces to interact with each other in a way
that is transparent, yet able to be controlled by the user
● How?
● Design with an expectation of co-evolution
● Provide feedback loops when releasing semi-autonomous entities into the world
● Engage responsibly with our dynamic creations
EMERGENT IMPLICATIONS FOR IA
No Static: IA for Dynamic Information Environments
Degler (2018) https://d4c.link/IAC18
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
What does it mean to respond appropriately?
How are complementary roles and
contributions fostered?
How is respect shown?
Will the relationship build and sustain
trust over time?
WHAT DOES A HEALTHY RELATIONSHIP LOOK LIKE?
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
HUMAN-MACHINE
COLLABORATION
● Semi-autonomous vehicles
● Information search and research
● Decision support
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
SEMI-AUTONOMOUS VEHICLES
Tesla Autopilot in Heavy LA Traffic by Scott Kubo https://youtu.be/m3-QzTFxoUg?t=14
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Levels of engagement and interaction
● Roles
● Transitions and timing
● Changes due to
● External influences
● Urgent situations
SEMI-AUTONOMOUS VEHICLES
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Features may be similar
● Longitudinal experience
● Over time needs, goals change
…our experience changes
● Formulate and test hypothesis
● Question assumptions
● Shift paradigms
I need to
explore and
collect value
INFORMATION SEARCH & RESEARCH
Wait… I know
that now.
Next, I need…
We can
work through
that idea
Explain.
What’s the
evidence?
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Complex situations and influences
● Elaborating context, conditions
● Options
● Clarification
● Changing circumstances affect use and goals
● Observers' reactions
CLARIFY SUSPEND
?
?
>X <X
?
OPTION A OPTION B
DECISION SUPPORT
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
MODELS
Understanding aspects of the environment and the
relationship between human and machine
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
SITUATION
SIGNALS
Location
Co-occurring events
Date / time
Conditions
Devices / connectivity
USER
SIGNALS
Usage patterns
Experience
Interests / profile
History
Community
CONTENT
SIGNALS
Link relationships
Text patterns
Categories / keywords
Metadata
TASK
SIGNALS
Outcomes / goals
Rules / requirements
Criticality
Sequence / status
Frequency for user
Degler (2013). Supporting Relevance for Users:
A Design Challenge https://d4c.link/semtech13
Degler (2018). No Static: IA for Dynamic
Information Environments https://d4c.link/IAC18
MODELS
FOR
CONTEXT
SIGNALS
(for content, as of 2013)
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
SITUATION
Location
Co-occurring events
Date / time
Participants
Devices / connectivity
ACTORS
Usage patterns
Experience
Interests / profile
History
Community
INFORMATION
Link relationships
Text patterns
Categories / keywords
Metadata
Data structures
TASK/OUTCOME Outcomes / goals
Rules / requirements
Criticality
Sequence / status
Frequency for user
ENVIRONMENT
Other people/things
Weather
Available resources
Politics/economics
Culture
MODELS EVOLVE
(for AI/dynamic IA, 2021)
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
COLLABORATION / ACTION
FRAMEWORK
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Event
Act
Monitor
Request
Continue
Complete
INTERACTIONS
COMMUNICATION NEGOTIATION COORDINATION
TIME CYCLES OF INTERACTION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Identify
Identify
Notify
Notify
Clarify
Clarify Instruct
Confirm Act
Hand Off
COMMUNICATION COORDINATION
NEGOTIATION
TIME CYCLE: AVOIDING A ROAD OBSTRUCTION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Identify
Identify
Notify
Notify
Clarify
Clarify Instruct
Confirm Act
Hand Off
COMMUNICATION COORDINATION
NEGOTIATION
TIME CYCLE: AVOIDING A ROAD OBSTRUCTION
But we know that most road situations aren’t like that…
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
(recover?)
Identify
Identify Instruct
Act Explain Identify
Hand Off
Assess Act
Learn
TIME CYCLE: AVOIDING A ROAD OBSTRUCTION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Formulate
Reflect
back
Clarify
Seek
Assess
Deliver Assess
Select Question Collect
Clarify Instruct
Schedule
Explain
Assess
Deliver Learn
Select
Seek
TIME CYCLE: INITIATING SEARCH FOR RESEARCH
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
Assess
Deliver
Explain
Instruct
Refine
Collect
Remove
Learn
Adjust
Question
Explain Seek
Assess Select
Deliver
Explain
Update
Update
Gather
Deliver
Reflect
back
Clarify
Seek
Adjust
CATALYST CLOSURE
TIME CYCLE: RESUMING SEARCH FOR RESEARCH
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Identify
Describe
Explain
Expand
Suggest Explain
Question
Refine Record
Clarify
Question
Reflect
back
Elaborate Prescribe
Suggest
TIME CYCLE: PROVIDING DECISION SUPPORT
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
CATALYST CLOSURE
Explain
Expand
Suggest Explain
Question
Refine Record
Discuss
Elaborate
Reflect
back
Elaborate Prescribe
Suggest
TIME CYCLE: PROVIDING DECISION SUPPORT
Review
Notify
Question
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
VARIATIONS IN TIME CYCLE PATTERNS
Autonomous
vehicles
journey
Information
research
research process
explore explore
Decision
support
diagnosis treatment pathway
emerge, evolve
extend
act
extend
act
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
Process Identification
Awareness of situation Notification
HUMAN-MACHINE COLLABORATION
COMMUNICATION
CATALYST CLOSURE
Event
Act
Monitor
Request
Continue
Complete
COMMUNICATION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
Clarification Confirmation
Instruction Insights emerge and evolve
HUMAN-MACHINE COLLABORATION
NEGOTIATION
CATALYST CLOSURE
Event
Act
Monitor
Request
Continue
Complete
COMMUNICATION NEGOTIATION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
Hand-offs are made Foster positive:
Action is taken
HUMAN-MACHINE COLLABORATION
COORDINATION
• Personal, societal, and environmental outcomes
• Collaboratory H-M relationships
CATALYST CLOSURE
Event
Act
Monitor
Request
Continue
Complete
COMMUNICATION NEGOTIATION COORDINATION
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
…a non-linear process
CONSIDER WITHIN BROADER PRODUCT PROCESSES !
Startup, design,
initial training
Adoption,
maturing
Evolution
through use
Visioning
Research
Design
Training
Use
Feedback
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
IAs SHAPING THE FUTURE
Reflecting on IA contributions to Human/AI Collaboration
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
● Models
● Time cycles
● Design vocabularies
● Interaction classifications
● “CNC” – communication, negotiation, coordination
● Emergence: Development and evolutionary process
REVISITING THE FRAMEWORK AND PERSPECTIVES
How IAs Shape AI for Human-Machine Collaboration
@carologic @ddegler #IAC21
How IAs can shape
the future of
human/AI
collaboration
IA CONFERENCE 2021
Carol Smith
! @ddegler
! @carologic
Duane Degler
https://d4c.link/IAC21

How IAs Can Shape the Future of Human-AI Collaboration

  • 1.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 How IAs can shape the future of human/AI collaboration IA CONFERENCE 2021 Carol Smith ! @ddegler ! @carologic Duane Degler https://d4c.link/IAC21
  • 2.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Existing data on a relatively narrow topic ● Algorithms (math) selected to reach desired outcome ● Training of system ● Evaluation and iteration CREATING ARTIFICIAL INTELLIGENCE Electric Motor Engineering: https://www.electricmotorengineering.com/amazon-acquiring-zoox-a-self-driving-startup/
  • 3.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● “Emergent” in AI is more than building “machine intelligence” ● Co-evolution Mutual learning Mutual enabling ● Mutual agency: Humans and Machines ● Goal: Machines augmenting Human abilities EMERGENT PROPERTIES IN AI
  • 4.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Dynamic IA: at the point of human interaction, the human experience is not with static structures IAs must allow many contextual forces to interact with each other in a way that is transparent, yet able to be controlled by the user ● How? ● Design with an expectation of co-evolution ● Provide feedback loops when releasing semi-autonomous entities into the world ● Engage responsibly with our dynamic creations EMERGENT IMPLICATIONS FOR IA No Static: IA for Dynamic Information Environments Degler (2018) https://d4c.link/IAC18
  • 5.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 What does it mean to respond appropriately? How are complementary roles and contributions fostered? How is respect shown? Will the relationship build and sustain trust over time? WHAT DOES A HEALTHY RELATIONSHIP LOOK LIKE?
  • 6.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 HUMAN-MACHINE COLLABORATION ● Semi-autonomous vehicles ● Information search and research ● Decision support
  • 7.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 SEMI-AUTONOMOUS VEHICLES Tesla Autopilot in Heavy LA Traffic by Scott Kubo https://youtu.be/m3-QzTFxoUg?t=14
  • 8.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Levels of engagement and interaction ● Roles ● Transitions and timing ● Changes due to ● External influences ● Urgent situations SEMI-AUTONOMOUS VEHICLES
  • 9.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Features may be similar ● Longitudinal experience ● Over time needs, goals change …our experience changes ● Formulate and test hypothesis ● Question assumptions ● Shift paradigms I need to explore and collect value INFORMATION SEARCH & RESEARCH Wait… I know that now. Next, I need… We can work through that idea Explain. What’s the evidence?
  • 10.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Complex situations and influences ● Elaborating context, conditions ● Options ● Clarification ● Changing circumstances affect use and goals ● Observers' reactions CLARIFY SUSPEND ? ? >X <X ? OPTION A OPTION B DECISION SUPPORT
  • 11.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 MODELS Understanding aspects of the environment and the relationship between human and machine
  • 12.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 SITUATION SIGNALS Location Co-occurring events Date / time Conditions Devices / connectivity USER SIGNALS Usage patterns Experience Interests / profile History Community CONTENT SIGNALS Link relationships Text patterns Categories / keywords Metadata TASK SIGNALS Outcomes / goals Rules / requirements Criticality Sequence / status Frequency for user Degler (2013). Supporting Relevance for Users: A Design Challenge https://d4c.link/semtech13 Degler (2018). No Static: IA for Dynamic Information Environments https://d4c.link/IAC18 MODELS FOR CONTEXT SIGNALS (for content, as of 2013)
  • 13.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 SITUATION Location Co-occurring events Date / time Participants Devices / connectivity ACTORS Usage patterns Experience Interests / profile History Community INFORMATION Link relationships Text patterns Categories / keywords Metadata Data structures TASK/OUTCOME Outcomes / goals Rules / requirements Criticality Sequence / status Frequency for user ENVIRONMENT Other people/things Weather Available resources Politics/economics Culture MODELS EVOLVE (for AI/dynamic IA, 2021)
  • 14.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 COLLABORATION / ACTION FRAMEWORK
  • 15.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Event Act Monitor Request Continue Complete INTERACTIONS COMMUNICATION NEGOTIATION COORDINATION TIME CYCLES OF INTERACTION
  • 16.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Identify Identify Notify Notify Clarify Clarify Instruct Confirm Act Hand Off COMMUNICATION COORDINATION NEGOTIATION TIME CYCLE: AVOIDING A ROAD OBSTRUCTION
  • 17.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Identify Identify Notify Notify Clarify Clarify Instruct Confirm Act Hand Off COMMUNICATION COORDINATION NEGOTIATION TIME CYCLE: AVOIDING A ROAD OBSTRUCTION But we know that most road situations aren’t like that…
  • 18.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 (recover?) Identify Identify Instruct Act Explain Identify Hand Off Assess Act Learn TIME CYCLE: AVOIDING A ROAD OBSTRUCTION
  • 19.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Formulate Reflect back Clarify Seek Assess Deliver Assess Select Question Collect Clarify Instruct Schedule Explain Assess Deliver Learn Select Seek TIME CYCLE: INITIATING SEARCH FOR RESEARCH
  • 20.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 Assess Deliver Explain Instruct Refine Collect Remove Learn Adjust Question Explain Seek Assess Select Deliver Explain Update Update Gather Deliver Reflect back Clarify Seek Adjust CATALYST CLOSURE TIME CYCLE: RESUMING SEARCH FOR RESEARCH
  • 21.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Identify Describe Explain Expand Suggest Explain Question Refine Record Clarify Question Reflect back Elaborate Prescribe Suggest TIME CYCLE: PROVIDING DECISION SUPPORT
  • 22.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 CATALYST CLOSURE Explain Expand Suggest Explain Question Refine Record Discuss Elaborate Reflect back Elaborate Prescribe Suggest TIME CYCLE: PROVIDING DECISION SUPPORT Review Notify Question
  • 23.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 VARIATIONS IN TIME CYCLE PATTERNS Autonomous vehicles journey Information research research process explore explore Decision support diagnosis treatment pathway emerge, evolve extend act extend act
  • 24.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 Process Identification Awareness of situation Notification HUMAN-MACHINE COLLABORATION COMMUNICATION CATALYST CLOSURE Event Act Monitor Request Continue Complete COMMUNICATION
  • 25.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 Clarification Confirmation Instruction Insights emerge and evolve HUMAN-MACHINE COLLABORATION NEGOTIATION CATALYST CLOSURE Event Act Monitor Request Continue Complete COMMUNICATION NEGOTIATION
  • 26.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 Hand-offs are made Foster positive: Action is taken HUMAN-MACHINE COLLABORATION COORDINATION • Personal, societal, and environmental outcomes • Collaboratory H-M relationships CATALYST CLOSURE Event Act Monitor Request Continue Complete COMMUNICATION NEGOTIATION COORDINATION
  • 27.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 …a non-linear process CONSIDER WITHIN BROADER PRODUCT PROCESSES ! Startup, design, initial training Adoption, maturing Evolution through use Visioning Research Design Training Use Feedback
  • 28.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 IAs SHAPING THE FUTURE Reflecting on IA contributions to Human/AI Collaboration
  • 29.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 ● Models ● Time cycles ● Design vocabularies ● Interaction classifications ● “CNC” – communication, negotiation, coordination ● Emergence: Development and evolutionary process REVISITING THE FRAMEWORK AND PERSPECTIVES
  • 30.
    How IAs ShapeAI for Human-Machine Collaboration @carologic @ddegler #IAC21 How IAs can shape the future of human/AI collaboration IA CONFERENCE 2021 Carol Smith ! @ddegler ! @carologic Duane Degler https://d4c.link/IAC21