1. The document discusses two papers related to trust in autonomous technologies like self-driving cars and medical devices. The first paper examines how trust is built over time from predictability to dependability to reliability. It also discusses the importance of trust in the innovating firm. 2. The second paper studies how the appearance and level of autonomy of unmanned vehicles affects perceived safety, anthropomorphism, and social presence. It found that a more human-like appearance and higher autonomy increased similarity to humans and positively impacted these factors. 3. Both papers emphasize the importance of operational safety, understandability, trialability, and balance between user control and system autonomy for gaining user trust in autonomous technologies.

1. Applied Artificial
Intelligence and Trust - The
Case of Autonomous
Vehicles and Medical
Assistance Devices
+ Technological Forecasting
& Social Change
- Monika Hengstler et al.
/ 김민준

2. Table of Contents
2
1. Paper 1
1. Background
2. Trust
3. Trust in the Technology
4. Case Studies
5. Results
2. Paper 2
1. Perceived Safety
2. Anthropomorphism
3. Experimental Results
3. Takeaways

3. Background
ADAS 및 자율주행의 인지부하
3
Google Self-driving Car
• Starting in 2012, Google’s self-driving cars
logged 1,600,000 km by June of 2015
• A total of 14 accidents recorded by July 2015
— no accidents caused by Google
14 accidents on 1,600,000 km? Pretty good!!

4. Background
ADAS 및 자율주행의 인지부하
4
Google Self-driving Car
14 accidents on 1,600,000 km? Pretty good!!
People complained that Google’s
self-driving cars were “unpredictable”
• Starting in 2012, Google’s self-driving cars
logged 1,600,000 km by June of 2015
• A total of 14 accidents recorded by July 2015
— no accidents caused by Google

5. Trust
5
“In interpersonal relationships, the essence of trust is the willingness
to be vulnerable to the actions of another person” (Mayer et al., 1995)
“Trust provides a valid foundation for describing the relationship between huma
1. Trust in the technology
2. Trust in the innovating firm and its communication
Trust, Perceived Risk, and Trust in Innovation

6. Trust and Perceived Risk
6
Perceived Risk
: a combination of uncertainty plus the seriousness
of the outcome involved
Perceived Risk in Innovation?
: uncertainty about the possibility of failure of a new product, or
the likelihood that the product will not work properly
directly linked with adoption
Trust, Perceived Risk, and Trust in Innovation

7. Trust in the Technology
7
1. Trust is mainly driven by the predictability of the technology
2. Over time, the driver of trust becomes dependability (consistent)
3. Ultimately, the relationship shifts to faith (reliability)
Trust, Perceived Risk, and Trust in Innovation

8. Trust in the Innovating Firm and its Communication
8
“Trust in the innovating firm and its communication
influence the adoption decision…” (Sternthal et al. 1978)
Trust, Perceived Risk, and Trust in Innovation

9. Trust in the Innovating Firm and its Communication
9
“… Particularly in the early stage of
commercialization, when customer
knowledge is low and an extensive public
discourse have not yet emerged…”
Trust, Perceived Risk, and Trust in Innovation

10. Trust in the Innovating Firm and its Communication
10
“… Particularly in the early stage of
commercialization, when customer
knowledge is low and an extensive public
discourse have not yet emerged…”
Trust, Perceived Risk, and Trust in Innovation

11. Case Studies
11
Selection Criteria
1. Identified industries in which applications of AI have
provoked skepticism
2. Selected cases that satisfied four conditions:
1. the application contains a component of AI
2. the application compensates for human flaws or
supplements human decision making
3. the application is on the market or is close to market
introduction
4. the application requires user involvement
Selection Criteria

12. Case Studies
12
Healthcare Automation
Medical Technology
IBM Watson
HP
AiCure
Fraunhofer IPA
Care-O-Bot 3

13. Case Studies
13
Transportation Automation
Transportation Industry
BMW
Deutsche Bahn
ZF Friedrichshafen AGDaimler -
Future Trucks
VAG Nürnberg

14. Data Collection
14
Sources
1. Semi-structured Interviews
2. Informal follow-ups via emails and phone calls
3. Archival data
Pilot Interviews
managers & engineers from the target industries
+ executives from outside the target industries

15. Results
15
Insights Gained from Target Analysis
1. Operational safety is necessary to initiate performance trust
2. Data security is an eminent factor influencing trust
3. Cognitive Compatibility, Trialability, Usability
• A fundamental determinant of trust in the technology
• A flawed system will not be trusted
• Operational safety is necessary, but not sufficient for acceptance

16. Results
16
Insights Gained from Target Analysis
1. Operational safety is necessary to initiate performance trust
2. Data security is an eminent factor influencing trust
3. Cognitive Compatibility, Trialability, Usability
• In transportation, data security = operational safety
• In healthcare, privacy protection is a major issue since all
applications deal with sensitive personal data

17. Results
17
Insights Gained from Target Analysis
1. Operational safety is necessary to initiate performance trust
2. Data security is an eminent factor influencing trust
3. Cognitive Compatibility, Trialability, Usability
• Cognitive compatibility : compatibility between what people feel
or think about an innovation - Understandability
• Trialability : a strategy to enhance understanding.
Displaying technological progress and providing a visualization
of the concrete benefits, and thereby reducing perceived risk
• Usability : ease of use, an intuitive interface, balance between
control and autonomy

18. Can Autonomous Vehicles
be Safe and Trustworthy?
Effects of Appearance and
Autonomy of Unmanned
Driving Systems
+ Int’l Journal of HCI
- Jae-Gil Lee et al.
/ 김민준
x 2016 Spring

19. Perceived Safety
Reducing Human Error
19
Automation is believed to be an effective way to reduce the human errors that con
Unmanned driving systems may increase perceived safety by explicitly removing

20. Perceived Safety
Reducing Human Error
20
Automation is believed to be an effective way to reduce the human errors that con
Unmanned driving systems may increase perceived safety by explicitly removing
Not Currently Possible

21. Anthropomorphism and Social Presence
Increasing Humanness
21
Anthropomorphism
: the attribution of humanlike characteristics to inanimate,
artificial agents such as computers and robots
Individuals mindlessly apply social rules and expectations when they interact with

22. Anthropomorphism and Social Presence
Increasing Humanness
22

23. Anthropomorphism and Social Presence
Increasing Humanness
23
Assigning anthropomorphic cues such as
agency, gender, and personality
is one way to make the quality of
human-robot interaction
more socially meaningful
= increasing trust
Human-like appearance and high
autonomy in an unmanned driving system
enhance the system’s similarity to humans

24. Anthropomorphism and Social Presence
Increasing Humanness
24
Assigning anthropomorphic cues such as
agency, gender, and personality
is one way to make the quality of
human-robot interaction
more socially meaningful
= increasing trust
Human-like appearance and high
autonomy in an unmanned driving system
enhance the system’s similarity to humans

25. Experiment Setup
The Effects of Appearance and Autonomy on User Perception
25

26. Results
The Effects of Appearance and Autonomy on User Perception
26
Pearson’s r correlation analyses conducted to examine the
relationship between social presence and the measure variables

27. Takeaways
Findings on Semi-autonomous Vehicles and their Perceptions
27
How do we make semi-autonomous driving appear
more human than it is?
There needs to be a trialability factor
: how do we allow other drivers to predict, and ultimately
have faith in semi-autonomous vehicles
Finding the balance between control and autonomy