210812 decs seminar

1. Tangible Interaction in the Dentist Office
2021.08.12
Byounghern, Kim.
Graduate School of Creative Design Engineering

2. “저는 지금 4만큼 긴장됩니다”
대부분의 감정 표현은
화자와 청자의 기준 오차로 수치적으로 표현이 어렵습니다.
2

3. U-K 브랜드 과제
통증 표현이 가능한 디바이스
표현 장치:
꿈틀이

4. 4
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Conveying Emotional Intensity
“저는 지금 4만큼 긴장됩니다”
DOI: 10.1109/ROMAN.2008.4600669
Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive
Communication, Technische Universität München, Munich, Germany, August 1-3, 2008

5. 5
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Conveying Emotional Intensity
“저는 지금 4만큼 긴장됩니다”
Conveying Emotional Intensity
“she can make an angry face; however, when she becomes angrier, her face
may turn red, or her behavior could become violent”
화날 떄, 표정의 변화가 있어도,
행동이나 얼굴 색 등으로 더 화났을 때를 표현한다.
DOI: 10.1109/ROMAN.2008.4600669
Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive
Communication, Technische Universität München, Munich, Germany, August 1-3, 2008

6. 6
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Conveying Emotional Intensity
“저는 지금 4만큼 긴장됩니다”
Conveying Emotional Intensity
“she can make an angry face; however, when she becomes angrier, her face
may turn red, or her behavior could become violent”
화날 떄, 표정의 변화가 있어도,
행동이나 얼굴 색 등으로 더 화났을 때를 표현한다.
DOI: 10.1109/ROMAN.2008.4600669
Purpose
정량적인 접근과 검증
Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive
Communication, Technische Universität München, Munich, Germany, August 1-3, 2008

7. 7
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Heart rate ~ changes Blinking period
P. Ekman, R. W. Levenson and W. V. Friesen, "Autonomic nervous
system activity distinguishes among emotions," Science, vol. 221, pp.
1208-1210, 1983
Such heart rate changes can be emulated by LED blinking in robots, which
will help people perceive the robot s emotion
1st
The human resting heart rate is 70~75bpm on average,
Accelerated 7~8 bpm by anger, fear or sadness.

8. 8
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Heart rate ~ changes Blinking period
P. Ekman, R. W. Levenson and W. V. Friesen, "Autonomic nervous
system activity distinguishes among emotions," Science, vol. 221, pp.
1208-1210, 1983
Such heart rate changes can be emulated by LED blinking in robots, which
will help people perceive the robot s emotion
1st
The human resting heart rate is 70~75bpm on average,
Accelerated 7~8 bpm by anger, fear or sadness.
2nd
20% faster (85bpm) for anger, fear, and sadness,
0% normal (70~75 bpm)
20% slower (55bpm) for happiness, surprise, and disgust.

9. 9
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
How about Color
F. H. Mahnke, COLOR, Environment, & Human Response, John Wiley
& Sons, 1996, pp. 60-66
F. Birren, Color Psychology and Color Therapy, Kessinger Publishing,
2006, pp. 137-150

10. 10
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
How about Color
F. H. Mahnke, COLOR, Environment, & Human Response, John Wiley
& Sons, 1996, pp. 60-66
F. Birren, Color Psychology and Color Therapy, Kessinger Publishing,
2006, pp. 137-150
- 11개의 색에 관련된 감정 (Mahnke)

11. 11
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
More about Color
W. J. Havlena and M. B. Holbrook, "The Varieties of Consumption
Experience: Comparing Two Typologies of Emotion in Consumer
Behavior,# Journal of Consumer Research, vol. 13, pp. 394-404, 1986
P. Valdez and A. Mehrabian, "Effects of Color on Emotions,# Journal
of Experimental Psychology: General, vol. 123, no. 4, pp. 394-409,
1994
According to Valdez [5],
(B = 밝기 / S = 채도)

12. 12
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
More about Color
W. J. Havlena and M. B. Holbrook, "The Varieties of Consumption
Experience: Comparing Two Typologies of Emotion in Consumer
Behavior,# Journal of Consumer Research, vol. 13, pp. 394-404, 1986
P. Valdez and A. Mehrabian, "Effects of Color on Emotions,# Journal
of Experimental Psychology: General, vol. 123, no. 4, pp. 394-409,
1994
According to Valdez [5],
(B = 밝기 / S = 채도)

13. 13
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
More about Color
W. J. Havlena and M. B. Holbrook, "The Varieties of Consumption
Experience: Comparing Two Typologies of Emotion in Consumer
Behavior,# Journal of Consumer Research, vol. 13, pp. 394-404, 1986
P. Valdez and A. Mehrabian, "Effects of Color on Emotions,# Journal
of Experimental Psychology: General, vol. 123, no. 4, pp. 394-409,
1994
According to Valdez [5],
(B = 밝기 / S = 채도)

14. 14
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Determined Expression
Blinking
55 bpm
55 bpm
55 bpm
85 bpm
85 bpm
85 bpm

15. 15
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Environment : Avatar of Doldori
• Avoiding uncanny valley effect
= 마스코트 타입 돌도리

16. 16
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Environment : Avatar of Doldori
• Avoiding uncanny valley effect
= 마스코트 타입 돌도리
Stimulus and Test set:

17. 17
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Environment : Avatar of Doldori
• Avoiding uncanny valley effect
= 마스코트 타입 돌도리
Stimulus and Test set:
Number of Questions: 18
Number of Participant: 30 (20s~30s)

18. 18
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Environment : Avatar of Doldori
• Avoiding uncanny valley effect
= 마스코트 타입 돌도리
Stimulus and Test set:
Number of Questions: 18
Number of Participant: 30 (20s~30s)
Express Intensity =

19. 19
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Environment : Avatar of Doldori
• Avoiding uncanny valley effect
= 마스코트 타입 돌도리
Stimulus and Test set:
Number of Questions: 18
Number of Participant: 30 (20s~30s)
Express Intensity =

20. 20
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Each trial
Asked :
“둘 중 어느 것에서 더 심한 감정이 표현되나요?”
Answered:
“왼쪽”, “오른쪽”, “모르겠어요”
Scoring:
2점 : 정답
1점 : 미응답 (“모르겠어요”)
0점 : 오답
100% W/O LED Target Cond,
(70% W/O LED)

21. 21
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Result

22. 22
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Result

23. 23
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Result
- 70%

24. 24
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Validation

25. 25
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Validation
독립시행 확률에서 벗어나야 “강조가 되었다.” 라고 평가.
100% W/O LED 100% W LED

26. 26
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Validation

27. 27
Determining Color and Blinking to Support Facial Expression of
a Robot for Conveying Emotional Intensity
Min-gyu Kim, Hui Sung Lee, Jeong Woo Park, Su Hun Jo, and Myung Jin Chung
1
Evaluation
Validation

28. Tangible Interaction in the Dentist Office
2021.08.12
Byounghern, Kim.
Graduate School of Creative Design Engineering

29. U-K 브랜드 과제
통증 입력이 가능한 디바이스
입력 장치:
?

30. 30
입력장치 관련 논문 조사
Prof. Frode Guribye
2
Designing for Tangible Affective Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction, October 2016
Article No.: 30Pages 1–10, https://doi.org/10.1145/2971485.2971547
Tangible Interaction in the Dentist Office
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied
Interaction March 2018 Pages 123–130 https://doi.org/10.1145/3173225.3173287