In this paper, we investigate how information visualization techniques can be leveraged to increase patient comprehension of personal medication schemes in order to make it easier for them to explore, explain and understand drug information. Using computer vision techniques, our solution is able to recognize medication boxes, or so-called pharmaceutical packages, which are laid on an ordinary table. A projector visualizes drug information such as interactions, adverse drug reactions, intolerances and the dosage regimen around corresponding boxes. Five prototypes are designed and evaluated following a user-centered, rapid-prototyping methodology. Test participants in our study included both general practitioners (GPs) and patients. Results are promising and clearly indicate that information visualization techniques are an effective means to explore and understand drug information. Even if this system was originally envisaged to be used as a means to improve `therapy dialogue' between GPs and their patients during consultations, our results show that both GPs and patients think it would be highly beneficial if patients were able to use the system at home.

1. A Proof-of-Concept Visualization to Increase
Comprehension of Personal Medication Schemes
Robin De Croon
Joris Klerkx & Erik Duval †
http://augment.cs.kuleuven.be
robin.decroon@cs.kuleuven.be
Thursday, January 26, 2017 1

2. Prof. dr. ir. Erik Duval✝
Thursday, January 26, 2017 2

3. Today
• Motivation and result
• User-centered rapid-prototyping
• Implementation details
• Evaluation
• Limitations
• Conclusion
Thursday, January 26, 2017 3

5. Medication information is complex
• 3 discussion groups
• “Why do I have to take so much medication?”
• “What are the adverse reactions for baby/wife?”
• “What are my adverse reactions?”
• “I need help with the choice between two bad alternatives”
• “GP asks me to bring all my medication to the practice”
• Health literacy
Thursday, January 26, 2017 5

6. Relevance in literature
6
D. Mohr, E. Montague, C. Stiles-Shields, S. Kaiser, C. Brenner, E. Carty-Fickes, H. Palac, J. Duffecy
“MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine,” in Pervasive
Computing Technologies For Healthcare (PervasiveHealth), 2015 9th International Conference On, 2015.
September 22, 2015

7. Relevance in literature
7
D. Mohr, E. Montague, C. Stiles-Shields, S. Kaiser, C. Brenner, E. Carty-Fickes, H. Palac, J. Duffecy
“MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine,” in Pervasive
Computing Technologies For Healthcare (PervasiveHealth), 2015 9th International Conference On, 2015.
September 22, 2015

8. Relevance in literature
8
D. Mohr, E. Montague, C. Stiles-Shields, S. Kaiser, C. Brenner, E. Carty-Fickes, H. Palac, J. Duffecy
“MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine,” in Pervasive
Computing Technologies For Healthcare (PervasiveHealth), 2015 9th International Conference On, 2015.
September 22, 2015

9. Relevance in literature
9
D. Mohr, E. Montague, C. Stiles-Shields, S. Kaiser, C. Brenner, E. Carty-Fickes, H. Palac, J. Duffecy
“MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine,” in Pervasive
Computing Technologies For Healthcare (PervasiveHealth), 2015 9th International Conference On, 2015.
September 22, 2015


10. Motivation
Thursday, January 26, 2017 10
Can information visualization techniques help?
Hard for general practitioner to explain
Patients bring all their medication to their GP
Medication information is complex and hard to understand

11. AugmentedTable
Thursday, January 26, 2017 11

12. :

14. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 14
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

15. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 15
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

17. Closer look

18. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 19
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

22. 23
Episodes
from medical record
Adverse reactions
Personal information
from medical record

23. reason
adverse reaction
unwanted interactions

24. September 22, 2015 25
how many days?
how many times a day?

25. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 27
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

26. Biggest difference
Thursday, January 26, 2017 28

27. 29

29. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 32
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

30. Thursday, January 26, 2017 33

31. Patients  General practitioners
• Patients
• like to see all possible adverse reactions
• have the feeling their GP hides information for them
• like that they have the same view as their GP
• General practitioners
• worried about the Nocebo phenomenon
• want to remain in control
Thursday, January 26, 2017 34

32. User-Centered, Rapid-Prototyping
Thursday, January 26, 2017 36
Low Fidelity High Fidelity ResultGP DemoPublic Demo
5 participants 5 participants 220 passers-by 2 general practitioners
design phase usability phase evaluation phase

34. Implementation details (1)
Thursday, January 26, 2017 38
Epson EH-TW5000
Logitech c930e
Medication boxes

35. Implementation details (2)
Thursday, January 26, 2017 39

36. Implementation details (3)
Thursday, January 26, 2017 40

37. Final evaluation
• 25 participants
• 16 males + 9 females, average age 32 ranging from 18 to 75
• Pre-questionnaire
• demographics, basic health information
• Task-based scenario
• concurrent think aloud protocol
• time-to-task
• number of errors
• Post-questionnaires
• dialogue questions
• perceived usefulness questionnaire
• system usability scale
Thursday, January 26, 2017 41
C. Lewis, Using the "thinking Aloud" Method in
Cognitive Interface Design, Yorktown Heights, NY:
IBM T.J. Watson Research Center
Brooke, John. "SUS-A quick and dirty usability
scale." Usability evaluation in industry 189.194 (1996): 4-7
O’Leary, P., Carroll, N., & Richardson, I. (2014). The Practitioner’s
Perspective on Clinical Pathway Support Systems. In 2014
IEEE International Conference on Healthcare Informatics (pp. 194–201)

38. System Usability Scale
Thursday, January 26, 2017
79.5
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS
scores mean: Adding an adjective rating scale. Journal of Usability Studies,
4(3), 114–123

39. Tasks
Thursday, January 26, 2017 43
1
1
3
2
1

40. Post-Questionnaire
Thursday, January 26, 2017 44

41. Limitations
•Animations not in real time
• ± 1s per box
• Evaluation setting
• not ’in the wild’
• No comparison
• primarily to evaluate if visualization can increase
comprehension
• Privacy issues are not considered
• used in private setting between GP and patient
Thursday, January 26, 2017 45

42. Looking for collaborations!
• Redesign the visualization for private use
• improve detection of medication boxes
• consider difficulties of private use
• evaluate if self-reflection is triggered
Thursday, January 26, 2017 46

43. Conclusion
• Succesful proof-of-concept to increase
comprehension of medication information
• Our design shows useful feedback
• Better for personal use, as help of GP is not
needed
Thursday, January 26, 2017 47
http://cdn.makeuseof.com/wp-content/uploads/2012/12/3D-Man-Presenting-Intro-Image.jpg?a53b57

44. Acknowledgements
Thursday, January 26, 2017 48
+ All participants!

45. Thank you!
Thursday, January 26, 2017 49
http://2.bp.blogspot.com/-gZjNR3XVULs/T_ZOVgE-5lI/AAAAAAAAAg8/6YVmd5Q064o/s1600/questions11.jpg
robin.decroon@cs.kuleuven.be