TRACK 8. Lastest technology trends in health science education Authors: José Miguel Toribio-Guzmán, Alicia García-Holgado, Felipe Soto Pérez, Francisco José García Peñalvo and Manuel Franco Martín

1. Heuristic Evaluation of
SocialNet
the Private Social Network
for Psychiatric Patients and
their Relatives
Authors:
José Miguel Toribio-Guzmán
Alicia García-Holgado
Felipe Soto Pérez
Francisco J. García-Peñalvo
Manuel A. Franco Martín

2. Introduction

3.  >Psiquiatric
treatment:
hospitalization only in
especific cases
 Mental Health Care:
Rehabilitation and social
integration in Day centers,
Shelter flats or Community
rehabilitation centers
 Family: lack of information about the
daily activities of patients
 Need: Connect
family with patients
a private
social
network for
monitoring
daily progress
of patients by
their relatives
 Each patient has a private area accessible
only to their caregivers and to authorized
persons, where these can share images, videos
or texts about activities, meetings,
achievements, etc..
 Management of users
through a hierarchy of
roles, combined with a
careful definition of the
permissions associated
with each role.
Roles
General Manager
Caregiver Manager
Caregiver
Family Member/Autorizhed
Patient

5. Objective

7. Methodology

8. Criticism about the reliability of their
findings and recommendations.
Difficult to reliably interpret the guidelines
and identify the same usability issues
Generating a lot of “false positives”
Zazelenchuck
(2006)
The heuristic evaluation method consists of one or more experienced evaluators
(three to five recommended), applying an established set of guidelines (or
heuristics) as they review a given system (Zazelenchuck ,2006 ; Wilson, 2013)

9. STRATEGY: double heuristic evaluation
ONE EXPERT EVALUATOR
Expert = With experience on
SocialNet
Expert = Whithout
experience on SocialNet
STUDY 1 STUDY 2
REDESIGN 1 REDESIGN 2
• 10 heuristic rules proposed by Nielsen + Privacy
by Pierotti
• Previous explanation of its usefulness and different
roles: GM, CM, C, F, P
• Check list
• Criticality level (low-medium-high)
• Whithout support
• Sessions: max. 2 hours

10. Results

11. Study 1
Profiles
0
5
10
15
1 2 3 4 5 6 7 8 9 10 11
Nºofproblems
Heuristics
Profiles Study 1
GM
CM
C
F
0
5
10
15
20
1 2 3 4 5 6 7 8 9 10 11
Nºofproblems
Heuristics
Study 1
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Consistency and
standards
Aesthetic and
minimalist
Design
Privacy
Criticality Level (1)
High criticality: serious usability problem should be solved
Medium criticality: usability problem, important fix
Low criticality: minor usability problem, fix it low priority

12. Study 2
Profiles
0
5
10
15
1 2 3 4 5 6 7 8 9 10 11
Nºofproblems
Heuristics
Study 2
0
2
4
6
8
1 2 3 4 5 6 7 8 9 10 11
Nºofproblems
Heuristics
Profiles Study 2
GM
CM
C
F
0%
20%
40%
60%
80%
100%
Consistency and
standards
Aesthetic and
minimalist
Design
Privacy
Criticality Level (2)
High criticality: serious usability problem should be solved
Medium criticality: usability problem, important fix
Low criticality: minor usability problem, fix it low priority

14. Conclusions

15. 1. The results suggest that the double heuristic evaluation methodology involving
just one evaluator is very useful, practical, low cost and easy to implement.
2. This technique has provided us with valuable data about the usability of
SocialNet. Aspects to improve included consistency, design and privacy issues.
Those aspects were redisigned and included in the programme as part of an
iterative process.
3. We also found that the second evaluation of usability performed by the same
evaluator led to new findings, which might suggest that there could be a
relationship between previous experience with the application and a better
capacity of the evaluator to find aspects to improve in the application.
4. We should compare the reliability of the double assessment carried out by one
evaluator with the one carried out by more than one evaluators, analyzing pros
and cons.

16. Heuristic Evaluation of
SocialNet
the Private Social Network
for Psychiatric Patients and
their Relatives
Authors:
José Miguel Toribio-Guzmán
Alicia García-Holgado
Felipe Soto Pérez
Francisco J. García-Peñalvo
Manuel A. Franco Martín

17. Heuristic Evaluation of
SocialNet
the Private Social Network
for Psychiatric Patients and
their Relatives
Authors:
José Miguel Toribio-Guzmán
Alicia García-Holgado
Felipe Soto Pérez
Francisco J. García-Peñalvo
Manuel A. Franco Martín
PhD. José Miguel Toribio-Guzmán
Iberian Institute for Research in
Psychosciences.
INTRAS Foundation
investigacion4@intras.es