Conference at HEC Montréal Tech3Lab on Tuesday April 19th.

1. PIERRE-MAJORIQUE LÉGER, Ph.D.
Co-director Tech3Lab
Director ERPsim Lab
User Experience
Research at Tech3Lab
APRIL 19TH 2016

2. © Copyright Tech3Lab 2015
Prof. Pierre-Majorique Léger, Ph.D.
Full Professor
Director ERPsim Lab
Co-director Tech3Lab
pml@hec.ca
GRAD STUDIES
POST-DOCTORATE
LABS VISITING PROFESSOR
Lab Serious games to learn
enterprise systems and
business analytics
https://www.researchgate.net/profile/Pierre-Majorique_Leger

4. © Léger et al. 2004-2015. ERPsim is a proprietary technology developed by researchers at HEC Montréal,
École Polytechnique de Montréal and Western Michigan Univ. Visit erpsim.hec.ca for more information.
ERPsim Academic Version 2015-2016
Lab Serious games to learn
enterprise systems and
business analytics
Manufacturing Game. Advanced
© Léger et al. 2004-2014. ERPsim is a proprietary technology developed by researchers at HEC Montréal,
École Polytechnique de Montréal and Western Michigan Univ. Visit erpsim.hec.ca for more information.
Commercial version
powered by
Game-based learning for ERP
ERPsim Team
Research team
Prof. Pierre-Majorique LÉGER, Ph.D.,
Director ERPsim Lab (HEC Montréal)
Prof. Gilbert BABIN, Ph.D.
(HEC Montréal)
Prof. Jacques ROBERT, Ph.D.
(HEC Montréal)
Prof. Robert PELLERIN, Ph.D.
(École Polytechnique de Montréal)
Prof. Bret WAGNER, Ph.D.
(Western Michigan University)
Operations and development team
Derick LYLE, MBA
R&D Director
Jean-François MICHON, M.Sc.,
Operations Manager
Félix GAUDET-LAFONTAINE, B.Comm.,
Business Analyst and Technical Lead
Samuel PLASSE, B.Comm, Analyst
Hikmath-Yemissi EYITAYO, B.Comm, Analyst
Cindy NGUYEN, B.Comm, Analyst
ERPsim Lab Mission :
Conduct research, development and transfer in the field
of serious games in information technology.
Statistics on ERPsim in the academic world
ACADEMIC COMMERCIAL RESEARCH
Many large organizations,
such as Boeing, Coca-Cola, 3M,
Kraft, Caterpillar, Pfizer and SAP,
are using ERPsim to train their
end-users on ERP systems.
Several researchers have
started using ERPsim to run
experimental protocol in IS.
Visit http://erpsim.hec.ca/en/cite
ERPsim by the numbers:
10+ years in use
200+ universities
1 000+ faculty trained
30 000+ students per year

5. © Léger et al. 2004-2015. ERPsim is a proprietary technology developed by researchers at HEC Montréal,
École Polytechnique de Montréal and Western Michigan Univ. Visit erpsim.hec.ca for more information.
ERPsim for SAP S/4HANA Roadmap
Lab Commercial version
powered by
What ERPsim Does?
Automation of
administrative tasks
Simulation of
a market
Simulation of
passing of time
Virtual System ERP System
1
2
3
Business analytics
Business decisions
Participants
1
2
Now available for SAP HANA

6. EASE OF USE?
© Copyright Tech3Lab 2015© Copyright Tech3Lab 2015

7. EASE OF USE?

8. © Copyright Tech3Lab 2016
Sorry,
ARE YOU IN
FLOW ?
Please stop inte-
rupting me. I am
in the FLOW !
Are you in flow ?
...

9. © Copyright Tech3Lab 2016
COGNITIVE STATE
EMOTIONAL
STATE
BEHAVIOR
ATTENTIONAL STATE

10. EASE OF USE?

11. EASE OF USE?

13. © Copyright Tech3Lab 2015
Financing Agencies

14. © Copyright Tech3Lab 2015
Tech3Lab 2016 :
The most important UX Lab
in North America

15. Tech3Lab 2016

16. TECH3LAB 2016 :
7 experimental rooms
© copyright Léger et Sénécal 2016

17. © copyright Léger et Sénécal 2016
TECH3LAB 2016 :
Broad range of the
lastest neuroscience tools to
capture user experience

18. © Copyright Tech3Lab 2016
Testimonial from Dr. Alan Pope
on HEC Montréal Tech3Lab
Lookingatthelablastevening,thelyricthatcametomindwas
from that philosopher Cat Stevens:“I have been happy lately
thinking about the good things to come, and I believe it could
be something good has begun,”and that is what I think of
when I see the Tech3Lab, that something good has begun
there, and something that’s unparalleled in any other
place that I know of, not even our facility.
Dr. Alan Pope, NASA Langley, 2015-11-12, HEC Montréal

19. © Copyright Tech3Lab 2015
SECTION 1
Emotion and
Attention in HCI
SECTION 2
Mobility and
tactile interfaces
in HCI
SECTION 3
Learning and
adaption in HCI

20. SECTION 1
Emotion and
Attention in HCI

21. © Copyright Tech3Lab 2015
What is eye-tracking?

22. © Copyright Tech3Lab 2015
Tobii EyeTracker X60
© Copyright Tech3Lab 2015

23. © Copyright Tech3Lab 2015
Tobii EyeTracker X60
© Copyright Tech3Lab 2015

24. © Copyright Tech3Lab 2015
Source: http://eyetracking.me/?page_id=9
What is Eye Tracking

25. © Copyright Tech3Lab 2015
Processing order:
Gaze path

26. © Copyright Tech3Lab 2015
Visual attention:
Heatmap

27. © Copyright Tech3Lab 2015
ERPsim on SAP HANA
Now available on SAP HANA
Automated
administrative tasks
Simulated market
Simulated
passing of time
Business analytics
Business decisions
VIRTUAL SYSTEM PARTICIPANTSERP SYSTEM
1 1
2 2
3

28. © Copyright Tech3Lab 2015
Attentional heatmap in during software interaction

29. © Copyright Tech3Lab 2016
User activation
and electrodermal activity

30. © Copyright Tech3Lab 2016
User activation
and electrodermal activity
VIGILANCE
REACTIVITY
DROWSINESS

31. © Copyright Tech3Lab 2016
ERP and Emotion
OBJECTIVE : COMPARING EMOTIONAL
REACTION OF NOVICE AND EXPERT IN
ERP TRAINING
Chercheur principal :
Chercheurs :
Financement :
Pierre-Majorique Léger, Ph.D.
René Riedl, Ph.D. (U Linz)
Jan vom Brocke, Ph.D.
Laboration ERPsim
Léger, P.-M., vom Brocke, J., and Riedl, R. (2014).“Emotional Response in Enterprise Resource Planning (ERP) System Decision Making”,
Industrial Management and Data Systems, 114(3), 456-471.

32. © Copyright Tech3Lab 2015
Emotional attention:
Heatmap
TECHNOLOGY DEVELOPED AT Tech3Lab
Courtemanche, F., et al., Method and Product for
Visualizing the Emotions of a User, in Provisional
patent application 2015. p. p. 14.

33. © Copyright Tech3Lab 2016
Mesure de l’attention visuelle Synchronisationaveclesmesures
physiologiques
Visualisationdel’émotionsouslaforme
d’une carte de chaleur
Carte de Chaleur Physiologique
OBJECTIF : REPRÉSENTER VISUELLEMENT LA TRIANGULATION DE LA
RÉACTION PHYSIOLOGIQUE ET ATTENTIONNELLE
Chercheur principal :
Chercheurs :
Étudiants Gradués :
Financement :
François Courtemanche, Ph.D.
Sylvain Sénécal, Ph.D.
Pierre-Majorique Léger, Ph.D.
Marc Fredette, Ph.D.
ThierryBaccino,Ph.D.(UdeParisVIII)
Vanessa Georges (M.Sc. Mkg)
FQRNT, CRSNG
Courtemanche, F., P.-M. Léger, M. Frédette, S. Sénécal, and A. Dufresne (2015) Method and Product for Visualizing the Emotions of a User, Provisional patent application. US 62/121,552 p. 14.
BREVET EN ATTENTE

34. SECTION 2
Mobility and
tactile interfaces
in HCI

35. The effect of touching
on advertising effectiveness
• NEED FOR TOUCH
+• TACTILE DEVICE
=
• UP TO 2X MORE CHANCES TO
RECOGNIZE BRANDS

36. The touch effect
VIRTUALLY TOUCHING THE
PRODUCT HAS SIGNIFICANT
EFFECT ON BRAND AND
PRODUCT RECOGNITION

37. © Copyright Tech3Lab 2016
Bureau Actif
OBJECTIF : VÉRIFIER LES EFFETS DE L’UTILISATION
D’UN BUREAU ACTIF SUR LA PRODUCTIVITÉ DES
TRAVAILLEURS.
Au delà des bénéfices pour la santé, nos résultats suggèrent
que l’utilisation du bureau actif entraîne des bénéfices au
niveau de l’attention, de la mémoire et de la créativité.
PLUS DE 12000 TÉLÉCHARGEMENTS
DEPUIS MAI 2015
Chercheur principal :
Chercheurs :
Financement :
Pierre-Majorique Léger, Ph.D.
Sylvain Sénécal, Ph.D.
Marc Fredette, Ph.D.
François Courtemanche, Ph.D.
Elise Labonté-Lemoine, Ph.D.
Radhika Santhanam
Conseil de recherches en
sciences humaines
Labonté-LeMoyne, É., Santhanam, R., Léger, P. M., Courteman-
che, F., Fredette, M., & Sénécal, S. (2015). The delayed effect of
treadmill desk usage on recall and attention. Computers in Hu-
man Behavior, 46, 1-5. http://www.sciencedirect.com/science/
article/pii/S0747563215000102

38. © Copyright Tech3Lab 2016
Avec la permission de
ICI Radio-Canada
PROJET DU Tech3Lab
Marcher en textant
OBJECTIF : ÉTUDIER LES EFFETS DE TEXTER EN MAR-
CHANT SUR L’ATTENTION VISUELLE ET LA COGNITION
DES “TEXTEURS” EN CONTEXTE URBAIN.
“Courtemanche, F., Léger, P.-M., Cameron, A.-F., Faubert, J., Labonté-LeMoyne, É., Sénécal, S., Fredette, M. et Bellavance, F. (2014). « Texting
While Walking: Measuring the Impact on Pedestrian Visual Attention », Gmunden Retreat on NeuroIS 2014, Gmunden, Autriche, 5-7 juin.
Chercheur principal :
Chercheurs :
Étudiants Gradués :
Financement :
Pierre-Majorique Léger, Ph.D.
Sylvain Sénécal, Ph.D.
Marc Fredette, Ph.D.
Francois Bellavance, Ph.D.
Ann-Frances Cameron, Ph.D.
Jocelyn Faubert, Ph.D. (UdM)
François Courtemanche, Ph.D.
Elise Labonté-Lemoine, Ph.D.
Frédéric Dupuis, (M.Sc. TI, 2014)
Fondation HEC Montréal

39. SECTION 3
Learning &
adaption in HCI

40. Measuring
brain activity

41. © Copyright Tech3Lab 2015
1011

42. © Copyright Tech3Lab 2015

43. © Copyright Tech3Lab 2015

44. © Copyright Tech3Lab 2015
http://upload.wikimedia.org/wikipedia/en/e/e4/Tetris_DOS_19 http://upload.wikimedia.org/wikipedia/en/e/e4/Tetris_DOS_1986.png
86.png

45. © Copyright Tech3Lab 2015
Learning in the brain
Source: Hill and Schneider, 2006

46. © Copyright Tech3Lab 2015
TRAITEMENT
CONTRÔLÉ
TRAITEMENT
AUTOMATIQUE
Learning in the brain
Source: Hill and Schneider,
Réduction de l’activation
du réseau de contrôle

47. ALPHA relaxed/reflecting
alert/working
drowsy/ideating
sleep/dreaming
deep dreamless
BETA
THETA
DELTA

48. © Copyright Tech3Lab 2015
Astronaut/aquanaut Nicole P. Stott and Ross Hein, a
professional aquanaut from the University of North
Carolina at Wilmington (UNCW), assist University of
Cincinnati physician Tim Broderick apply a net with
electrodesforanelectroencephalogram(EEG)study

49. © Copyright Tech3Lab 2015
ALPHA relaxed/reflecting
alert/working
drowsy/ideating
sleep/dreaming
deep dreamless
BETA
THETA
DELTA
Pope, Alan T., Edward H. Bogart, and Debbie S. Bartolome.“Biocybernetic system evaluates indices
of operator engagement in automated task.”Biological psychology 40.1 (1995): 187-195.

50. © Copyright Tech3Lab 2016
Pierre-Majorique Léger, Ph.D.
Sylvain Sénécal, Ph.D.
Marc Fredette, Ph.D.
Marie-ChristineBastarache-Roberge
(M.Sc. IA)
Shirley-Anne Pagé (M.Sc. TI)
CARTE DE CHALEUR CULOMÉTRIQUE PARCOURSOCULAIRE
OBJECTIF : ÉTUDIER L’EFFET DES TYPES DE
TUTORIEL DE JEU SUR L’INTENTION D’UTILI-
SATION D’APPLICATIONS MOBILES
Chercheur principal :
Chercheurs :
Étudiants Gradués :
Financement :
Pierre-Majorique Léger, Mario Lefebvre, Sylvain Sénécal, François Courtemanche, Marie-Christine Bastarache-Roberge, Shirley-Anne Pagé, Raphaël Morin, Emma Campbell and
Marc Fredette (2016) Using UX Heatmap in Game User Experience Research, CHI Game User Research, May 8th 2016.

51. © Copyright Tech3Lab 2015
Mobile Eye-tracking
ASSESSING ATTENTION AND
BEHAVIOUR IN SOFTWARE AND
MECHANICAL DEVELOPMENT

52. © Copyright Tech3Lab 2015
Understanding
problem solving
ASSESSING SELECTIVE ATTENTION
IN A MULTIPLAN ENVIRONMENT

53. © Copyright Tech3Lab 2015
Monitoring learner’s
engagement in real-time

54. © Copyright Tech3Lab 2015
!!
!
Figure 1. Illustration of pupillary responses in cognitive task
execution, (A) Mental multiplication task and pupil size change,
(B) Difficulty effect on pupil dilation evoked by mental multi-
plication of two numbers displayed together for eight seconds
(adopted from Klingner's Dissertation (Figure 5.5) [1]).
(B)
(A)
Source: Hossein & Yeasin, 2014

55. © Copyright Tech3Lab 2016
OBJECTIF : ÉTUDIER L’EFFET DE LA RÉDUCTION
DE L’ÉMOTION NÉGATIVE LIÉE AU DESIGN SUR
L’EFFICACITÉ DES APPLICATIONS ÉDUCATIVES
ET DE FORMATION
CARTE DE CHALEUR OCULOMÉTRIQUE PARCOURSOCULAIRE
Chercheur principal :
Chercheurs :
Étudiants Gradués :
Financement :
Pierre-Majorique Léger, Ph.D.
Sylvain Sénécal, Ph.D.
Marc Fredette, Ph.D.
Patrick Charland, Ph.D. (UQAM)
Marie-Laure Di-Fabio (M.Sc. Mkg)
Yannick Skelling (Doctorat, Science
de l’éducation, UQAM)
Pierre-Majorique Léger, Sylvain Sénécal, Marc Fredette, Vanessa Georges, Marie-Laure Di Fabio and Patrick Charland (2016). Measuring the Impact of Design on Users’Cognitive
Load and Performance in the Learning of Mathematics, colloque scientifique de l’ARN 2016 - Symposium de neuroéducation, Montréal, Qc.

56. Flow and cognitive
absorption

57. FLOW
=
DIFFICULTY AND
COMPETENCY
+
PSYCHOPHYSIOLOGICAL
STATE OF THE LEARNER
Predicting
the flow state
16%
18%
© Copyright Tech3Lab 2015
Léger, Pierre-Majorique, et al.“Neurophysiological correlates of cognitive absorption in an enactive
training context.”Computers in Human Behavior 34 (2014): 273-283.

58. FLOW OF PLAYER (A)
=
DIFFICULTY +COMPETENCY
+
PLAYER (A)
+
PLAYER (B)
Predicting flow in
multiplayer context
66%
Bastarache, Léger, Courtemanche, Sénécal and Fredette (2015) Measuring Flow Using
Psychophysiological Data in a Multiplayer Gaming Context, Information Systems and
Neuroscience, Lecture Notes in Information Systems and Organisation.

59. © Copyright Tech3Lab 2016
Pierre-Majorique Léger, Ph.D.
Sylvain Sénécal, Ph.D.
Marc Fredette, Ph.D.
Marie-ChristineBastarache-Roberge
(M.Sc. IA)
Shirley-Anne Pagé (M.Sc. TI)
CARTE DE CHALEUR CULOMÉTRIQUE PARCOURSOCULAIRE
OBJECTIF : ÉTUDIER L’EFFET DES TYPES DE
TUTORIEL DE JEU SUR L’INTENTION D’UTILI-
SATION D’APPLICATIONS MOBILES
Chercheur principal :
Chercheurs :
Étudiants Gradués :
Financement :
Pierre-Majorique Léger, Mario Lefebvre, Sylvain Sénécal, François Courtemanche, Marie-Christine Bastarache-Roberge, Shirley-Anne Pagé, Raphaël Morin, Emma Campbell and
Marc Fredette (2016) Using UX Heatmap in Game User Experience Research, CHI Game User Research, May 8th 2016.

60. Conclusion

61. © Copyright Tech3Lab 2015
SECTION 1
Emotion and
Attention in HCI
SECTION 2
Mobility and
tactile interfaces
in HCI
SECTION 3
Learning and
adaption in HCI

62. © Copyright Tech3Lab 2015
Example of industrial research
financial assistance

63. Thank you!