Conference presented at the UX Strat Europe 2016 conference in Amsterdam by Dr. Carine Lallemand (University of Luxembourg).
Abstract:
While conducting UX research, we make several conclusions that will in turn provide the foundation for our UX strategy. But what if these inferences happen to be wrong, based on invalid findings and false beliefs? How critically would this impact your organization and projects? How can you safeguard a UX strategy by ensuring the quality of research conclusions?
There might be numerous threats to validity in UX research, some of which might depend on the method used or the way it is used. A method is only a guide to action that needs to be configured, adapted, and complemented to match specific project requirements. To be successful, it is essential to ensure validity in strategic UX research methods. Failing to do so is taking the risk to base strategic decisions on false beliefs. In this talk, we will therefore see how to tackle validity issues and make the most out of UX research to stand out from the crowd by delivering value and differentiation. Through the presentation of validated cutting edge UX methods and business cases, you will be able to spot opportunities for improvement in your UX strategy!
UX insight 2017 Keynote - Insightful UX methods, from research to practiceCarine Lallemand
Opening keynote talk at UX insight 2017 (Utrecht, NL) by Dr Carine Lallemand (University of Luxembourg).
Insightful UX methods - from research to practice
Abstract: While UX practitioners are working hard at the front to design better products or services, scientists work in the shadows to develop a myriad of novel and highly valuable theories and methods.
During this talk, you will discover this ever-growing UX toolbox that could greatly support you in collecting richer, insightful and more valid data. We will also show you how your daily UX research practices can be backed up and enriched by scientific research on human experience.
If you’re not yet convinced that academia might be relevant for practice, you’ll be excited to discover that together we have the power to better understand users in order to design desirable experiences, create business value and societal impact. Get inspired by concrete methodological examples and boost the value of your upcoming projects!
Join us for our new webinar series Putting Users in UX.
Throughout the series we discuss research methods for involving your audiences in user experience design and development.
In episode 1, we start with methods for generating ideas and imagining the future of your app, website, or other digital product.
In subsequent episodes, we’ll examine methods for design collaboration and evaluation as well as some of the important mechanics of planning, conducting and analyzing your research.
UX is omnipresent nowadays and will grow more and more the tool of innovation. Companies are becoming aware of the vitality of adopting this technology from the start. The Importance of UX is a presentation of how we as a UX Design Team implement UX in projects.
UX insight 2017 Keynote - Insightful UX methods, from research to practiceCarine Lallemand
Opening keynote talk at UX insight 2017 (Utrecht, NL) by Dr Carine Lallemand (University of Luxembourg).
Insightful UX methods - from research to practice
Abstract: While UX practitioners are working hard at the front to design better products or services, scientists work in the shadows to develop a myriad of novel and highly valuable theories and methods.
During this talk, you will discover this ever-growing UX toolbox that could greatly support you in collecting richer, insightful and more valid data. We will also show you how your daily UX research practices can be backed up and enriched by scientific research on human experience.
If you’re not yet convinced that academia might be relevant for practice, you’ll be excited to discover that together we have the power to better understand users in order to design desirable experiences, create business value and societal impact. Get inspired by concrete methodological examples and boost the value of your upcoming projects!
Join us for our new webinar series Putting Users in UX.
Throughout the series we discuss research methods for involving your audiences in user experience design and development.
In episode 1, we start with methods for generating ideas and imagining the future of your app, website, or other digital product.
In subsequent episodes, we’ll examine methods for design collaboration and evaluation as well as some of the important mechanics of planning, conducting and analyzing your research.
UX is omnipresent nowadays and will grow more and more the tool of innovation. Companies are becoming aware of the vitality of adopting this technology from the start. The Importance of UX is a presentation of how we as a UX Design Team implement UX in projects.
Building Buy-In: Internally Positioning UX for Executive ImpactJohn Whalen
Why can’t other people in your organization see what you see? That UX insights you uncovered will revolutionize your company and delight your customers like never before! Doesn’t everyone “get” UX nowadays?
The truth is more complicated than just recognizing UX value: Your professional goals and focus are different than those of others in your organization (e.g., C-Suite, Product Managers, Marketers, Developers) by design. What to do? Learn how to position and present your work for maximum uptake to ensure UX has a sizeable and valuable impact on your products and customer experience.
We reveal what we have learned – often the hard way – about linking UX research and design with organizational goals and strategic directives. With a little planning, you can to ensure your creative UX work has an influence and actually sees the light of day when the product is launched.
#UXPA2016
We’ve all had discussions about the great ‘UX’ of a product, or the poor ‘UI’ of a website. Is it a secret language you will never be lucky to know more about it?
Actually, it is very simple, For example: While User Experience is a bunch of tasks focused on optimization of a product for effective and enjoyable use; User Interface Design is its complement, the look and spirit, the presentation and interactivity of a product.
UX design is not a step in the process, it's in everything we do. More than anything it is a project philosophy, not just a set of tools, methods and deliverables.
In this presentation we explain how you can differentiate through design, why user experience design matters as well as share our knowledge around all the activities that helps ensure a great UX/UI design.
Stop UX Research being a Blocker. How to fit UX research into agile teams.
UX research can’t be rushed but it also can’t be uncapped.
Some research activities will take longer than others, but it’s most important to differentiate between research that provides specific value in the moment vs. research that pays off strategically in the long run.
Foundational research methods will help you decide where you want to go, while directional methods will give you turn by turn directions for how to get there.
Maebh Costello, Director of UX Design Labs, McKesson
Building the first UX team in a global business is very exciting. But handling the resultant demand for the team's multidisciplinary skill set is challenging. I quickly realised that you cannot scale a team by hiring only. I needed to think differently. I needed to use Design Thinking to explore how might we share my team's resources with our primary users, software developers. We re-envisioned how we share our design resources. This innovation leads to the creation of cutting edge technical solutions, enabling developers to access and use the design resources in their development environments. Learn how we at McKesson's global UX design labs team used this strategy to invigorate our workflow and scale.
Key Takes:
Design Thinking works, don't be afraid to use it on yourself and your team.
Make the most of your design resources such as Design Systems and UX Writing Style guides.
Bring design resource to the users environment.
Scale your UX Design team with design thinking.
An overview about what UX design is, for a mixture of tech, support and business people (tough mix!).
There are two main points I wanted to get across: 1. UX design is not just about usabllity (and Jakob Nielsen) 2. UX design is a rigorous process (not magic and guesswork).
If you have any feedback about how to make this presentation better, I'd be happy to hear it.
An introduction to UX - User Experience.
Where does UX come from, what are the benefits of using it, and how can it be applied to day to day agency work?
Understanding the User Centred Design process and how UX is an integral part of every piece of digital work that is produced.
BlendWebMix 2017 - Guérilla UX, "quick" mais pas "dirty" - Carine LallemandCarine Lallemand
Les ressources limitées des projets de conception incitent souvent à appliquer des méthodes UX rapides, low-cost, « quick & dirty ». Mais le « guerilla UX » peut aussi être « quick » sans être « dirty », être inspirant, et constituer une alternative valide aux méthodes traditionnelles de design UX. Au-delà des célèbres tests utilisateurs à la mode Starbucks, cette conférence vous présentera de nombreuses alternatives guérilla aux entretiens, questionnaires, observations, en passant aussi par l’idéation, le tri de cartes ou le maquettage. Une bonne dose d’inspiration pour se donner les moyens de faire de l’UX quand on n’en a pas les moyens !
Building Buy-In: Internally Positioning UX for Executive ImpactJohn Whalen
Why can’t other people in your organization see what you see? That UX insights you uncovered will revolutionize your company and delight your customers like never before! Doesn’t everyone “get” UX nowadays?
The truth is more complicated than just recognizing UX value: Your professional goals and focus are different than those of others in your organization (e.g., C-Suite, Product Managers, Marketers, Developers) by design. What to do? Learn how to position and present your work for maximum uptake to ensure UX has a sizeable and valuable impact on your products and customer experience.
We reveal what we have learned – often the hard way – about linking UX research and design with organizational goals and strategic directives. With a little planning, you can to ensure your creative UX work has an influence and actually sees the light of day when the product is launched.
#UXPA2016
We’ve all had discussions about the great ‘UX’ of a product, or the poor ‘UI’ of a website. Is it a secret language you will never be lucky to know more about it?
Actually, it is very simple, For example: While User Experience is a bunch of tasks focused on optimization of a product for effective and enjoyable use; User Interface Design is its complement, the look and spirit, the presentation and interactivity of a product.
UX design is not a step in the process, it's in everything we do. More than anything it is a project philosophy, not just a set of tools, methods and deliverables.
In this presentation we explain how you can differentiate through design, why user experience design matters as well as share our knowledge around all the activities that helps ensure a great UX/UI design.
Stop UX Research being a Blocker. How to fit UX research into agile teams.
UX research can’t be rushed but it also can’t be uncapped.
Some research activities will take longer than others, but it’s most important to differentiate between research that provides specific value in the moment vs. research that pays off strategically in the long run.
Foundational research methods will help you decide where you want to go, while directional methods will give you turn by turn directions for how to get there.
Maebh Costello, Director of UX Design Labs, McKesson
Building the first UX team in a global business is very exciting. But handling the resultant demand for the team's multidisciplinary skill set is challenging. I quickly realised that you cannot scale a team by hiring only. I needed to think differently. I needed to use Design Thinking to explore how might we share my team's resources with our primary users, software developers. We re-envisioned how we share our design resources. This innovation leads to the creation of cutting edge technical solutions, enabling developers to access and use the design resources in their development environments. Learn how we at McKesson's global UX design labs team used this strategy to invigorate our workflow and scale.
Key Takes:
Design Thinking works, don't be afraid to use it on yourself and your team.
Make the most of your design resources such as Design Systems and UX Writing Style guides.
Bring design resource to the users environment.
Scale your UX Design team with design thinking.
An overview about what UX design is, for a mixture of tech, support and business people (tough mix!).
There are two main points I wanted to get across: 1. UX design is not just about usabllity (and Jakob Nielsen) 2. UX design is a rigorous process (not magic and guesswork).
If you have any feedback about how to make this presentation better, I'd be happy to hear it.
An introduction to UX - User Experience.
Where does UX come from, what are the benefits of using it, and how can it be applied to day to day agency work?
Understanding the User Centred Design process and how UX is an integral part of every piece of digital work that is produced.
BlendWebMix 2017 - Guérilla UX, "quick" mais pas "dirty" - Carine LallemandCarine Lallemand
Les ressources limitées des projets de conception incitent souvent à appliquer des méthodes UX rapides, low-cost, « quick & dirty ». Mais le « guerilla UX » peut aussi être « quick » sans être « dirty », être inspirant, et constituer une alternative valide aux méthodes traditionnelles de design UX. Au-delà des célèbres tests utilisateurs à la mode Starbucks, cette conférence vous présentera de nombreuses alternatives guérilla aux entretiens, questionnaires, observations, en passant aussi par l’idéation, le tri de cartes ou le maquettage. Une bonne dose d’inspiration pour se donner les moyens de faire de l’UX quand on n’en a pas les moyens !
NORDICHI'14 - Carine Lallemand - How Relevant is an Expert Evaluation of UX b...Carine Lallemand
Carine Lallemand - How Relevant is an Expert Evaluation of UX based on a Psychological Needs-Driven Approach? Paper presented at the 8th Nordic Conference on Human-Computer Interaction NORDICHI’14.
UX Design : Concevoir des expériences positives et engageantes - Carine Lalle...Carine Lallemand
Slides de la présentation "Concevoir des expériences positives et engageantes : l’UX Design de la théorie à la pratique" - par Carine Lallemand
Présentée lors du World Usability Day 2014 à Bruxelles (organisé par le Café Numérique).
Questionnaire d'évaluation UX AttrakDiff - version françaiseCarine Lallemand
Présentation de la version française du questionnaire AttrakDiff pour l'évaluation de l'expérience utilisateur (UX), validée par l'étude de Lallemand et al. (2015).
Lallemand, C., Koenig, V., Gronier, G., & Martin, R. (2015). Création et validation d’une version française du questionnaire AttrakDiff pour l’évaluation de l’expérience utilisateur des systèmes interactifs, Revue Européenne de Psychologie Appliquée. doi:10.1016/j.erap.2015.08.002
Workshop UX Design présenté lors du FLUPA UX-Day 2013. Animé par Carine Lallemand, Kerstin Bongard-Blanchy, Ioana Ocnarescu et Jean-Baptiste Labrune.
Résumé : Concevoir pour l'expérience utilisateur par l'approche des Experience Triggers (E.T.).
Embrace UX and adapt your evaluation methods accordingly (CanUX 2015 - short ...Carine Lallemand
Short talk presented at the CanUX 2015 conference (Ottawa).
"Embrace UX and adapt your evaluation methods accordingly!"
Carine Lallemand, University of Luxembourg
Presented 5/11/17 @LOCO_UX by @jkooda of @liminaUX
This talk covers the anatomy of a UX Eval, how to use it as a business development tool, and how to ensure you have a logical and most importantly beneficial return on your client's investment.
Atelier sur le design émotionnel réalisé au Web à Québec WAQ16 par Carine Lallemand en avril 2016. http://webaquebec.org/
Descriptif atelier (90 min) - Concevoir des expériences émotionnelles positives nécessite une compréhension de la nature des émotions et de leur impact sur l'expérience utilisateur (UX). Si certains designers talentueux sont capables de concevoir des expériences émotionnelles de manière "intuitive", il est possible pour tous d'adopter une approche plus structurée du design émotionnel.
Dans cet atelier, vous découvrirez le concept de granularité émotionnelle et comment développer cette qualité indispensable du designer UX. L’utilisation d’un outil de design émotionnel vous aidera ensuite à générer des concepts qui pourront intéresser, surprendre ou même fasciner vos utilisateurs ! Enfin, des outils d'évaluation des émotions seront présentés, car une fois un système conçu, il est indispensable de vérifier qu’il suscite bien l’expérience émotionnelle attendue.
Presents an introduction to some basic metrics for usability and some current trends in UX evaluation methods. Includes some indicative examples from UX evaluation studies conducted by the author
MyUOC is the new open-source online learning environment from the Open University of Catalonia (UOC) that has been designed to allow users to build their own learning environment according to their needs. Its innovative framework, based on Open Knowledge Initiative (OKI), turns MyUOC into the first truly interoperable learning platform. Indeed, MyUOC frees institutions and users from a limited set of tools or a concrete environment, providing instead a customized and "closer to the user" learning platform. This innovative open-source environment, based in standards, aims to promote and establish flexibility and interoperability in the educational community.
* Caroline Copestake, Project Manager, Office of Learning Technology, Universitat Oberta de Catalunya
* Alicia Valls Saez, User Centered Design, Universitat Oberta de Catalunya
In today’s digital age, creating a delightful user experience (UX) has become paramount for businesses seeking to stand out in a competitive landscape. Behind every intuitive website, app, or device lies a careful understanding of users and their needs. This is where UX research comes into play. In this guide, we will demystify this topic, exploring its significance, the role of a UX Researcher, and how to embark on this exciting career path.
A presentation to introduce UX for internships at Dextra.
The content was based on The UX Book – Process and Guidelines for Ensuring a Quality User Experience and there are some images from the book.
Evaluation of Web Applications based on UX ParametersIJECEIAES
The objective of evaluating User Experience (UX) in this era of technology is to enhance the user satisfaction. Earlier applications were built with the aim of reducing the work of users. But with the evolution of the technology, the emergence of new gadgets and new trends in the information technology, the applications had to be more user-centric. The primary objective of this research is to evaluate the user experience of web applications based on different UX parameters using different techniques and given a rating. Each of these ratings are combined to determine the overall rating of UX for the web application. Also, the secondary objective of this research is to provide suggestions or recommendations based on the ratings to improve the UX of the web applications. An experimental study was conducted and the results show a significant improvement. Areas of further enhancements have also been identified and presented.
Teaching/Learning IA: Considerations for UX Strategy in Educational ContextsGuiseppe Getto
My poster for the 2014 IA Summit (http://2014.iasummit.org/). It depicts a workflow for helping folks without UX experience to start working on projects.
Book Formatting: Quality Control Checks for DesignersConfidence Ago
This presentation was made to help designers who work in publishing houses or format books for printing ensure quality.
Quality control is vital to every industry. This is why every department in a company need create a method they use in ensuring quality. This, perhaps, will not only improve the quality of products and bring errors to the barest minimum, but take it to a near perfect finish.
It is beyond a moot point that a good book will somewhat be judged by its cover, but the content of the book remains king. No matter how beautiful the cover, if the quality of writing or presentation is off, that will be a reason for readers not to come back to the book or recommend it.
So, this presentation points designers to some important things that may be missed by an editor that they could eventually discover and call the attention of the editor.
Between Filth and Fortune- Urban Cattle Foraging Realities by Devi S Nair, An...Mansi Shah
This study examines cattle rearing in urban and rural settings, focusing on milk production and consumption. By exploring a case in Ahmedabad, it highlights the challenges and processes in dairy farming across different environments, emphasising the need for sustainable practices and the essential role of milk in daily consumption.
White wonder, Work developed by Eva TschoppMansi Shah
White Wonder by Eva Tschopp
A tale about our culture around the use of fertilizers and pesticides visiting small farms around Ahmedabad in Matar and Shilaj.
Hello everyone! I am thrilled to present my latest portfolio on LinkedIn, marking the culmination of my architectural journey thus far. Over the span of five years, I've been fortunate to acquire a wealth of knowledge under the guidance of esteemed professors and industry mentors. From rigorous academic pursuits to practical engagements, each experience has contributed to my growth and refinement as an architecture student. This portfolio not only showcases my projects but also underscores my attention to detail and to innovative architecture as a profession.
Transforming Brand Perception and Boosting Profitabilityaaryangarg12
In today's digital era, the dynamics of brand perception, consumer behavior, and profitability have been profoundly reshaped by the synergy of branding, social media, and website design. This research paper investigates the transformative power of these elements in influencing how individuals perceive brands and products and how this transformation can be harnessed to drive sales and profitability for businesses.
Through an exploration of brand psychology and consumer behavior, this study sheds light on the intricate ways in which effective branding strategies, strategic social media engagement, and user-centric website design contribute to altering consumers' perceptions. We delve into the principles that underlie successful brand transformations, examining how visual identity, messaging, and storytelling can captivate and resonate with target audiences.
Methodologically, this research employs a comprehensive approach, combining qualitative and quantitative analyses. Real-world case studies illustrate the impact of branding, social media campaigns, and website redesigns on consumer perception, sales figures, and profitability. We assess the various metrics, including brand awareness, customer engagement, conversion rates, and revenue growth, to measure the effectiveness of these strategies.
The results underscore the pivotal role of cohesive branding, social media influence, and website usability in shaping positive brand perceptions, influencing consumer decisions, and ultimately bolstering sales and profitability. This paper provides actionable insights and strategic recommendations for businesses seeking to leverage branding, social media, and website design as potent tools to enhance their market position and financial success.
Dive into the innovative world of smart garages with our insightful presentation, "Exploring the Future of Smart Garages." This comprehensive guide covers the latest advancements in garage technology, including automated systems, smart security features, energy efficiency solutions, and seamless integration with smart home ecosystems. Learn how these technologies are transforming traditional garages into high-tech, efficient spaces that enhance convenience, safety, and sustainability.
Ideal for homeowners, tech enthusiasts, and industry professionals, this presentation provides valuable insights into the trends, benefits, and future developments in smart garage technology. Stay ahead of the curve with our expert analysis and practical tips on implementing smart garage solutions.
UX STRAT 2016 - Ensuring Validity in Strategic UX Research Methods
1. Ensuring Validity in Strategic
UX Research Methods Dr. Carine Lallemand
University of Luxembourg
@carilallUX STRAT Europe 2016
2. 01
WHO AM I?
CARINE LALLEMAND
« I DESIGN,
ADAPT AND
VALIDATE
UX RESEARCH
METHODS »
Carine Lallemand
Guillaume Gronier
Méthodes
de design
30 MÉTHODES FONDAMENTALES POUR CONCEVOIR
ET ÉVALUER LES SYSTÈMES INTERACTIFS
DESIGN
32€
ConceptionNordCompo
DESIGN
Articulant théorie et pratique, cet ouvrage présente 30 fiches
méthodologiques couvrant l’essentiel du design UX et de
l’ergonomie des interactions homme-machine (IHM). Vous serez
guidé pas à pas à travers les étapes de réalisation de chaque
méthode et accompagné pour prendre les décisions les plus
adaptées à votre projet. Chaque fiche méthode intègre égale-
ment une partie théorique et des illustrations concrètes pour
faciliter la compréhension.
Véritable portfolio théorique et méthodologique, cet ouvrage
est un guide indispensable à toute personne impliquée dans
la conception de systèmes
interactifs. Professionnels,
chefs de projets, étudiants,
enseignants et chercheurs
y trouveront de précieuses
ressources pour mener à
bien leurs projets.
Grâce aux méthodes d’UX
design, créez des produits et
des services qui attirent, qui
captivent, qui enchantent et
inspirent pour améliorer la
vie de ceux qui les utilisent !
AU SOMMAIRE
Introduction au design UX ⍟ Planification ⍟ Définition du projet ⍟ Recrute-
ment des utilisateurs ⍟ Déontologie et éthique ⍟ Exploration ⍟ Entretien ⍟
Focus group ⍟ Observation ⍟ Questionnaire exploratoire ⍟ Sondes culturelles
⍟ Idéation ⍟ Brainstorming ⍟ Cartes d’idéation ⍟ Design studio ⍟ Experience
maps ⍟ Personas ⍟ Techniques génératives ⍟ Génération ⍟ Design persuasif
⍟ Gamification ⍟ Iconographie ⍟ Maquettage ⍟ Storyboarding ⍟ Tri de cartes
⍟ Évaluation ⍟ Complétion de phrases ⍟ Courbes d’éva-
luation UX ⍟ Échelles d’utilisabilité ⍟ Échelles UX ⍟ Éva-
luation des émotions ⍟ Évaluation experte ⍟ Inspection
cognitive ⍟ Journal de bord UX ⍟ Test des 5 secondes ⍟
Tests utilisateurs
CodeG14143
ISBN978-2-212-14143-6
« Aucun ouvrage francophone
ne rassemble autant
de savoir-faire ! Simple,
pratique et pédagogique,
c’est LE guide essentiel
de l’UX au quotidien. »
Corinne Leulier,
Psychologue - Ergonome,
directrice UX chez Klee Group
« Ergonomie, psychologie,
ingénierie, design, sociologie,
ethnographie… Ce livre est
une formidable proposition
pragmatique, claire et
actualisée des méthodes pour
la conception et l’évaluation
de l’expérience utilisateur ! »
Julien Kahn,
responsable pôle ergonomie
chez Orange
Chercheur à l’université de Luxembourg,
Carine Lallemand est spécialisée dans les
méthodes de conception et d’évaluation
de l’expérience utilisateur (UX). Impliquée
depuis 2010 dans l’association FLUPA, elle
est également conférencière et enseigne
l’UX design.
Guillaume Gronier est chercheur ergo-
nome au Luxembourg Institute of Science
and Technology. Ses principales activités
portent sur l’amélioration de l’expérience
utilisateur, l’acceptation technologique
et l’implication des utilisateurs dans le
processus de conception. Il est l’un des
fondateurs de l’association FLUPA.
Méthodes de design UX
UX
CarineLallemand
GuillaumeGronierMéthodesdedesignUX
Préface d’Alain Robillard-Bastien
FORMER VICE-
PRESIDENT
CURRENT COUNCIL
MEMBER
RESEARCHER
AT THE UNIVERSITY
OF LUXEMBOURG
@CARILALL
3. 01
WE NEED TO BASE STRATEGIC DECISIONS
ON VALID FINDINGS
4. 01
COLLECTING VALID AND RELIABLE DATA?
—> VALID & RELIABLE —> CONTEXTUALIZED & DYNAMIC
Asking SIRI?
Making a good
guess?
On-site live wind
measurement
Meteorological information
provided by official services
5. How can you safeguard a UX strategy by
ensuring the quality of research
conclusions?
6. Whenever we measure or observe we should be
concerned with whether we are measuring what we
intend to measure or with how our observations are
influenced by the circumstances in which they are made
8. 01
WORLD IA DAY 2016 PRESENTATION TITLE HERE
<STRATEGIC THINKING
>Doing the right things
= Using the right methods
TACTICAL THINKING
Doing things right
= Using the methods right
10. « Strangely, while I find the proposition to consider the experience
before the thing quite a radical change, many practitioners and
academics of HCI happily embrace experience – however, without
changing much in their approach. »
-Prof. Marc Hassenzahl (2013)
11. The nature and complexity of UX involves a deep
change in the methods we use
UX is highly dynamic
The memory of an experience matters more than the
experience itself
UX is highly contextual
UX is holistic1
2
3
4
5 UX is about emotions and psychological needs
12. UX is holistic
Thüring & Mahlke, 2007
A system’s perceived attractiveness is based on the perception of
its pragmatic and hedonic qualities
System
User
Context
Interaction
characteristics
Perception of non-instrumental qualities
Emotions
Perception of instrumental qualities
Components of User Experience
Consequences
overall evaluation,
acceptance, intention to
use, choice of alternatives
1
13. System
User
Context
Interaction
characteristics
Perception of non-instrumental qualities
Emotions
Perception of instrumental qualities
Components of User Experience
Consequences
overall evaluation,
acceptance, intention to
use, choice of alternatives
Usability scales
(SUS, QUIS, SUMI, WAMMI, etc)
established usability questionnaires focus on pragmatic aspects
only… this is not enough!
1
UX is holistic
Thüring & Mahlke, 2007
14. We need to assess both pragmatic and hedonic
perceived qualities of a system
AttrakDiff scale
(Hassenzahl et al., 2003)
User Experience
Questionnaire
(Laugwitz et al., 2008)
meCUE scale
(Minge & Riedel, 2013)
1
Using standardized and validated UX scales
15. The AttrakDiff scale: a standardized UX assessment tool
28 items (word pairs) divided into four subscales:
• Pragmatic qualities
• Hedonic qualities - stimulation
• Hedonic qualities - identification
• Attractiveness
• Single evaluation
• Comparison product A - product B
• Comparison Before - After
An abridged version (10 items)
Portfolio of results (comparison A vs. B)
(Hassenzahl et al., 2003)
16. UX is highly contextual
Context
User System
Social context
Technical context
Temporal context
Task context
Physical context
Time
2
17. user testing in a
controlled
environment
expert evaluation
traditional evaluation methods assess UX in an
artificial environment
Context
User System
Time
2
UX is highly contextual
18. How does UX alter laboratory evaluation?
Study conducted in 2015 (Lallemand et al., 2015)
Experiment involving 70 users, who were asked to
evaluate their UX with two systems
Research objective: assessing the quality and limitations
of « lab testing » for the evaluation of UX.
Results:
- validity of our assessment was limited to only the
pragmatic aspects of the interaction
- significant order effects
- impact of the scenarios of use on the felt experience
- impact of the environment and the lack of ecological
validity
- lack of evaluation of the dynamics of the experience
19. We need to evaluate UX in a natural or realistic setting
Field testing and
observation
"In-sitro" user testing
(Kjeldskov et al., 2004)
Experience sampling
(Csikszentmihalyi , 1990)
2
Ecological validity and the « turn to the wild »
20. Before usage
Anticipated UX
Imagining experience
During usage
Momentary UX
Experiencing
After usage
Episodic UX
Reflecting on an
experience
Over time
Cumulative UX
Recollecting multiple periods
of use
When:
What:
How:
UX White Paper, 2010
There are several time spans of UX
UX starts before the interaction and doesn’t end immediately
after the interaction
UX is highly dynamic
3
21. traditional or psychophysiological evaluation
methods focus on momentary UX… this is
not enough!
UX White Paper, 2010
user testing psychophysiological
measurements
Before usage
Anticipated UX
Imagining experience
During usage
Momentary UX
Experiencing
After usage
Episodic UX
Reflecting on an
experience
Over time
Cumulative UX
Recollecting multiple
periods of use
When:
What:
How:
UX is highly dynamic
3
22. The memory of an experience matters more than the
experience itself
Episodic UX is a reconstruction,
a remembered experience biased by cognitive
processes
The momentary experience is not as important
as the way it is remembered.
It’s the memory of an experience that influences
user’s behavior and the way he talks or
recommends the product to someone
4
23. We need to assess UX across time and to focus
on the memory of experiences
UX Curve
(Kujala et al., 2011)
Diary methods
Retrospective UX assessment
Analytic scale
(Karapanos et al., 2010)
Longitudinal study
3 4
24. The UX Curve method: retrospective UX evaluation
What they will tell you is biased by their memory, it is not similar to how they really felt
What matters is how they remember the experience with your system because they will
behave on this basis.
Unvalid, yet reliable?
performed simply on the basis of whether the starting point of the
curve was higher or lower compared to the end point. For example,
the curve in Fig. 2 was categorized as being improving as its start-
ing point was lower than its ending point, even though the curve
deteriorates in the middle. If the starting and ending points were
at the same level, the curve was categorized as stable. As the curves
were freehand drawings, they were categorized as stable if there
was a very small deviation (less than one millimeter) between
the vertical values of the starting and ending points of the curve.
However, it can be seen from Figs. 3–10 that the categorization
was rather straight-forward to do with the three trend type catego-
ries. The relationships between the curve types and the key
Fig. 4. The deteriorating and stable general UX Curves with user IDs.
Fig. 5. The improving Attractiveness curves with user IDs.
Fig. 7. The improving ease of use curves with user IDs.
Fig. 8. The deteriorating and stable ease of use curves with user IDs.
Fig. 4. The deteriorating and stable general UX Curves with user IDs.
Fig. 5. The improving Attractiveness curves with user IDs.
Fig. 6. The deteriorating and stable Attractiveness curves with user IDs.
Fig. 7. The improving ease of use curves with user IDs.
Fig. 8. The deteriorating and stable ease of use curves with user IDs.
Fig. 9. The improving utility curves with user IDs.
Results: Mean attractiveness curves
8
3.6.2011
Facebook Mobile phoneLong-term UX curves (for a specific UX dimension)
Kujala et al., 2011
25. UX is about emotions and psychological needs
Thinking about the experience first
Designing for emotions and psychological
needs
Using science-based design tools
5
26. Using science-based (yet pragmatic) design tools
5
UX theories as powerful triggers of innovative design ideas
—> Defining your Unique Value Proposition
PLEX Cards
playful experiences
(Lucéro & Arrasvuori, 2010)
Positive Emotional
Granularity Cards
(Yoon, Desmet, & Pohlmeyer, 2013)
UX Cards
psychological needs
(Lallemand et al., 2015)
28. Established evaluation methods only explore a limited
part of UX
single user testing
sessions
psychophysiological
measurements
expert evaluationusability scales
As we gain a deeper understanding of UX, we have to adapt
the methods we use to ensure validity
29. 01
WORLD IA DAY 2016
Some kind of illustration or image?
HEADER OPTION
SUB HEAD OR SHORT DESCRIPTION
Some kind of explanatory text, reference or footnote can go here and wrap to two lines, if needed.
USING THE
METHODS RIGHT
2
30. UX RESEARCH METHODS ARE
« Ingredients and Meals Rather Than Recipes »
…just as the quality of what is cooked reflects the quality of its
ingredients, so does the quality of UX work reflect the quality of
resources as configured and combined. Woolrych et al., 2011
32. 01
SAMPLING: TARGETING THE RIGHT USERS
Making the most out of opportunistic sampling?
Probability sampling: process that gives all the individuals in the population equal
chances of being selected
Opportunistic sampling: the availability of participants guides on-the-spot sampling
decisions
Sample size vary in different research settings. All else being equal, large sized sample
leads to increased precision in estimates of various properties of the population.
33. 01
WHAT ABOUT GUERRILLA RESEARCH?
A reasonable option?
Fast and cheap way to get a certain type of
feedback
• Only for consumer-oriented product
• Testing the understanding of the Value
Proposition or the usability of one specific
feature
Not always ‘better than no research’
35. 01
RESEARCH BIASES A few examples
Selection bias: one relevant group in the population has a higher probability of being
included in the sample.
—> Choosing a random or representative sample
Experimenter / interviewer bias: differential treatment of participants
—> Standardized procedures and instructions.
Expectancy / observer bias: the researcher’s expectations affect the outcome of a study
—> Having independent observers and computing inter-raters agreement
Social desirability bias: the tendency of respondents to answer questions in a manner that
will be viewed favorably by others
—> Careful formulation of questions and items. Use of projective techniques.
37. 01
COMBINING QUANTITATIVE & QUALITATIVE
Understanding « how » and « why »
Quantitative research methods: rely on using large sample sizes to establish trends and
conclusions.
Qualitative research: appropriate for getting a more in-depth, contextual understanding
of why those trends occur.
The best research strategies incorporate both approaches
38. Profile Unfinished sentence UX dimension
non ebook-
reader
Compared with a paper book, a digital book is… Comparison between products
In my opinion, digital books are addressed to… Identity / product image
I have never read digital books because… Frustrations / Barriers to use
I would read a digital book if… Expectations and needs
I expect a digital book to / that… Expectations and needs
When I read a paper book, I feel… Affects
ebook reader
Compared with a paper book, a digital book is… Comparison between products
The reading experience on a digital book is… Global UX
The problem with ebooks is… Issues and frustrations
What I love about ebooks is… Positive aspects / Appropriation factors
What frustrates me the most with a digital book is… Issues and frustrations
I find that the interface of a digital book is… Specific UX - Interface
I dream of a digital book that… Expectations / Dreams
Ongoing study (Lallemand & Mercier, 2015)
Designing an optimal e-reading experience
39. 01
LIKERT SCALE VS. SENTENCE COMPLETION
On a 7-points Likert scale, how would you rate
your overall e-reading experience? (N = 1284)
Self-reported overall e-reading experience
(7 points Likert scale)
Valence Frequency Percent
Negative 228 17,8 %
Positive 817 63,9 %
Neutral 160 12,5 %
Mixted 74 5,8 %
« The reading experience on a
digital book is… »
Valence analysis of sentence L_SC_2
Ongoing study (Lallemand & Mercier, 2015)
Designing an optimal e-reading experience
40. 01
LIKERT SCALE VS. SENTENCE COMPLETION
The problem with ebooks is…
- the price
- the lack of availability and choice
- the absence of a sensual experience (feeling the
paper in one’s hands)
- the navigation and information architecture
- the battery / the need for a network connexion
- their bad quality
- the impossibility to lend the book to a friend
- DRM (digital rights management)
- the bad reading experience
- the screen and visual fatigue
- it is dematerialized
- …
that you don’t see what people are reading
because you don’t see the book cover…
you can't skim or flip through easily
I’m not able to physically track my
progress in the book
Designing an optimal e-reading experience
Ongoing study (Lallemand & Mercier, 2015)
41. 01
VALIDITY & RIGOR, YET SCALED TO THE NEED
Basing strategic decisions on valid findings
Rigor should be proportional to the risk
Catching up on emerging research and using freely available valid
yet lightweight UX methods developed in Academia
Rethinking your Unique Value Proposition thanks to UX theories
42. THANK YOU FOR YOUR ATTENTION
Dr. Carine Lallemand
Twitter @carilall http://uxmind.eu
43. 01
REFERENCES
• Csikszentmihalyi, M. (1990). Flow. The psychology of optimal experience, Harper and Row.
• Hassenzahl, Marc (2013): User Experience and Experience Design. In: Soegaard, Mads and Dam, Rikke Friis (eds.). "The Encyclopedia of
Human-Computer Interaction, 2nd Ed.". Aarhus, Denmark: The Interaction Design Foundation.
• Hassenzahl, M., Burmester, M., & Koller, F. (2003). AttrakDiff : Ein Fragebogen zur Mes- sung wahrgenommener hedonischer und pragmatischer
Qualität. In J. Ziegler & G. Szwillus (Eds.) Mensch & Computer 2003. Interaktion in Bewegung, 187–196. Stuttgart: B.G. Teubner.
• Kahneman, D., et al., (2004). A survey method for characterizing daily life experience: The Day Reconstruction Method, Science, CCCVI(5), 702.
• Karapanos, E., Martens, J.-B., & Hassenzahl, M. (2010). On the Retrospective Assessment of Users’ Experiences Over Time : Memory or Actuality
? Proc. of CHI 2010, 2689-2698.
• Kjeldskov, J., & Skov, M.B. (2007). Studying Usability In Sitro : Simulating Real World Phenomena in Controlled Environments. International Journal
of Human-Computer Interac- tion, 22(1-2), 7–36.
• Kujala,S., Roto,V., Väänänen-Vainio-Mattila,K., Karapanos,E., &Sinnelä,A. (2011). UX Curve: A method for evaluating long-term user experience.
Interacting with Computers, 23, 473-483.
• Lallemand, C. (2015). Towards Consolidated Methods for the Design and Evaluation of User Experience. (Doctoral dissertation). University of
Luxembourg. https://publications.uni.lu/handle/10993/21463
• Laugwitz, B, Held, T., & Schrepp, M. (2008). Construction and evaluation of a user expe- rience questionnaire. In A. Holzinger (Ed.) USAB 2008,
LNCS 5298. Berlin: Springer Verlag.
• Lucero, A., & Arrasvuori. J. (2010) PLEX Cards : a source of inspiration when designing for playfulness. Proc. of Fun and Games 2010. New York,
USA: ACM, 28-37.
44. 01
REFERENCES
• Minge, M., & Riedel, L. (2013). meCUE – Ein modularer Fragebogen zur Erfassung des Nutzungserlebens. Presented at Mensch und Computer
2013, Bremen.
• Roto, V., Law, E., Vermeeren, A., & Hoonhout, J. (2011) User Experience White Paper: Bringing clarity to the concept of user experience. Result
from Dagstuhl Seminar on Demar- cating User Experience, Finland.
• Thüring, M., & Mahlke, S. (2007). Usability, aesthetics and emotions in human-technology interaction. International Journal of Psychology, 42(4),
253-264.
• Yoon, J., Desmet, P. M. A., & Pohlmeyer, A. E. (2013). Embodied Typology of Positive Emotions: The Development of a Tool to Facilitate Emotional
Granularity in Design (pp. 1195–1206). Presented at the 5th International Congress of International Association of Sciences of Design Research,
Tokyo, Japan.
• Woolrych, A., Hornbæk, K., Frøkjær, E. & Cockton, G. (2011). “Ingredients and meals rather than recipes : a proposal for research that does not
treat usability evaluation methods as indivisible wholes”. International Journal of Human-Computer Interaction, 27(10), 940-970
• Adam Cooper, Cetis Blog 2014 - http://blogs.cetis.org.uk/
• http://www.uxbooth.com/articles/complete-beginners-guide-to-design-research/
Download the UX Cards : http://uxmind.eu/portfolio/ux-design-and-evaluation-cards
Download the PLEX Cards : http://www.funkydesignspaces.com/plex/
Download the Positive Emotional Granularity Cards : www.diopd.org/emotioncards