Preference and Desirability Testing: Measuring Emotional Response to Guide De...Paul Doncaster
(From UPA 2011-Atlanta) Usability practitioners have a variety of methods and techniques to inform interaction design and identify usability problems. However, these tools are not as effective at evaluating the visceral and emotional response generated by visual design and aesthetics. This presentation will discuss why studying visual design is important, review considerations for preference and desirability testing and present two alternative approaches to user studies of visual designs in the form of case studies.
Jeff Belden MD and Janey Barnes PhD co-presented at HIMSS Virtual Conference June 2010. You can hear the audio recording if you are a HIMSS member, available online.
Preference and Desirability Testing: Measuring Emotional Response to Guide De...Paul Doncaster
(From UPA 2011-Atlanta) Usability practitioners have a variety of methods and techniques to inform interaction design and identify usability problems. However, these tools are not as effective at evaluating the visceral and emotional response generated by visual design and aesthetics. This presentation will discuss why studying visual design is important, review considerations for preference and desirability testing and present two alternative approaches to user studies of visual designs in the form of case studies.
Jeff Belden MD and Janey Barnes PhD co-presented at HIMSS Virtual Conference June 2010. You can hear the audio recording if you are a HIMSS member, available online.
UXPA International 2013 The Note-Taker's Perspective UserWorks
Kristen Davis's and Dick Horst's 2013 UXPA International presentation on The Note-Taker's Perspective During Usability Testing: Recognizing What's Important, What’s Not.
Creativity is the act of turning new and imaginative ideas into reality. Creativity is characterised by the ability to perceive the world in new ways, to find hidden patterns, to make connections between seemingly unrelated phenomena, and to generate solutions.
Slides talk about complete process of usability testing, extensively discusses usability components, phases of usability testing process and significance of designing with empathy
Day 1 slides from a two-day workshop on UX foundations by Meg Kurdziolek and Karen Tang. Day 1 covered the building blocks of design process and design research methods.
A3 Problem Solving Template v1.2 (April 2015) by Henrik Knibe.docxSALU18
A3 Problem Solving Template v1.2 (April 2015) by Henrik Kniberg and Tom Poppendieck
License: Creative Commons Attribute 4.0 International
Original link: http://www.crisp.se/lean/a3-template
Background PLAN
Current condition PLAN
Goal / Target Condition PLAN
Root Cause Analysis PLAN
Countermeasures (experiments) DO
Confirmation (results) CHECK
Follow up (actions) ACT
Owner:
Mentor:
Date:
A3: <problem statement>
http://www.crisp.se/henrik.kniberg/
http://www.poppendieck.com/people.htm
http://creativecommons.org/licenses/by/4.0/
http://www.crisp.se/lean/a3-template
A3 Problem Solving Template v1.2 (April 2015) by Henrik Kniberg and Tom Poppendieck
License: Creative Commons Attribute 4.0 International
Original link: http://www.crisp.se/lean/a3-template
Background PLAN
● Why is this important?
● Why should the reader care about this situation and be motivated to participate in
improving?
Assessment Questions
1. Is there a clear theme for the problem report that reflects the contents?
2. Is the topic relevant to the organization’s objectives?
3. Is there any other reason for working on this topic (e.g. learning purposes)?
Current condition PLAN
● How do things work today?
● What is the problem?
● Baseline Metrics?
Assessment Questions
1. Is the current condition clear and logically depicted in a visual manner?
2. How could the current condition be made clearer for the audience?
3. Is the current condition depiction framing a problem or a situation to be resolved?
4. What is the actual problem in the current condition?
5. Are the facts of the situation clear, or are there just observations and opinions?
6. Is the problem quantified in some manner or is it too qualitative?
Goal / Target Condition PLAN
● What outcomes are expected for what reasons?
● What changes in metrics can be plausibly expected?
Assessment Questions
1. Is there a clear goal or target?
2. What, specifically, is to be accomplished?
3. How will this goal be measured or evaluated?
4. What will improve, by how much, and when?
Root Cause Analysis PLAN
● What is the root cause(s) of the problem?
● Use a simple problem analysis tool (e.g. 5 why’s, fishbone diagram, cause/effect diagram) to
show cause-and-effect relationships.
Assessment Questions
1. Is the analysis comprehensive at a broad level?
2. Is the analysis detailed enough and did it probe deeply enough on the right issues?
3. Is there evidence of proper five-whys thinking about the true cause?
4. Has cause and effect been demonstrated or linked in some manner?
5. Are all the relevant factors considered (human, machine, material, method, environment,
measurement, and so on?)
6. Do all those who will need to collaborate in implementing the countermeasures agree on the
cause/effect reasoning?
Countermeasures (experiments) DO
● Proposed countermeasure(s) to address each candidate root cause (this should be a series
of quick experiment to validate causal model analysis)
● Predicted result for e.
Organic vs Mechanistic StructuresMechanistic OrganicIn.docxhopeaustin33688
Organic vs Mechanistic Structures
Mechanistic Organic
Individual specialization:
Employees work separately
and specialize in one task
Joint Specialization:
Employees work together and
coordinate tasks
Simple integrating mechanisms:
Hierarchy of authority well-defined
Complex integrating mechanisms:
task forces and teams are primary
integrating mechanisms
Centralization:
Decision-making kept as high as possible.
Most communication is vertical.
Decentralization:
Authority to control tasks is delegated.
Most communication lateral
Standardization:
Extensive use made of rules & Standard
Operating Procedures
Mutual Adjustment:
Face-to-face contact for coordination.
Work process tends to be unpredictable
Much written communication Much verbal communication
Informal status in org based on size of
empire
Informal status based on perceived
brilliance
Organization is a network of positions,
corresponding to tasks. Typically each
person corresponds to one task
Organization is network of persons or
teams. People work in different capacities
simultaneously and over time
Page 1 of 1Organic vs Mechanistic Structures
6/24/2014http://www.analytictech.com/mb021/organic_vs_mechanistic_structure.htm
Question 1.1. (TCO 4) The ABC format stands for (Points : 5)
abstract, body, conclusion.
analysis, body, content.
appendix, block, conclusion.
attention, build, conclude.
Question 2.2. (TCO 1) Parallelism in a list refers to (Points : 5)
using bullets and numbers.
using no more than 10 items in a list.
keeping all points grammatically the same.
keeping all points as short as possible.
Question 3.3. (TCO 1) Graphics receive the most attention when they are placed where on a page? (Points : 5)
Near the bottom of the page
In the center of the page
Near the top of the page
On the right-hand side of the page
Question 4.4. (TCO 2) Formal definitions include all of the following except (Points : 5)
the term itself.
a class to which the term belongs.
distinguishing features of the term.
several paragraphs or more.
Question 5.5. (TCO 2) Effective instructions include (Points : 5)
placing only one action in each step.
beginning each step with a noun.
avoiding the use of lists.
first-person references.
Question 6.6. (TCO 3) The "you" attitude best refers to which of the following? (Points : 5)
A focus on “you,” the writer
A focus on your reader’s perspective
The use of writer-centered prose
The use of first person
Question 7.7. (TCO 3) When writing a bad-news message, it’s best to (Points : 5)
open with the bad news first.
open with a buffer statement.
place the bad news last.
use e-mail when possible.
Question 8.8. (TCO 5) At a presentation, most listeners remember information best when it is grouped in (Points : 5)
three.
UXPA International 2013 The Note-Taker's Perspective UserWorks
Kristen Davis's and Dick Horst's 2013 UXPA International presentation on The Note-Taker's Perspective During Usability Testing: Recognizing What's Important, What’s Not.
Creativity is the act of turning new and imaginative ideas into reality. Creativity is characterised by the ability to perceive the world in new ways, to find hidden patterns, to make connections between seemingly unrelated phenomena, and to generate solutions.
Slides talk about complete process of usability testing, extensively discusses usability components, phases of usability testing process and significance of designing with empathy
Day 1 slides from a two-day workshop on UX foundations by Meg Kurdziolek and Karen Tang. Day 1 covered the building blocks of design process and design research methods.
A3 Problem Solving Template v1.2 (April 2015) by Henrik Knibe.docxSALU18
A3 Problem Solving Template v1.2 (April 2015) by Henrik Kniberg and Tom Poppendieck
License: Creative Commons Attribute 4.0 International
Original link: http://www.crisp.se/lean/a3-template
Background PLAN
Current condition PLAN
Goal / Target Condition PLAN
Root Cause Analysis PLAN
Countermeasures (experiments) DO
Confirmation (results) CHECK
Follow up (actions) ACT
Owner:
Mentor:
Date:
A3: <problem statement>
http://www.crisp.se/henrik.kniberg/
http://www.poppendieck.com/people.htm
http://creativecommons.org/licenses/by/4.0/
http://www.crisp.se/lean/a3-template
A3 Problem Solving Template v1.2 (April 2015) by Henrik Kniberg and Tom Poppendieck
License: Creative Commons Attribute 4.0 International
Original link: http://www.crisp.se/lean/a3-template
Background PLAN
● Why is this important?
● Why should the reader care about this situation and be motivated to participate in
improving?
Assessment Questions
1. Is there a clear theme for the problem report that reflects the contents?
2. Is the topic relevant to the organization’s objectives?
3. Is there any other reason for working on this topic (e.g. learning purposes)?
Current condition PLAN
● How do things work today?
● What is the problem?
● Baseline Metrics?
Assessment Questions
1. Is the current condition clear and logically depicted in a visual manner?
2. How could the current condition be made clearer for the audience?
3. Is the current condition depiction framing a problem or a situation to be resolved?
4. What is the actual problem in the current condition?
5. Are the facts of the situation clear, or are there just observations and opinions?
6. Is the problem quantified in some manner or is it too qualitative?
Goal / Target Condition PLAN
● What outcomes are expected for what reasons?
● What changes in metrics can be plausibly expected?
Assessment Questions
1. Is there a clear goal or target?
2. What, specifically, is to be accomplished?
3. How will this goal be measured or evaluated?
4. What will improve, by how much, and when?
Root Cause Analysis PLAN
● What is the root cause(s) of the problem?
● Use a simple problem analysis tool (e.g. 5 why’s, fishbone diagram, cause/effect diagram) to
show cause-and-effect relationships.
Assessment Questions
1. Is the analysis comprehensive at a broad level?
2. Is the analysis detailed enough and did it probe deeply enough on the right issues?
3. Is there evidence of proper five-whys thinking about the true cause?
4. Has cause and effect been demonstrated or linked in some manner?
5. Are all the relevant factors considered (human, machine, material, method, environment,
measurement, and so on?)
6. Do all those who will need to collaborate in implementing the countermeasures agree on the
cause/effect reasoning?
Countermeasures (experiments) DO
● Proposed countermeasure(s) to address each candidate root cause (this should be a series
of quick experiment to validate causal model analysis)
● Predicted result for e.
Organic vs Mechanistic StructuresMechanistic OrganicIn.docxhopeaustin33688
Organic vs Mechanistic Structures
Mechanistic Organic
Individual specialization:
Employees work separately
and specialize in one task
Joint Specialization:
Employees work together and
coordinate tasks
Simple integrating mechanisms:
Hierarchy of authority well-defined
Complex integrating mechanisms:
task forces and teams are primary
integrating mechanisms
Centralization:
Decision-making kept as high as possible.
Most communication is vertical.
Decentralization:
Authority to control tasks is delegated.
Most communication lateral
Standardization:
Extensive use made of rules & Standard
Operating Procedures
Mutual Adjustment:
Face-to-face contact for coordination.
Work process tends to be unpredictable
Much written communication Much verbal communication
Informal status in org based on size of
empire
Informal status based on perceived
brilliance
Organization is a network of positions,
corresponding to tasks. Typically each
person corresponds to one task
Organization is network of persons or
teams. People work in different capacities
simultaneously and over time
Page 1 of 1Organic vs Mechanistic Structures
6/24/2014http://www.analytictech.com/mb021/organic_vs_mechanistic_structure.htm
Question 1.1. (TCO 4) The ABC format stands for (Points : 5)
abstract, body, conclusion.
analysis, body, content.
appendix, block, conclusion.
attention, build, conclude.
Question 2.2. (TCO 1) Parallelism in a list refers to (Points : 5)
using bullets and numbers.
using no more than 10 items in a list.
keeping all points grammatically the same.
keeping all points as short as possible.
Question 3.3. (TCO 1) Graphics receive the most attention when they are placed where on a page? (Points : 5)
Near the bottom of the page
In the center of the page
Near the top of the page
On the right-hand side of the page
Question 4.4. (TCO 2) Formal definitions include all of the following except (Points : 5)
the term itself.
a class to which the term belongs.
distinguishing features of the term.
several paragraphs or more.
Question 5.5. (TCO 2) Effective instructions include (Points : 5)
placing only one action in each step.
beginning each step with a noun.
avoiding the use of lists.
first-person references.
Question 6.6. (TCO 3) The "you" attitude best refers to which of the following? (Points : 5)
A focus on “you,” the writer
A focus on your reader’s perspective
The use of writer-centered prose
The use of first person
Question 7.7. (TCO 3) When writing a bad-news message, it’s best to (Points : 5)
open with the bad news first.
open with a buffer statement.
place the bad news last.
use e-mail when possible.
Question 8.8. (TCO 5) At a presentation, most listeners remember information best when it is grouped in (Points : 5)
three.
Purpose Before Action: Why You Need a Design Language Systemcreckling
Abstract: Ask two designers to design the same user interface and you will likely end up with two very different designs and interactions on the page. Ask two developers to implement that page and you will end up with different code, too! And that, in a nutshell, is why you need a system.
Have you ever wondered what it takes to build your own design language system? It sounds intimidating, but it's not!
Link: https://uxpabostonconference2018.sched.com/event/E2NS/purpose-before-action-why-you-need-a-design-language-system
Design thinking is a cooperative problem-solving framework based on observations and experiments. This is a short introduction to the methods and pocesses of design thinking, with practical examples of how it's used to create products, services and on-screen experiences.
This is an example of the type of research reports that we do. Of course, your report would be custom and answer the questions you need to make a good business decision.
Usability testing (or user testing) involves measuring the ease with which users can complete common tasks on your website. The results of the analysis are a huge eye-opener and their implementation often leads to:
Increased sales and task completion and a high rate of return site visitors
A greatly improved understanding of your customers’ needs
A significant reduction in call centre enquiries
A much more user-focused in-house development team Source: http://www.wbcsoftwarelab.com/wbcblog/read-basics-of-usability-testing
Introduction to Prototyping - Scottish UPA - June 2011Neil Allison
Presented to the Scottish Usability Professionals Association, Edinburgh, 22 June 2011.
Covering the basics, the benefits, some tools, some tips and a case study.
Collaborative Experience design workshop
Facilitated by
Kiran K S
User Experience Designer
Hewlett Packard, Singapore
and
Shaun Chen
User Experience Designer
Hewlett Packard, Singapore
Every study starts with a question. This session at CSUN 2014 started by examining the questions that usability testing can answer. Short case studies illustrate how the right technique will help us know not only what is happening but also why it’s happening. It's an overview of usability testing as a research method, and what you can (and can’t) learn from working with real people as they try to use a web site or other product.
Similar to Desirability and Preference Testing - UPA International 2011 (20)
Beyond Usability Testing: Assessing the Usefulness of Your Designhawleymichael
Usability tests are meant to find usability problems. If your question is, “where are the usability problems in this design”, usability testing is right for you. With usability testing, can study how well someone can get from point A to point B and where are the problems along the way. Finding usability problems is the focus, and the method works great.
But, we are finding that many of the questions business sponsors and stakeholders have are not about finding usability problems. The questions they have are more about the overall usefulness of a design, its potential for success, and how well it meets expectations.
This presentation will define usefulness research, show how it is different from usability tests, and offer different approaches for asking the right questions of users. Whether you think this is slap-your-forehead obvious or a method that needs to be expanded and refined, we seek to have a lively conversation.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
Desirability and Preference Testing - UPA International 2011
1. Preference and Desirability Testing: Measuring Emotional Response to Guide Design Michael Hawley Chief Design Officer, Mad*Pow Paul Doncaster Senior User Experience Designer, Thomson Reuters
2. Agenda Why we should care Why it’s not always as simple as asking:“Which option do you prefer?” Methods to consider Case Study: Greenwich Hospital Case Study: WestlawNext Summary/Comparison
5. An important role of visual design is to lead users through the hierarchy of a design as we intend For interactive applications, a sense of organization can affect perceived usability and, ultimately, users’ overall satisfaction with the product Functional Desirability
13. Poor articulation “It reminds me of…” “It’s nice and clean.” “There’s just something about it . . .” “I ordinarily don’t like red, but for some reason it works here . . .” “It’s better than the other ones.”
14. What Stakeholders Should Care About “We should go with design C over A and B, because I feel it evokes the right kind of emotional response in our audience that is closer to our most important brand attributes.”
16. Present three different concepts or ideas to participants, and ask them to identify how two of them are different from the third and why. 14 Triading
30. Determine intended brand attributes (and their opposites) 21 Product Reaction Cards: Before You Begin Leverage existing marketing/brand materials Alternatively, stakeholder brainstorm to identify key brand attributes/descriptors using full list of product reaction cards as a start Tip: “If the brand was a person, how would it speak to your customers?”
31. Methodology Include 60/40 split of positive and negative words Target 60 words, optimized to test brand Simple question: “Which of the following words do you feel best describe the site/design/product (please select 5):” One comp per participant, or multiple comps per participant (no more than 3) Participants Qualitative: Paired with usability testing Quantitative: Target minimum of 30 per option if possible 22 Product Reaction Cards: Conducting
32. 23 Process - Analyzing Calculate percentage of positive and negative attributes per design Visualize overall sentiment of feedback using “word clouds” (see wordle.net) 68% Positive 32% Negative
39. Additional feedback obtained via participant interviews (qualitative)Survey Questions Hello, I am requesting feedback on a website I am working on. Your answers let me know if the site is conveying the right feel. 1. What are your initial reactions to the web site? 2. Which of the following words best do you feel best describe the site (select 5):
55. Sessions were held in 4 cities over 5 days Seattle Denver Memphis Minneapolis-St. Paul 4 sessions were held per day, with a maximum of 25 participants per session 1.5 hours allotted per study, most participants finished in less than 1 hour 319 participants successfully completed their sessions Phase 1: Logistics & Execution
56. Participants completed the study at individual workstations at their own pace All workstations included a 20” monitor, at 1024x768 resolution Phase 1: Logistics & Execution Memphis, TN, May 2009
57. Brief review of Westlaw critical screens Positive/negative word selection to describe Westlaw 36 Positive/negative product descriptors
58. Each set of Element variations were viewed in full screen Participant selects “top choice” by dragging a thumbnail image to a drop area 37 Homepage: Design Elements
60. Homepage: Design Elements (1) All options viewed in full screen Participant selects “top choice” by dragging a thumbnail image to a drop area
61.
62.
63. Visual Weight (6 options) Use of Imagery (8 options) Components (4 options) Search Area (4 options) Palette (10 options) Homepage: Design Elements
64. 19 HP designs viewed in full screen (randomized) All 19 options are presented again; participant assigns a rating using a 10-point slider. Top 5 and Bottom 2 choices are positioned in order of rating values on one long, scrollable page. Next to each design displayed, rates key aspects for each design on a 5-point scale Homepage: Design Gallery
102. Home Page (19) HP16 & HP15 designs consistently placed in the Top 5 across all filters Results List (14) RL4 consistently placed in the Top 3 across all sample filters, and was the #1 choice for 80% of all participants Document Display (9) DD3 placed in the Top 5 across all sample filters and was the #1 choice for 77% of all participants Phase 1: High-level Results
103. Note, participants were asked to describe the current Westlaw before being shown the new designs. 55 Phase 1: Word Selection Results
108. “No Big Fonts Please”The study narrowed the list of potential designs, and we better understood what design elements that Westlaw users liked and disliked. Phase 1: High-level Results
109. 57 Phase 2: September 2009 Kansas City, MO, Sept 2009
112. Get closure on other design options for online and printed content
113.
114. Method View, Rate, and Pick Top Choice for Homepage (3 options) Result List (2 options) Document Display (2 options) “Why?” Simple preference selection for two unresolved UI design issues Citing References: Grid display or List display? Out of Plan Indication design (6 options) Type formatting preferences for 3 different content types Font Face Font Size Margin Width Phase 2: September 2009
115. Logistics 3 cities (Philadelphia, Kansas City, Los Angeles) 1 Day 226 participants Analysis Filters (8 categories) were used to score the designs for each visual preference Results Clear choices for top designs in each of all categories “Why” feedback shed new light on designs under consideration and helped focus “homestretch” design activities Phase 2: September 2009
116. Home Page (3) HP3 ranked #1in 94% of filter groups (54% of total participants) Results List (2) RL5 ranked #1in 97% of filter groups (58% of total participants) Document Display (2) DD7 ranked #1in 94% of filter groups (61% of total participants) Phase 2: High-level Results
117. The main concerns regarding Homepage Design HP3 Search Box Too small How do I do a Terms-and-Connectors search? Browse Section How do I specify multiple or specific search content? Poor organization Poor label Need access to “often-used” content Need better access to help 62 Participant Comments: Homepage
118. Goals Get feedback on branding options from decision makers and those who influence purchase of the product Get closure on final outstanding design issues Tool Same as in Rounds 1 & 2, with some minor revisions to accommodate specialized input Phase 3: December 2010
119. Method Wordmark/Branding View wordmark color combinations and design elements against different backgrounds, pick top choice and provide comments Make a final “Top Choice” from all selections Simple preference selection for outstanding UI design issues Header Space: Tile or No Tile? Notes Design Location: Inline or Column? State: Open or Closed? Headnote Icon design (4 variations) Phase 3: December 2010
120. What color combination do you prefer? Please rank the 4 combinations below according to your preferences. To rank, click and drag an item from the left to a box on the right. Your Most Liked 1 2 3 4 Your Least Liked
121. Logistics 3 cities (Seattle, Denver, Boston) 1 Day 214 participants Analysis Simple preference, no advanced filters Results Decision-makers confirmed that critical brand elements should be retained Phase 3: December 2010
141. Both groups valued support in design decision making Align methodology with needs of the project Research-inspired, not research-decided 74 Summary/Comparison
143. Benedek, Joey and Trish Miner. “Measuring Desirability: New Methods for Evaluating Desirability in a Usability Lab Setting.” Proceedings of UPA 2002 Conference, Orlando, FL, July 8–12, 2002. http://www.microsoft.com/usability/uepostings/desirabilitytoolkit.doc Lindgaard, Gitte, Gary Fernandes, Cathy Dudek, and J. Brown. "Attention Web Designers: You Have 50 Milliseconds to Make a Good First Impression!" Behaviour and Information Technology, 2006. http://www.imagescape.com/library/whitepapers/first-impression.pdf Rohrer, Christian. “Desirability Studies: Measuring Aesthetic Response to Visual Designs.” xdStrategy.com, October 28, 2008. Retrieved February 10, 2010. http://www.xdstrategy.com/2008/10/28/desirability_studies 76 Additional Reading
144. User Focus. "Measuring satisfaction: Beyond the Usability Questionnaire." Retrieved February 10, 2010. http://www.userfocus.co.uk/articles/satisfaction.html UserEffect. "Guide to Low-Cost Usability Tools." Retrieved May 12, 2010.http://www.usereffect.com/topic/guide-to-low-cost-usability-tools Tullis, Thomas and Jacqueline Stetson. “A Comparison of Questionnaires for Assessing Website Usability.” Usability Professionals’ Association Conference, 2004.home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf Westerman, S. J., E. Sutherland, L. Robinson, H. Powell, and G. Tuck. “A Multi-method Approach to the Assessment of Web Page Designs.” Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, 2007.http:// portal.acm.org/citation.cfm?id=1422200 77 Additional Reading
Impacts a product's or application's perceived:UtilityUsabilityCredibility
If users have a positive impression of the design aesthetics, they are more likely to overlook or forgive poor usability or limited functionality. With a negative impression, users are more likely to find fault with an interaction, even if a product’s overall usability is good and the product offers real value.
High desirability feeds into the motivational factors that help trigger target behavior.
High desirability feeds into the motivational factors that help trigger target behavior.
The simplicity of the question doesn’t work well with larger numbers of design options, especially if some are highly similar
People can have a difficult time articulating what it is about a design they like or dislike
The whys are important for stakeholder acceptance (branding guidelines)Business sponsors and stakeholders often want substantial customer feedback to assure them a given direction is correct.
TriadingQualitative interview technique that reveals constructsElicits attributes that are important to users in their vocabularyResearcher asks the participant to identify how two of the three examples are different from the thirdIn typical user research interviews, a researcher asks participants about their thoughts on a defined list of topics. The disadvantage of this approach is that the researcher may be inquiring about topics that are of little value or significance to the experience of the participants. Generally, participants will dutifully answer questions about any topics we ask them about, without thinking more broadly, going beyond the limits our questions impose, or interrupting us to tell us about dimensions that may be more relevant to them. Participants assume researchers are interested in studying the particular topics they’ve included in their interview scripts and don’t raise other issues that might be more pertinent to their overall experience with a product or potential design.Triading is a method that allows a researcher to uncover dimensions of a design space that are pertinent to its target audience. In triading, researchers present three different concepts or ideas to participants and ask them to identify how two of them are different from the third. Participants describe, in their own terms, the dimensions or attributes that differentiate the concepts. Participants follow this process iteratively—identifying additional attributes they feel distinguish two of the concepts from the third until they can’t think of any other distinguishing factors. By repeating this process across multiple participants, researchers can see trends that define audience segments or personas.The benefit of this process is that it uncovers dimensions of a particular domain that are important to the target audience rather than the researcher or designer. In addition, the dimensions participants identify are generally emotional aspects that it is important for experience designers to consider. For example, participants may describe differences in groups as “warm” versus cold” or business-like” versus fun.” Designers can then use the most relevant or common dimensions as inspiration for further design and exploration.
Benefits – straightforward and easy to administer on a large scaleNegatives – if you want to pick more than a clear winner but rather understand the emotional connections/reactions to each design this will not lend itself to that.
Obvious examples are consumer electronics or other retail productsAlso appropriate for applications in healthcare, insurance, financial, travel, etc.
Sensors track participants’ physiological measurements to particular designs. Changes in suggest a particular emotional response.Paired with attitudinal and self-reporting surveys measurements give a multifaceted view of emotional reactions to a design
Respondents are being asked: "To which extent do the feelings expressed by the characters correspond with your own feelings towards the stimulus?“Building on the responses of many people allows you to abstract valuable data pertaining to the emotional performance of your website, product, service.
“My initial reaction to this web site is that it seems kind of plain. There is not much going on in the page, and the colors seem kind of drab.”“This is a nice looking website. It is well designed, well laid out, and is appealing to look at. It makes me want to continue to navigate the site to learn more. “
“Men don’t really go with children… where there’s a baby, there must be a mother.”“My initial reaction to the website is that it seems very clean and modern. I like the layout, it looks like its easy to find information.”
“I felt love. I saw a mother holding a child…that’s pretty touchy. The site looks good, and it makes the hospital trustworthy.”“My initial reaction was that the hospital is represented by a caring, warm and friendly website.”
*** review no big fonts **
Evolution of how the document separates from the header and tools, and related topics on right