Slides from a workshop at the 2019 Service Design in Government conference, Edinburgh, March 2019.
The workshop challenged participants to consider:
what happens after you've done some user research for your service? Decisions made, do you move on and forget it? Or do you preserve that research for re-use and future team members? The session was an opportunity for user researchers in government to describe, compare and improve ResearchOps activities.
Discussing a Topic Map for How to Design a Better Form 2019 MarchCaroline Jarrett
If a person working on a government form wants to improve that form, what advice can we offer?
This discussion of a topic map for 'how to design a better form' is from a webinar on 9th April 2019 for the GSA (General Services Administration) Research Guild, and Digital.gov, in the US.
Inwards and outwards research: choosing your research methods according to th...Caroline Jarrett
Is your user research looking inwards, at how your service works, or outwards, at the lives of those it affects?
The right research in the right direction at the right time can truly add value - but there’s usually no point in running a survey of 10,000 people in discovery or waiting until beta to look for high-level user needs.
This session, run with Clara Greo at the 2020 Service Design in Government conference, was a chance for colleagues to share their research questions, and think about how to map them to the right methods.
A presentation on Label placement in forms, at the Technical Communication Summit, Seattle, US, April 2010. Amongst the time-consuming controversies we look at are left and right alignment, labels above and below fields, how to handle required fields, colons, and sentence case.
The first part of a workshop on user experience surveys. Topics: (1) how to improve the questions in surveys and (2) how to assess UX using a survey.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Forms that work: Understanding forms to improve their design by @cjformsCaroline Jarrett
A day-long workshop on forms design, focusing on why businesses need forms and how people interact with them.
Accessibility note: I've tried to make this version of the presentation accessible. If you find that it's not working for you, please let me know and I'll try my best to solve the problems.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Workshop at UXBristol by Caroline Jarrett and Francis Rowland. Builds on 'But the lightbulb has to want to change' by Steve Krug and Caroline Jarrett.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Write better survey questions, run a survey from start to finish, survey tips from the expert survey methodologists. Workshop at JBoye Conference, Aarhus, Denmark, 2011.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Slides from a workshop at the 2019 Service Design in Government conference, Edinburgh, March 2019.
The workshop challenged participants to consider:
what happens after you've done some user research for your service? Decisions made, do you move on and forget it? Or do you preserve that research for re-use and future team members? The session was an opportunity for user researchers in government to describe, compare and improve ResearchOps activities.
Discussing a Topic Map for How to Design a Better Form 2019 MarchCaroline Jarrett
If a person working on a government form wants to improve that form, what advice can we offer?
This discussion of a topic map for 'how to design a better form' is from a webinar on 9th April 2019 for the GSA (General Services Administration) Research Guild, and Digital.gov, in the US.
Inwards and outwards research: choosing your research methods according to th...Caroline Jarrett
Is your user research looking inwards, at how your service works, or outwards, at the lives of those it affects?
The right research in the right direction at the right time can truly add value - but there’s usually no point in running a survey of 10,000 people in discovery or waiting until beta to look for high-level user needs.
This session, run with Clara Greo at the 2020 Service Design in Government conference, was a chance for colleagues to share their research questions, and think about how to map them to the right methods.
A presentation on Label placement in forms, at the Technical Communication Summit, Seattle, US, April 2010. Amongst the time-consuming controversies we look at are left and right alignment, labels above and below fields, how to handle required fields, colons, and sentence case.
The first part of a workshop on user experience surveys. Topics: (1) how to improve the questions in surveys and (2) how to assess UX using a survey.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Forms that work: Understanding forms to improve their design by @cjformsCaroline Jarrett
A day-long workshop on forms design, focusing on why businesses need forms and how people interact with them.
Accessibility note: I've tried to make this version of the presentation accessible. If you find that it's not working for you, please let me know and I'll try my best to solve the problems.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Workshop at UXBristol by Caroline Jarrett and Francis Rowland. Builds on 'But the lightbulb has to want to change' by Steve Krug and Caroline Jarrett.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Write better survey questions, run a survey from start to finish, survey tips from the expert survey methodologists. Workshop at JBoye Conference, Aarhus, Denmark, 2011.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Better UX Surveys: a workshop led by Caroline Jarrett at the UCD 2012 conference in London, UK on 10th November 2012. Slides include feedback from some exercises.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Six crucial survey concepts that UX professionals need to knowCaroline Jarrett
Surveys can be a really valuable source of great data. This workshop explores six crucial survey concepts:
1. Ask questions that people can answer
2. Satisfaction is a slippery topic
3. Assess the total survey error
4. Understand who responds
5. your survey goals drive your analysis
6. Test everything.
But the light-bulb has to want to change: Why do usability problems so often...Caroline Jarrett
New: accessible version / Creative Commons ShareAlike
Steve Krug and I did this presentation at the User Experience Professionals’ Association Conference, Las Vegas, Nevada 2012
At the time, I didn't know about how important it is to make the slides accessible. This new version has proper alt-text on each image, and we hope it will work if you're using a screenreader. Please let me know if you have any problems with it.
We've also changed the permissions: it's now Creative Commons ShareAlike.
Ten tips for surveys: on questions, process, and testing your survey.
Books mentioned are listed here: http://rosenfeldmedia.com/uxzeitgeist/lists/cjforms/10-tips-for-a-better-survey-stc2011
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Tips for better surveys: better questions in your questionnaire, better overall survey process. From UPA2012 in Las Vegas.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Effective Use of Surveys in UX | Triangle UXPA WorkshopAmanda Stockwell
On a scale of 1-10, how much do you love this workshop?
Ok, hopefully that is an obviously bad question, both because it hasn't happened yet and because it has some bias baked right in. But take a quick look around all the surveys floating out in the world, and they often don't seem much better. Surveys can be a powerful tool for a UX researcher, but many of us haven't learned how to get the most out of them. In this workshop we'll cover:
Best use cases for surveys (and when to avoid them)
An overview of question types
Guidelines for writing effective, unbiased survey questions
Tips to increase overall engagement and participation
Hands on practice crafting surveys
Basic survey analysis
Ten tips for creating a better survey - questions, process, and testing. Presented at UX Bristol, 15th July 2011.
This is an updated version of '10 tips for a better survey' presented at STC2011.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Ideas for design of complex transactions by @cjforms 2013Caroline Jarrett
A workshop at UX Cambridge 2013 #uxcam where we discussed design tips and ideas for tackling complex forms and transactions.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Buttons on forms and surveys: a look at some research 2012Caroline Jarrett
Does 'Submit' or 'Send' or 'OK' go to the left or right of 'Cancel'? Does 'Next' go to the left or right of 'Previous'? This talk at the Information Design Conference 2012 discusses three research studies on forms and surveys.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
New design tips for complex forms, presented at Malta's first usability and user experience conference.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Presentation given to the SLA at Drexel University covering the reasons for taxonomy testing, Delphi-method card sorting, remote card sorting, usability testing, and search analysis. A list of resources and online validation tools is included.
Taxonomies, while critical, are often created in collaboration with businesses and in isolation from users, which leads to misalignment of expectations and a disconnection from their mental models. But testing taxonomy is not difficult, doesn't have to be expensive, and offers clearly identifiable value to projects. In this very practical session you'll learn about when to test, the different kind of tests available, and what works best (and what doesn't) at different stages of different projects.
Presented at IA Summit 2015 with Alberta Soranzo
Labels and buttons on forms and other timeconsuming forms controversies - from CHI 2011 Vancouver.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Design tips for complex forms, a presentation at the Clarity 2010 conference in Lisbon. Gives some ideas for how to improve difficult, lengthy forms.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Introduction to Usability Testing for Survey ResearchCaroline Jarrett
The basics of how to incorporate usability testing in the development process of a survey. Workshp first presented at the SAPOR conference, Raleigh, North Carolina USA, October 2011 by Emily Geisen of RTI and Caroline Jarrett of Effortmark.
Design tips for complex forms, presented at JBoye11 Aarhus. For different tips, see "Design tips for complex forms at Clarity 2010".
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Surveys that work: using questionnaires to gather useful data, November 2010Caroline Jarrett
This presentation to the 22nd Australasian Computer-Human Interaction Conference, OZCHI 2010, compares survey processes and looks at some of the detail of designing surveys – including how to avoid survey error.
Design tips for complex forms; presentation at UPA2010 Munich.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Better UX Surveys: a workshop led by Caroline Jarrett at the UCD 2012 conference in London, UK on 10th November 2012. Slides include feedback from some exercises.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Six crucial survey concepts that UX professionals need to knowCaroline Jarrett
Surveys can be a really valuable source of great data. This workshop explores six crucial survey concepts:
1. Ask questions that people can answer
2. Satisfaction is a slippery topic
3. Assess the total survey error
4. Understand who responds
5. your survey goals drive your analysis
6. Test everything.
But the light-bulb has to want to change: Why do usability problems so often...Caroline Jarrett
New: accessible version / Creative Commons ShareAlike
Steve Krug and I did this presentation at the User Experience Professionals’ Association Conference, Las Vegas, Nevada 2012
At the time, I didn't know about how important it is to make the slides accessible. This new version has proper alt-text on each image, and we hope it will work if you're using a screenreader. Please let me know if you have any problems with it.
We've also changed the permissions: it's now Creative Commons ShareAlike.
Ten tips for surveys: on questions, process, and testing your survey.
Books mentioned are listed here: http://rosenfeldmedia.com/uxzeitgeist/lists/cjforms/10-tips-for-a-better-survey-stc2011
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Tips for better surveys: better questions in your questionnaire, better overall survey process. From UPA2012 in Las Vegas.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Effective Use of Surveys in UX | Triangle UXPA WorkshopAmanda Stockwell
On a scale of 1-10, how much do you love this workshop?
Ok, hopefully that is an obviously bad question, both because it hasn't happened yet and because it has some bias baked right in. But take a quick look around all the surveys floating out in the world, and they often don't seem much better. Surveys can be a powerful tool for a UX researcher, but many of us haven't learned how to get the most out of them. In this workshop we'll cover:
Best use cases for surveys (and when to avoid them)
An overview of question types
Guidelines for writing effective, unbiased survey questions
Tips to increase overall engagement and participation
Hands on practice crafting surveys
Basic survey analysis
Ten tips for creating a better survey - questions, process, and testing. Presented at UX Bristol, 15th July 2011.
This is an updated version of '10 tips for a better survey' presented at STC2011.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Ideas for design of complex transactions by @cjforms 2013Caroline Jarrett
A workshop at UX Cambridge 2013 #uxcam where we discussed design tips and ideas for tackling complex forms and transactions.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Buttons on forms and surveys: a look at some research 2012Caroline Jarrett
Does 'Submit' or 'Send' or 'OK' go to the left or right of 'Cancel'? Does 'Next' go to the left or right of 'Previous'? This talk at the Information Design Conference 2012 discusses three research studies on forms and surveys.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
New design tips for complex forms, presented at Malta's first usability and user experience conference.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Presentation given to the SLA at Drexel University covering the reasons for taxonomy testing, Delphi-method card sorting, remote card sorting, usability testing, and search analysis. A list of resources and online validation tools is included.
Taxonomies, while critical, are often created in collaboration with businesses and in isolation from users, which leads to misalignment of expectations and a disconnection from their mental models. But testing taxonomy is not difficult, doesn't have to be expensive, and offers clearly identifiable value to projects. In this very practical session you'll learn about when to test, the different kind of tests available, and what works best (and what doesn't) at different stages of different projects.
Presented at IA Summit 2015 with Alberta Soranzo
Labels and buttons on forms and other timeconsuming forms controversies - from CHI 2011 Vancouver.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Design tips for complex forms, a presentation at the Clarity 2010 conference in Lisbon. Gives some ideas for how to improve difficult, lengthy forms.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Introduction to Usability Testing for Survey ResearchCaroline Jarrett
The basics of how to incorporate usability testing in the development process of a survey. Workshp first presented at the SAPOR conference, Raleigh, North Carolina USA, October 2011 by Emily Geisen of RTI and Caroline Jarrett of Effortmark.
Design tips for complex forms, presented at JBoye11 Aarhus. For different tips, see "Design tips for complex forms at Clarity 2010".
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Surveys that work: using questionnaires to gather useful data, November 2010Caroline Jarrett
This presentation to the 22nd Australasian Computer-Human Interaction Conference, OZCHI 2010, compares survey processes and looks at some of the detail of designing surveys – including how to avoid survey error.
Design tips for complex forms; presentation at UPA2010 Munich.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Prototype Version 1:
Tasks for interviewees
Task #1
Try to get in contact with a research project of your degree
Task #2
Find a FAQ/forum where other students have asked questions
Task #3
Find research project associated with a certain professor
Study Protocol
- Introduction to project
- (Undergraduate Research Projects)
- (Help support undergraduates in finding relevant research opportunities)
- Provide instructions
- Administer relevant demographics to determine interviewee attributes
- Ask if we can record
- Ask them to speak their thoughts out loud
- Show them the paper prototype they are going to interact on
- Ask them to try perform task 1
- Don't provide help
- Ask what they are expected/looking for
- Tell them to say when they have ‘ended/finished’ and found what they are
looking for
- Repeat for task 2 and 3
- Ask questions depending on their past actions (if relevant)
- Administer. UX questionnaires
Quantitative (Scale of 1 to 5 if applicable)
- I found the system unnecessarily complex
- I thought the system was easy to use
- I felt confident about using the system
- I did not feel stressed or lost while navigating the interface
- # of errors doing all the task
Qualitative (descriptive)
- Thoughts on the process
- Did anything feel unnecessary but helpful?
- Did you feel as if you reached your goal too quickly
- Did you feel as if you required some technical background
- Ask follow up interview questions if their answers warrant it
- Wrap up
- Ask if they have any questions they want to ask
- Give group code
Executive Summary
Topic
Our topic for this research project is Undergraduate Research Opportunities.
Top Three Design Goals
Our top three design goals were centered around making sure that the website had relevant
links, as many of the links on the website currently lead to dead pages. Additionally, making the
primary reason that most users are on the website for the main focus of the website was
another design goal. Currently, the website feels as though it does not center itself specifically
around research opportunities for undergraduate students, as it requires the user to navigate
through the website for a bit before being able to find this. Finally, our third most important
design goal was making sure that the user was aware of where they were at any given time.
Currently the user can easily get lost trying to find specific information, being unaware as to
whether or not they are on the right track.
Discoveries during research
1. Dead links riddle the website, making it irrelevant as a source for finding many of the
information it claims to provide
2. The website itself does not feel like a branch from the school's original website. It does
not aesthetically look pleasing nor fitting
3. The website could be minimized a lot and focus primarily on research opportunities and
other things second
4. Many of the p ...
Designing to save lives: Government technical documentation Laurian Vega
In this presentation the speakers will discuss the methods and strategies of writing technical communication in the design of software for the government sector with the broader goal of evaluating best practices for how to create a positive user experience for a particular user group. Creating software for the government, and specifically in defense contracting, involves understanding a specific set of user needs and a variety of command and control net-centric contexts ranging from real-time analytics, cyber-situational awareness, to strategic and operational planning. The best practices for designing and writing for such a diverse set of needs involves tight integration with the software development team, stakeholders, and users such that the right words and elements are incorporated into the interface and that the technical documentation properly reflects the software’s features. The presenters will further discuss examples of content strategy driving from their industry experience and expertise.
How to Ask for Technical Help? Evidence-based Guidelines for Writing Question...Fabio Calefato
Slides presenting results from our IST paper (https://arxiv.org/abs/1710.04692) / IEEE Software blog post (http://blog.ieeesoftware.org/2017/11/can-we-trust-stack-overflow-netiquette.html) investigating whether we can trust Stack Overflow netiquette for writing better questions.
2 hours training on Mobile UX with Farah Nuraini, Interaction Designer at Traveloka, Indonesia
45 min theory: Research, Analysis, Design solutions and Testing
+ 1h15 min of hands-on exercises with the 5 facilitators from Traveloka.
Going out and talking to people (customer and non-customers) twice a month is scary, but we can do a lot to improve our interviewing skills as well as our relationship with customers. View this slide show to gain some insight into optimizing your user testing sessions to gain deeper understanding of our customers to best deliver value.
Requirements Engineering for the HumanitiesShawn Day
This workshop explores how requirements engineering can be employed by digital and non-digital humanities scholars (and others) to conceptualise and communicate a research project.
requirementsEngineeringAs the field of digital humanities has evolved, one of the biggest challenges has been getting the marrying technical expertise with humanities scholarly practice to successfully deliver sustainable and sound digital projects. At its core this is a communications exercise. However, to communicate effectively demands an ability to effectively translate, define and find clarity in your own mind.
Getting Started With User-Centered Content by Emileigh Barnes & Kate Garklavs...Blend Interactive
Writing for the web is messy and complicated. As web content managers, we must weigh user needs against stakeholder demands, tight timelines, budget constraints, and more. We’re often thrown into projects that are already underway or lack a clear strategy. Our work is constrained by organizational pressures.
In this workshop, we’ll talk about aligning content with project goals, creating a strategy that puts users first, and building products that can maintain momentum and success, even after we’re gone.
Agile-Friendly User Research. Nina Belk, UX People, 2013Nina Belk
“It takes too long." "We don’t have the budget." "We don’t really need it, we can just optimise once we’ve gone live.” Sound familiar?
As UX embraces agile as a project delivery approach, research seems get left out in the cold. Rather than shivering and complaining about it though maybe we just need to stick two fingers up to these assumptions and dare to do things a little differently!
In her workshop at UX People, Nina helped delegates explore how to bring research in from the cold on agile projects. There were tips on getting the research basics right (effective participant recruitment and facilitation techniques), and delegates were given the opportunity to road-test their facilitation and analysis skills in an agile-friendly framework (full exercises not available in this presentation).
If you're looking to arm yourself with some practical skills, and a research approach that will blow those assumptions about speed, cost and the lack of value out of the water then this workshop would have been for you, but you'll have to make do with this SlideShare presentation instead!
Similar to How to design a form: Discussing a curriculum (20)
In this workshop for the Virtual SDinGov 2024 , Caroline takes participants through two sets of guidelines in search of advice on how to make a single forms question accessible. She then introduces her own question protocol as a method of scrutinising and improving any question.
A presentation for the the Content Wrangler's coffee and content session on how to design and run surveys and gain actionable insights from the survey data.
Some thoughts on good survey design delivered to students at Olin College of Engineering. Caroline's talk covers her survey process, survey goals and focusing on a specific decision, sample and sampling error, ditching rating scales, and losing fear of open answers.
The Phylogenetic Tree in forms design - making forms work for complex academ...Caroline Jarrett
How can we guide busy academics in specialist fields through application processes that are complex, vary greatly depending on the funder, and always seem to be extra urgent? Especially when the stakes are high: awards can be in the millions, and research income is important to fund work that we can all benefit from.
For this year's HE Connect conference, Cambridge University Senior Product Manager Karen Fernandes and forms expert Caroline Jarrett reflected on how current work at Cambridge, and government forms patterns, can help (or hinder) this sort of multi-person, multi-challenge process.
In this half day workshop for ~WebExpo2023 Caroline Jarrett shares four ways to improve your survey so that you get plenty of useful responses.
Goals: Ruthlessly focus your survey on an immediate decision.
Sample: Write an invitation that makes people want to answer.
Questions: Ditch the rating scales.
Responses: Lose your fear of open answers.
Two ways to improve your survey, webinar for Delib 2023.pptxCaroline Jarrett
In this webinar for Delib, Caroline shows you how to get better results from shorter, more frequent surveys - with a special emphasis on local government and the requirement to run statutory consultations. Understanding and identifying the Most Crucial Question and making space for the Burning Issue are both helpful techniques for creating shorter more focused surveys.
Did you love the form that you filled in most recently? Or did you hit some problems? Most of us find all sorts of small or major problems with lots of the forms we are forced to use.
In this talk for #WebExpo2023, Caroline turns that around. She points out the ways in which not fixing your forms is costing your organisation a lot of money. She then goes on to share plenty of practical tips for making improvements that will enable people to successfully complete your forms.
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Caroline Jarrett
In this webinar for product managers, Caroline introduces two key concepts from her book on surveys: identifying the most crucial question as part of getting clear on your goals, and allowing respondents to tell you the things that they want to - their burning issue. The webinar was organised by Productboard and held on March 30, 2023.
In this member call for Boye & Co Caroline takes participants through her process for expert reviews of forms. She also shares some of her top tips for making them easier to use and more effective.
What is a service designer SDinGOV 22 with all stickies.pptxCaroline Jarrett
In this case study for the 2022 Service Design in Government conference Caroline challenges people to think about their own definitions and shares her own - which is based on her three-layer model for creating good forms.
Helping teenage boys to become responsible adults.pptxCaroline Jarrett
Teenage boys use our services but many of us know little about them. In this session, Bukola (Kiki) Jolugbo and Caroline Jarrett shared some facts about teenage boys and some principles for helping them to become responsible adults.
Some thoughts on surveys: Boye and Company member conference callCaroline Jarrett
Slides from a short presentation on creating effective surveys. The event was a conference call for members of a community network organised by Janus Boye of Boye & Company.
Plain language to improve your survey houston 2022Caroline Jarrett
Plain language skills are vital for surveys - and especially to writing good questions and creating them for your survey audience. This presentation was prepared for the University of Houston's 8th Biannual Forum on Plain English, 24 February 2022.
Surveys that work:training course for Rosenfeld Media, day 1Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 1 of the course: goals and sample.
Surveys that work: training course for Rosenfeld media, day 2Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 2 of the course: questions, questionnaire and fieldwork
Surveys that work: training course for Rosenfeld Media, day 3 Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 3 of the course: responses and reports.
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorCaroline Jarrett
A presentation for Harvard University's User Research Community on some of the key issues in creating effective surveys, including: why run a survey, writing good questions, statistical significance and how to avoid errors.
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANEFebless Hernane
CapCut is an easy-to-use video editing app perfect for beginners. To start, download and open CapCut on your phone. Tap "New Project" and select the videos or photos you want to edit. You can trim clips by dragging the edges, add text by tapping "Text," and include music by selecting "Audio." Enhance your video with filters and effects from the "Effects" menu. When you're happy with your video, tap the export button to save and share it. CapCut makes video editing simple and fun for everyone!
ARENA - Young adults in the workplace (Knight Moves).pdfKnight Moves
Presentations of Bavo Raeymaekers (Project lead youth unemployment at the City of Antwerp), Suzan Martens (Service designer at Knight Moves) and Adriaan De Keersmaeker (Community manager at Talk to C)
during the 'Arena • Young adults in the workplace' conference hosted by Knight Moves.
Visual Style and Aesthetics: Basics of Visual Design
Visual Design for Enterprise Applications
Range of Visual Styles.
Mobile Interfaces:
Challenges and Opportunities of Mobile Design
Approach to Mobile Design
Patterns
White wonder, Work developed by Eva TschoppMansi Shah
White Wonder by Eva Tschopp
A tale about our culture around the use of fertilizers and pesticides visiting small farms around Ahmedabad in Matar and Shilaj.
Fonts play a crucial role in both User Interface (UI) and User Experience (UX) design. They affect readability, accessibility, aesthetics, and overall user perception.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
Connect Conference 2022: Passive House - Economic and Environmental Solution...TE Studio
Passive House: The Economic and Environmental Solution for Sustainable Real Estate. Lecture by Tim Eian of TE Studio Passive House Design in November 2022 in Minneapolis.
- The Built Environment
- Let's imagine the perfect building
- The Passive House standard
- Why Passive House targets
- Clean Energy Plans?!
- How does Passive House compare and fit in?
- The business case for Passive House real estate
- Tools to quantify the value of Passive House
- What can I do?
- Resources
2. @leedsmeetup comments
I tried out some ideas at the Leeds meetup
These slides come from a session at the meetup on 27th February 2019.
I threw various slides and ideas at people, because I knew that those
meetups attract a knowledgeable and friendly crowd.
When you see a slide with @leedsgovdesign comments at the top,
I’ve added it afterwards.
Sometimes the comments come from attendees, sometimes they
capture something I said but didn’t have a slide for, sometimes they’re
my reflections.
Many thanks to Simon Wilson for organising and to everyone who came.
2
3. @leedsmeetup comments
We need advice on ‘how to design a form’
I’m working with the NHS Digital Standards and Redesign team.
We recently had results from usability testing a form, built by a team of
colleagues from the NHS Digital Front-End library. The form didn’t test
well, and we realised that it was probably because we offer little advice
about how to design a form using the patterns in the library. We know
that some teams won’t have access to any designers.
These slides contain some ideas about what might go into that
curriculum. The curriculum might become a training session, or might
become advice online, or the need might be met some other way.
3
4. @leedsmeetup comments
Ian Roddis published about the need for
advice while I was typing up these notes
4
https://medium.com/@ianroddis/the-path-of-user-needs-avoiding-beautiful-
nonsense-and-the-shelves-of-wisdom-fe19a9b7bff3
5. This talk is inspired by Ralph Hawkins
Ralph Hawkins
Service designer
Government Digital Service
@ralph_hawkins
6. @leedsmeetup comments
Please use and discuss these slides
This talk was inspired by one that Ralph Hawkins did at the GDS
Forms-a-Palooza in January 2019. He described how to design a form
and I’ve used some of his ideas and slides here.
If I’ve got a slide, or something on it, from somewhere else then there’s
a credit. If there isn’t a credit and there ought to be then please tell me
and I’ll correct it.
Anything I’ve created is ‘Creative commons’ licensed, meaning:
Please use it and say where you got it from.
I’m very keen for people to try out these slides and tell me what works
and what doesn’t.
6
8. @leedsmeetup comments
I asked attendees what was missing from
the four steps
Most of the suggestions were topics that I had included, but weren’t
obvious from the four steps. I’ll mention these later.
Attendees pointed out that I had skipped:
• Identify user needs
• What do the users want?
• Why? (what are the objectives?)
• Are we starting from scratch or starting with an existing form?
• What are the outputs? (measures of success?)
• Consider the medium
• Prerequisites, for example what do people need to fill in the form? And how do they
get it?
• Who to include when designing a form (team, helpers and stakeholders)
8
9. @leedsmeetup comments
Join in the discussion about the need for a form
Because of comments around needs, I started a discussion on Twitter.
People joined in with great comments. I’ve got lots to think about.
9 https://twitter.com/cjforms/status/1100786122920284160
10. How to
design
a form
1. Investigate your forms
– Find out how you’ll use the answers
– Observe people working with the forms
– Observe users filling in the forms
2. Write the questions
– Create a question protocol
– Interview users about the topics on the form
3. Get the questions into order
– Start with one thing per page
– Provide a sense of control
– Do card sorting with users for order of topics
4. Put the questions onto pages
– Use the simplest possible interaction design
– Put the right button in the right place
– Do usability testing with users
10
11. @leedsmeetup comments
Attendees did not recognise some terms
I asked attendees if there was anything in the expanded list of topics
that they did not recognise. As I expected (knowledgeable crowd)
nearly everything was reasonably familiar, with these exceptions:
• ‘question protocol’
• ‘sense of control’
We return to those topics later.
11
12. Activities
with users
in red with
an asterisk
1. Investigate your forms
– Find out how you’ll use the answers
– Observe people working with the forms
* Observe users filling in the forms
2. Write the questions
– Create a question protocol
* Interview users about the topics on the form
3. Get the questions into order
– Start with one thing per page
– Provide a sense of control
* Do card sorting with users for order of topics
4. Put the questions onto pages
– Use the simplest possible interaction design
– Put the right button in the right place
* Do usability testing with users
12
19. @leedsmeetup comments
Attendees wanted to know the outcomes of
each step
It’s not obvious that ‘Observe the actual process’ is intended to include:
• Find out who is using the forms
• Get to know the processes and technology behind the forms
• Establish metrics such as failure rates, error rates, any other
performance issues
19
22. Find out about people in crisis
22
https://meyerweb.com/eric/thoughts/2014/12/24/inadvertent-algorithmic-cruelty/
23. @leedsmeetup comments
Missing topic: accessibility and inclusivity
I explicitly mentioned ‘find out about people in crisis’.
Attendees pointed out that we also need to be explicit about designing
for accessibility and inclusivity, right from the start.
23
25. GDPR is your friend
25
“Any processing of personal data should be lawful and fair. It should be
transparent to natural persons that personal data concerning them are
collected, used, consulted or otherwise processed and to what extent
the personal data are or will be processed”.
https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32016R0679
26. Create your question protocol
26
https://www.uxmatters.com/mt/archives/2010/06
the-question-protocol-how-to-make-sure-every-form-field-is-necessary.php
27. @leedsmeetup comments
The question protocol includes validation rules
It wasn’t obvious to attendees that a question protocol includes:
- The validation rules
- The text of error messages
- The reason you are obtaining every answer and how you will obtain
that answer (not always by asking a user a question)
27
28. @leedsmeetup comments
We need a clearer name for ‘question protocol’
The term ‘question protocol’ is jargon that is unfamiliar to attendees.
We briefly discussed some alternatives, including Jessica Enders’ term
‘Question by Question’.
I’d like to find out whether we need to invent jargon here, or whether
there is a term for this that is already in use and works better than
‘question protocol’.
28
29. Track a sample of forms through your process
to find out how you use the answers
29 Image credit: Shutterstock
36. Progress indicators do not work
• Simple forms don’t need them
• ‘Step by step’ indicators aren’t flexible enough
• Difficult forms need summary pages
36
38. A successful summary screen gives control
• You can access each step in any order
• You can see which step(s) are un-started, partially complete, fully
done
• Each step “knows” which step is usually next
• Each step “knows” if it can’t be done yet
• You can see steps that are about things other than filling in the form:
– Steps in the organisation’s control
– Steps that are purely about reading content
– Steps that mean obtaining documents from elsewhere
– Anything else that you have to do to get to your goal
42. Do card sorting with users for order of topics
• Eligibility first?
• Easy questions first?
• Filter questions first?
• Signing ceremonies and signatures at the end
42
45. GDS
( ) radio buttons
[ ] check boxes
[ ] text input
{{ dynamic content }}
Use Ralph’s conventions for speedy design
Layout-in-text conventions from Ralph Hawkins
46. GDS
Where do you live?
() England
() Scotland
() Wales
() Northern Ireland
() Other
An example of design-in-a-document
Example from Ralph Hawkins
47. Looks here
first for button
Best place for a button:
aligned with left-hand end of text boxes
47
2 Then looks here
3 Looks here
last
1
https://www.slideshare.net/cjforms/buttons-on-forms-and-surveys-a-look-at-some-research-2012
48. Label the buttons with what they do
48
https://www.uxmatters.com/mt/archives/2012/05/7-basic-best-practices-for-buttons.php
49. Usability test your form with users
49 Image credit: @gerrygaffney, Infodesign.com.au
50. How to
design
a form
1. Investigate your forms
– Find out how you’ll use the answers
– Observe people working with the forms
– Observe users filling in the forms
2. Write the questions
– Create a question protocol
– Interview users about the topics on the form
3. Get the questions into order
– Start with one thing per page
– Provide a sense of control
– Do card sorting with users for order of topics
4. Put the questions onto pages
– Use the simplest possible interaction design
– Put the right button in the right place
– Do usability testing with users
50
51. A great form works well across
all three layers
Relationship
Conversation
Appearance
Easy to get it done
Easy to move on
Goals achievedEasy to understand
Easy to answer
Goals achievedEasy to use
Easy to read
Schema from “Forms that work: Designing web forms for usability”, Jarrett and Gaffney (2008) www.formsthatwork.com51
Activities with users are in red. These are:
Observe users filling in the forms
Interview users about the topics on the form
Do card sorting with users for order of topics
Do usability testing with users
Back to designing forms
For example, the Residential Tenancies regulation...
If the law defines the form, then you’ve got a somewhat different set of problems.
It’s helpful to get the process of dealing with the form mapped out. I call this the ‘assumption’ process because it’s usually simpler than the real life one.
The actual process is likely to have many entry points, workarounds, back-tracking and a variety of other factors that make it more complicated.
Observing the actual process comes in two parts: observing the people who deal with the forms (usually, but not always, colleagues / members of staff)
Observe the people who fill in the forms (usually, but not always, members of the general public). Sometimes a colleague helps the user to fill in the form. Sometimes there are no members of the general public involved, only colleagues.
Your form will be encountered by people in crisis. This example from Eric Meyer happened when Facebook gave him a celebratory picture of his daughter. Sadly, Eric’s daughter died from brain cancer that year. People who have to fill in your form will be: recently bereaved, sick, suffering from a mental health crisis, dealing with a crisis in their personal or professional lives. Or they may have temporary or permanent disabilities.
People who are directors know whether they are a director of a close company or not. People who aren’t directors don’t have to consider the topic of close companies.
‘Start with one thing per page’ does not mean that forms design starts here. It means that organising questions onto pages starts with one question on each page.
You might want to put things on post-it notes, or sketch rough pages to figure out flows.
I strongly recommend doing this as a group.
The 'check your answers' pattern from GDS shows the forms steps, but appears at the end of the form
The Task List pattern from GDS shows the forms steps but not the content steps. It has a strange interaction design, with something that looks like a button but isn’t a button to indicate status
The GDS Step by Step pattern provides an order of steps, but doesn’t include any form-filling steps. It gives the impression that steps must be done in a specific order, and doesn’t include any status indicator.
You end up with something like this.
Ralph adds a big number in the top right. I recommend that you choose a name for each page that reflects the question on the page, as that makes it conceptually easier to re-order questions and to remove questions.
For the first version optimise for quick to create and edit.
I use a pseudocode in a google doc so it can be written quickly and shared easily and done by anyone.
With 1 document page per web page
// Designing a form is a multidisciplinary activity. Ask someone to be a critical friend who job it is to find ways to make the questions simpler.