Some thoughts on good survey design delivered to students at Olin College of Engineering. Caroline's talk covers her survey process, survey goals and focusing on a specific decision, sample and sampling error, ditching rating scales, and losing fear of open answers.
In this half day workshop for ~WebExpo2023 Caroline Jarrett shares four ways to improve your survey so that you get plenty of useful responses.
Goals: Ruthlessly focus your survey on an immediate decision.
Sample: Write an invitation that makes people want to answer.
Questions: Ditch the rating scales.
Responses: Lose your fear of open answers.
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorCaroline Jarrett
A presentation for Harvard University's User Research Community on some of the key issues in creating effective surveys, including: why run a survey, writing good questions, statistical significance and how to avoid errors.
Surveys that work: a webinar for FocusVision 2021Caroline Jarrett
Creating surveys that work for participants and deliver high quality insight is no mean feat. This is because the survey process is complex, with multiple considerations at every step in the journey.
In this webinar for FocusVision, I introduce the Survey Octopus, my friendly way of talking about the many issues that make surveys one of the most challenging research methods. I also explain how the Survey Octopus maps into the Total Survey Error concept that underpins the work of many survey methodologists.
The Survey Octopus will help you design better surveys by thoughtfully considering:
• What you want to ask about
• Who you want to ask
• The number of people you need to ask
Surveys that work: an introduction to using Total Survey Error for the UX Ins...Caroline Jarrett
Surveys are easy to do – but harder to do well. In this interactive workshop - delivered to the UX Insight Festival 2020 - I take you through using Total Survey Error as a way of balancing the issues and good practice in survey design to get the best results from your survey.
The session also covered my 7-step survey process, starting with Goals and thinking about Sampling, Questions, Questionnaires, Fieldwork, Responses and Reports. Plus we tackle some of the questions I'm most often asked about creating surveys that work.
Many of us receive multiple requests to complete surveys every day. Some of us find that colleagues or clients think of ‘doing a survey’ as the same as ‘doing some research’ – which may explain why organizations send out so many survey requests.
In this webinar, you’ll meet the Survey Octopus, Caroline Jarrett’s friendly way of talking about the many issues that make surveys one of the most challenging research methods.
The Survey Octopus will help you to:
Explain to colleagues that a survey may not be the first research method to try
Help to justify a choice to work with a “non significant” number of responses
Think about the steps that go into delivering a survey that works
As a bonus, Caroline will also explain how her Survey Octopus maps into the Total Survey Error concept that underpins the work of many survey methodologists.
Introduction to survey methods at LibDesign2016. A workshop led by Caroline Jarrett for people working in the library service and public sector in the Czech Republic. Caroline Jarrett led this workshop in Prague in September 2016 as part of the LibDesign 2016 conference.
Surveys that work:training course for Rosenfeld Media, day 1Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 1 of the course: goals and sample.
In this half day workshop for ~WebExpo2023 Caroline Jarrett shares four ways to improve your survey so that you get plenty of useful responses.
Goals: Ruthlessly focus your survey on an immediate decision.
Sample: Write an invitation that makes people want to answer.
Questions: Ditch the rating scales.
Responses: Lose your fear of open answers.
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorCaroline Jarrett
A presentation for Harvard University's User Research Community on some of the key issues in creating effective surveys, including: why run a survey, writing good questions, statistical significance and how to avoid errors.
Surveys that work: a webinar for FocusVision 2021Caroline Jarrett
Creating surveys that work for participants and deliver high quality insight is no mean feat. This is because the survey process is complex, with multiple considerations at every step in the journey.
In this webinar for FocusVision, I introduce the Survey Octopus, my friendly way of talking about the many issues that make surveys one of the most challenging research methods. I also explain how the Survey Octopus maps into the Total Survey Error concept that underpins the work of many survey methodologists.
The Survey Octopus will help you design better surveys by thoughtfully considering:
• What you want to ask about
• Who you want to ask
• The number of people you need to ask
Surveys that work: an introduction to using Total Survey Error for the UX Ins...Caroline Jarrett
Surveys are easy to do – but harder to do well. In this interactive workshop - delivered to the UX Insight Festival 2020 - I take you through using Total Survey Error as a way of balancing the issues and good practice in survey design to get the best results from your survey.
The session also covered my 7-step survey process, starting with Goals and thinking about Sampling, Questions, Questionnaires, Fieldwork, Responses and Reports. Plus we tackle some of the questions I'm most often asked about creating surveys that work.
Many of us receive multiple requests to complete surveys every day. Some of us find that colleagues or clients think of ‘doing a survey’ as the same as ‘doing some research’ – which may explain why organizations send out so many survey requests.
In this webinar, you’ll meet the Survey Octopus, Caroline Jarrett’s friendly way of talking about the many issues that make surveys one of the most challenging research methods.
The Survey Octopus will help you to:
Explain to colleagues that a survey may not be the first research method to try
Help to justify a choice to work with a “non significant” number of responses
Think about the steps that go into delivering a survey that works
As a bonus, Caroline will also explain how her Survey Octopus maps into the Total Survey Error concept that underpins the work of many survey methodologists.
Introduction to survey methods at LibDesign2016. A workshop led by Caroline Jarrett for people working in the library service and public sector in the Czech Republic. Caroline Jarrett led this workshop in Prague in September 2016 as part of the LibDesign 2016 conference.
Surveys that work:training course for Rosenfeld Media, day 1Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 1 of the course: goals and sample.
Some thoughts on surveys: Boye and Company member conference callCaroline Jarrett
Slides from a short presentation on creating effective surveys. The event was a conference call for members of a community network organised by Janus Boye of Boye & Company.
Surveys that Work 2020: training course for HMRC user researchers 2020Caroline Jarrett
Slides from a training course on effective surveys, delivered to usability researchers at HMRC. The course took place at HMRC's Longbenton, Newcastle, offices, on January 30, 2020. Survey examples submitted by participants for review have been removed from this presentation.
A presentation for the the Content Wrangler's coffee and content session on how to design and run surveys and gain actionable insights from the survey data.
Surveys are still really popular as a research method with colleagues (if not with service designers).
These slides are from a workshop at the 2021 Service Design in Government conference (@sdingov21) on 'how to improve the survey that is going to happen whether you like it or not'.
In the workshop we looked at a 7-step process for a survey and considered ways of encouraging colleagues to combine surveys with other research methods.
We also practiced techniques for looking at – and improving - a questionnaire.
Surveys that work: training course for Rosenfeld media, day 2Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 2 of the course: questions, questionnaire and fieldwork
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Caroline Jarrett
In this webinar for product managers, Caroline introduces two key concepts from her book on surveys: identifying the most crucial question as part of getting clear on your goals, and allowing respondents to tell you the things that they want to - their burning issue. The webinar was organised by Productboard and held on March 30, 2023.
Total Survey Error for non-specialists: creating better conversations. A presentation of the Survey Octopus at the TSE2015 conference in Baltimore, September 2015.
How to get better results from a survey: Meet the Survey OctopusCaroline Jarrett
The Survey Octopus is a friendly creature who will help you to think about all the crucial issues in crafting a survey.
Presentation by Caroline Jarrett @cjforms for the 2014 Content Strategy Summit #CSSummit
Slides from a workshop introduction to survey methods. The workshop was prepared for staff of the European Bioinformatics Institute in Cambridge, February 2017
Two ways to improve your survey, webinar for Delib 2023.pptxCaroline Jarrett
In this webinar for Delib, Caroline shows you how to get better results from shorter, more frequent surveys - with a special emphasis on local government and the requirement to run statutory consultations. Understanding and identifying the Most Crucial Question and making space for the Burning Issue are both helpful techniques for creating shorter more focused surveys.
Getting valid results from surveys: meet the Survey Octopus.
Surveys are a powerful research method, but not easy to get right. The Survey Octopus is a way of thinking through the issues that will ensure that you'll get solid results from your survey that you can use to make decisions. Presentation from the UX New Zealand conference 2015 #uxnz2015
Speaker: Caroline Jarrett
To help us get the best out of this tricky research method, Caroline will describe the Survey Octopus, a friendly creature that helps her to tackle all the issues that may lie between 'What we want to ask, and who we want to ask', and a solid, reliable number that can be used to make decisions.
Along the way, we'll encounter the key concept in survey methodology, Total Survey Error, and the various types of error that can affect your survey.
Plain language to improve your survey houston 2022Caroline Jarrett
Plain language skills are vital for surveys - and especially to writing good questions and creating them for your survey audience. This presentation was prepared for the University of Houston's 8th Biannual Forum on Plain English, 24 February 2022.
Surveys that work: training course for Rosenfeld Media, day 3 Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 3 of the course: responses and reports.
The Survey Octopus - getting valid data from surveys, presentation for UX in ...Caroline Jarrett
Getting valid results from surveys: meet the Survey Octopus.
Surveys are a powerful research method, but not easy to get right. The Survey Octopus is a way of thinking through the issues that will ensure that you'll get solid results from your survey that you can use to make decisions. Presentation from the UX in the City conference, Oxford, March 2016
How to Conduct a Survey gf form to anylyzedenjrodrigo
Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of student
Did you love the form that you filled in most recently? Or did you hit some problems? Most of us find all sorts of small or major problems with lots of the forms we are forced to use.
In this talk for #WebExpo2023, Caroline turns that around. She points out the ways in which not fixing your forms is costing your organisation a lot of money. She then goes on to share plenty of practical tips for making improvements that will enable people to successfully complete your forms.
In this workshop for the Virtual SDinGov 2024 , Caroline takes participants through two sets of guidelines in search of advice on how to make a single forms question accessible. She then introduces her own question protocol as a method of scrutinising and improving any question.
The Phylogenetic Tree in forms design - making forms work for complex academ...Caroline Jarrett
How can we guide busy academics in specialist fields through application processes that are complex, vary greatly depending on the funder, and always seem to be extra urgent? Especially when the stakes are high: awards can be in the millions, and research income is important to fund work that we can all benefit from.
For this year's HE Connect conference, Cambridge University Senior Product Manager Karen Fernandes and forms expert Caroline Jarrett reflected on how current work at Cambridge, and government forms patterns, can help (or hinder) this sort of multi-person, multi-challenge process.
Some thoughts on surveys: Boye and Company member conference callCaroline Jarrett
Slides from a short presentation on creating effective surveys. The event was a conference call for members of a community network organised by Janus Boye of Boye & Company.
Surveys that Work 2020: training course for HMRC user researchers 2020Caroline Jarrett
Slides from a training course on effective surveys, delivered to usability researchers at HMRC. The course took place at HMRC's Longbenton, Newcastle, offices, on January 30, 2020. Survey examples submitted by participants for review have been removed from this presentation.
A presentation for the the Content Wrangler's coffee and content session on how to design and run surveys and gain actionable insights from the survey data.
Surveys are still really popular as a research method with colleagues (if not with service designers).
These slides are from a workshop at the 2021 Service Design in Government conference (@sdingov21) on 'how to improve the survey that is going to happen whether you like it or not'.
In the workshop we looked at a 7-step process for a survey and considered ways of encouraging colleagues to combine surveys with other research methods.
We also practiced techniques for looking at – and improving - a questionnaire.
Surveys that work: training course for Rosenfeld media, day 2Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 2 of the course: questions, questionnaire and fieldwork
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Caroline Jarrett
In this webinar for product managers, Caroline introduces two key concepts from her book on surveys: identifying the most crucial question as part of getting clear on your goals, and allowing respondents to tell you the things that they want to - their burning issue. The webinar was organised by Productboard and held on March 30, 2023.
Total Survey Error for non-specialists: creating better conversations. A presentation of the Survey Octopus at the TSE2015 conference in Baltimore, September 2015.
How to get better results from a survey: Meet the Survey OctopusCaroline Jarrett
The Survey Octopus is a friendly creature who will help you to think about all the crucial issues in crafting a survey.
Presentation by Caroline Jarrett @cjforms for the 2014 Content Strategy Summit #CSSummit
Slides from a workshop introduction to survey methods. The workshop was prepared for staff of the European Bioinformatics Institute in Cambridge, February 2017
Two ways to improve your survey, webinar for Delib 2023.pptxCaroline Jarrett
In this webinar for Delib, Caroline shows you how to get better results from shorter, more frequent surveys - with a special emphasis on local government and the requirement to run statutory consultations. Understanding and identifying the Most Crucial Question and making space for the Burning Issue are both helpful techniques for creating shorter more focused surveys.
Getting valid results from surveys: meet the Survey Octopus.
Surveys are a powerful research method, but not easy to get right. The Survey Octopus is a way of thinking through the issues that will ensure that you'll get solid results from your survey that you can use to make decisions. Presentation from the UX New Zealand conference 2015 #uxnz2015
Speaker: Caroline Jarrett
To help us get the best out of this tricky research method, Caroline will describe the Survey Octopus, a friendly creature that helps her to tackle all the issues that may lie between 'What we want to ask, and who we want to ask', and a solid, reliable number that can be used to make decisions.
Along the way, we'll encounter the key concept in survey methodology, Total Survey Error, and the various types of error that can affect your survey.
Plain language to improve your survey houston 2022Caroline Jarrett
Plain language skills are vital for surveys - and especially to writing good questions and creating them for your survey audience. This presentation was prepared for the University of Houston's 8th Biannual Forum on Plain English, 24 February 2022.
Surveys that work: training course for Rosenfeld Media, day 3 Caroline Jarrett
Surveys seem easy: anyone can throw together a few questions, send them out, and hope that they are rewarded with a decent response. But we’ve all seen examples of poorly conceived surveys that couldn’t possibly deliver real insights for the organisation that sponsored them.
This highly participative three-session training - arranged by Rosenfeld Media as part of its Virtual Training with UX Industry Leaders programme - takes you through the whole process of creating an effective survey, from defining a goal through analysis of data and creating a presentation.
These slides come from day 3 of the course: responses and reports.
The Survey Octopus - getting valid data from surveys, presentation for UX in ...Caroline Jarrett
Getting valid results from surveys: meet the Survey Octopus.
Surveys are a powerful research method, but not easy to get right. The Survey Octopus is a way of thinking through the issues that will ensure that you'll get solid results from your survey that you can use to make decisions. Presentation from the UX in the City conference, Oxford, March 2016
How to Conduct a Survey gf form to anylyzedenjrodrigo
Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of students in highschool and college. This can help students to make or conduct a survey easily. Expect to conduct a survey to analyze and make a solution to the challenges and problems faced of student
Did you love the form that you filled in most recently? Or did you hit some problems? Most of us find all sorts of small or major problems with lots of the forms we are forced to use.
In this talk for #WebExpo2023, Caroline turns that around. She points out the ways in which not fixing your forms is costing your organisation a lot of money. She then goes on to share plenty of practical tips for making improvements that will enable people to successfully complete your forms.
In this workshop for the Virtual SDinGov 2024 , Caroline takes participants through two sets of guidelines in search of advice on how to make a single forms question accessible. She then introduces her own question protocol as a method of scrutinising and improving any question.
The Phylogenetic Tree in forms design - making forms work for complex academ...Caroline Jarrett
How can we guide busy academics in specialist fields through application processes that are complex, vary greatly depending on the funder, and always seem to be extra urgent? Especially when the stakes are high: awards can be in the millions, and research income is important to fund work that we can all benefit from.
For this year's HE Connect conference, Cambridge University Senior Product Manager Karen Fernandes and forms expert Caroline Jarrett reflected on how current work at Cambridge, and government forms patterns, can help (or hinder) this sort of multi-person, multi-challenge process.
In this member call for Boye & Co Caroline takes participants through her process for expert reviews of forms. She also shares some of her top tips for making them easier to use and more effective.
What is a service designer SDinGOV 22 with all stickies.pptxCaroline Jarrett
In this case study for the 2022 Service Design in Government conference Caroline challenges people to think about their own definitions and shares her own - which is based on her three-layer model for creating good forms.
Helping teenage boys to become responsible adults.pptxCaroline Jarrett
Teenage boys use our services but many of us know little about them. In this session, Bukola (Kiki) Jolugbo and Caroline Jarrett shared some facts about teenage boys and some principles for helping them to become responsible adults.
Overview of how to make good forms that explains that a form builder can help, but it's essential to understand why you're asking the questions - and to write good questions.
Inwards and outwards research: choosing your research methods according to th...Caroline Jarrett
Is your user research looking inwards, at how your service works, or outwards, at the lives of those it affects?
The right research in the right direction at the right time can truly add value - but there’s usually no point in running a survey of 10,000 people in discovery or waiting until beta to look for high-level user needs.
This session, run with Clara Greo at the 2020 Service Design in Government conference, was a chance for colleagues to share their research questions, and think about how to map them to the right methods.
Write Clearly: take your web writing to the next level, May 2016Caroline Jarrett
These slides, setting out a series of rules for producing clear and effective web writing, come from a workshop delivered to staff of EBI/EMBL in May 2016
Understanding the costs of data capture: paper, automatic and with the intern...Caroline Jarrett
Organisations have sometimes been surprised and disappointed when they re-engineer a forms-based data capture process but fail to achieve their anticipated savings.
This paper, delivered to the CIMTECH conference, University of Hertfordshire, in 2000 explains:
how capture costs are built up from data entry plus dealing with problems
an example of costs for an automated process, and for dealing with the paper forms that are left after you bring in an internet process
four techniques for investigating the costs of your current process.
Surveys that work: using questionnaires to gather useful data, November 2010Caroline Jarrett
This presentation to the 22nd Australasian Computer-Human Interaction Conference, OZCHI 2010, compares survey processes and looks at some of the detail of designing surveys – including how to avoid survey error.
Expert Accessory Dwelling Unit (ADU) Drafting ServicesResDraft
Whether you’re looking to create a guest house, a rental unit, or a private retreat, our experienced team will design a space that complements your existing home and maximizes your investment. We provide personalized, comprehensive expert accessory dwelling unit (ADU)drafting solutions tailored to your needs, ensuring a seamless process from concept to completion.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page pmgdscunsri
Figma is a cloud-based design tool widely used by designers for prototyping, UI/UX design, and real-time collaboration. With features such as precision pen tools, grid system, and reusable components, Figma makes it easy for teams to work together on design projects. Its flexibility and accessibility make Figma a top choice in the digital age.
Can AI do good? at 'offtheCanvas' India HCI preludeAlan Dix
Invited talk at 'offtheCanvas' IndiaHCI prelude, 29th June 2024.
https://www.alandix.com/academic/talks/offtheCanvas-IndiaHCI2024/
The world is being changed fundamentally by AI and we are constantly faced with newspaper headlines about its harmful effects. However, there is also the potential to both ameliorate theses harms and use the new abilities of AI to transform society for the good. Can you make the difference?
Hello everyone! I am thrilled to present my latest portfolio on LinkedIn, marking the culmination of my architectural journey thus far. Over the span of five years, I've been fortunate to acquire a wealth of knowledge under the guidance of esteemed professors and industry mentors. From rigorous academic pursuits to practical engagements, each experience has contributed to my growth and refinement as an architecture student. This portfolio not only showcases my projects but also underscores my attention to detail and to innovative architecture as a profession.
Book Formatting: Quality Control Checks for DesignersConfidence Ago
This presentation was made to help designers who work in publishing houses or format books for printing ensure quality.
Quality control is vital to every industry. This is why every department in a company need create a method they use in ensuring quality. This, perhaps, will not only improve the quality of products and bring errors to the barest minimum, but take it to a near perfect finish.
It is beyond a moot point that a good book will somewhat be judged by its cover, but the content of the book remains king. No matter how beautiful the cover, if the quality of writing or presentation is off, that will be a reason for readers not to come back to the book or recommend it.
So, this presentation points designers to some important things that may be missed by an editor that they could eventually discover and call the attention of the editor.
2. Caroline Jarrett @cjforms (CC) BY SA-4.0
2
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
4. Caroline Jarrett @cjforms (CC) BY SA-4.0
4
Here is my process in stages
Establish your
goals for the
survey
Decide who to
ask and how
many
Build the
questionnaire
Run the
survey from
invitation to
follow-up
Clean and
analyse the
data
Present the
results
Goals Sample Questionnaire Fieldwork Responses Reports
Test the
questions
Questions
5. Caroline Jarrett @cjforms (CC) BY SA-4.0
5
The process is connected in many ways
Goals
Questions
Questionnaire
Response
Sample
Fieldwork
Response
Reports
6. Caroline Jarrett @cjforms (CC) BY SA-4.0
6
There are errors all around the Survey Octopus
Why you want ask
Lack of
validity
Measurement
error
Processing
error
Who you want to ask
Coverage error
Sampling error
Non-response
error
Adjustment
error
The number
7. Caroline Jarrett @cjforms (CC) BY SA-4.0
7
You get a better survey by doing many things well
Establish your
goals for the
survey
Decide who to
ask and how
many
Build the
questionnaire
Run the
survey from
invitation to
follow-up
Clean and
analyse the
data
Present the
results
Questions
you need
answers to
The right
people in
the sample
Goals Sample Questionnaire Fieldwork
Answers from
the right people
Responses Reports
Accurate
Answers
Useful
Decisions
Test the
questions
Questions
Questions
people can
answer
Questions
people can
interact with
8. Caroline Jarrett @cjforms (CC) BY SA-4.0
8
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
10. Caroline Jarrett @cjforms (CC) BY SA-4.0
10
The goals set the scene for the survey
Goals
Establish your
goals for the
survey
Questions you
need answers
to
11. Caroline Jarrett @cjforms (CC) BY SA-4.0
11
The error to avoid: Lack of validity,
when the questions you ask don’t match the goals
Lack of
validity
12. Caroline Jarrett @cjforms (CC) BY SA-4.0
12
Establish the goals for your survey
What do you want to know?
Why do you want to know?
What decision will you make based on
these answers?
What number do you need to make the
decision?
13. Caroline Jarrett @cjforms (CC) BY SA-4.0
13
A survey is a quantitative method.
What do you want to know?
Why do you want to know?
What decision will you make based on
these answers?
What number do you need to make the
decision?
The result of a survey
is a number
14. Caroline Jarrett @cjforms (CC) BY SA-4.0
14
Don’t confuse two sorts of number
A number of responses, such as
10,000 purchasers of candy bars
10,000 individual answers to the question
“which is your preferred candy bar”
The number which is the result of the
survey, such as 18% prefer Snickers
15. Caroline Jarrett @cjforms (CC) BY SA-4.0
15
For example, I was writing a blogpost
What do you want to know? “Which topic is most interesting?”
Why do you want to know? “To write the most useful blog post”
What decision will you make based on
these answers?
“Pick one of the available topics”
What number do you need to make the
decision? “I’ll pick the topic with most votes”
16. Caroline Jarrett @cjforms (CC) BY SA-4.0
16
Here’s an example of thinking about goals
What do you want to know? “We want to know how our
customers are feeling”
Why do you want to know? “We want to provide great
telephone support”
What decision will you make based on
these answers?
“We will decide whether to replace
the call centre staff with AI”
What number do you need to make the
decision? “If more than half are unhappy, we
will change to AI”
19. Caroline Jarrett @cjforms (CC) BY SA-4.0
19
Takeaway If you don’t yet need a number
to help you to make your
decision, choose a different
method to do first
20. Caroline Jarrett @cjforms (CC) BY SA-4.0
20
Overall, we’re aiming for useful decisions
Establish your
goals for the
survey
Decide who to
ask and how
many
Build the
questionnaire
Run the
survey from
invitation to
follow-up
Clean and
analyse the
data
Present the
results
Questions
you need
answers to
The right
people in
the sample
Goals Sample Questionnaire Fieldwork
Answers from
the right people
Responses Reports
Accurate
Answers
Useful
Decisions
Test the
questions
Questions
Questions
people can
answer
Questions
people can
interact with
21. Caroline Jarrett @cjforms (CC) BY SA-4.0
21
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
23. Caroline Jarrett @cjforms (CC) BY SA-4.0
23
You get a better survey by doing many things well
Establish your
goals for the
survey
Decide who to
ask and how
many
Questions
you need
answers to
The right
people in
the sample
Goals Sample
24. Caroline Jarrett @cjforms (CC) BY SA-4.0
24
There are three errors to look out for
Why you want ask Who you want to ask
Coverage error
Sampling error
Non-response
error
The number
25. Caroline Jarrett @cjforms (CC) BY SA-4.0
25
We want the final group to be representative
Who you want to ask
The ones whose
responses you use
Mostly people you
want to ask
Maybe some you
didn’t want to ask
Representativeness
26. Caroline Jarrett @cjforms (CC) BY SA-4.0
26
Coverage error happens when the list you sample
from doesn’t exactly match “who you want to ask”
The list you sample from
Coverage error
Who you want to ask
27. Caroline Jarrett @cjforms (CC) BY SA-4.0
27
Sampling error happens when you ask a sample
The list you sample from
The ones you ask
Sampling error
28. Caroline Jarrett @cjforms (CC) BY SA-4.0
28
Non-response error happens when
the ones who respond are different from
the ones you ask
in a way that affects the final number
The ones you ask
The ones who respond
Non-response error
29. Caroline Jarrett @cjforms (CC) BY SA-4.0
29
Adjustment error happens when
the decisions you make about
whose responses you use
are not completely ideal*
*usually you’ll be OK on this, it’s not an error I worry about too much in practice
The ones who respond
The ones whose
responses you use
Adjustment error
30. Caroline Jarrett @cjforms (CC) BY SA-4.0
30
We don’t get exactly the respondents we want
The list you sample from
The ones you ask
The ones who respond
The ones whose
responses you use
Coverage error
Sampling error
Non-response error
Adjustment error
Who you want to ask
31. Caroline Jarrett @cjforms (CC) BY SA-4.0
31
Sampling is when we worry about three errors
The list you sample from
The ones you ask
The ones who respond
Coverage error
Sampling error
Non-response error
Who you want to ask
32. Caroline Jarrett @cjforms (CC) BY SA-4.0
32
Or, here they are with the Survey Octopus
Why you want ask Who you want to ask
Coverage error
Sampling error
Non-response
error
The number
33. Caroline Jarrett @cjforms (CC) BY SA-4.0
33
Takeaway Think about sampling error,
but do not neglect coverage
error and non-response error
34. Caroline Jarrett @cjforms (CC) BY SA-4.0
34
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
36. Caroline Jarrett @cjforms (CC) BY SA-4.0
36
We need questions that people can answer
Establish your
goals for the
survey
Decide who to
ask and how
many
Questions
you need
answers to
The right
people in
the sample
Goals Sample
Test the
questions
Questions
Questions
people can
answer
37. Caroline Jarrett @cjforms (CC) BY SA-4.0
37
Bad questions create measurement error
Why you want ask
Measurement
error
Who you want to ask
The number
38. Caroline Jarrett @cjforms (CC) BY SA-4.0
38
Let’s try an example.
• Think of a time you stayed at a hotel
• What ONE thing would have created a better experience?
40. Caroline Jarrett @cjforms (CC) BY SA-4.0
40
Grids are a major cause of survey drop-out
35%
20%
20%
15%
5%
5%
Total incompletes across the 'main' section of the questionnaire
(after the introduction stage)
Subject Matter
Media Downloads
Survey Length
Large Grids
Open Questions
Other
Source: Database of 3 million+ web surveys conducted by Lightspeed Research/Kantar
From Coombe, R., Jarrett, C. and Johnson, A. (2010) “Usability testing of market
research surveys” ESRA Lausanne
41. Caroline Jarrett @cjforms (CC) BY SA-4.0
41
Takeaway Rating scales are hard.
Test your questionnaire with
open answers first.
42. Caroline Jarrett @cjforms (CC) BY SA-4.0
42
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
44. Caroline Jarrett @cjforms (CC) BY SA-4.0
44
There are two errors around responses
Why you want ask
Processing
error
Who you want to ask
Adjustment
error
The number
45. Caroline Jarrett @cjforms (CC) BY SA-4.0
45
We met adjustment error before
Adjustment error happens when the decisions you make about
whose responses you use are not completely ideal*
*usually you’ll be OK on this, it’s not an error I worry about too much in practice
The ones who respond
The ones whose
responses you use
Adjustment error
46. Caroline Jarrett @cjforms (CC) BY SA-4.0
46
Processing error is very similar
Why you want ask
Processing error
happens when the
decisions you make
about how you use the
individual answers
are not completely ideal
Processing
error
Who you want to ask
Adjustment
error
The number
47. Caroline Jarrett @cjforms (CC) BY SA-4.0
47
Typing in the answers is “coding”
Image credit: https://www.census.gov/history/www/census_then_now/notable_alumni/herman_hollerith.html
48. Caroline Jarrett @cjforms (CC) BY SA-4.0
48
These days, survey tools do a lot of coding for us
Type of question
• Radio buttons
(Yes, No, Not sure)
• Check boxes
• Numeric entry only
• Open box (text entry)
Results are likely to have
• Text of the option
(Yes, No, Not sure)
• A column for each of the
checkboxes
• A number
• Text as typed
49. Caroline Jarrett @cjforms (CC) BY SA-4.0
49
We’re often too frightened of open answers
For example, here are some examples of asking for age
50. Caroline Jarrett @cjforms (CC) BY SA-4.0
50
We asked farmers for ‘size of farm’ with an open box
It took me 10 minutes to convert 781 text answers to numbers
Type of reply Example % of replies
Just a number 7 81%
with ha 87ha 4%
with hectares 125 hectares 1%
Other (next slide) 1%
Did not answer/ answer is 'N/A' 12%
51. Caroline Jarrett @cjforms (CC) BY SA-4.0
51
Here are the 1% ‘other’ answers
Farmer’s answer
7+
~ 2800Ha
Approx 32.37
843.65 + 67.
As coded by me
7
2800
32
911
52. Caroline Jarrett @cjforms (CC) BY SA-4.0
52
Takeaway If the person who answers is
likely to ‘just know’ their
response as a number,
give them an open box for it
56. Caroline Jarrett @cjforms (CC) BY SA-4.0
56
You can choose from many different coding frames
• Topic
• Who is responsible for doing something (department)
• Positive or negative about something (sentiment)
• Nuggets for the report (cherry-picking)
Johnny Saldaña lists many more in his book
Image credit: The Coding Manual for Qualitative Researchers | Online Resources (sagepub.com)
57. Caroline Jarrett @cjforms (CC) BY SA-4.0
57
I do coding for each question in five steps
Step 1 Read a sample of the open answers
Step 2 Decide on a coding frame
Step 3 Apply the coding frame (phase 1 coding)
Step 4 Think about it
Step 5 Revise the coding frame and repeat (phase 2 coding)
58. Caroline Jarrett @cjforms (CC) BY SA-4.0
58
What I ought to do is different
Goals Decide on a coding frame.
Fieldwork Apply the coding frame to the first few responses.
Think about it. Revise.
Responses Apply the better coding frame (phase 1 coding).
Think about it.
Reports Revise the coding frame and tweak it all again
(phase 2 coding).
59. Caroline Jarrett @cjforms (CC) BY SA-4.0
59
CAQDAS tools can have hefty learning curves
Before buying one, look at this: Choosing a CAQDAS package | University of Surrey
Image credit: Choosing an appropriate CAQDAS package - University of Surrey - Guildford (archive.org)
computer-assisted qualitative data analysis software
60. Caroline Jarrett @cjforms (CC) BY SA-4.0
60
I made a word cloud from an example dataset
https://www.freewordcloudgenerator.com/generatewordcloud
61. Caroline Jarrett @cjforms (CC) BY SA-4.0
61
I got a summary from ChatGPT
• Used Playground - OpenAI API
• Chose model: text-davinci-003
• Pasted in all the comments with tl;dr at the end
“Overall, I experienced long wait times and confusion on the
website and helpline, however, the staff were friendly and
helpful, and I'm glad I eventually got the product I needed.”
https://platform.openai.com/playground/
62. Caroline Jarrett @cjforms (CC) BY SA-4.0
62
Takeaway Don’t wait until the report is
due to think about coding
63. Caroline Jarrett @cjforms (CC) BY SA-4.0
63
Today’s agenda
My survey process
Goals Focus your survey on a specific decision
Sample Don’t obsess over sampling error
Questions Ditch the rating scales
Responses Lose your fear of open answers
Recap and questions
65. Caroline Jarrett @cjforms (CC) BY SA-4.0
65
You get a better survey by doing many things well
Establish your
goals for the
survey
Decide who to
ask and how
many
Build the
questionnaire
Run the
survey from
invitation to
follow-up
Clean and
analyse the
data
Present the
results
Questions
you need
answers to
The right
people in
the sample
Goals Sample Questionnaire Fieldwork
Answers from
the right people
Responses Reports
Accurate
Answers
Useful
Decisions
Test the
questions
Questions
Questions
people can
answer
Questions
people can
interact with
66. Caroline Jarrett @cjforms (CC) BY SA-4.0
66
All these errors add up to Total Survey Error
(Lack of)
validity
Measurement
error
Processing
error
Coverage error
Sampling error
Non-response
error
Adjustment
error
The number
Why you want ask Who you want to ask
67. Caroline Jarrett @cjforms (CC) BY SA-4.0
67
Takeaway Your aim with a survey is
to make choices that keep
Total Survey Error
as low as practical, overall
68. Caroline Jarrett @cjforms (CC) BY SA-4.0
68
The aim is to make good choices at each step
Why you want to ask
The reason you’re doing it
The questions you ask
The answers you get
The answers you use
Who you want to ask
The list you sample from
The sample you ask
The ones who respond
The ones whose
responses you use
The number
69. Caroline Jarrett @cjforms (CC) BY SA-4.0
69
The aim is to minimise Total Survey Error
The number
Coverage error
Sampling error
Non-response error
Adjustment error
(Lack of) validity
Measurement error
Processing error
Why you want to ask Who you want to ask
The reason you’re doing it
The questions you ask
The answers you get
The answers you use
The list you sample from
The sample you ask
The ones who respond
The ones whose
responses you use
71. Caroline Jarrett @cjforms (CC) BY SA-4.0
71
Total Survey Error diagram as presented in
Groves, R. M., F. J. Fowler, M. P. Couper, J. M. Lepkowski, E. Singer and R. Tourangeau (2009).
Survey methodology. Hoboken, N.J., Wiley.
Total survey error is a
central concept in
survey methodology
72. Caroline Jarrett @cjforms (CC) BY SA-4.0
72
Ask me questions: Caroline Jarrett
Social media @cjforms
caroline.jarrett@effortmark.co.uk
www.effortmark.co.uk
Editor's Notes
The octopus again; we've looked at 6 of the 8 tentacles.
The octopus again; we've looked at 6 of the 8 tentacles.
The octopus again; we've looked at 6 of the 8 tentacles.
Coverage error happens when some people in the defined group are not in the list you sample from
Sampling error happens when you ask a sample of people from the list, so some people get left out
Non-response error can happen when the people who respond are different from the people who do not respond in a way that affects the overall result of the survey
Adjustment error happens when you make less-than-perfect decisions about including or excluding people who respond
At the end of all of that, what we are aiming for is that the ones whose responses you use are appropriately representative of the people you wanted in the first place
The octopus again; we've looked at 6 of the 8 tentacles.
The octopus again; we've looked at 6 of the 8 tentacles.