This document provides guidance on developing and conducting surveys. It discusses when to use surveys and outlines key steps in the survey process, including determining the purpose and intended users, developing survey items and response formats, reviewing items, pilot testing, administration, analysis and communication of results. The goal is to help users obtain useful information through systematic and well-designed surveys. Professional assistance is recommended, as surveys require expertise in areas like sampling and statistical analysis.
Questionnaire ppt for lecture modified 28 jan 2Ashok Randive
Easy to understand powerpoint presentation of Questionnaire design in Research methodology .It is useful for postgraduate students especially writing the Synopsis of Dissertation work .
This presentation describes the steps in designing a questionnaire. Also includes video clips for the process in evaluating the questionnaires for its reliability analysis.
Questionnaire ppt for lecture modified 28 jan 2Ashok Randive
Easy to understand powerpoint presentation of Questionnaire design in Research methodology .It is useful for postgraduate students especially writing the Synopsis of Dissertation work .
This presentation describes the steps in designing a questionnaire. Also includes video clips for the process in evaluating the questionnaires for its reliability analysis.
Research methodology unit ii-data collectionManoj Kumar
This PPT will give basic idea about
Data Collection
Primary Data collection Methods
Secondary Data collection Methods
Secondary Data collection Methods
Steps in Developing a Questionnaire
Construction of a Schedule
Attitudinal scales
Validity and Reliability of the Instrument
Unit-I
https://www2.slideshare.net/ManojKumar730/research-methodology-unitiresearch-and-its-various-process
Unit-iii
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitiiisampling
Unit-IV
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitivmeasurement-and-data-preperationfor-bbabcommba-and-for-other-ug-and-pg-students
Unit-V
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitvreseach-report-for-bcom-bba-mba-and-other-ug-and-pg-courses
Interview Method for Qualitative ResearchPun Yanut
Interview is the verbal conversation between two people with the objective of collecting relevant information for the purpose of research.
Interviewing, a method for conducting research, is a technique used to understand the experiences of others.
McNamra (1999), the interviewer can pursue in-depth information around the topic.
Interview may be useful as follow-up to certain respondent
How to Identify the Research Gap While Writing a PhD Dissertation Literature ...PhD Assistance
PhD Assistance gives you tips to Identify Research Gaps in the Literature Review for writing a PhD dissertation.
A Research Gap is a Topic or field for which insufficient data restrict the ability to conclude a research question. If we are looking for a research issue, what is the healthiest beverage for humans? You can discover multiple studies and potential answers to the questions. Research gap identification eventually makes way for new and exciting research.
PhD Assistance offers UK Dissertation Research Topics Services. When you Order Dissertation Services at PhD Assistance, we promise you the following – Plagiarism free, Always on Time, outstanding customer support, written to Standard, Unlimited Revisions support and High-quality Subject Matter Experts.
Learn More:http://bit.ly/3aomOF3
Contact Us:
For Any Queries : Website: https://www.phdassistance.com/
UK NO: +44–1143520021
India No: +91–4448137070
WhatsApp No: +91 91769 66446
Email: info@phdassistance.com
Research methodology unit ii-data collectionManoj Kumar
This PPT will give basic idea about
Data Collection
Primary Data collection Methods
Secondary Data collection Methods
Secondary Data collection Methods
Steps in Developing a Questionnaire
Construction of a Schedule
Attitudinal scales
Validity and Reliability of the Instrument
Unit-I
https://www2.slideshare.net/ManojKumar730/research-methodology-unitiresearch-and-its-various-process
Unit-iii
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitiiisampling
Unit-IV
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitivmeasurement-and-data-preperationfor-bbabcommba-and-for-other-ug-and-pg-students
Unit-V
https://www2.slideshare.net/ManojKumar730/research-methodlogy-unitvreseach-report-for-bcom-bba-mba-and-other-ug-and-pg-courses
Interview Method for Qualitative ResearchPun Yanut
Interview is the verbal conversation between two people with the objective of collecting relevant information for the purpose of research.
Interviewing, a method for conducting research, is a technique used to understand the experiences of others.
McNamra (1999), the interviewer can pursue in-depth information around the topic.
Interview may be useful as follow-up to certain respondent
How to Identify the Research Gap While Writing a PhD Dissertation Literature ...PhD Assistance
PhD Assistance gives you tips to Identify Research Gaps in the Literature Review for writing a PhD dissertation.
A Research Gap is a Topic or field for which insufficient data restrict the ability to conclude a research question. If we are looking for a research issue, what is the healthiest beverage for humans? You can discover multiple studies and potential answers to the questions. Research gap identification eventually makes way for new and exciting research.
PhD Assistance offers UK Dissertation Research Topics Services. When you Order Dissertation Services at PhD Assistance, we promise you the following – Plagiarism free, Always on Time, outstanding customer support, written to Standard, Unlimited Revisions support and High-quality Subject Matter Experts.
Learn More:http://bit.ly/3aomOF3
Contact Us:
For Any Queries : Website: https://www.phdassistance.com/
UK NO: +44–1143520021
India No: +91–4448137070
WhatsApp No: +91 91769 66446
Email: info@phdassistance.com
Researching people: using questionnaires and interviewsJenna Condie
Social research methods lecture for animation masters students @salforduni. Introducing the two dominant social research methods - questionnaires and interviews.
Qualitative Research Evaluation Essay
Essay on Types Of Research
Mba
Sampling Methods Essay
Sample Methodology Essay
Research Methodology Report Sample
Essay on Research Methodology
English 101 Research Paper
Example Of Search Strategy
Essay on Medical Research
Research Methods Essay
Importance And Purpose Of Research Essay
Sample Research Proposal on Methodology
Example Of A Research Paper
Career Research Essay
Methodology of Research Essay examples
Essay about Sampling
Research Critique Essay example
C H7A P T E R Collecting Qualitative Data Qualitative da.docxRAHUL126667
C H7A P T E R Collecting
Qualitative Data
Qualitative data collection is more than simply deciding on whether you will observe or interview people. Five steps comprise the process of collecting qualitative data. You need to identify your participants and sites, gain access, determine the types of data to collect, develop data collection forms, and administer the process in an ethical manner.
By the end of this chapter, you should be able to:
· ◆ Identify the five process steps in collecting qualitative data.
· ◆ Identify different sampling approaches to selecting participants and sites.
· ◆ Describe the types of permissions required to gain access to participants and sites.
· ◆ Recognize the various types of qualitative data you can collect.
· ◆ Identify the procedures for recording qualitative data.
· ◆ Recognize the field issues and ethical considerations that need to be anticipated in administering the data collection. Maria is comfortable talking with students and teachers in her high school. She does not mind asking them open-ended research questions such as “What are your (student and teacher) experiences with students carrying weapons in our high school?” She also knows the challenges involved in obtaining their views. She needs to listen without injecting her own opinions, and she needs to take notes or tape-record what people have to say. This phase requires time, but Maria enjoys talking with people and listening to their ideas. Maria is a natural qualitative researcher.
204
CHAPTER 7 Collecting Qualitative Data 205 WHAT ARE THE FIVE PROCESS STEPS
IN QUALITATIVE DATA COLLECTION?
There are five interrelated steps in the process of qualitative data collection. These steps should not be seen as linear approaches, but often one step in the process does follow another. The five steps are first to identify participants and sites to be studied and to engage in a sampling strategy that will best help you understand your central phenome- non and the research question you are asking. Second, the next phase is to gain access to these individuals and sites by obtaining permissions. Third, once permissions are in place, you need to consider what types of information will best answer your research questions. Fourth, at the same time, you need to design protocols or instruments for collecting and recording the information. Finally and fifth, you need to administer the data collection with special attention to potential ethical issues that may arise.
Some basic differences between quantitative and qualitative data collection are helpful to know at this point. Based on the general characteristics of qualitative research, qualita- tive data collection consists of collecting data using forms with general, emerging questions to permit the participant to generate responses; gathering word (text) or image (picture) data; and collecting information from a small number of individuals or sites. Thinking more specifically now ...
a) Research in subject/discipline
b) Methods of data collection in the subject
c) Drawing conclusion, generalization and theory development
d) Preparing reference, notes and bibliography
ACTIVITY 1
Chosen Research Design: Qualitative
Why do you think this design is appropriate to your research interest?
Based on my understanding of qualitative research, I believe it can be appropriate for certain types of research questions. In my view, qualitative research is particularly useful for exploring complex phenomena, gaining insights into people's experiences and perspectives, and developing theory. I also recognize that it can be valuable in applied settings, such as healthcare or social work, where understanding people's experiences is crucial for improving practice.
Guide Questions
1. Did you remember the research design listed in the table?
YES, I have remembered all the research design listed in the table.
2. What other research designs did you recall which is/ are not listed in the table?
Longitudinal Study
Cross-sectional Study
Survey Research
Action Research
Participatory Action Research
Grounded Theory
Ethnographic Research
3. Was it easy or hard to determine the research design to be used in your selected topic or interest?
For me, it is easy because in the first place I already have an idea where to start. I believe when you select a topic, you already considered what design you will use.
4. What are the factors that you consider in selecting a research design for your study?
As a researcher, I must consider various factors when selecting a qualitative research design for my study. These include the research question, the purpose of the study, the nature of the phenomenon being studied, and the available resources and time frame. Additionally, I must reflect on my own philosophical and theoretical perspectives to ensure that the chosen design aligns with my worldview and research goals.
Reflection
How does research design make your study colorful/ interesting?
As a researcher, I have come to appreciate how qualitative research design can add color and interest to a study. By using methods such as open-ended interviews, observations, and document analysis, I can capture the rich and complex experiences, perspectives, and contexts of the participants. This type of research allows me to delve deeper into the phenomenon being studied and gain a more nuanced understanding of it.
One of the benefits of using qualitative research is the ability to create vivid descriptions, quotes, and narratives that add depth and meaning to the study. It's fascinating to see how the data can come to life and offer a unique perspective on the topic. Additionally, I've found that unexpected findings often emerge during qualitative research, which can add to the intrigue and interest of the study.
Overall, I believe that qualitative research design offers a powerful way to explore the intricacies and nuances of human experience. It enables me to create a study that is more compelling and engaging, as well as provides insights that cannot be obtained through other research methods.
ACTIVITY 2: TELL ME THE QUANTITY
Directions: Read the qu
data collection is just systematic way approach for gather and measure information form variety source for the aim of get complete and accurate of an area that interested
Running Head Dissertation of Service Quality Improvement .docxcharisellington63520
Running Head: Dissertation of Service Quality Improvement 1
Dissertation of Service Quality Improvement 2
DISSERTATION OF SERVICE QUALITY IMPROVEMENT
Lusciano Foster
Ashford University
Business Research Methods & Tools (NAG1428A)
BUS642
Loay Alnaji
July 20, 2014
Dissertation of Service Quality Improvement
A research proposal for a possible dissertation entails keen consideration of peer-reviewed articles to establish the possibilities given regarding the topic. Problems, purpose and, hypothesis of the research are to be established to guide during the research. Planning dissertation research for a business follows a format that gives prospectus clients or supporters a vivid view of the reasons and importance of the research.
Service quality improvement has been a critical issue to most business setting, rendering them to provide poor services. They focus on spending a lot of money on ill- conceived services in addition, undermining the best methods to offer their customers with quality services. In such cases, customers feel unsatisfied and not treated in a manner they would like to be handled. Excellent service is an important approach because customer’s loyalty and satisfaction is improved. Every business should focus on how to improve their services in order to retain their customers and gain more customers.
Customers view value as the profit acquired from the trouble encountered such as unfriendly employees, high prices, services that are not attractive and locations that are not convenient to them. With excellent services, profit maximization of the company is improved and customer’s burdens on non-price issues are minimized. Most business organizations suffer low profit because their services do not meet customers’ expectations. Prior researches have concentrated on how services can be measured and nature of customer’s expectations without considering the service quality improvement factor, in order to improve their profits (Loshin, 2011).
This research will help to identify means of improving service in business organizations. Quality need to be described by the customer, whereby it should conform to his or her specification. Most company’s view quality as conformance to organization specifications and this research will help to solve this problem by identifying the best methods of delivering quality service. This research will help to address the questions on how to respond to customers and taking care of them (Hernon, 2011).
Ethics has become a keystone for carrying out successful and significant research. Due to this, the ethical conduct of individual researchers is under unprecedented analysis (Best & Kahn, 2006; Field & Behrman, 2004; Trimble& Fisher, 2006). Some of the ethical concerns likely to be experienced when conducting research are ex.
how good quality qualitative data analysis (QDA) can help you identify impacts of your
programs to better meet your objectives and the needs of the community
the steps involved in undertaking basic QDA, including repeated reading, analysis and
interpretation
the value of involving others in the QDA process
the difference between description and interpretation
the value of seeking feedback on your analysis and using triangulation to increase thetrustworthiness of findings
PAT H F I N D E R I N T E R N AT I O N A L TO O L S E R I E S.docxkarlhennesey
PAT H F I N D E R I N T E R N AT I O N A L TO O L S E R I E S
Monitoring and Evaluation – 2
CONDUCTING IN-DEPTH
INTERVIEWS:
A Guide for Designing and
Conducting In-Depth Interviews
for Evaluation Input
By
Carolyn Boyce, MA, Evaluation Associate
Palena Neale, PhD, Senior Evaluation Associate
May 2006
PAT H F I N D E R I N T E R N AT I O N A L TO O L S E R I E S
Monitoring and Evaluation – 2
CONDUCTING IN-DEPTH
INTERVIEWS:
A Guide for Designing and
Conducting In-Depth Interviews
for Evaluation Input
By
Carolyn Boyce, MA, Evaluation Associate
Palena Neale, PhD, Senior Evaluation Associate
May 2006
Acknowledgements
The authors would like to thank the following Pathfinder employees and partners for their
technical inputs into this document: Anne Palmer (Futures Group International), Ugo
Daniels (African Youth Alliance (AYA)), Veronique Dupont (Pathfinder/Extending Service
Delivery (ESD)), Cathy Solter, Lauren Dunnington, and Shannon Pryor (Pathfinder
headquarters). Jenny Wilder and Mary Burket are also thanked for their inputs and
assistance in editing and producing this document.
2 PATHFINDER INTERNATIONAL: CONDUCTING IN-DEPTH INTERVIEWS
What is an In-Depth Interview?
In-depth interviewing is a qualitative research technique that involves conducting intensive
individual interviews with a small number of respondents to explore their perspectives on a
particular idea, program, or situation. For example, we might ask participants, staff, and others
associated with a program about their experiences and expectations related to the program, the
thoughts they have concerning program operations, processes, and outcomes, and about any
changes they perceive in themselves as a result of their involvement in the program.
When are In-Depth Interviews Appropriate?
In-depth interviews are useful when you want detailed information about a person’s
thoughts and behaviors or want to explore new issues in depth. Interviews are often used
to provide context to other data (such as outcome data), offering a more complete picture
of what happened in the program and why. For example, you may have measured an
increase in youth visits to a clinic, and through in-depth interviews you find out that a
youth noted that she went to the clinic because she saw a new sign outside of the clinic
advertising youth hours. You might also interview a clinic staff member to find out their
perspective on the clinic’s “youth friendliness.”
In-depth interviews should be used in place of focus groups if the potential participants
may not be included or comfortable talking openly in a group, or when you want to
distinguish individual (as opposed to group) opinions about the program. They are often
used to refine questions for future surveys of a particular group.
What are the Advantages and Limitations of In-Depth Interviews?
The primary advantage of in-depth interviews is that they provide much more detailed
information than what is available through other data col ...
[Note: This is a partial preview. To download this presentation, visit:
https://www.oeconsulting.com.sg/training-presentations]
Sustainability has become an increasingly critical topic as the world recognizes the need to protect our planet and its resources for future generations. Sustainability means meeting our current needs without compromising the ability of future generations to meet theirs. It involves long-term planning and consideration of the consequences of our actions. The goal is to create strategies that ensure the long-term viability of People, Planet, and Profit.
Leading companies such as Nike, Toyota, and Siemens are prioritizing sustainable innovation in their business models, setting an example for others to follow. In this Sustainability training presentation, you will learn key concepts, principles, and practices of sustainability applicable across industries. This training aims to create awareness and educate employees, senior executives, consultants, and other key stakeholders, including investors, policymakers, and supply chain partners, on the importance and implementation of sustainability.
LEARNING OBJECTIVES
1. Develop a comprehensive understanding of the fundamental principles and concepts that form the foundation of sustainability within corporate environments.
2. Explore the sustainability implementation model, focusing on effective measures and reporting strategies to track and communicate sustainability efforts.
3. Identify and define best practices and critical success factors essential for achieving sustainability goals within organizations.
CONTENTS
1. Introduction and Key Concepts of Sustainability
2. Principles and Practices of Sustainability
3. Measures and Reporting in Sustainability
4. Sustainability Implementation & Best Practices
To download the complete presentation, visit: https://www.oeconsulting.com.sg/training-presentations
Digital Transformation and IT Strategy Toolkit and TemplatesAurelien Domont, MBA
This Digital Transformation and IT Strategy Toolkit was created by ex-McKinsey, Deloitte and BCG Management Consultants, after more than 5,000 hours of work. It is considered the world's best & most comprehensive Digital Transformation and IT Strategy Toolkit. It includes all the Frameworks, Best Practices & Templates required to successfully undertake the Digital Transformation of your organization and define a robust IT Strategy.
Editable Toolkit to help you reuse our content: 700 Powerpoint slides | 35 Excel sheets | 84 minutes of Video training
This PowerPoint presentation is only a small preview of our Toolkits. For more details, visit www.domontconsulting.com
VAT Registration Outlined In UAE: Benefits and Requirementsuae taxgpt
Vat Registration is a legal obligation for businesses meeting the threshold requirement, helping companies avoid fines and ramifications. Contact now!
https://viralsocialtrends.com/vat-registration-outlined-in-uae/
An introduction to the cryptocurrency investment platform Binance Savings.Any kyc Account
Learn how to use Binance Savings to expand your bitcoin holdings. Discover how to maximize your earnings on one of the most reliable cryptocurrency exchange platforms, as well as how to earn interest on your cryptocurrency holdings and the various savings choices available.
The world of search engine optimization (SEO) is buzzing with discussions after Google confirmed that around 2,500 leaked internal documents related to its Search feature are indeed authentic. The revelation has sparked significant concerns within the SEO community. The leaked documents were initially reported by SEO experts Rand Fishkin and Mike King, igniting widespread analysis and discourse. For More Info:- https://news.arihantwebtech.com/search-disrupted-googles-leaked-documents-rock-the-seo-world/
Putting the SPARK into Virtual Training.pptxCynthia Clay
This 60-minute webinar, sponsored by Adobe, was delivered for the Training Mag Network. It explored the five elements of SPARK: Storytelling, Purpose, Action, Relationships, and Kudos. Knowing how to tell a well-structured story is key to building long-term memory. Stating a clear purpose that doesn't take away from the discovery learning process is critical. Ensuring that people move from theory to practical application is imperative. Creating strong social learning is the key to commitment and engagement. Validating and affirming participants' comments is the way to create a positive learning environment.
Implicitly or explicitly all competing businesses employ a strategy to select a mix
of marketing resources. Formulating such competitive strategies fundamentally
involves recognizing relationships between elements of the marketing mix (e.g.,
price and product quality), as well as assessing competitive and market conditions
(i.e., industry structure in the language of economics).
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
How To Conduct Survey 209
1. S urvey
H a ndbook
Archester Houston, Ph.D.
TQLO
Organizational Systems Division
Total Quality Leadership Office
Office of the Under Secretary of the Navy
1
2. Survey Handbook
Archester Houston, Ph.D.
Organizational Systems Division
Total Quality Leadership Office
TQ LO
Office of the Under Secretary of the Navy
What is a Survey?
A survey is a systematic method of collecting information from a selected group of people by asking a
series of questions. Surveys can be used to collect various types of information. They can collect
information on people’s behaviors, job performance, knowledge, preferences, attitudes, beliefs,
feelings, etc. For a survey to provide useful information, care must be taken in its development and
use reasons, including the cost in terms of time and money.
This handbook provides you with an overview of developing and conducting a survey. It also offers
tips for writing or modifying survey items to meet your special needs. However, it will not make you
an expert in survey development. It is strongly advised that you obtain professional assistance when
possible, especially in survey design and statistical analysis.
When Should I Use a Survey?
Although surveys are a popular method of collecting data, they must be used under the appropriate
conditions. Consider using a survey:
. . . when it is faster, easier, or less expensive to use than other methods. Sometimes other data
collection methods are preferable. For example, to determine the number of people using a clinic, you
can simply count the number of signatures on the sign-in sheet, or examine the daily records, rather
than conducting a survey to obtain this information.
. . . when the information does not already exist in some form. Checking whether relevant and accurate
data exist in archives, records, or databases can save a great deal of time, money, and effort. For
example, before asking employees the names and dates of each course taken within the past year,
consult their training files to obtain this information.
2
3. Preparing for a Survey
A number of issues should be resolved before drafting the first survey item. Use the following
questions to help you in preparing for a survey:
What is the purpose of the survey?
Surveys can be used for many purposes, including:
Determining customer needs/assessing customer satisfaction
Identifying organizational strengths and weaknesses
Targeting areas needing improvement
Assessing the effectiveness of new or existing policies or programs
Without a clear purpose it is likely that the survey effort will flounder. This can result in wasted
resources, useless data, and disappointment on the part of those who initiated the survey and those
who responded to it.
Be very careful about conducting a survey “just to see what’s going on.” Conducting a survey can
draw attention to an organization from the people who receive the survey and from those who
learn that it is being conducted. This attention can led to expectations that executive actions will
soon follow.
Survey information can be valuable in guiding improvement efforts at the process, organizational,
and systems level. Information on planning and conducting improvement efforts can be found in a
variety of DON Total Quality Leadership publications, including:
A Handbook for Strategic Planning(Wells andDoherty, 1994)
Strategic Management for Senior Leaders: A Handbook for Implementati
on
(Wells, 1996)
A Total Quality Leadership Process Improvement Model (Houston and
Dockstader, 1993)
Process Improvement NotebookCulbertson et. al., 1997)
(
Use these publications to assist you in determining and clarifying the information needs that would
require a survey.
3
4. Who will use the results?
Identify who will be using the results of the survey and what their information needs are. What
types of decisions are they going to make based on the results? How should the information be
sorted for them? Do they need detailed responses or is the “big picture” sufficient? How do they
prefer to have information presented to them?
What specific information is needed?
To meet the purpose of the survey, identify the topics or issues of interest and the forms of
information needed. For example, if you are interested in maintaining equipment at an athletic
center, then you might ask questions about how often people use the center, what facilities they
use, and hours of use. You might also ask people to rate the quality of the swimming pool,
treadmills, exercise machines, shower area, towel service, etc. If you are interested in meeting
future needs, you might ask people to identify their anticipated physical fitness needs or interests.
Each of these topics could be the subject of one or more survey items.
Who will be responsible for developing the survey?
Surveys are often developed by small teams. When considering membership, include individuals
who have some knowledge of the topics or issues of interest. Also try to include individuals who
have experience planning tools or graphic methods. If possible, have a member with experience in
survey development and statistical analysis.
Who will be surveyed?
Identify the types of people who can provide the information you are interested in. Do they belong
to a single rank or organizational level or do they come from a variety of ranks or levels? Do they
work in the organization or are they end-users of the organization’s products or services?
How will the survey be administered?
There are several ways to conduct surveys. Examples include face-to-face interviews, telephone
interviews, and written surveys. The latter include those conducted by mail, computer, and group
sessions.
Select the method that will provide sufficient information as efficiently as possible. Interviews can
provide very detailed information, but require special training to conduct effectively, can be time-
consuming, and might be difficult to analyze and interpret. Interviews can be useful when you need
4
5. to collect detailed information from a relatively small group of people. Interviews can be used to
explore issues and options to a greater extent than written surveys. Written surveys typically
provide less detailed information, but can be used to collect large amounts of information in a
relatively short period of time.
What resources will be needed?
Identify the staff and other resources required for the survey. Depending on the type of survey
being conducted, resources can include a project manager, trained interviewers, statisticians, data
analysts, printing costs, mailing costs, data entry, and data processing. Keep in mind that the
people who respond to the survey should be considered as a resource in terms of number, time
invested, and information provided.
What survey items will be used?
Based on the information requirements, determine if you can use an existing survey, modify an
existing one, or if you need to develop an entirely new survey. (Developing survey items will be
covered later.)
How will survey information be analyzed and reported?
Decide what methods will be used to summarize, interpret, and communicate the survey results.
Data can be summarized with methods as simple as tallies, percentages, or averages. Depending
on the decisions that are going to be made based on the survey information, more complex analytic
methods might be appropriate. These more complex methods could involve analysis of variance to
compare the results from different groups such as managers and employees or regression analysis
to check the relationship between two variables such as job satisfaction and intent to leave the
organization.
Decide how you will display the survey information. This decision should be influenced by the
interests and preferences of the audience. Do they prefer simple graphs, statistical charts, or text
summaries? The presentation format of results to executives who are considering policy changes
might be different from that offered to external customers. If you need to present the results to
different groups, consider tailoring the level of detail and data display methods to the different
levels of interest.
5
6. How many people need to respond to the survey?
Due to limited resources, it might not be feasible to collect survey information from every member
of a group you’re interested in; for example, it would be very difficult and costly to survey every
member of the Department of the Navy. Sampling is a technique used to determine the size and
types of group subsets needed to provide representative information about the larger group.
Obtain the help of someone skilled in sampling techniques when you try to determine how many
survey respondents you need. Inappropriate samples can lead to misleading results, inaccurate
interpretations, and ineffective actions.
If you have addressed the previous questions and decided that conducting a survey would be useful
and feasible, then here are a set of activities to assist your effort. They include: constructing survey
items, selecting response formats, reviewing items, creating survey introduction and instructions, pilot
testing a survey, administering a survey, analyzing survey results, sampling, and communicating results
and determining implications for improvement. These activities can be helpful whether you are
creating a completely new survey or modifying an existing one.
Constructing Survey Items
Write survey questions for each topic of interest, jotting down whatever comes to mind. At the
beginning it is better to have too many items than too few. not focus on writing the perfect
Do
question. It is more important at the beginning to cover all of the topics than to be elegant in phrasing.
Consider using brainstorming, tree diagrams, and other idea-generation methods to create survey
items. Individuals who have attended the DON TQL Methods for Managing Qualitycourse should be
familiar with them. Information on these methods can be found Memory Jogger II(Brassard &
in
Ritter, 1994).
Try to create items that are:
Clearly written. Statements should be short and easy to read. Do not use jargon, technical terms, or
acronyms that are unfamiliar to the people answering the survey.
Concise. Get to the point as quickly as possible. Eliminate extraneous words or ideas, so the
respondent can concentrate on the survey item without being distracted.
Specific. Focus on one idea at a time. Each item should collect information on a single behavior,
attitude, opinion, event or subject.
6
7. Explicit. Do not force people to guess about what is being asked. Be sure they understand what
information you wantby explicitly stating so. If necessary, highlight or underline what is needed by
way of an answer.
Selecting Response Formats
Along with the statements and questions, you need to provide methods for people to give their
answers. Typically, survey items are used to ask people how much they with some statement,
agree
how important something is, or howoften something happens. Here are some common types of
survey response formats used to collect information:
Rating Scales. Surveys often ask that products or services be rated according to some scale. Some
survey items present statements and ask people to rate how much they agree or disagree with the
statements. Some examples of rating scales are presented below:
My supervisor encourages subordinates to participate in important decisions.
1 2 3 4 5 6
Strongly Disagree Slightly Slightly Agree Strongly
Disagree Disagree Agree Agree
How satisfied are you with the service you received?
1 2 3 4 5
Very Dissatisfied Neutral Satisfied Very
Dissatisfied Satisfied
Please rate the condition of the housing you were provided:
1 Bad, in need of total rehabilitation
2 Very Poor, in need of several major repairs
3 Poor, in need of at least one major repair
4 Fair, in need of minor repairs
5 Good Condition
6 Excellent Condition
7
8. When creating rating scales, be sure that the end points or anchors are equal and opposite in meaning.
If that is not done, there is a risk of biasing the responses you get from the survey. For example, the
following rating scale might provide answers you like, but not information you need:
1 2 3 4 5
Mostly Completely Very Extremely Raving
Satisfied Satisfied Satisfied Satisfied Fan
Ranking Items. Another common response choice is to ask respondents to rank-order a list of options
in terms of some factor, such as importance. These data help to prioritize what is most important to
respondents. Thus, if speed of service and cost for a restaurant on base are ranked higher than quality
of food and variety on the menu, then efforts can be focused on those aspects most important to
respondents.
Please rank the following five improvement objectives in terms of importance by marking a
1 next to the most important objective, a 2 next to the second most important objective, and
so forth:
Having a quick success
Increasing the amount of output
Reducing the price charged to customers
Reducing work backlog
Reducing the number of defects
Selecting Options. This response format presents a list of statements or options and asks respondents
to circle all that apply to them. This format is similar to the ranking question, but does not require
survey respondents to put things in an order. This kind of question is easier to respond to than having
to rank-order questions, for in many cases respondents cannot prioritize options when they feel that
everything is of equal importance.
Please circle the numbers next to each of the graphic or statistical methods that your team
has used to analyze process performance data:
1. Pareto diagrams
2. Histograms
3. Scatter diagrams
4. Run charts
5. Control charts
6. Regression analysis
7. Taguchi methods
8
9. Comments and Open-ended Questions The fourth question/response type allows respondents to
.
provide additional comments or other information in response to general questions. These questions
usually leave blank space where respondents can write whatever is important in their own words and
format. Examples are listed below.
Do you have any suggestions on how we can improve?
Are there any products or services you need that we do not currently provide?
Is there anything else you would like us to know?
This information can be very useful in understanding issues that have not been touched upon or to
gather ideas and generate options for improvement. On the down side, responses to these types of
questions can be difficult to interpret.
Demographic Questions. Demographic information is typically used to segment respondents into
smaller groups based on specific characteristics such as rank, age, or organizational level. This
segmentation is important if one of the purposes of the survey is to determine if there are significant
differences in responses between groups. The following are examples of demographic questions:
Which one of the following age categories do you currently fall in:
_____Under 20
_____20-29
_____30-39
_____40-49
50-59
Over 59
What is the highest educational level you have attained:
Less than high school diploma or GED
High school diploma or GED
Associate Degree
Bachelor’s Degree
Master’s Degree
Doctoral Degree
9
10. What is your martial status?
Single (never married)
Married
Divorced/Separated
Widowed
What is your current rank and pay grade?
What is your organizational level?
a. Directorate
b. Division Director
c. Branch Head
d. Section Head
e. First-line Supervisor
f. Non-Supervisory
Demographic items can be included that ask people to identify themselves, i.e., give their names or
Social Security numbers. If you ask respondents to identify themselves in this manner, they might not
feel comfortable providing honest feedback, particularly if it is “bad news.” To help reduce potential
concerns about privacy, you should include a description of how the survey answers will be used and a
promise to keep individual responses anonymous. For large or more formal surveys it might be
appropriate to include a Privacy Act Statement. The statement should read as follows:
Public Law 93-579, the Privacy Act of 1974 requires that you be informed
of the purposes and uses to be made of the survey. Authority to collect this
information is granted in Title 5 of the United States Code. Providing this
information is voluntary. The information will be used for statistical
purposes only. In no case will the information be used for making
decisions affecting specific individuals.
Reviewing Items
After you have developed a set of potential survey items and response scales, review them to make
sure that they are:
Relevant to the purpose of the survey. Items that stray from the purpose will provide the
not
information needed. Be sure to have a specific reason for why an item is being asked in a survey.
Always focus on the purpose of the survey and the type of information that will be needed to support
that purpose. Carefully compare the items to your survey purpose to ensure that they address the
issues that have been identified.
10
11. Appropriate for the individuals being surveyed. Do not include items that people do not have the
knowledge to answer. For example, store customers could probably answer questions about a store’s
layout; but they would not be able to answer questions about a store’s compliance with fire
regulations.
Capable of providing the appropriate type of results.Think ahead to how the information will be
summarized. The summary of results should provide the types and level of information required by the
survey users. Will the results be presented in simple bar graphs or subjected to advanced analysis?
How much detail will be required to meet the information needs of those using the survey? For
instance, if the survey users are interested in general impressions, there is little reason to present
averages calculated to the seventh decimal point. On the other hand, if the survey users need to make
precise distinctions among quality features, then just providing a list of verbatim comments is not
going to be helpful either.
Eliminate items that are inappropriate or redundant and clarify items that are unclear. Check items to
ensure that they are not:
Ambiguous. Avoid words or phrases that can be misinterpreted.
Do you enjoy exciting tours?
This organization is energetic and active.
Overlapping. Avoid presenting response choices that overlap. Overlapping choices can lead to
confusion on the part of the respondent and difficulty in interpreting information.
Circle the number that best represents the number of hours per week you spend on physical
readiness training:
1. None at all
2. Less than one hour per week
3. One to two hours per week
4. Two to three hours per week
5. Three to four hours per week
6. Four or more hours per week
Double-barreled. Avoid having respondents address two different issues in the same item.
The clerk listened to me carefully and took a short time to handle my request.
11
12. Evaluate the presence and quality of the listed statements with the following scale. You will
provide a single response for each statement by circling the appropriate number. Use your
discretion to balance the presence/quality response.
Presence: None Partially Organization-
Wide
0 1 2 3 4 5 6 7 8 9 10
Quality: No Satisfactory Excellent
Performance
Leading. Avoid giving clues that point to the desired answer, or limiting the answers to those
desired.
Do you feel that you are being forced to pay too much for daycare services?
Redundant. Avoid asking the same question more than once.
Rewrite or delete inappropriate or repetitive items. Then review the remaining ones for clarity and to
ensure that they can collect the information required. In addition to reviewing the items yourself, you
might consider conducting a pilot test of the survey.
Survey Introduction and Instructions
Surveys usually have a short introduction explaining the purpose of the survey and how the data will
be used. Sometimes this information is explained in a cover letter attached to the survey. Short
instructions on how to complete the survey usually follow the introduction. Sometimes an example is
provided to show how to mark response boxes or fill out an answer sheet. If demographic items are in
the survey, provide a statement to reassure people that their responses will remain anonymous. That
statement can be reinforced by adding the Privacy Act Statement (presented in the section on
demographics) to the end of the instructions. Be sure to give people instructions on how, when, and
where they are to return the completed survey.
Pilot Testing a Survey
After you have a draft survey, you can conduct a pilot test to further check and refine the survey. Pilot
testing involves trying out a survey before wide-scale distribution to make sure it is easy to understand
and provides appropriate data. Pilot testing is usually done with a small group of respondents who are
representative of the larger group. If you choose to conduct a pilot test, consider taking the following
steps:
12
13. Explain the process. Gather together the group who will be pilot testing the survey. Briefly explain
that they are to evaluate the survey as they are taking it and identify questions that are unclear, topics
that are missing, and suggestions about improvements.
Request written comments. Ask people to make notes on the survey where they have questions or
comments. Some individuals will not feel comfortable discussing survey problems with the group, but
will provide written feedback. Collect the completed surveys at the end of the meeting and review any
written comments provided.
Measure time requirements. Time how long it takes people to complete the survey. Use this
information to determine if the survey is too long, or if it could be expanded in length.
Hold a group discussion. After everyone has completed the survey, review each section of the survey
with the group to gather feedback. Record the information and study it after the pilot testing session.
Sometimes comments that do not seem to represent be a good idea initially can, upon further
reflection, be very useful. Ask if important issues or satisfaction areas were left off the survey. Also
ask if there are any other demographic questions that need to be added to the survey.
Use the information obtained through the pilot test to modify the survey. Modifications could involve
rewriting items to increase their clarity, eliminating items that do not provide relevant information, or
adding items to obtain more complete information on important issues. Once you have a final version
of the survey and have identified the sample, it is time to administer the survey.
Administering the Survey
Two common methods of administering written surveys are by mail and in-person. Here are some
things to consider when using one or the other.
Mail-Out Surveys. The most common method of administration is to mail surveys to the customer
sample with a stamped, business reply envelope. Remember to budget for postage costs, which can be
substantial if several thousand surveys are being mailed. When using the mail-out process, allow time
for the survey to get to its destination, time for the respondent to complete it, and time for the survey
to be returned. Surveys mailed to distant (i.e., overseas) addresses might require 2-16 weeks for their
return. Local surveys might take 2-3 weeks to come back.
In-Person Surveys. In-person surveys can be done in different ways. One format is to ask respondents
to complete on-the-spot surveys as they receive products or services from the organization. Only very
short surveys are practical in this type of situation. The survey administrator usually stands by as the
13
14. customer completes the survey and might give the customer some small token of appreciation for
completing the survey. A second format is to ask respondents to come to a particular location to
complete a customer survey. A third format is to visit respondents at their work sites and ask them to
complete the customer satisfaction survey.
Analyzing the Survey Results
After surveys have been administered, you need to summarize, analyze, and interpret the results. This
requires sorting and consolidating individual responses to survey items so that they can be more easily
displayed and understood. Some common methods of summarizing and analyzing are presented next.
See Brassard (1988), Brassard and Ritter (1994), and the DONToolkit (1996) for more information
about these and other methods.
Frequency distributions. Frequency distributions are a very simple method of displaying the variation in
responses to survey items. These distributions can be developed by counting and recording answers
according to the response scales used in the survey. Frequency distributions are typically presented as
tables or bar graphs for ease of interpretation.
1 2 3 4 5
Very Dissatisfied Dissatisfied Neutral Satisfied Very Satisfied
3 14 3 30 50
Availability of
technical support
10 15 2 45 28
Responsiveness of
technical support
Time to complete
1 3 0 88 8
technical support
service
Courtesy shown by
17 70 0 7 6
technical support
provider
Figure 1. Example of a table showing a frequency distribution of responses to survey items.
14
15. 100
80
Availability of technical support
60 Responsiveness of technical support
40 Time to complete technical support
service
Courtesy shown by technical support
20
provider
0
Very Neutral Very Satisfied
Dissatisfied
Figure 2. Example of a frequency distribution presented in a bar graph.
Percentages. One of the simplest ways to summarize survey information is with percentages.
Percentages are calculated by dividing the total of a specific response choice by the total number of
responses and multiplying by 100. Percentages can be displayed using tables, bar graphs, or pie charts.
Very Dissatisfied
Very Satisfied 10%
28%
Very Dissatisfied
Dissatisfied
Dissatisfied
Neutral
15%
Satisfied
Very Satisfied
Neutral
2%
Satisfied
45%
Figure 3. Example of percentages presented in a pie chart.
15
16. Problems Experienced Using Laser Printer
April 1991
Percentage of Occurrences
30
25
20
15
10
5
0
Double-spaced Garbled Lost text Extra blank space Other
Figure 4. Example of ranked data presented in Pareto chart.
a
Pareto charts. Pareto charts are used to presented ranked data.Pareto charts are particularly useful in
helping to focus attention on major factors or issues.
Pareto charts are bar graphs that present data in
descending order of frequency or magnitude combined with a cumulative percentage line.
Unless a statistician or someone well-versed in survey development and statistical analysis is available,
keep the analyses focused on frequency distributions, rank orderings, counts, and averages. More
complicated statistical analyses, such as analysis of variance or regression analysis, should be
conducted by people familiar with them.
Sampling
Since surveys can be expensive in terms of printing, mailing, and data entry costs, it is common to
select a subset or small group of people from which to gather data. This subset or small group is
known as a sample. The people targeted to fill out a survey are chosen from a specificpopulation. A
population consists of all members of an organization or group of people who possess the desired
traits, knowledge, experience, or characteristics of interest to the survey project. A population may
consist of, for example, all civilian and military employees of the Department of the Navy, all personnel
within a command, all department heads, or the users of a product or service.
A rule of thumb for selecting the size of a sample is to randomly select 10 to 20% of the members
from the population being investigated. Random sampling means that each member of the population
has an equal chance of being surveyed. Random sampling improves the probability that the
16
17. information obtained through the survey will represent the responses the entire population would give.
Please consult with someone who has statistical expertise when developing a sample, especially if you
intend to use more advanced analytic methods to interpret the results.
The number of respondents could be quite large. One way to simplify the situation is to think of
respondents in terms of segmentation. Segmentation means to sort respondents into groups based on
similar characteristics, such as relationship to the organization (internal, end-user, supplier), rank, or
the types of products or services used. Sorting respondents into groups is a commonly used method
to identify and distinguish the experiences and perceptions of distinct groups. Demographic items are
used in surveys to identify respondents so that their data can be sorted and analyzed as needed.
For instance, a DON organization could segment respondents by whether they are part of afloat or
ashore commands, operational or support units, headquarters offices or field activities, or a
combination of these work environments. External respondents could also be grouped by their use of
the organization’s product: those respondents who use a naval station’s piers versus tenant commands
that inhabit buildings on the naval station versus respondents who travel to the naval station to use the
legal services, the library, and club facilities.
Communicating Survey Results and Determining Implications for
Improvement
One of the most important actions after collecting and analyzing survey data is communicating the
results. You might need to tailor presentations of results for different groups in the organization. First,
report the results to managers in the organization, particularly those in areas highlighted by the data.
Presentations of results to those working in the processes should focus on specific product or service
requirements. People working in the process have intimate knowledge of that process, and can offer
ideas on how to improve it.
A summary of the survey results should be provided to respondents when possible along with a
discussion of planned efforts to address identified problems and concerns. The surest way to kill
respondents' interest in providing information is to do nothing with the information they provide.
17
18. Conclusion
Surveys can be used to provide information to support improvement efforts. Surveys can be used to
obtain information on external customer requirements, current satisfaction levels, ideas on how to
improve, and the effects of previous efforts. Based on this information, decisions can be made on
where to focus the organization’s future improvement efforts. Keep the following in mind when
beginning an survey:
Have a clear purpose for conducting a survey.
Tailor your survey to the particular respondents and issues being assessed.
Keep surveys short and simple.
Communicate results to managers and respondents.
Use results to guide future improvement efforts.
Resources on Surveys
The following sources provide more information on developing and interpreting surveys.
Brassard, M. (1989). The memory jogger+. Methuen, MA: GOAL/QPC.
Brassard, M.,& Ritter, D. (1994). The memory jogger II: A Pocket Guide of Tools for Continuous
Improvement & Effective Planning Methuen, MA: GOAL/QPC.
.
Culbertson, A., Houston, A.,Faast, D., White, M.,Aguirre, M., & Behr, C. (1995). The process
improvement notebook Washington, DC: Department of the Navy.
.
Federal Quality Institute. (1993).Self-assessment guide for organizational performance and
customer satisfaction. Washington, DC: U. S. Government Printing Office.
Fowler, F. J. (1988). Survey research methods(Applied Social Research Methods Series Volume 1).
Newbury Park, CA: Sage Publications.
Garvin, D. A. (Fall 1984). What does quot;product qualityquot; really mean?
Sloan Management Review
26(1), 25-43.
Government Accounting Office. (1993 Developing and using questionnaires
). (GAO/PEMD-
10.1.7). Washington,D.C.: Government Printing Office.
18
19. Hayes, B. (1992). Measuring customer satisfaction ASQC Quality Press: Milwaukee, WI.
.
Henry, G. T. (1990). Practical sampling Newbury Park, CA: Sage.
.
Office of Management and Budget. (1993). Resource manual for customer surveys Washington,
.
DC: Executive Office of the President.
Scholtes, P. (1988). The team handbook Madison, WI: Joiner Associates Inc.
.
Spendolini, M. J. (1992). Customer satisfaction measurement Laguna Beach, CA: MJS Associates.
.
Wells, D. L. (1996). Strategic management for senior leaders: A handbook for implementation.
Washington, DC: Department of the Navy
Wells, D. L. &Doherty, L. M. (1994). A handbook for strategic planning. Washington, DC:
Department of the Navy
Zimmerman, R. E.,Steinmann, L., &Schueler V. (October 1996). Designing customer surveys that
work. Quality Digest, 16(10), 22-28.
19