2. Table of Contents
-
Survey Research
Reliability and Validity
Survey Monkey
Our Survey
Results
Grounded Theory
Research Questions
Next Steps
3. Survey Research
• What is survey research?
• Advantages and Disadvantages
• Research Methods
• Designing the research tool
• Ethics
4. Survey Research
What is survey research?
- Descriptive research
- Analytical Studies
- Evaluation Research
“Research strategy not a research method”
5. Survey Research
Advantages
•Produces empirical data
•Can better generalize a
population
Cost effective
•
Disadvantages
●Lacks detail and depth
●Significance can be
neglected
●Hard to achieve proper
response rate
10. Survey Research:
Designing The Research Tool
Question Design
Improving respondent recall
Be specific
Sensitive questions
•
•
•
11. Survey Research:
Designing The Research Tool
Piloting
Are the instructions clear?
Do the questions make sense?
Are sufficient response options available?
Are any questions systematically missed?
•
•
•
•
14. Reliability and Validity
Test-Retest and Alternate Form Reliability
If r>0.70 then reliable
Test-retest is giving two similar test at
different time periods
Alternate form is similar of test-retest
(changing the word of questions in a similar
form or change the order)
•
•
•
18. Reliability and Validity
Face Validity
checking to see if there is a clear purpose
Does not focus on content, focuses on how
relatable is it to the topic
•
•
19. Reliability and Validity
Construct Validity
to prove that there are other material out
there to support the test and the results
if you construct a new survey but there is
no previous research or studies on it then it
may not have great validity
•
•
20. Reliability and Validity
Criterion Validity
based on the performance of the construct
theory
if we have an existing survey that can allow
for comparison with the new survey then
this is concurrently valid.
Ex. a new IQ test compared to a similar IQ
test to check for validity
•
•
•
21. Survey Monkey
• How to create a survey
• Collect data
• How to analyze results
• Exporting documents
• Creator’s view vs the participant’s view
https://www.surveymonkey.com
26. Research Questions
• Is behavior counseling sufficient in converting people
from inactive to an active lifestyle?
• Could household cleaning and gardening be enough
physical activity to label someone as active?
• Testing the KIN and College of Science population,
would we see more physical activity performance in
KIN students than College of Science students?
27. Next Steps
• Create surveys for Bod Pod and pQCT
• Create and use surveys for research (i.e.
•
comparing amount of physical activity for
different majors, gender, or age groups)
Develop guidelines to help students that are
interested in utilizing survey methods in
their research
28. Works Cited
Babbie, E. (2013). The basics of social research. Cengage Learning.
Duke initiative on survey methodology and research. (2010). Retrieved from
http://dism.ssri.duke.edu/question_design.php
Fowler, F. J. (2013). Survey research methods (Vol. 1). Sage.
Glaser, B. G., & Strauss, A. L. (2009). The discovery of grounded theory: Strategies for qualitative
research. Transaction Publishers.
Kelley, K., Clark, B., Brown, V., & Sitzia, J. (2003). Good practice in the conduct and reporting of
survey research. International Journal for Quality in Health Care, 15(3), 261-266.
Litwin, Mark. How to Measure Survey Reliability and Validity. Sage Publications. 1995.
McLeod, S. A. (2007). What is Validity?. Retrieved from
Kelley, K., Clark, B., Brown, V., & Sitzia, J. (2003). Good practice in the conduct and reporting of survey research. International Journal for Quality in Health Care, 15(3), 261-266.
Kelley, K., Clark, B., Brown, V., & Sitzia, J. (2003). Good practice in the conduct and reporting of survey research. International Journal for Quality in Health Care, 15(3), 261-266.
Fowler, F. J. (2013). Survey research methods (Vol. 1). Sage.
http://www.amstat.org/sections/srms/srmslogo.gif
Reliable: appropriate for the intended use
Valid: acceptable to respondents
Avoid: double-barrelled, double negatives; erroneous assumptions; loaded, leading, emotional, or evocative language as it can bias responses; jargon; emphasis on one side of an issue (consider providing counter-arguments); complex sentences;
http://dism.ssri.duke.edu/question_design.php
Specifics: Clarify ambiguous and imprecise terms or break them down into several questions, Define terms very specifically when necessary, avoid complex
Babbie, E. (2013). The basics of social research. Cengage Learning.
http://en.wikipedia.org/wiki/File:Socrates_BM_GR1973.03-27.16.jpg
http://mrhoyestokwebsite.com/Page%20Images/Ethics.jpg
Litwin, Mark. How to Measure Survey Reliability and Validity. Sage Publications. 1995.
Definition: The degree of stability exhibited when a measurement is repeated under identical conditions
McLeod, S. A. (2007). What is Validity?. Retrieved from http://www.simplypsychology.org/validity.html
Trochim, William M. The Research Methods Knowledge Base, 2nd Edition. Internet WWW page, at URL: <http://www.socialresearchmethods.net/kb/> (version current as of October 20, 2006).
"Alternate-Form Reliability." statistics.com. N.p., n.d. Web. 19 Feb 2014. <http://www.statistics.com/index.php?page=glossary&term_id=707>.
Def: How well a survey measures what it is intended to measure
http://www.lifeinthedoglane.com/wp-content/uploads/2013/06/Dogonomics-Affording-A-Dog-Crunching-The-Numbers-1024x682.jpg
http://1.bp.blogspot.com/_Dsfp8ETCCPc/TUMYDb-qtAI/AAAAAAAABpA/wY_LM6507Y4/s1600/numbers.jpg