What is the surveySo what is what you learn from the survey – what is the data telling you
What is the surveySo what is what you learn from the survey – what is the data telling you Now what – what are you going to do with the information?Program Development & Evaluation comes in when you USE the information that you have gathered.
Online survey basics
Use of Surveys in Extensionfor Program Development &EvaluationSarah Baughman, Ph.D. Mike Lambur, Ph.D.eXtension Virginia Cooperative Extension
Benefits & Challenges Quick Cost effective Simplifies data analysis Capabilities/functionality Multiple devices Intended audience musthave internet access Easily sent to spam folder Technical difficulties Literacy Easy to develop “bad”surveys
Ask what you need to know,not what is interesting toknow
Developing Sound QuestionsSurvey questions should be:ClearShortUnbiasedRelevant
Clear QuestionsTarget the vocabulary and grammar to thepopulation surveyed What was your AGI last year?Avoid ambiguity, confusion, and vagueness What is your income? Do you jog regularly? Does your company have pension and healthinsurance benefits? How many years have you been in the program? 1-2 years 2-3 years 3-5 years
Short QuestionsTry to keep questions to 20 words or lessLong questions can be intimidatingTravel to other countries has becomeincreasingly popular recently. Have you evertraveled to another country? If yes, you mighthave traveled to other countries to enjoy thescenery. How important was the scenery indeciding to take the trip?
Unbiased QuestionsBiased questions contain words or phrases thatlead the respondent to a particular answerDo you think the new cafeteria provides betterfood than the old cafeteria?Most doctors say that cigarette smoke causeslung disease for those near a smoker. Do youagree?Wouldn’t you like to receive our free brochure?
Relevant QuestionsConsider the respondents’ interest in and ability toanswer the questionsMost people do not want to appear uninformed, sorather than admit to having little or no knowledgeabout a question, they are likely to select orprovide a response
Types of QuestionsFactualWhat respondents’ knowAttitudinalHow respondents’ feelBehaviorWhat respondents’ doDemographicWho respondents’ are
Question Response Formats Close-ended responses Mutiple choice Must be mutually exclusive Must be exhaustive Rating scales Respondents’ indicate the degree of response to thequestion Ranking Respondents’ indicate, in order, their preference amonga list of responses
Question Response FormatsOpen-ended responsesAllow respondents’ to answer in their own wordsUnless carefully focused and worded,respondents’ may provide minimal information
Other ConsiderationsLong questionnaires get less response thanshort questionnairesProvide a well written cover letterGive your questionnaire a title that is short andmeaningful to the respondentPlace the most important items in the first partof the questionnairePay attention to the flow of questionsTry to keep similar questions/topics togetherUse page breaksMake it convenient to respond
Qualtrics Informal Learning June 26 – Qualtrics Basics July 10 – Panels & Distributing July 17 – Reporting Ongoing discussion, tips, etc on the Google+ Online Surveyscommunity 2PM Eastern Time for all sessions
References Websites http://www.statpac.com/surveys http://www.analytictech.com/mb313/principl.htm http://www.qualtrics.com/university/researchsuite/ Hardcopy Dillman, Don. (2007). Mail and internet surveys: The tailoreddesign method. John Wiley & Sons, Inc: Hoboken, NJ.