SlideShare a Scribd company logo
1 of 5
Developing Survey Goals ,[object Object],[object Object],PFC  Goals   PBIS (Outcomes) PSC (Activity/strategy) Goal 1 Health Goal 4 System Support Goal 3 Early Care and Education Goal 2 Family Support Early Intervention  Health Care Compliance Child Care Placements Staff Education Staff Benefits Stability Parenting Skills  Family Literacy Early Intervention/Spec. Ed Family Support Pre-K Classes Parent Education Literacy programs CCR&R, More at Four, Subsidy, Quality Enhancement/Maintenance Training, Prof. Development Program Eval/Coordination, System Integration, Community Outreach,  Family Resource Center Predict needs of client,  community or system Measure satisfaction with programs, services Determine change in community or client behaviors, perspectives Evaluate program effectiveness Assess program impact on client, community, system Gauge knowledge gained and implemented These goals overlap; they are not mutually exclusive.  Many can be examined within one survey
Closed Ended (Quantitative)   Open Ended (Qualitative)   Responses are researchers  ‘acceptable’ choices Makes responses socially acceptable Responses are mutually exclusive  Narrative form replaces vague responses  Range of responses exceeds appropriate question length  Measure preferences or behaviors  Measure knowledge (pre-or post)  Questions and answers are consistent and understandable Questions are administered to respondents in the same manner each time Respondents have access to information needed to answer the question Respondents are willing to provide answers Five Challenges to Writing Good Questions ,[object Object],[object Object],[object Object],[object Object],[object Object],Determine Survey Goals :  Smart Start Contract Activity Design (CAD)  or agency/program goals Determine Survey Scope :  Inquiry, Evaluation or Predictive Survey Question Development  Question and responses are standardized
Children 0-5 years old and not in Kindergarten Children 5 yrs + and in Kindergarten Cumberland County (all persons) Households with children Households without children Persons interested in the well-being of children, families, schools and community Children and Health Children and Early Care & Education  Children and Families   Children and System Support  Subsets of Children  Subsets of Community (With or without children)  Legislator/Policy Makers School Personnel  (K-12)  Direct Service Providers Community Leaders/Stakeholders   Determining Survey Populations
Design Analysis Evaluation Survey Question Bank Centralized database of survey questions aligned with Performance Based Incentive Standards (PBIS) and Purpose Service Codes (PSC)  Aid in survey design Questions are evaluated, pre-tested Streamline data collection Outputs track service area progress  Smart Start, local agencies evaluate similar areas ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Construct Validity Correlation of several questions  asked in a similar way Predictive Validity Measures that predict answers to  other related questions. Discriminant Validity Extent of differentiation in expected responses
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Strengthen program and community data collection  through integrative survey development processes  Objective 2:  A centralized database of questions and  templates for survey design. Objective 3:  Customers/clients use surveys to collect program data.   Objective 1:  Data is collected from  a variety of community organizations.   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

What's hot

Standard 5 Artifacts Decision Making
Standard 5 Artifacts Decision MakingStandard 5 Artifacts Decision Making
Standard 5 Artifacts Decision Makingrenee22093
 
EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)Justin Piff
 
Modernizing Idaho Medicaid: Prevention, Wellness & Responsibility
Modernizing Idaho Medicaid: Prevention, Wellness & ResponsibilityModernizing Idaho Medicaid: Prevention, Wellness & Responsibility
Modernizing Idaho Medicaid: Prevention, Wellness & Responsibilitynashp
 
Tools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeTools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeJustin Piff
 
Wosmek Review Paper Presentation
Wosmek Review Paper PresentationWosmek Review Paper Presentation
Wosmek Review Paper PresentationBrad Wosmek
 
Building African Advocacy Through Evaluation
Building African Advocacy Through EvaluationBuilding African Advocacy Through Evaluation
Building African Advocacy Through Evaluationaspeninstitute
 
Insight to child poverty
Insight to child povertyInsight to child poverty
Insight to child povertylocalinsight
 
Lessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsLessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsMEASURE Evaluation
 
Easterday Poster Presentation 8500
Easterday Poster Presentation 8500Easterday Poster Presentation 8500
Easterday Poster Presentation 8500Joann Easterday
 
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)Uniting ReGen
 
The decision support practices and research needs of nonprofits
The decision support practices and research needs of nonprofitsThe decision support practices and research needs of nonprofits
The decision support practices and research needs of nonprofitsflorishes
 
Ash edu 675 week 4 dq 1 observation reconnaissance new
Ash edu 675 week 4 dq 1 observation reconnaissance newAsh edu 675 week 4 dq 1 observation reconnaissance new
Ash edu 675 week 4 dq 1 observation reconnaissance newshyaminfo02
 

What's hot (20)

Standard 5 Artifacts Decision Making
Standard 5 Artifacts Decision MakingStandard 5 Artifacts Decision Making
Standard 5 Artifacts Decision Making
 
Carrie slides
Carrie slidesCarrie slides
Carrie slides
 
Bowen fp mch
Bowen fp mchBowen fp mch
Bowen fp mch
 
EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)
 
Reference transaction
Reference transactionReference transaction
Reference transaction
 
Modernizing Idaho Medicaid: Prevention, Wellness & Responsibility
Modernizing Idaho Medicaid: Prevention, Wellness & ResponsibilityModernizing Idaho Medicaid: Prevention, Wellness & Responsibility
Modernizing Idaho Medicaid: Prevention, Wellness & Responsibility
 
Tools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeTools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems Change
 
resume.no address
resume.no addressresume.no address
resume.no address
 
Wosmek Review Paper Presentation
Wosmek Review Paper PresentationWosmek Review Paper Presentation
Wosmek Review Paper Presentation
 
Academic detailing
Academic detailingAcademic detailing
Academic detailing
 
Improving impact - do accountability mechanisms deliver results
Improving impact - do accountability mechanisms deliver resultsImproving impact - do accountability mechanisms deliver results
Improving impact - do accountability mechanisms deliver results
 
Building African Advocacy Through Evaluation
Building African Advocacy Through EvaluationBuilding African Advocacy Through Evaluation
Building African Advocacy Through Evaluation
 
A3 lewis etoria
A3 lewis etoriaA3 lewis etoria
A3 lewis etoria
 
Insight to child poverty
Insight to child povertyInsight to child poverty
Insight to child poverty
 
Lessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health EvaluationsLessons Learned from OVC Evaluations for Future Public Health Evaluations
Lessons Learned from OVC Evaluations for Future Public Health Evaluations
 
Easterday Poster Presentation 8500
Easterday Poster Presentation 8500Easterday Poster Presentation 8500
Easterday Poster Presentation 8500
 
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)
Staff & Consumer Social Media Practice: Findings & Next Steps (30 Nov 2016)
 
6
66
6
 
The decision support practices and research needs of nonprofits
The decision support practices and research needs of nonprofitsThe decision support practices and research needs of nonprofits
The decision support practices and research needs of nonprofits
 
Ash edu 675 week 4 dq 1 observation reconnaissance new
Ash edu 675 week 4 dq 1 observation reconnaissance newAsh edu 675 week 4 dq 1 observation reconnaissance new
Ash edu 675 week 4 dq 1 observation reconnaissance new
 

Viewers also liked

International Rapid Disaster Response in Case of Flooding
International Rapid Disaster Response in Case of FloodingInternational Rapid Disaster Response in Case of Flooding
International Rapid Disaster Response in Case of FloodingGlobal Risk Forum GRFDavos
 
JGG - Digital Capability Offering
JGG - Digital Capability OfferingJGG - Digital Capability Offering
JGG - Digital Capability OfferingJohn Gardner, CMC
 
Tugas Uas Komunikasi bisnis NURHAMDANI
Tugas Uas Komunikasi bisnis NURHAMDANITugas Uas Komunikasi bisnis NURHAMDANI
Tugas Uas Komunikasi bisnis NURHAMDANIDani Nurhamdani
 
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaan
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaanPengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaan
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaanguest7455d511
 
The Woodlands TX | Home Sales Month By Month - October 2016
The Woodlands TX | Home Sales Month By Month - October 2016The Woodlands TX | Home Sales Month By Month - October 2016
The Woodlands TX | Home Sales Month By Month - October 2016Ken Brand
 
An Assessment of the level of vulnerability to climate change risks in a deve...
An Assessment of the level of vulnerability to climate change risks in a deve...An Assessment of the level of vulnerability to climate change risks in a deve...
An Assessment of the level of vulnerability to climate change risks in a deve...Global Risk Forum GRFDavos
 

Viewers also liked (9)

International Rapid Disaster Response in Case of Flooding
International Rapid Disaster Response in Case of FloodingInternational Rapid Disaster Response in Case of Flooding
International Rapid Disaster Response in Case of Flooding
 
JGG - Digital Capability Offering
JGG - Digital Capability OfferingJGG - Digital Capability Offering
JGG - Digital Capability Offering
 
Point Nine Marketing Presentation
Point Nine Marketing PresentationPoint Nine Marketing Presentation
Point Nine Marketing Presentation
 
Question 5 media
Question 5 mediaQuestion 5 media
Question 5 media
 
Tugas Uas Komunikasi bisnis NURHAMDANI
Tugas Uas Komunikasi bisnis NURHAMDANITugas Uas Komunikasi bisnis NURHAMDANI
Tugas Uas Komunikasi bisnis NURHAMDANI
 
PC magazine_7.2016
PC magazine_7.2016PC magazine_7.2016
PC magazine_7.2016
 
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaan
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaanPengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaan
Pengaruh facebook dalam memperkuat strategi komunikasi bisnis perusahaan
 
The Woodlands TX | Home Sales Month By Month - October 2016
The Woodlands TX | Home Sales Month By Month - October 2016The Woodlands TX | Home Sales Month By Month - October 2016
The Woodlands TX | Home Sales Month By Month - October 2016
 
An Assessment of the level of vulnerability to climate change risks in a deve...
An Assessment of the level of vulnerability to climate change risks in a deve...An Assessment of the level of vulnerability to climate change risks in a deve...
An Assessment of the level of vulnerability to climate change risks in a deve...
 

Similar to Survey Design Series

Evaluation Principles: Theory-Based, Utilization-Focused, Participatory
Evaluation Principles: Theory-Based, Utilization-Focused, ParticipatoryEvaluation Principles: Theory-Based, Utilization-Focused, Participatory
Evaluation Principles: Theory-Based, Utilization-Focused, ParticipatoryMHTP Webmastere
 
A guide for comprehensive needs assessment
A guide for comprehensive needs assessmentA guide for comprehensive needs assessment
A guide for comprehensive needs assessmentk1hinze
 
A guide for comprehensive needs assessment
A guide for comprehensive needs assessmentA guide for comprehensive needs assessment
A guide for comprehensive needs assessmentk1hinze
 
Going To Scale District Level MO SW-PBS SI 2008
Going To Scale District Level MO SW-PBS SI 2008Going To Scale District Level MO SW-PBS SI 2008
Going To Scale District Level MO SW-PBS SI 2008Nanci Johnson
 
Full Program Design
Full Program DesignFull Program Design
Full Program Designforeman
 
Feature Forum: Leveraging Surveys
Feature Forum: Leveraging SurveysFeature Forum: Leveraging Surveys
Feature Forum: Leveraging SurveysNaviance
 
Evaluating Impact of OVC Programs: Standardizing our methods
Evaluating Impact of OVC Programs: Standardizing our methodsEvaluating Impact of OVC Programs: Standardizing our methods
Evaluating Impact of OVC Programs: Standardizing our methodsMEASURE Evaluation
 
Wishlife: Logic Model For CSR Planning (base version)
Wishlife: Logic Model For CSR Planning (base version)Wishlife: Logic Model For CSR Planning (base version)
Wishlife: Logic Model For CSR Planning (base version)Tushar Tiwari
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes successcontentli
 
Program Evaluation In the Non-Profit Sector
Program Evaluation In the Non-Profit SectorProgram Evaluation In the Non-Profit Sector
Program Evaluation In the Non-Profit Sectorwishart5
 
Best Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMBest Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMGreenlights
 
Grant Writing: Summary Concepts 1 4
Grant Writing: Summary Concepts 1 4Grant Writing: Summary Concepts 1 4
Grant Writing: Summary Concepts 1 4hberline
 
Evaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeEvaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeMEASURE Evaluation
 
Basics Of Grant Writing from Precise Edit
Basics Of Grant Writing from Precise EditBasics Of Grant Writing from Precise Edit
Basics Of Grant Writing from Precise EditDavid Bowman
 
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...Kyle Brown
 

Similar to Survey Design Series (20)

Evaluation Principles: Theory-Based, Utilization-Focused, Participatory
Evaluation Principles: Theory-Based, Utilization-Focused, ParticipatoryEvaluation Principles: Theory-Based, Utilization-Focused, Participatory
Evaluation Principles: Theory-Based, Utilization-Focused, Participatory
 
A guide for comprehensive needs assessment
A guide for comprehensive needs assessmentA guide for comprehensive needs assessment
A guide for comprehensive needs assessment
 
A guide for comprehensive needs assessment
A guide for comprehensive needs assessmentA guide for comprehensive needs assessment
A guide for comprehensive needs assessment
 
Going To Scale District Level MO SW-PBS SI 2008
Going To Scale District Level MO SW-PBS SI 2008Going To Scale District Level MO SW-PBS SI 2008
Going To Scale District Level MO SW-PBS SI 2008
 
Full Program Design
Full Program DesignFull Program Design
Full Program Design
 
Assessment
AssessmentAssessment
Assessment
 
Feature Forum: Leveraging Surveys
Feature Forum: Leveraging SurveysFeature Forum: Leveraging Surveys
Feature Forum: Leveraging Surveys
 
Evaluating Impact of OVC Programs: Standardizing our methods
Evaluating Impact of OVC Programs: Standardizing our methodsEvaluating Impact of OVC Programs: Standardizing our methods
Evaluating Impact of OVC Programs: Standardizing our methods
 
Wishlife: Logic Model For CSR Planning (base version)
Wishlife: Logic Model For CSR Planning (base version)Wishlife: Logic Model For CSR Planning (base version)
Wishlife: Logic Model For CSR Planning (base version)
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
 
The Grants Academy
The Grants Academy The Grants Academy
The Grants Academy
 
CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2
CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2
CCIH-2017-Monitoring-and-Evaluation-Preconference-Module-2
 
IDEA Best Practice Chairs & Admin
IDEA Best Practice Chairs & AdminIDEA Best Practice Chairs & Admin
IDEA Best Practice Chairs & Admin
 
Program Evaluation In the Non-Profit Sector
Program Evaluation In the Non-Profit SectorProgram Evaluation In the Non-Profit Sector
Program Evaluation In the Non-Profit Sector
 
Best Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMBest Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNM
 
Grant Writing: Summary Concepts 1 4
Grant Writing: Summary Concepts 1 4Grant Writing: Summary Concepts 1 4
Grant Writing: Summary Concepts 1 4
 
CCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
CCIH-2017-Monitoring-and-Evaluation-Preconference-OutlineCCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
CCIH-2017-Monitoring-and-Evaluation-Preconference-Outline
 
Evaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health InitiativeEvaluation: Lessons Learned for the Global Health Initiative
Evaluation: Lessons Learned for the Global Health Initiative
 
Basics Of Grant Writing from Precise Edit
Basics Of Grant Writing from Precise EditBasics Of Grant Writing from Precise Edit
Basics Of Grant Writing from Precise Edit
 
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...
The Four Questions You Must Ask to Transform Your Prevention Strategy from Go...
 

Survey Design Series

  • 1.
  • 2.
  • 3. Children 0-5 years old and not in Kindergarten Children 5 yrs + and in Kindergarten Cumberland County (all persons) Households with children Households without children Persons interested in the well-being of children, families, schools and community Children and Health Children and Early Care & Education Children and Families Children and System Support Subsets of Children Subsets of Community (With or without children) Legislator/Policy Makers School Personnel (K-12) Direct Service Providers Community Leaders/Stakeholders Determining Survey Populations
  • 4.
  • 5.