Recommended
More Related Content
Similar to Adapting and implementing evidence-based interventions
Similar to Adapting and implementing evidence-based interventions (20)
Recently uploaded
Recently uploaded (20)
Adapting and implementing evidence-based interventions
- 1. Grace Lee, Manager of Service Design Susannah Staats, Director of Service Design May 3, 2019 Adapting Evidence- Based Interventions with Intervention Mapping
- 2. Grace Lee, MPH Manager of Service Design Playworks Susannah Staats, MA Director of Service Design Playworks
- 3. Game Time Stand Up If
- 4. “IM Adapt should be useful for planners who are considering EBIs to avoid developing an intervention from the beginning. Not wanting to develop an intervention de novo could be from awareness of insufficient resources for developing an intervention from scratch, or because a funder has required the use of an existing EBI.” “Planners may choose pieces of interventions that are the most appealing to them or that seem the most feasible, often without soliciting input from the original developers or the new community and without systematically determining what in an EBI needs to change and what may stay the same.” Chapter 10: Using IM to adapt EBIs, Planning Health Promotion Programs
- 5. Goals Introduce the work of the Design Team at Playworks Walk through the application of Intervention Mapping at Playworks Discuss the development of an adapted intervention: key successes and challenges with real world application
- 6. Today Game + Introduction Playworks + Design Team Intervention Mapping at Playworks Successes + Challenges with real world application Closing
- 8. Who are we?
- 9. We believe in leveraging the power of play to bring out the best in every kid.
- 12. HIGH FUNCTIONING RECESS CARING CONSISTENT ADULT STRONG SCHOOL PARTNERSHIP POSITIVE SCHOOL CLIMATE Students have strong social and emotional skills Students are engaged in school Classroom supports a positive environment QUALITY PROGRAM GREAT RECESS CLIMATE Students are emotionally and physically safe at recess School values recess Students are engaged in play, physical activity, and enjoy recess Development of student’s pro-social skills Safe, organized and active playground HIGH FUNCTIONING RECESS
- 17. Playworks History 1996 Coach Direct service to kids Pro Professional Development 2006 Team Up Capacity Building for Schools 2015 PlayworksU Online learning 2018 Recess Lab Free resources and assessment to improve recess 2017 Recess Reboot One-week Training Intensive Part-time Coach Direct service to kids20 interventions!
- 20. AT PLAYWORKS Living Logic Model 20 Program Plans (customer contracts) 19 in-person interventions 1 online intervention Frontline staff training & resources Intervention curricula & materials Staff performance management tools Quality calls, assessments & initiatives Participant Surveys, Youth Surveys Outputs Tool (internal staff) Annual Survey, Net Promoter Score (NPS) Program Design Program Production Program Implementation Program Evaluation Logic Model of Change
- 21. JULYAUG SEPT OCT NOV DEC JAN FEB MAR APR MAY JUNE Implement Interventions, Monitor Quality Eval Analysis Needs Assessment Adapt & Improve Interventions Eval Data Collection Eval Analysis
- 22. Our Evidence A randomized control trial by Stanford University and Mathematica Policy Research (2013) found that compared to students at similar schools, Playworks students were more physically active and teachers reported that students had greater feelings of school safety and less bullying behavior. RAND Review: Social and Emotional Learning Interventions Under the Every Student Succeeds Act (2017) RWJF: Building A Culture of Health Through Safe and Healthy Elementary School Recess (2016) See more studies on Playworks...
- 23. POSITIVE SCHOOL CLIMATE HIGH FUNCTIONING RECESS CARING CONSISTENT ADULT STRONG SCHOOL PARTNERSHIP Students have strong social and emotional skills Classroom supports a positive environment GREAT RECESS CLIMATE Development of student’s pro- social skills Safe, organized and active playground PLAYWORKS SERVICES Students are emotionally and physically safe at recess School values recess Students are engaged in play, physical activity, and enjoy recess INPUTS OUTCOMES Students are engaged in school
- 24. 1) Living Logic Model (Logic Model of Change) Behavior Change Objectives Determinants Outcomes Quality of Life
- 25. 2) Intervention Map (program components) Behavior Change Objectives DeterminantsProgram components, degree of intervention
- 26. Building out our theory of change. What levels of intervention are necessary to reach outcomes? Prioritize determinants by: 1) Relevance - strength of association with the behavior 2) Changeability - how likely will the intervention influence a change in this determinant? Mapping the current service design: ● What is the standard expectation for our services, across all regions? ● What do we promise to deliver to our school partners, for each service? ● Are we setting and communicating these expectations with regional staff? Logic Model Intervention Map
- 30. Recess Reboot Need Input Outputs Outcomes Schools that are: - invested in safe & healthy play, eager to sustain change - located in rural areas, difficult to reach - do not have professional development time - may be unfamiliar with Playworks Time & staff investment in program development (pilot testing process) Cost for program development, travel and implementation Human Resources - Impact Team & national support - Trainer - Supervisor - Sales staff Recess Reboot intervention design and sales/delivery protocol Sales and frontline staff trainings to match, support and deliver the service Four day, onsite intervention Sustainable change through onsite program launch, modeling and training
- 31. Gradual Release of Responsibility Model PLAYWORKS SCHOOL DAY 1 DAY 2 DAY 3 DAY 4 Intro & Observe I Do We Do You Do Recess Reboot
- 33. Fall 2016 Spring 2017 Pac NW So Cal CO May - Dec 2017 RR 2.0 PILOTRR 1.0 PILOT INTERVENTION DESIGN TIMELINE Pac NW So Cal CO UT Nor Cal AZ NY NJ NE TX Jan - Summer 2018 RR 3.0 PILOT Learn about users through testing Tests create new ideas for the project Learn from prototypes to spark new ideas Tests reveal insights that redefine the problem
- 35. Successes ● 45 Trainers equipped to deliver Recess Reboot ● ~100 schools received Recess Reboot since 2017 (across the country) = $1 million revenue ● Intervention Adopted, Implemented & Sustained at Playworks
- 36. Challenge Rigor vs Reality ● Keeping up with the pace! Windows of opportunity during the school year ● Designing for flexibility - “fixed” vs. “flexible” program components
- 37. Challenge Influencing & Accountability ● Lots of change management! ● Working with leadership at regional and national to set up frontline staff for success Playworks National 23 Regions Regional Success Impact Marketing Dev & Partnerships Mission Support Design Quality Eval Program Director Sales/Dev Frontline (Coaches, Site Coor, Trainers) Program Managers Finance People Solutions Operations
- 38. Closing
- 39. Pair Up! Share 1 key takeaway with your partner