360 Data on Scholars' Behavior, Skills and Attitudes: Measurement for Program Improvement and Scholar Outcomes


Published on

For many years the measurement of student outcomes has focused solely on grades and test scores. Higher Achievement is looking beyond these outcomes to include skills, attitudes and behaviors. This workshop will share the 360 Data that Higher Achievement collects on the scholars they serve. The workshop will describe how the data is analyzed and how Higher Achievement shares best practices.

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

360 Data on Scholars' Behavior, Skills and Attitudes: Measurement for Program Improvement and Scholar Outcomes

  1. 1. 360 Data on Scholars Skills, Attitudes, and Behaviors: Measurement for Program Improvement and Scholar Outcomes <br />Elizabeth Barrett<br />Director of Evaluation<br />Higher Achievement<br />ebarrett@higherachievement.org<br />202.567.2444<br />
  2. 2. Agenda<br />Higher Achievement and 360 Data<br />How do we analyze the data<br />Collection and reporting<br />Analysis techniques<br />Internal Use<br />Program improvement<br />Individual scholar support<br />External Use<br />How to communicate this information effectively<br />360 data as it relates to other outcomes<br />Interactive Session<br />
  3. 3. Higher Achievement<br />Academic enrichment and support program for middle school children from underserved communities<br />Rigor + Opportunities = Results<br />Culture of high expectations <br />3 components:<br />After-School Academy, Summer Academy and High School Placement<br />
  4. 4. Higher Achievement<br />Locations in<br />DC Metro (including Alexandra, VA)<br />Baltimore<br />Richmond, VA opening Summer 2011<br />Expanding to Pittsburgh, PA<br />This summer we will be serving 700 scholars<br />
  5. 5. Higher Achievement and 360 data<br />Focus has been on grades and test scores<br />Movement beyond these outcomes<br />21st Century skills, soft skills, etc.<br />These skills are just as important as hard skills<br />Aligning with our Culture of high expectations<br />Spirit, excellence and respect<br />Higher Achievement’s movement toward skills, attitudes and behaviors<br />High school preparation and beyond<br />
  6. 6. Higher Achievement and 360 Data<br />Gather data from<br />Scholars about themselves<br />Mentors or Summer Teachers about each scholar<br />Parents about their child<br />Collected bi-annually<br />1 time for each After-School Academy and SummerAcademy<br />
  7. 7. 360 Survey<br />
  8. 8. 360 Survey<br />
  9. 9. Collection and Reporting <br />Customized database management <br /> system: ISIS<br />Electronically collects and stores data<br />Reporting feature allows data to be manipulated in <br />Excel – qualitative responses<br />SPSS – quantitative analysis<br />
  10. 10. Analysis Techniques<br />We keep it simple<br />Averages – questions and categories<br />% Agree/Disagree<br />Regression Analysis<br />Group Response: parent, mentor/summer teacher and scholar<br />Across Academy Trends<br />Academy Trends<br />Affiliate/Center/Individual<br />
  11. 11. Example – Across Academy Trends<br />
  12. 12. Example – Across Academy Trends<br />
  13. 13. Example – Affiliate Trends<br />
  14. 14. Example – Affiliate Trends<br />Greatest Need<br /> 1. Behavior changes<br /> 2. Build confidence in public speaking<br /> 3. Increasing organization skills and preparedness<br />Greatest Strength<br /> 1. Attitudes/skills <br /> 2. Applies academic knowledge/skills<br /> 3. Interacts respectfully with peers<br /> 4. Enjoys Higher Achievement<br />
  15. 15. Example – Affiliate/Center/Individual<br />
  16. 16. Example – Affiliate/Center/Individual<br />
  17. 17. Example - Regressions<br />Attitudes and skills…<br />Respect toward adults (A)<br />Confidence in academic ability (A)<br />Applies academic knowledge/skills (S)<br />….predict key behaviors<br />Confidence in public speaking/presenting (B)<br />Interacting respectfully with peers (B)<br />Based on regression analyses<br />
  18. 18. Internal Use – Program Improvement<br />Identify and plan center activities based on strength and weakness areas (After-School Academy and Summer Academy planning)<br />Comments home to families during Summer Academy (7th and 8th graders)<br />Target scholars based on grades/behavior issues (6th and 7th graders)<br />Need for scholar tointernalize information<br />lead to change<br />
  19. 19. Internal Use – Individualization<br />Push for individualization through data<br />Individual scholar grade report<br />Increased, decreased, maintained – Top/Bottom % <br />Student Achievement Plans for struggling scholars<br />Goal setting, weekly progress reports<br />360 Individual Reports<br />Internal motivation to improve attitudes and behaviors<br />Incorporate grades and test scores<br />
  20. 20. External Data Use<br />Identified 3 key outcomes to externally communicate:<br />Scholar interacts respectfully with peers (behavior)<br />Scholar applies academic knowledge and skills (skill)<br />Scholar confidence in academic abilities (attitude)<br />Align with core model and culture<br />
  21. 21. External Use - Communication<br />Effective Communication<br />Consistency:<br />Written and verbal communication across ALL staff<br />Aligns with Key Messages:<br />Our research-based program challenges middle school students to meet their full potential in three key areas: academics, social skills, and leadership. When students get the skills and support they need to invest in their own success, they discover that they can be scholars. <br />
  22. 22. 360 and Other Outcomes<br />360 data as it relates to other outcomes data<br />Compliments/back up other outcomes data<br />Grades<br />Test scores<br />Attendance<br />High school placement<br />Used to show impact on soft skills<br />Leadership<br />Confidence in academic ability<br />Social Skills<br />
  23. 23. Example<br />65% showed significant improvement in math <br />60% showed significant improvement in reading <br />Teacher surveys show: <br />73% of the students improved in homework completion <br />71% improved in overall academic performance <br />Parent surveys show: <br />92% are getting better grades on their report cards <br />Student surveys show: <br />68% feel better about their ability to read and speak English <br />81% are more comfortable solving math problems <br />86% reported an improvement on homework completion <br />
  24. 24. Interactive Session <br />After-School Academy main components<br />Study Hall<br />Community Meeting: all scholars and staff gather for academic related activities<br />Mentoring with structured curricula in math, literature and seminars<br />Scenario:<br />During After-School Academy planning you need to compose an action plan for our Ward 1 Achievement Center based on:<br />Individual Scholar Grade Report<br />Center level 360 report<br />Come up with actionable items that can be implemented for the whole center that addresses needs/weakness and/or celebrates successes/strengths.<br />