Research panel

248 views

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
248
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • in your commentary, you will explain that we moved from phases of practice beginning, emerging ,etc to a more standards driven model.Thanks we are going to make sure all the presentations flow in illustatins. I am waiting for otehrs, thanks very mcuh. Right on track
  • To respond to national trends and expectationsTo answer specific questions about the value of the NAF academy at my high school
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • in your commentary, you will explain that we moved from phases of practice beginning, emerging ,etc to a more standards driven model.Thanks we are going to make sure all the presentations flow in illustatins. I am waiting for otehrs, thanks very mcuh. Right on track
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • Again, where does data center fit in, it is participation data, self reported- Perhaps the focus here is that since the data center is self reported it is not as reliable as data directly form the district.Mary is addressing the qualitative piece with the survey, wonder if you should stick to the necessity of student level and at risk data and the importance of comparison data that will be available.
  • Maybe divide CE slides into collection and reporting – what you will know as a reslut ofthis partnership and how it will benefit you.
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • Mary, this is the most important issue for you to discuss. The addition of survey information will enable a more comprehensive review of placement on the network stages.
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • Self Assessment and Planning Tool- academy team review of capacity to meet NAF standards and planning processConnectEDU-Student level data-college and career ready dataPerception Survey- to establish how key stakeholders perceive academy performanceScoring process to determine placement on the NAF development Stages
  • Research panel

    1. 1. TIMELESS Learning<br />Policy & Practice<br />
    2. 2. JD Hoye<br />President <br />National Academy Foundation<br />
    3. 3. Theory of Change<br />Student Outcomes<br />Academy<br />Students<br />Local Partners & Advisory Board<br />Community Benefits<br />Increased Capacity to Implement NAF Model<br />NAF Supports<br />Academy Outcomes<br />Local Education Partners<br />NAF Funders & Partners<br />
    4. 4. Research, Data and Evaluation<br />PANEL <br />DISCUSSION<br />
    5. 5. Moving Toward a Performance Measurement System<br />
    6. 6. Performance Measurement <br />Where We Are Going:<br /><ul><li>Clarifying What it Means to Be a NAF Academy
    7. 7. Streamline Data Collection and Reporting
    8. 8. Self-Assessment Tool revised based on feedback from Academies and additional input from experts
    9. 9. Increase Opportunities For Teachers, Administrators, Parents, and Students</li></ul>Where We Have Been:<br /><ul><li>Creating Standards for High Fidelity
    10. 10. Essential Data to Collect
    11. 11. Including all Members of the Network in the Discussion
    12. 12. Rich Dialogue Around Performance Measurement</li></li></ul><li>Performance Measurement System<br />Clearly Articulated Standards & Benchmarks<br />System for Collecting Data For Those Indicators & Benchmarks<br />System for Analyzing Reporting, <br />Process for Using Indicator Data to improve student performance<br />
    13. 13. Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />
    14. 14. Context for Performance Measurement System<br />
    15. 15. Key Findings From Previous Research<br />MDRC Random Assignment Study Most Definitive<br />No Measurable Effects<br />Academic Achievement<br />Graduation Rates<br />Post-Secondary Education Outcomes<br />Positive Effects On<br />Student Engagement<br />Career Related/Work-Based Learning Experiences<br />Long Term Earnings (Substantial Effects)<br />
    16. 16. Key Developments in Research and Evaluation<br />Increased Premium on Rigorous Evaluation and Reliable Estimates of Program Effects<br />Increased Attention to Career and College Readiness and Overlap Between the Two<br />Early Indicators of High School Success<br />Emphasis on Data-Driven Decision-Making<br />
    17. 17. Need For Additional Research<br />Impacts on Academic Outcomes, Post-Secondary Education<br />Key Drivers of Positive Impacts<br />Understanding Cross-Site Variation in Impacts<br />NAF Specific Impacts<br />
    18. 18. What does it mean to be a NAF Academy?<br />What Experiences Should Students Have?<br />What Outcomes Should Fully Implemented NAF Academies Achieve?<br />What Data Are Required<br />To Evaluate NAF? <br />To Monitor Implementation?<br />To Maximize program Effectiveness? <br />Key Research & Evaluation Questions for NAF<br />
    19. 19. Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />
    20. 20. Self-Assessment and Planning Tool Overview<br />Development Process:<br /><ul><li>Conducted three tier process:
    21. 21. 280 academies reviewed
    22. 22. Variance review, 5 in each region
    23. 23. Visit 15 sites
    24. 24. Site visits conducted by a team of experts including MDRC, National Career Academy Coalition, and members of the Data Tracking Steering Committee to the 15 Academies that scored in the Leader/ Distinguished category or are AOEs
    25. 25. Self-Assessment Tool revised based on feedback from Academies and additional input from experts</li></ul>Guiding Principles:<br /><ul><li>Clearly articulate a tangible rubric on what defines a NAF Academy
    26. 26. Demonstrate emerging and best practice along the rubric
    27. 27. Develop a tool that allows Academies to reflect on their performance against the rubric
    28. 28. Encourage and inform an exchange of best practices and lessons learned among Academies and between NAF and the Academies</li></li></ul><li>The Self-Assessment Tool has 4 key sections<br />Each Section outlines the core concepts in the rubric…<br />…and drives each concept to a level of tangible detail<br />Academy Development<br />Advisory Board<br />Curriculum & Instruction<br />Work-Based Learning & Internships<br /><ul><li>Recruitment
    29. 29. Cohort scheduling ensures that academy students experience NAF academy courses plus a minimum of two core subject at each grade level.
    30. 30. Cohort scheduling ensures that students receive instruction in a personalized environment where every child is known by a caring adult.
    31. 31. Cohort scheduling assumes a schedule where there is weekly common planning time for the academy team of at least three staff, so that integrated learning, student supports and individualized student assessment can occur.
    32. 32. Length of Program
    33. 33. Cohort Scheduling
    34. 34. Academy Decision-Making
    35. 35. Data Collection & Revision
    36. 36. Board Membership
    37. 37. Professional Development
    38. 38. Board Function
    39. 39. Academy Leadership
    40. 40. Board Supports
    41. 41. Integration
    42. 42. Instructional Practices
    43. 43. Instructional Supports
    44. 44. Provides a WBL Program
    45. 45. Internship Completion
    46. 46. Students’ Career Goals</li></li></ul><li>Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />
    47. 47. Why Student Data?<br />
    48. 48. Why ConnectEDU?<br />
    49. 49. Why ConnectEDU?<br />
    50. 50. Why ConnectEDU?<br />
    51. 51. Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />
    52. 52. Why Do Surveys?<br /><ul><li> Provide NAF periodic snapshots of how academies and students are performing.
    53. 53. Provide individual academies information to help inform their own growth and improvement.
    54. 54. Fill in the gaps in the performance measurement system with data that can not be obtained using other data sources.</li></li></ul><li>Whom To Survey?<br /><ul><li> Students
    55. 55. Teachers
    56. 56. Parents
    57. 57. Employers</li></li></ul><li>Surveys: Next Steps<br />Focus on a student survey to measure behavior, attitudes and outcomes for which we don’t have measures in school records.<br />Select/create instrument or instruments.<br />Select a sample of academies that represent the network.<br />Survey all students in the sampled academies.<br />Conduct in-class or on-line student survey every two years to measure changes.<br />
    58. 58. Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />
    59. 59. Preparation<br />Ensure Data Quality<br />Organize for collaborative work<br />Build assessment literacy and skill in data interpretation<br />
    60. 60. Create data overview<br />Dig into student data<br />Inquiry<br />
    61. 61. Move Beyond Data Analysis<br />Examine policy and procedures and instruction<br />Plan to assess programs<br />Acting and assessing<br />
    62. 62. Components of the NAF Performance Measurement System<br />Self-Assessment & Planning Tool<br />Student-level Data (ConnectEDU)<br />Stakeholders<br /> Surveys<br />Creating a Culture of Inquiry<br />

    ×