Presentation For Gene S Revision 3


Published on

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Highlight our desire to differentiate based on each school’s needs.
  • This slide is in both presentations, basic and themed.
  • This slide is in both presentations.
  • This slide is both presentations. Refer back to guiding questions from the fall. Bring copy of those guiding questions for both presentations.
  • Slide in both presentations. Reinforce the concept of themed carousal when new data surfaces.
  • Slide in both presentations Stress each method can be modified to address basic or themed format
  • Slide in both presentations Generate ideas on from audience of themed carousel-What examples can you share concerning themed carousel?
  • Slide only in Basic presentation.
  • Slide in both presentations Emphasize these are some of the topics that the leadership team should address when planning their carousel activity.
  • Slide found in both presentations Emphasis on readiness component around needed skills.
  • Slide found in both presentations Emphasis on these are readiness issues no matter what format is used.
  • Reference SIP guide section. Reference Guiding questions from the fall.
  • Slide in both presentations Question to ask-Why process skills?
  • Slide in both presentations Reference SIP guide
  • Slide found in Basic training Question to ask—What do we mean by Domains of Data? Question to ask-What do we mean by non-negotiable?
  • Slide found in Basic training.
  • Slide in both presentations Emphasis the team (referencing the leadership team.
  • Slide in both presentations. What might be examples of “community sensitive”?
  • Slide in both presentations
  • Slide in both presentation
  • Slide in both presentations Emphasize I-3 as a new sources of data
  • Slide in both presentations Incorporate the SPR as an additional data source.
  • Slide in both presentations
  • Slide in both presentations
  • Slide in both Team is leadership team.
  • Slide in both presentations
  • Have sample data from xyz school to get audience involved
  • Have spreadsheet from xyz school district to show what the concerns look like
  • Presentation For Gene S Revision 3

    1. 1. Washington State University August 12, 2009
    2. 2. <ul><li>Jack McCullough, Planning and Solutions Coach </li></ul><ul><li>The Center for Educational Effectiveness, Inc. </li></ul>
    3. 3. Group Norms <ul><li>Participate in a positive manner. </li></ul><ul><li>Actively listen to the viewpoints of your colleagues. </li></ul><ul><li>Disagree in a respectful manner. </li></ul><ul><li>Take care of personal needs. </li></ul><ul><li>Stay on task. </li></ul><ul><li>Refrain from sidebar conversations. </li></ul><ul><li>Have fun! </li></ul>
    4. 4. Today you will: <ul><li>Receive one set of Data Carousel Planning Templates per person and learn how to use it </li></ul><ul><li>Share stories concerning common experience with data reviews </li></ul><ul><li>Refine your Theory of Action surrounding the use of data </li></ul><ul><li>Identify common concerns when proposing a data review </li></ul><ul><li>Receive one Data Primer and discuss how it might be used </li></ul><ul><li>Receive one Data Carousel Accelerator sample and discuss how it might be used </li></ul><ul><li>Begin planning your data carousel/activity </li></ul><ul><li>Receive a list of potential resources. </li></ul>
    5. 5. “ Even if you're on the right track, you'll get run over if you just sit there.&quot; — Will Rogers
    6. 6. Creating the case for Common Language and Consistent Practice Using Marvin’s Model An engagement activity
    7. 7. A Culture of Inquiry What comes to your mind? Using Marvin’s Model
    8. 8. Remember adults have different learning styles and perspectives when working with data. It helps to remember the “beach ball.”
    9. 9. Data-analysis is like the ocean because…
    10. 10. Data <ul><li>d a · ta : noun; plural, but singular or plural </li></ul><ul><li>in construction, from the Latin, plural of datum. </li></ul><ul><li>Factual information (as measurements or statistics) used as a basis for reasoning, discussion or calculation. </li></ul><ul><li>Information output by a sensing device that includes both useful and irrelevant or redundant information and must be processed to be meaningful. </li></ul><ul><ul><ul><ul><ul><li>- Merriam Webster’s Collegiate Dictionary </li></ul></ul></ul></ul></ul>
    11. 11. “ We are a society that is data rich but information poor.” -Robert H. Waterman
    12. 12. Avoid the Drip <ul><li>D ata R ich I nformation P oor </li></ul>
    13. 13. Are these numbers considered data? <ul><li>122 100 </li></ul><ul><li>90 103 </li></ul><ul><li>117 </li></ul>
    14. 14. What kind of data are these? <ul><li>122 ° 100 ° </li></ul><ul><li>110 ° 90 ° 103 ° 117 ° </li></ul>
    15. 15. We bring the meaning to the data. <ul><li>122 °F 100 °F 110 °F </li></ul><ul><li>90 °F 103 °F </li></ul><ul><li>117 °F </li></ul>
    16. 16. Guiding Assumptions <ul><li>1. Data have no meaning. </li></ul><ul><li>Data are just information until people organize, analyze and interpret meaning. </li></ul><ul><li>Interpretation is subjective; data are objective. </li></ul><ul><li>Frames of reference influence the meaning we derive from the data we collect and select. </li></ul>
    17. 17. <ul><li>2. Understanding should proceed planning. </li></ul><ul><li>Determine the desired outcome. </li></ul><ul><li>Clearly define the problems. </li></ul><ul><li>Cultivate collegial dialogue prior </li></ul><ul><li>to planning. </li></ul>
    18. 18. 3. Knowledge is both a personal and a social construction. <ul><li>Human beings are meaning-making organisms. </li></ul><ul><li>We sift through personal and social filters, forming beliefs and ways of knowing. </li></ul><ul><li>Individuals interact with information and with others shape new understandings about our world. </li></ul>
    19. 19. 4. Cycles of inquiry <ul><li>Inquiry, experimentation and reflection accelerate continuous growth and learning. </li></ul><ul><li>Learning occurs when we shift from professional certainty to conscious curiosity. </li></ul><ul><li>Constant pursuit of meaningful questions from thoughtful data analysis and ongoing monitoring of progress. </li></ul>
    20. 20. 5. Norms of data-driven collaboration <ul><li>Data alone leads to no action. </li></ul><ul><li>Collective inquiry generates continuous improvements. </li></ul><ul><li>Meaning and action result from professional learning communities that develop a shared commitment to improve student learning. </li></ul><ul><li>- Wellman, Bruce and Lipton, Laura.(2004). Data Driven Dialogue. </li></ul>
    21. 21. <ul><li>“Teachers blaze the path to knowledge when they purposefully use data as a source for analyzing progress and proactively plan for improvement.” </li></ul><ul><li>Wellman & Lipton. (2004). Data Driven Dialogue. </li></ul>
    22. 22. School Improvement Planning: Nine Characteristics Of High Performing Schools Evaluate plan’s impact on student achievement Set and prioritize goals It is a Process Craft action plans Study and select research-based practices Assess readiness to benefit Collect sort and select data Build and analyze portfolio Implement and monitor plan
    23. 23. Benefits of data analysis <ul><li>It is more than solving a particular student learning problem </li></ul><ul><li>School/District improvement teams become more efficient and effective </li></ul><ul><li>Decisions making becomes ore collaborative </li></ul><ul><li>Teachers develop more positive attitudes about their and their students’ abilities </li></ul><ul><li>Educators feel more in charge of their own destinies </li></ul><ul><li>Development of school wide culture if inquiry </li></ul>
    24. 24. Data Carousel Planning Template <ul><li>CEE has created template sheets to assist your team in planning your data carousel activity. </li></ul><ul><li>You will spend time today using these sheets and will identify (today) many of your challenges for planning and executing a successful carousel. </li></ul>
    25. 25. Data Carousel Planning Template Steps <ul><li>Assess Readiness </li></ul><ul><li>Planning Process </li></ul><ul><li>Selection of Data </li></ul><ul><li>Implementation </li></ul><ul><li>Immediate Follow-up and Next Steps </li></ul>
    26. 26. <ul><li>Key Data Decisions </li></ul><ul><ul><li>Depth & breadth of data </li></ul></ul><ul><ul><li>Carousel model </li></ul></ul><ul><ul><li>Presentation of data </li></ul></ul><ul><ul><li>Responding to Guiding Questions </li></ul></ul>Planning Process
    27. 27. Carousels are: <ul><li>A data sharing and exploration strategy </li></ul><ul><li>A data analysis activity </li></ul><ul><li>A process to identify needs and “next steps” in digging deeper </li></ul><ul><li>Effective to engage multiple times per year </li></ul>
    28. 28. Carousel Models <ul><li>Traditional (i.e. SIP/SSIRG guide) </li></ul><ul><li>Packet Method </li></ul><ul><li>Large Chart Method </li></ul><ul><li>Guided PowerPoint </li></ul>
    29. 29. Digging Deeper- Theme Carousel: Math Across the Curriculum Needs, Goals == Research and Action Planning Theme -B Theme -C Other Data Sources: EES, WASL Analysis, Local Assessments, Demographics Basic Carousel Information informs SIP Plan Steps 6,7, & 8 and next year’s revisions School Performance Review Report Chronology for Planning and Implementation
    30. 30. Data Carousel <ul><li>A means for engaging the entire staff in the process of data analysis </li></ul><ul><li>Typically 2-3 hours in length if done at one setting (My bias is not to do it in one setting) </li></ul><ul><li>Intended to be a high level scan to determine trends, strengths and concerns </li></ul>
    31. 31. <ul><li>Arrangements </li></ul><ul><ul><li>Space </li></ul></ul><ul><ul><li>Materials </li></ul></ul><ul><ul><li>Roles </li></ul></ul><ul><ul><li>Timeline/schedule </li></ul></ul><ul><ul><li>Food or snacks </li></ul></ul><ul><ul><li>Reminders </li></ul></ul><ul><ul><li>Distribute prep materials </li></ul></ul><ul><ul><li>Prepare facilitators </li></ul></ul>Implementation
    32. 32. <ul><li>Time and People Decisions </li></ul><ul><ul><li>Number </li></ul></ul><ul><ul><li>Stakeholders </li></ul></ul><ul><ul><li>Skills </li></ul></ul><ul><ul><li>Communication </li></ul></ul>
    33. 33. <ul><li>Data Training Requirements </li></ul><ul><ul><li>4 Domains of Data </li></ul></ul><ul><ul><li>Writing narratives </li></ul></ul><ul><ul><li>Types of carousel </li></ul></ul>
    34. 34. Why are some schools successful and others not when implementing the same improvement strategies? Readiness Guiding Question Assess readiness to benefit
    35. 35. <ul><li>Willingness – attitudes, experiences, buy-in </li></ul><ul><li>Process Skills </li></ul><ul><ul><li>Decision-making </li></ul></ul><ul><ul><li>Conflict management </li></ul></ul><ul><ul><li>Problem-solving </li></ul></ul><ul><ul><li>Code of cooperation </li></ul></ul><ul><li>Roles We Play </li></ul>Assess Readiness
    36. 36. Check Your Readiness <ul><li>Using the “Assessing General Readiness” worksheet discuss your school’s readiness to engage in the School Improvement Process and craft plans to respond to the challenges you foresee. </li></ul>
    37. 37. Basic or Initial Carousels <ul><li>All 4 Domains of Data </li></ul><ul><li>Designed to give large groups (i.e. all staff, all certs, all certs+IA/ParaPros or greater “community stakeholders”) a broad view of information </li></ul><ul><li>Contain “non-negotiables” </li></ul>
    38. 38. Process 1: Carousel So, let’s say there are 4 tables for the 4 data groups… Staff are asked to look at the data and craft narratives They do this for about 20 minutes Then they move to the next table Repeat until all data has been reviewed Logistical Considerations: Who will be involved in the Carousel? What could you do to make it even more fun? A theme perhaps? Should staff be assigned tables? Snacks, meals and comfort of participants?
    39. 39. Pause and Reflect on what you saw and heard. What is running around in your head?
    40. 40. Where Do We Go From Here? <ul><li>Teachers and principals alike assess student and teacher achievement early and often – and use the information to drive improvement rather than assign blame. </li></ul><ul><li>The key, however, is not simply that the successful schools have data – it’s who is using the data and how they use the data. </li></ul><ul><li>Beat The Odds (2006) </li></ul>
    41. 41. Guided Questions <ul><li>Help bring clarity </li></ul><ul><li>Helps bring focus to more than one thing </li></ul><ul><li>Helps bring focus to elements of leadership </li></ul><ul><li>Guided Question Stem </li></ul><ul><ul><li>“What evidence do I have…” </li></ul></ul>
    42. 42. Well conceived guided questions should <ul><li>Inquire into the nature (what) </li></ul><ul><li>Inquire into the quality (how well) </li></ul><ul><li>Inquire into the frequency (how often) </li></ul>
    43. 43. Remember that with data analysis you are trying to define the problem , not solve it.
    44. 44. Triangulation - <ul><li>Adding relevance and meaning through multiple data sources </li></ul>
    45. 45. Some guided questions to use when thinking about Dr. Ken Jenkins UNC @Chapel Hill <ul><li>Where are your widest achievement gaps? </li></ul><ul><li>How persistent have these gaps been? </li></ul><ul><li>Are there dramatic difference from one year to the next? What might explain the differences? </li></ul><ul><li>Are the gender difference worth noting? </li></ul><ul><li>Is there any relationship you can determine between the population of free and reduced price lunch students and general student achievement? </li></ul><ul><li>For High School, are there differences between major curriculum areas worth noting? </li></ul><ul><li>What are the bright spots contained within the data? </li></ul>
    46. 46. Has the team collected data from multiple indicators (i.e. student assessment, perception, demographic, school context)? Has the team determined what data should be included in the school’s portfolio? Has the team determined a process for allowing all stakeholders to analyze the data? Has the team determined how the data will be displayed? Collect, Sort and Select Data
    47. 47. <ul><li>Characteristics, Qualities and Types </li></ul><ul><ul><li>4 Domains </li></ul></ul><ul><ul><li>Formative </li></ul></ul><ul><ul><li>Summative </li></ul></ul><ul><ul><li>Longitudinal </li></ul></ul><ul><ul><li>Relevant </li></ul></ul><ul><ul><li>Reliable </li></ul></ul><ul><ul><li>Valid </li></ul></ul><ul><ul><li>Aligned with standards </li></ul></ul><ul><ul><li>Community sensitive </li></ul></ul>Selection of Data
    48. 48. Selecting Data <ul><li>From the data that has been collected you will need to purposefully select a subset for staff review. </li></ul><ul><li>What questions do you want to investigate? </li></ul><ul><li>What do you believe the staff “cares about”? </li></ul><ul><li>Choose a reasonable (say 6-8 pages) amount for their review. </li></ul><ul><li>What background knowledge will staff need to interpret the data? </li></ul>
    49. 49. Demographics Contex t Perceptions Student Learning Collecting Data Collect sort and select data
    50. 50. Collecting Data Contex t Perceptions Student Learning Demographics <ul><li>Guiding Questions: </li></ul><ul><li>Who are our students? </li></ul><ul><li>What trends do we see in our student population? </li></ul><ul><li>What trends do we see in our community? </li></ul>Collect sort and select data Free and Reduced ESL Special Populations Gender Ethnicity Mobility Dropout Rates Demographics
    51. 51. Collecting Data Demographics Contex t Student Learning Perceptions <ul><li>Guiding Questions: </li></ul><ul><li>How do the members of our school community feel about our school and district? </li></ul><ul><li>How satisfied are school community members with our educational programs? </li></ul><ul><li>What do the members of our school community perceive to be the strengths and needs of our school? </li></ul>Collect sort and select data Perceptions 9 Characteristics Technology
    52. 52. Collecting Data Demographics Contex t Perceptions Student Learning <ul><li>Guiding Questions: </li></ul><ul><li>How successful are our programs in support of struggling learners? </li></ul><ul><li>What factors outside the school may be influencing student achievement? </li></ul>Collect sort and select data Context Healthy Youth Survey Safe Schools Data Discipline Data School Programs
    53. 53. Demographics Perceptions Contex t Student Learning <ul><li>Guiding Questions: </li></ul><ul><li>What evidence can we gather about our students’ learning? </li></ul><ul><li>What evidence can be gather about curriculum, instructional and assessment alignment to standards? </li></ul><ul><li>To what do we attribute our achievement trends? </li></ul>Collect sort and select data Student Learning WASL Local Assessments Classroom Based Assessments GPA
    54. 54. <ul><li>Has the team selected appropriate data from each domain? </li></ul><ul><li>Is data displayed in a manner that is easy to interpret? </li></ul><ul><li>Do staff members know how to craft narrative statements? </li></ul><ul><li>Is there a process for engaging staff in review of data? </li></ul><ul><li>Is there a model for reaching consensus? </li></ul>Build and Analyze Portfolio
    55. 55. School Portfolio
    56. 56. <ul><li>Data exploration during the carousel activity </li></ul><ul><ul><li>Logistics – people, facility, movement of data, # of copies, cost </li></ul></ul><ul><ul><li>Encourage open-mindedness </li></ul></ul>
    57. 57. <ul><li>During the carousel activity </li></ul><ul><ul><li>Review why and process </li></ul></ul><ul><ul><li>Basic skill review </li></ul></ul><ul><ul><li>Allow all participants opportunity to see data </li></ul></ul><ul><ul><li>Narrative statements - process </li></ul></ul>
    58. 58. Writing Narratives <ul><li>Keep it simple- Communicate a single idea. </li></ul><ul><li>Make them short and easy to read </li></ul><ul><li>Avoid Evaluation- Describe what you see, not what caused it or what to do about it </li></ul>
    59. 59. Criteria for Good Narratives <ul><li>Content </li></ul><ul><ul><li>Describe building wide performance </li></ul></ul><ul><ul><li>Describe trends in performance over time </li></ul></ul><ul><ul><li>Describe high and low performing groups </li></ul></ul><ul><ul><li>Compare performance in your building with a benchmark for example statewide performance </li></ul></ul><ul><li>Format </li></ul><ul><ul><li>Good Narratives </li></ul></ul><ul><ul><ul><li>Communicate a single idea about student performance </li></ul></ul></ul><ul><ul><ul><li>Are short, clear sentences or phrases </li></ul></ul></ul><ul><ul><ul><li>Are descriptive rather than evaluative </li></ul></ul></ul><ul><ul><ul><li>Use everyday language that is easy to understand </li></ul></ul></ul><ul><ul><ul><li>Are independent statement that incorporate numbers </li></ul></ul></ul>
    60. 60. Product 1: List of Concerns <ul><li>At the end of the Carrousel, the staff should have access to a list of concerns based on data </li></ul><ul><li>You will need to determine the method for collecting concerns and returning them to staff </li></ul>
    61. 61. Process 2: Rating and Ranking <ul><li>The team should select a process for reaching consensus about the school’s priority concerns. </li></ul><ul><li>We have used a rating and ranking activity </li></ul><ul><ul><li>Staff is given printed copies of the concerns from the Data Carousel </li></ul></ul><ul><ul><li>They are asked to read for clarification (not allowed to lobby for or against a concern) </li></ul></ul><ul><ul><li>They are also asked to eliminate any duplicates </li></ul></ul><ul><ul><li>Staff select their 5 greatest concerns </li></ul></ul><ul><ul><li>Staff assign points to their concerns (5 to 1) with 5 points assigned to the greatest concern and 1 go the least </li></ul></ul><ul><ul><li>Public vote for each concern </li></ul></ul><ul><ul><li>Most points wins </li></ul></ul>
    62. 62. Product 2: A prioritized list of concerns <ul><li>At the end of the Data Carrousel, the staff will leave with a list of prioritized concerns. </li></ul><ul><li>Next step is typically a leadership team activity: Group concerns into themes and craft goal statements. </li></ul><ul><li>This process results in a deeper understanding of the school’s data, allows for staff input regarding priorities, supports a transparent decision making process. </li></ul>
    63. 63. “I am tired of talk that come to nothing. It makes my heart sick when I remember all the good words and broken promises…” Chief Joseph
    64. 65. Pre-Mortem Process Learning Improvement Team for Climbing Higher School/District <ul><li>You are a member of the school’s LIT charged with planning a data sharing activity with some “tough” data </li></ul><ul><li>Reflect on the various “personalities” you might have to work with during the data review planning process </li></ul><ul><li>Suggestions </li></ul><ul><ul><li>Recall the following </li></ul></ul><ul><ul><ul><li>Principles of Adult Learning </li></ul></ul></ul><ul><ul><ul><li>5 by 5 Whys </li></ul></ul></ul>
    65. 70. Most recent parent survey results
    66. 71. Time to prepare… <ul><li>Take some time to review the readiness worksheet and consider the context of your data review. </li></ul><ul><li>Craft some questions you would like to have your data address. </li></ul><ul><li>Create your plan for engaging the staff in a Data Carrousel </li></ul>
    67. 72. Additional Resources <ul><li>Informing Practices and Improving Results with Data-Driven Decisions (August 2000-ECS (Education Commission of the States Issued Paper) </li></ul><ul><li>“ The Flywheel Effect” by Timothy D. Kanold </li></ul><ul><li>“ Buried Treasure-Developing a Management Guide to Mountains of School Data”-January 2005 (Center for reinventing public education authored by Mary Beth Celio and James Harvey) </li></ul>
    68. 73. Source: “Addressing Barriers to Learning” Vol. 9, Number 4. Fall 2004. From School Mental Health Project/Center for Mental Health in Schools, UCLA.
    69. 74. Questions? <ul><li>Don’t hesitate to call CEE – 425-283-0384 Sue is ext 1#, Greg is ext 2#, Jack at 425-444-6600 and Terry at ? </li></ul><ul><li>OR you can email us: </li></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul>