Assessment 2.0 using assessment to enhance 21st c. learning

1,360 views

Published on

4 Comments
1 Like
Statistics
Notes
  • Please stay in touch!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • fantastic session
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Jonathan let me know what you think of this book.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • MegaSkils Dorothy Rich
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
1,360
On SlideShare
0
From Embeds
0
Number of Embeds
537
Actions
Shares
0
Downloads
12
Comments
4
Likes
1
Embeds 0
No embeds

No notes for slide

Assessment 2.0 using assessment to enhance 21st c. learning

  1. 1. Assessment 2.0: Using Assessment to Enhance 21 st c. Learning Jonathan E. Martin Head of School St. Gregory College Prep www.21k12blog.net
  2. 2. <ul><li>Begin with the end in mind </li></ul><ul><li>Backward design </li></ul>www.21k12blog.net
  3. 3. <ul><li>What gets measured gets done </li></ul>www.21k12blog.net
  4. 4. <ul><li>The measurement is the message </li></ul>www.21k12blog.net
  5. 5. Agenda <ul><li>internal </li></ul><ul><li>Rethinking in-class assessments </li></ul><ul><li>Expanded reporting, particularly with 21 st c. skills </li></ul><ul><li>Pat Bassett’s Demonstrations of Learning </li></ul><ul><li>Digital Portfolios </li></ul><ul><li>external </li></ul><ul><li>High School Survey of Student Engagement (hssse) </li></ul><ul><li>NWEA’s Measurement of Academic Progress (MAP) </li></ul><ul><li>College and Work Readiness Assessment (CWRA) </li></ul>www.21k12blog.net
  6. 6. In Class <ul><li>Exhibitions and Presentations </li></ul><ul><li>Online publications: US Gov’t Wiki </li></ul><ul><li>PBL and demonstrations </li></ul>
  7. 7. Testing the right way <ul><li>Do we still believe in testing? </li></ul><ul><li>Rethinking the test to enhance the development of higher order thinking: conceptual, critical, analytical. </li></ul>
  8. 8. From Pat Bassett, Schools of the Future prez.
  9. 9. From Pat Bassett & Chapin School
  10. 10. Open Computer Testing <ul><li>Nothing changes if the assessments are still geared to pencil and paper. Those assessments were developed when there were no computers and the power of Google was not there for students on question of fact. That power gives them the power of argument and allows real thinking: Unleash them. </li></ul><ul><li>Norman Constantine, Wakefield School. </li></ul>
  11. 11. Denmark <ul><li>This is the Danish language exam.  </li></ul><ul><li>Students can use the internet to answer any of the four questions. They can access any site they like, even Facebook, but they cannot message each other or email anyone outside the classroom. </li></ul><ul><li>The teachers also think the nature of the questions make it harder to cheat in exams. Students are no longer required to regurgitate facts and figures. Instead the emphasis is on their ability to sift through and analyse information. </li></ul><ul><li>Minister for education in Denmark, Bertel Haarder, says: “Our exams have to reflect daily life in the classroom and daily life in the classroom has to reflect life in society.  The internet is indispensable, including in the exam situation. </li></ul><ul><li>I’m sure that is would be a matter of very few years when most European countries will be on the same line.” </li></ul>
  12. 12. performance task assessment <ul><li>It is an empty exercise to assess student learning without providing a means to adjust teaching in response to deficiencies revealed through the information gleaned from that assessments. </li></ul><ul><li>Marc Chun: Taking Teaching to the (Performance) Task . </li></ul>www.21k12blog.net
  13. 13. Performance Task Assessment elements <ul><li>Real-world scenario </li></ul><ul><li>Authentic, complex process </li></ul><ul><li>Higher-order thinking </li></ul><ul><li>Authentic performance </li></ul><ul><li>Transparent evaluation criteria </li></ul>www.21k12blog.net
  14. 14. Performance task assessment rubric <ul><li>considering an issue from multiple perspectives </li></ul><ul><li>critically examining evidence </li></ul><ul><li>valuing claims that are backed by appropriate and adequate evidence, </li></ul><ul><li>reasoning objectively and dispassionately </li></ul><ul><li>arriving at informed judgments and decisions. </li></ul>www.21k12blog.net
  15. 15. Scenario (created by Kristy Miller, University of Evansville) Prior to the election, a bill is proposed in the state senate that would ban aspartame, an artificial sweetener, from being added to any soft drink or food product. Senator Dulce is opposed to the bill. You are an advisor to State Senator Nathan Dulce, who is running for reelection against County Commissioner Pat Sauer. Pat Sauer made two arguments in favor of the bill during a recent TV interview: First, Sauer said that because of the strong correlation between the number of people who consume aspartame and headaches, “banning aspartame would improve the health of the state’s citizens.” Second, he said that “aspartame should be replaced with sucralose.” Documents : Local newspaper article opposing aspartame Data from the Department of Health about headaches and aspartame Task: Senator Dulce wants to make sure he votes appropriately on the aspartame bill, so he has asked you to analyze the strengths and/or limitations of each of Sauer’s two main points.
  16. 16. expanding student reporting <ul><li>assessing and reporting on desired outcomes </li></ul>www.21k12blog.net
  17. 17. Sources for skill sets <ul><li>P artnership for 21 st c. Skills : </li></ul><ul><li>creativity, </li></ul><ul><li>critical thinking, </li></ul><ul><li>collaboration, </li></ul><ul><li>communication </li></ul><ul><li>T ony Wagner’s Seven Survival Skills </li></ul><ul><li>NAIS commission’s list of essential 21 st c. capacities </li></ul>www.21k12blog.net
  18. 18. The “egg” www.21k12blog.net
  19. 19. St. Gregory’s “egg” <ul><li>Effort </li></ul><ul><li>Integrity </li></ul><ul><li>Leadership </li></ul><ul><li>Communication skills </li></ul><ul><ul><li>Writing </li></ul></ul><ul><ul><li>Speaking </li></ul></ul><ul><ul><li>Listening </li></ul></ul><ul><ul><li>Digital communications </li></ul></ul>www.21k12blog.net
  20. 20. Egg continued <ul><li>Thinking skills </li></ul><ul><ul><li>Inquisitiveness </li></ul></ul><ul><ul><li>Analytic thinking </li></ul></ul><ul><ul><li>Synthetic thinking </li></ul></ul><ul><ul><li>Critical thinking </li></ul></ul><ul><li>Innovation skills </li></ul><ul><ul><li>Creativity and ingenuity   </li></ul></ul><ul><ul><li>Adaptability   </li></ul></ul><ul><ul><li>Initiative    </li></ul></ul><ul><ul><li>Experimentation and risk-taking     </li></ul></ul><ul><li>Complex, real-world, problem-solving </li></ul>www.21k12blog.net
  21. 21. The Egg: a work in progress <ul><li>Just tacking to report card not successful enough. </li></ul><ul><li>Embedding it instead in advisory, conferencing, goal-setting, and self-assessment. </li></ul>www.21k12blog.net
  22. 22. Pat Bassett’s call for “demonstrations of learning” <ul><li>Define the skills of your graduates, and required “exhibitions” or demonstrations of those skills for graduation. </li></ul>www.21k12blog.net
  23. 23. Demonstrations of Learning : “What you do, not what you know, is the ultimate test of education.” ~PFB Tweet <ul><li>Conduct a fluent conversation in a foreign language about of piece of writing in that language. </li></ul><ul><li>Write a cogent and persuasive opinion piece on a matter of public importance. </li></ul><ul><li>Declaim with passion and from memory a passage that is meaningful, of one’s own or from the culture’s literature or history. </li></ul><ul><li>Demonstrate a commitment to creating a more sustainable and global future with means that are scalable </li></ul><ul><li>Invent a machine or program a robot capable of performing a difficult physical task. </li></ul>
  24. 24. Demonstrations of Learning <ul><li>Exercise leadership in arena which you have passion and expertise . </li></ul><ul><li>Using statistics, assess if a statement by a public figure is demonstrably true. </li></ul><ul><li>Assess media coverage of a global event from various cultural/national perspectives. </li></ul><ul><li>Describe a breakthrough for a project-based team on which you participated in which you contributed to overcoming a human-created obstacle. </li></ul><ul><li>Produce or perform or interpret a work of art. </li></ul>
  25. 25. <ul><li>Wouldn’t it be great if each school in a competitive set defined their lists differently, driven by unique mission, and families chose schools by their defined outcomes (and demonstrated success at those outcomes?) </li></ul>www.21k12blog.net
  26. 26. <ul><li>What are/ would be your school’s </li></ul><ul><li>demonstrations of learning? </li></ul><ul><li>Discuss. </li></ul>www.21k12blog.net
  27. 27. Digital Portfolios: Keeping it Altogether, Online <ul><li>Whether it be for demonstrations of learning, or exhibitions of essential skills, or online publication, a digital portfolio can hold student work for accountability and demonstrated progression of learning, and can be an exhibit of your school’s learning program. </li></ul><ul><li>High Tech High Digital Portfolios </li></ul><ul><li>New Tech Network Digital Portfolios </li></ul>
  28. 28. <ul><li>external assessment: measuring what matters </li></ul>www.21k12blog.net
  29. 29. Moving to the External <ul><li>Not everything that can be counted counts, and not everything that counts can be counted. </li></ul><ul><li>Albert Einstein </li></ul><ul><li>Data must inform, not replace, judgment. </li></ul>www.21k12blog.net
  30. 30. Balancing the Scorecard <ul><li>Our schools will be evaluated and measured, whether we like it or not, especially with SAT scores and college lists. </li></ul><ul><li>We need to take the initiative, inside schools, to broaden the measurements and balance the scorecard. </li></ul>www.21k12blog.net
  31. 31. Does your educational mission include: <ul><li>Meaningful student engagement in learning? </li></ul><ul><li>Supportive school culture and strong community? </li></ul><ul><li>Personalized learning for breadth of student abilities in core subjects? </li></ul><ul><li>Development of higher order thinking skills, and effective problem-solving skills? </li></ul>www.21k12blog.net
  32. 32. <ul><li>Let’s measure mission: </li></ul>www.21k12blog.net
  33. 33. <ul><li>To improve accountability. </li></ul><ul><li>In accreditation </li></ul><ul><li>To Boards </li></ul><ul><li>To parents </li></ul><ul><li>To funders </li></ul>www.21k12blog.net
  34. 34. <ul><li>For marketing and communications. </li></ul>www.21k12blog.net
  35. 35. <ul><li>To improve learning in the 21 st century! </li></ul>www.21k12blog.net
  36. 36. NAIS monograph: July 2010 Student Outcomes that Measure the School’s Value Added <ul><li>“ Independent schools are now being challenged to show  how  their educational model generates what it does and how it is  worth  the investment. </li></ul><ul><li>“ Consider using a tool or tools that best fits your school, mission, and community, knowing that the  primary purpose for doing so is institutional assessment and improvement . You will be stronger and more financially viable for doing so.” </li></ul>www.21k12blog.net
  37. 37. <ul><li>3 assessments featured in Nais monograph </li></ul><ul><li>hssse </li></ul><ul><li>map </li></ul><ul><li>cwra </li></ul>www.21k12blog.net
  38. 38. <ul><li>High School Survey of Student Engagement </li></ul><ul><li>HSSSE </li></ul>www.21k12blog.net
  39. 42. Education Secretary Duncan: Beyond the Bubble Tests: The Next Generation of Assessments  <ul><li>I believe the impact of this  next generation of assessments in the classroom will be dramatic —and that the new assessments will support learning and instructional practices that teachers have long hungered for themselves. </li></ul>www.21k12blog.net
  40. 43. <ul><li>computer adaptive assessment </li></ul>www.21k12blog.net
  41. 44. Duncan: <ul><li>One-shot, year-end bubble tests administered on a single day, too often lead to a dummying down of curriculum and instruction throughout the course of the entire school year. </li></ul><ul><li>In short, most of the assessment done in schools today is after the fact and designed to indicate only whether students have learned. Not enough is being done to assess students’ thinking as they learn to boost and enrich learning, and track student growth. </li></ul><ul><li>For the first time, state assessments will make widespread use of smart technology. They will provide students with realistic, complex performance tasks, immediate feedback, computer adaptive testing, and incorporate accommodations for a range of students. </li></ul>www.21k12blog.net
  42. 45. <ul><li>Northwest Evaluation Association </li></ul><ul><li>Measures of Academic Progress </li></ul><ul><li>St. Gregory teachers discuss on video </li></ul><ul><li>the MAP </li></ul>www.21k12blog.net
  43. 46. Duncan: <ul><li>One of the biggest frustrations of teachers with existing assessments is that they fail to test higher-order reasoning and writing skills, and thus fail to show what students know and can do. </li></ul><ul><li>For the first time, many teachers will have the state assessments they have longed for–  tests of critical thinking skills and complex student learning that are not just fill-in-the-bubble tests of basic skills but support good teaching in the classroom. </li></ul><ul><li>The new assessments will better measure the higher-order thinking skills so vital to success in the global economy of the 21st century and the future of American prosperity. To be on track today for college and careers, students need to show that they can analyze and solve complex problems, communicate clearly, synthesize information, apply knowledge, and generalize learning to other settings. </li></ul>www.21k12blog.net
  44. 47. <ul><li>Council for Aid to Education’s </li></ul><ul><li>College and Work Readiness Assessment </li></ul><ul><li>CWRA </li></ul>www.21k12blog.net
  45. 48. <ul><li>St. Gregory students discuss the CWRA </li></ul><ul><li>Video (5 minute version) </li></ul><ul><li>Video (1.5 minute version) </li></ul>www.21k12blog.net
  46. 49. Example Performance Task: Source: Council for Aid to Education, CWRA Institutional Report <ul><li>You advise Pat Williams, the president of DynaTech, a company that makes precision electronic instruments and navigational equipment. Sally Evans, a member of DynaTech’s sales force, recommended that DynaTech buy a small private plane (a SwiftAir 235) that she and other members of the sales force could use to visit customers. </li></ul><ul><li>Pat was about to approve the purchase when there was an accident involving a SwiftAir 235. Your document library contains the following materials: </li></ul>www.21k12blog.net
  47. 50. Documents or Artifacts: <ul><li>Newspaper article about the accident </li></ul><ul><li>Federal Accident Report on in-flight breakups in single-engine planes </li></ul><ul><li>Internal Correspondence (Pat’s e-mail to you and Sally’s e-mail to Pat) </li></ul><ul><li>Charts relating to SwiftAir’s performance characteristics </li></ul><ul><li>Excerpt from magazine article comparing SwiftAir 235 to similar planes </li></ul><ul><li>Pictures and descriptions of SwiftAir Models 180 and 235 </li></ul>www.21k12blog.net
  48. 51. Questions: <ul><li>Do the available data tend to support or refute the claim that the type of wing on the SwiftAir 235 leads to more in-flight breakups? </li></ul><ul><li>What is your preliminary recommendation about whether or not DynaTech should buy the plane and what is the basis for this recommendation? </li></ul>www.21k12blog.net
  49. 52. From CAE: <ul><li>CWRA tasks require that students integrate: </li></ul><ul><li>critical thinking, </li></ul><ul><li>analytic reasoning, </li></ul><ul><li>problem solving, </li></ul><ul><li>and written communication skills. </li></ul><ul><li>The holistic integration of these skills on the CWRA tasks mirrors the requirements of serious thinking and writing tasks faced in life outside of the classroom. </li></ul>www.21k12blog.net
  50. 53. Scoring www.21k12blog.net
  51. 54. www.21k12blog.net St. Gregory seniors Mean Raw Score Points Increase 128 Percentile Increase, on the College Freshman scale 30 percentile points (67 th  to 97 th ) Median Standard Deviation Increase .92 (compared to .51 at other high schools)
  52. 55. <ul><li>Q & A </li></ul>www.21k12blog.net
  53. 56. <ul><li>Thank you. </li></ul>www.21k12blog.net

×