1.
A DESIGN TO CHANGE ASSESSMENT: EVIDENCE CENTERED DESIGN & DEMOCRATIZING LEARNING Adam Ingram-Goble, Ben Shapiro, Ben Stokes, Yoon Jeon Kim, and Peter Wardrip adamaig@gmail.com www.ecdemocratized.com DML 2012

2.
THE CURRENT STATE OF ASSESSMENT: EFFECTS OF NO CHILD LEFT BEHIND• Positives • Increased use of rubrics makes assessment more open • Increasing content alignment at both local and national levels • Disaggregation of data

3.
THE CURRENT STATE OF ASSESSMENT: EFFECTS OF NO CHILD LEFT BEHIND• Positives • Increased use of rubrics makes assessment more open • Increasing content alignment at both local and national levels • Disaggregation of data• Negatives • Increased stress on everyone: School Admins, Teachers, and Students • Some Admins game the system by reclassifying students, encouraging them to skip school on test days, etc. • Some students drop out rather than confront the expected failure, or participate in something they don’t see the value of

4.
INNOVATIVE COMBINATIONDemocratizing Evidence Centered Learning Design In Combination, We hope... • Students gain control in their learning • Assessment becomes openly accessible to both the Assessed and the Assessor(s) • Shifts debate on assessment to include creating value for the learner

5.
DEMOCRATIZING LEARNING Learning Democracy Environment DesignAgency to say what Participatory & matters Social Addresses power Shared Access relationsRuns on Advocacy & Self-directed Negotiation

6.
EVIDENCE CENTERED DESIGN: THE TWO-MINUTE PRIMER !

7.
ECD MODEL COMPONENTS WE USE Task Model Competency Model What are students asked to do?The set of knowledge, skills, or abilities used for inferences Evidence Model What behaviors reveal competency? What is the mathematical connection between behaviors and competency?

8.
ECD MODEL COMPONENTS WE USE Task Model Competency Model What are students asked to do?The set of knowledge, skills, or abilities used for inferences Rubric Evidence Model What behaviors reveal competency? What is the mathematical connection between behaviors and competency?

9.
RUBE GOLDBERG EXAMPLE • Task Model • Build a Rube Goldberg machine • Competency Model • Understanding of physics and systems • Rubric: Systems Thinking Skills Novice Apprentice ... Master Consistently identifies Identifies some discrete Inconsistently identifies discrete elements and theirDynamic Thinking elements and ... dynamic interconnections relationships and behaviors relationships in systems Consistently understands Inconsistently shows Inconsistently identifies Closed-Loop loops and employs leverage understanding of leverage points of change ... Thinking points of change within feedback loops in systems systems

10.
iPad 7:11 PM ECDemocratized Username Password Login

11.
iPad 7:11 PM Challenges + Profile LogoutThe Rube Goldberg MachineThe Boston Tea Party Adam Ingram-Goble (@adamaig) About Me I’m interested in building software that changes classroom practice, and makes learning fun. Recent Accomplishments Systematically Discrete Received 10 agreements with initial assessments of dynamic thinking evidence. I’ve got something to say! Provided feedback on 30 evidence submissions of other groups. Find 20 examples of something beautiful in my That? Oh, that’s art. neighborhood.

12.
iPad 7:11 PM The Rube Goldberg Machine: The Challenge EditOverview You are challenged to create a "mousetrap car" that can be entered into a classroom contest. The spring of a mousetrap can store a considerable amount of potential energy when it is pulled back and its tension is increased. When released, this energy can be transformed into the kinetic energy of movement, making the mousetrap the perfect "motor" for a homemade car. (Show More)Resources Requirements Rubric (Choose at least 2 skills) Dynamic Thinking The ability to identify discrete elements within a system, understanding of the behaviors and characteristics of elements within a system, including multiple dynamic interconnections affecting an outcome Closed-Loop Thin... Understanding of feedback dynamics (i.e., reinforcing and balancing feedback loops): ability to specify types of causal relationships within a system. The ability to show that reinforcing and balancing feedback loops inform and can continually modify the workings of a system...(more) Homological Und... Able to transfer systems understanding from one system to another. The Challenge Kickstart Evidence Finalize

13.
iPad 7:11 PM Project Evidence Library + The Rube Goldberg Machine: Collect New Evidence Publish it! Working Pulley! ... Lvl 2 - Dynamic ThinkingFeb. 29th Bad Lever. Too m.. Lvl 2 - Dynamic ThinkingMar. 1st Gravity is powerf... Lvl 3 - NewtonianMar. 2nd Describe the evidence. This is evidence of ... + Unspecified Updated 20 minutes ago The Challenge Kickstart Evidence Finalize

14.
iPad 7:11 PM Challenges + Profile LogoutThe Rube Goldberg MachineThe Boston Tea Party Adam Ingram-Goble (@adamaig) About Me I’m interested in building software that changes classroom practice, and makes learning fun. Recent Accomplishments Systematically Discrete Received 10 agreements with initial assessments of dynamic thinking evidence. I’ve got something to say! Provided feedback on 30 evidence submissions of other groups. Find 20 examples of something inspiring in my That? Oh, that’s art. neighborhood.

15.
THIS IS JUST THE BEGINNING• Underlying design principles of ECDemocratized Assessment• An illustrative case of our idea• A few other things we are thinking about: • Game play mechanics around evidence collection and sharing • How would this integrate with other data sources?• How does yours differ?