21. Issues with Assessment
• Campbell’s Law:
“The more any quantitative social indicator is used
for social decision-making, the more subject it will
be to corruption pressures and the more apt it will
be to distort and corrupt the social processes it is
intended to monitor.”
22. Issues with Assessment
• Confounding Variables
• Student background
• School & district effects
• Earlier teachers and
schools
• Incomplete records
• Linking students to
teachers
• Using Achievement
Tests as Outcomes
• Effects of timing of tests
• Construction and
scaling of tests
• Inflation of scores
• Achievement tests as a
proxy for teacher
effectiveness
• Measurement error
23. What does the National
Assessment of Educational
Progress (NAEP) tell us about
reading?
Excerpts from the NAEP 2008 Trends in Academic Progress
& The Nation’s Report Card 2011
Jill A. Aguilar
CUR 515 Seminar in Curriculum Development
In Reading and Language Arts
Fall 2012
24.
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37. WHAT CAN DATA (NOT) TELL US?
Now that we’ve talked about DATA…
38. Task 1
• Data display DUE 9/26/13, All DUE 10/3/13
• 20 points possible
• Collect literacy assessment data
– “Data are values of qualitative or quantitative
variables, belonging to a set of items. Data are
typically the results of measurements and can
be visualized using graphs or images.”
• Create a data display (table or chart)
