SlideShare a Scribd company logo
Linking Data Systems to
Local Reforms
     Dr. Christopher A. Thorn, Assistant Scientist
      Wisconsin Center for Education Research
          University of Wisconsin-Madison
Core Information System Gaps
• Many HR systems do not handle multiple roles
  well (or at all)
• SIS focused on managing student-teacher ratios
  and scheduling rather than learning
• IT and Research offices understaffed and often
  disconnected from curricular departments
• Finance and HR not tied to research agenda
• Market for decision support systems lag
  educational needs – models often don’t fit
Data Quality Problems
• Poor links between students and teachers – often
  nonexistent links to subjects taught
• Little systematic data on system inputs or on
  fidelity of implementation
• Limited support for performance evaluation
  systems – framework, rubrics, and process
• Quality problems are tied to use. NCLB
  compliance quality is unacceptable for adult
  accountability
Analytical Gaps in
Accountability Systems
• VA Models are haaaaaaaaard
• Tests given in mid-year complicates assignment of
  productivity – pre and post in year
• Lack of vertical scales complicates measurement
  of productivity – claims of linearity also an issue
• Lack of links to licensure systems complicates
  assessment of changes in teacher characteristics
  and efficacy of teacher preparation institutions
• Limits of annual data
What have been the big surprises?
• Districts drop number of initiatives to focus on
  program quality and evaluation
• Unions demanding VA results for equity
• National union bringing technical expertise to the
  table to solve local problems
• Talent pool in national vendors thin
• New demands for diagnostic assessment
• New demands for PD that works

More Related Content

What's hot

Inspections as a Twin Vehicle for School Development and Control
Inspections as a Twin Vehicle for School Development and ControlInspections as a Twin Vehicle for School Development and Control
Inspections as a Twin Vehicle for School Development and Control
EduSkills OECD
 
EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)
Justin Piff
 
Tools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeTools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems Change
Justin Piff
 
2007 MESPA Data-Driven Elementary School Principals
2007 MESPA Data-Driven Elementary School Principals2007 MESPA Data-Driven Elementary School Principals
2007 MESPA Data-Driven Elementary School Principals
Scott McLeod
 
United in Diversity Attainment targets in Flemish Education Governance
United in Diversity Attainment targets in Flemish Education GovernanceUnited in Diversity Attainment targets in Flemish Education Governance
United in Diversity Attainment targets in Flemish Education Governance
EduSkills OECD
 
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
cdcummings
 
Creating a System of TA for Instructors
Creating a System of TA for InstructorsCreating a System of TA for Instructors
Creating a System of TA for Instructors
krislama
 
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
EduSkills OECD
 
AAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
AAU Undergraduate STEM Education Initiative: Building a STEM Reform NetworkAAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
AAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
SERC at Carleton College
 
Facets of Educational Technology
Facets of Educational TechnologyFacets of Educational Technology
Facets of Educational Technology
University of Wisconsin - Superior
 
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaulQcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
Rohit Kaul
 
Porto Walti EDEN Paris 2008 Presentation
Porto Walti EDEN Paris 2008 PresentationPorto Walti EDEN Paris 2008 Presentation
Porto Walti EDEN Paris 2008 Presentation
Stella Porto
 
Brown
BrownBrown
Data Collection and Accessibility for Inclusive Excellence
Data Collection and Accessibility for Inclusive ExcellenceData Collection and Accessibility for Inclusive Excellence
Data Collection and Accessibility for Inclusive Excellence
Presence
 
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experience
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experiencePam Muth and Lisa Bolton: Optimising QILT to improve the student experience
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experience
Studiosity.com
 
CCCC 2012
CCCC 2012CCCC 2012
CCCC 2012
jjory7
 
Applying to psm programs
Applying to psm programsApplying to psm programs
Applying to psm programs
InsideTheAdcom.com & American Advisors
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCT
cies
 
Research panel
Research panelResearch panel
Research panel
NAFCareerAcads
 
Design Process
Design ProcessDesign Process
Design Process
Tawana Washington
 

What's hot (20)

Inspections as a Twin Vehicle for School Development and Control
Inspections as a Twin Vehicle for School Development and ControlInspections as a Twin Vehicle for School Development and Control
Inspections as a Twin Vehicle for School Development and Control
 
EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)EERS Presentation (Justin and Sarah)
EERS Presentation (Justin and Sarah)
 
Tools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems ChangeTools for Measuring Place-Based Systems Change
Tools for Measuring Place-Based Systems Change
 
2007 MESPA Data-Driven Elementary School Principals
2007 MESPA Data-Driven Elementary School Principals2007 MESPA Data-Driven Elementary School Principals
2007 MESPA Data-Driven Elementary School Principals
 
United in Diversity Attainment targets in Flemish Education Governance
United in Diversity Attainment targets in Flemish Education GovernanceUnited in Diversity Attainment targets in Flemish Education Governance
United in Diversity Attainment targets in Flemish Education Governance
 
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
A STUDY OF TECHNOLOGY LEADERSHIP AMONG ELEMENTARY PRINCIPALS IN A SUBURBAN TE...
 
Creating a System of TA for Instructors
Creating a System of TA for InstructorsCreating a System of TA for Instructors
Creating a System of TA for Instructors
 
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
 
AAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
AAU Undergraduate STEM Education Initiative: Building a STEM Reform NetworkAAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
AAU Undergraduate STEM Education Initiative: Building a STEM Reform Network
 
Facets of Educational Technology
Facets of Educational TechnologyFacets of Educational Technology
Facets of Educational Technology
 
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaulQcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
Qcl 14-v3 causeeffectdiagram-simsree_rohit_kaul
 
Porto Walti EDEN Paris 2008 Presentation
Porto Walti EDEN Paris 2008 PresentationPorto Walti EDEN Paris 2008 Presentation
Porto Walti EDEN Paris 2008 Presentation
 
Brown
BrownBrown
Brown
 
Data Collection and Accessibility for Inclusive Excellence
Data Collection and Accessibility for Inclusive ExcellenceData Collection and Accessibility for Inclusive Excellence
Data Collection and Accessibility for Inclusive Excellence
 
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experience
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experiencePam Muth and Lisa Bolton: Optimising QILT to improve the student experience
Pam Muth and Lisa Bolton: Optimising QILT to improve the student experience
 
CCCC 2012
CCCC 2012CCCC 2012
CCCC 2012
 
Applying to psm programs
Applying to psm programsApplying to psm programs
Applying to psm programs
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCT
 
Research panel
Research panelResearch panel
Research panel
 
Design Process
Design ProcessDesign Process
Design Process
 

Viewers also liked

MoynihanThesisFinal16
MoynihanThesisFinal16MoynihanThesisFinal16
MoynihanThesisFinal16
Owen Moynihan
 
I have no idea if this worked
I have no idea if this workedI have no idea if this worked
I have no idea if this worked
kitkatkat
 
Sound in movies
Sound in moviesSound in movies
Sound in movies
jackm199
 
Talking to Administrators about SmartMusic
Talking to Administrators about SmartMusicTalking to Administrators about SmartMusic
Talking to Administrators about SmartMusic
MakeMusic
 
Music & Film
Music & FilmMusic & Film
Music & Film
Christopher Baker
 
Music and Sound in Movies
Music and Sound in MoviesMusic and Sound in Movies
Natyashastra
NatyashastraNatyashastra
Natyashastra
Janak Maru
 
Natyashastra
NatyashastraNatyashastra
Natyashastra
Sardarsinh Solanki
 
Inroduction to Natyashastra
Inroduction to NatyashastraInroduction to Natyashastra
Inroduction to Natyashastra
solankipintu
 
Styles and techniques for Music Video
Styles and techniques for Music Video Styles and techniques for Music Video
Styles and techniques for Music Video
957303Hayley
 
The Aesthetic and Intellectual Traditions of India
The Aesthetic and Intellectual Traditions of IndiaThe Aesthetic and Intellectual Traditions of India
The Aesthetic and Intellectual Traditions of India
freealan
 
Aesthetics
AestheticsAesthetics
Aesthetics
Yamini Soni
 
Aesthetics ppt
Aesthetics pptAesthetics ppt
Aesthetics ppt
kaustav sengupta
 
Slideshare ppt
Slideshare pptSlideshare ppt
Slideshare ppt
Mandy Suzanne
 

Viewers also liked (14)

MoynihanThesisFinal16
MoynihanThesisFinal16MoynihanThesisFinal16
MoynihanThesisFinal16
 
I have no idea if this worked
I have no idea if this workedI have no idea if this worked
I have no idea if this worked
 
Sound in movies
Sound in moviesSound in movies
Sound in movies
 
Talking to Administrators about SmartMusic
Talking to Administrators about SmartMusicTalking to Administrators about SmartMusic
Talking to Administrators about SmartMusic
 
Music & Film
Music & FilmMusic & Film
Music & Film
 
Music and Sound in Movies
Music and Sound in MoviesMusic and Sound in Movies
Music and Sound in Movies
 
Natyashastra
NatyashastraNatyashastra
Natyashastra
 
Natyashastra
NatyashastraNatyashastra
Natyashastra
 
Inroduction to Natyashastra
Inroduction to NatyashastraInroduction to Natyashastra
Inroduction to Natyashastra
 
Styles and techniques for Music Video
Styles and techniques for Music Video Styles and techniques for Music Video
Styles and techniques for Music Video
 
The Aesthetic and Intellectual Traditions of India
The Aesthetic and Intellectual Traditions of IndiaThe Aesthetic and Intellectual Traditions of India
The Aesthetic and Intellectual Traditions of India
 
Aesthetics
AestheticsAesthetics
Aesthetics
 
Aesthetics ppt
Aesthetics pptAesthetics ppt
Aesthetics ppt
 
Slideshare ppt
Slideshare pptSlideshare ppt
Slideshare ppt
 

Similar to 2008 cecr annual meeting linking data systems to local reforms

2010 bush foundation inputs, process indicators, and intermediate outcomes
2010 bush foundation inputs, process indicators, and intermediate outcomes2010 bush foundation inputs, process indicators, and intermediate outcomes
2010 bush foundation inputs, process indicators, and intermediate outcomes
Christopher Thorn
 
2012 it in education management socio-technical gaps exposed by the tif program
2012 it in education management socio-technical gaps exposed by the tif program2012 it in education management socio-technical gaps exposed by the tif program
2012 it in education management socio-technical gaps exposed by the tif program
Christopher Thorn
 
Dr. Jamil 828 Day 5.pdf
Dr. Jamil 828 Day 5.pdfDr. Jamil 828 Day 5.pdf
Dr. Jamil 828 Day 5.pdf
MuhammadJamil382420
 
Interview presentation.pptx
Interview presentation.pptxInterview presentation.pptx
Interview presentation.pptx
Dr. S. Dinesh Kumar
 
Business Cluster SWOT Analysis
Business Cluster SWOT AnalysisBusiness Cluster SWOT Analysis
Business Cluster SWOT Analysis
UNC Eshelman School of Pharmacy
 
Ehlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circleEhlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circle
FOTIM
 
1710 track1 bagirov
1710 track1 bagirov1710 track1 bagirov
1710 track1 bagirov
Rising Media, Inc.
 
What are we learning from learning analytics: Rhetoric to reality escalate 2014
What are we learning from learning analytics: Rhetoric to reality escalate 2014What are we learning from learning analytics: Rhetoric to reality escalate 2014
What are we learning from learning analytics: Rhetoric to reality escalate 2014
Shane Dawson
 
Policy imperatives for systems-oriented approaches to scaling up
Policy imperatives for systems-oriented approaches to scaling upPolicy imperatives for systems-oriented approaches to scaling up
Policy imperatives for systems-oriented approaches to scaling up
Institute for Reproductive Health Georgetown University
 
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
Partners in School Innovation
 
PBIS FASP Presentation
PBIS FASP PresentationPBIS FASP Presentation
PBIS FASP Presentation
Kathryn Tromblay PsyS, NCSP
 
Using Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student EngagementUsing Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student Engagement
Dave Shields
 
Stephen "Steve" Muzzy Memphis Schools Presentation
Stephen "Steve" Muzzy Memphis Schools PresentationStephen "Steve" Muzzy Memphis Schools Presentation
Stephen "Steve" Muzzy Memphis Schools Presentation
steve muzzy
 
Developing an Effective IT Governance Structure from the Ground Up
Developing an Effective IT Governance Structure from the Ground UpDeveloping an Effective IT Governance Structure from the Ground Up
Developing an Effective IT Governance Structure from the Ground Up
Frank Cervone
 
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
Leslie Dare
 
Professor Graham Gibbs Presentation
Professor Graham Gibbs PresentationProfessor Graham Gibbs Presentation
Professor Graham Gibbs Presentation
Chris McEwan
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINAL
Ellen Wagner
 
Westat Presentation
Westat PresentationWestat Presentation
Westat Presentation
Ohio Education Research Center
 
Collaborative Research Networks
Collaborative Research NetworksCollaborative Research Networks
Collaborative Research Networks
INSPIRE_Network
 
Cesa 6 effectiveness project ppt
Cesa 6 effectiveness project pptCesa 6 effectiveness project ppt
Cesa 6 effectiveness project ppt
roverdust
 

Similar to 2008 cecr annual meeting linking data systems to local reforms (20)

2010 bush foundation inputs, process indicators, and intermediate outcomes
2010 bush foundation inputs, process indicators, and intermediate outcomes2010 bush foundation inputs, process indicators, and intermediate outcomes
2010 bush foundation inputs, process indicators, and intermediate outcomes
 
2012 it in education management socio-technical gaps exposed by the tif program
2012 it in education management socio-technical gaps exposed by the tif program2012 it in education management socio-technical gaps exposed by the tif program
2012 it in education management socio-technical gaps exposed by the tif program
 
Dr. Jamil 828 Day 5.pdf
Dr. Jamil 828 Day 5.pdfDr. Jamil 828 Day 5.pdf
Dr. Jamil 828 Day 5.pdf
 
Interview presentation.pptx
Interview presentation.pptxInterview presentation.pptx
Interview presentation.pptx
 
Business Cluster SWOT Analysis
Business Cluster SWOT AnalysisBusiness Cluster SWOT Analysis
Business Cluster SWOT Analysis
 
Ehlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circleEhlers assessement of information literacy skills circle
Ehlers assessement of information literacy skills circle
 
1710 track1 bagirov
1710 track1 bagirov1710 track1 bagirov
1710 track1 bagirov
 
What are we learning from learning analytics: Rhetoric to reality escalate 2014
What are we learning from learning analytics: Rhetoric to reality escalate 2014What are we learning from learning analytics: Rhetoric to reality escalate 2014
What are we learning from learning analytics: Rhetoric to reality escalate 2014
 
Policy imperatives for systems-oriented approaches to scaling up
Policy imperatives for systems-oriented approaches to scaling upPolicy imperatives for systems-oriented approaches to scaling up
Policy imperatives for systems-oriented approaches to scaling up
 
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
Leading Complex District Transformation Efforts - SREE Conference 9/3/2014
 
PBIS FASP Presentation
PBIS FASP PresentationPBIS FASP Presentation
PBIS FASP Presentation
 
Using Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student EngagementUsing Ping SSO to Boost Student Engagement
Using Ping SSO to Boost Student Engagement
 
Stephen "Steve" Muzzy Memphis Schools Presentation
Stephen "Steve" Muzzy Memphis Schools PresentationStephen "Steve" Muzzy Memphis Schools Presentation
Stephen "Steve" Muzzy Memphis Schools Presentation
 
Developing an Effective IT Governance Structure from the Ground Up
Developing an Effective IT Governance Structure from the Ground UpDeveloping an Effective IT Governance Structure from the Ground Up
Developing an Effective IT Governance Structure from the Ground Up
 
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
How We are Thriving, Not Just Surviving, Under our Commitment to Assessment i...
 
Professor Graham Gibbs Presentation
Professor Graham Gibbs PresentationProfessor Graham Gibbs Presentation
Professor Graham Gibbs Presentation
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINAL
 
Westat Presentation
Westat PresentationWestat Presentation
Westat Presentation
 
Collaborative Research Networks
Collaborative Research NetworksCollaborative Research Networks
Collaborative Research Networks
 
Cesa 6 effectiveness project ppt
Cesa 6 effectiveness project pptCesa 6 effectiveness project ppt
Cesa 6 effectiveness project ppt
 

More from Christopher Thorn

2015 Carnegie Pathways Spotlight
2015 Carnegie Pathways Spotlight2015 Carnegie Pathways Spotlight
2015 Carnegie Pathways Spotlight
Christopher Thorn
 
Thorn ODE BHK Talk 2013 09-16 handout
Thorn ODE BHK Talk 2013 09-16 handoutThorn ODE BHK Talk 2013 09-16 handout
Thorn ODE BHK Talk 2013 09-16 handout
Christopher Thorn
 
2012 carnegie foundation the accidental revolution-teacher accountability val...
2012 carnegie foundation the accidental revolution-teacher accountability val...2012 carnegie foundation the accidental revolution-teacher accountability val...
2012 carnegie foundation the accidental revolution-teacher accountability val...
Christopher Thorn
 
2011 data quality challenges when implementing classroom value added models
2011 data quality challenges when implementing classroom value added models2011 data quality challenges when implementing classroom value added models
2011 data quality challenges when implementing classroom value added models
Christopher Thorn
 
2011 aera data quality and a new policy agenda
2011 aera data quality and a new policy agenda2011 aera data quality and a new policy agenda
2011 aera data quality and a new policy agenda
Christopher Thorn
 
2010 ohio tif meeting creating a comprehensive teacher effectiveness system
2010 ohio tif meeting  creating a comprehensive teacher effectiveness system2010 ohio tif meeting  creating a comprehensive teacher effectiveness system
2010 ohio tif meeting creating a comprehensive teacher effectiveness system
Christopher Thorn
 
2010 nces management information systems conference when world collide
2010 nces  management information systems conference   when world collide2010 nces  management information systems conference   when world collide
2010 nces management information systems conference when world collide
Christopher Thorn
 
2010 eagle co technology presentation
2010 eagle co technology presentation2010 eagle co technology presentation
2010 eagle co technology presentation
Christopher Thorn
 
2010 uw-madison - systems thinking and it leadership
2010   uw-madison - systems thinking and it leadership2010   uw-madison - systems thinking and it leadership
2010 uw-madison - systems thinking and it leadership
Christopher Thorn
 
2008 nces summer data conference making the case for longitudinal data of t...
2008 nces summer data conference   making the case for longitudinal data of t...2008 nces summer data conference   making the case for longitudinal data of t...
2008 nces summer data conference making the case for longitudinal data of t...
Christopher Thorn
 
2006 tuebingen university wcer capabilities - grenzübergänger
2006 tuebingen university   wcer capabilities - grenzübergänger2006 tuebingen university   wcer capabilities - grenzübergänger
2006 tuebingen university wcer capabilities - grenzübergängerChristopher Thorn
 
2006 qualitative strategies conference uni durham - are we there yet - grow...
2006 qualitative strategies conference   uni durham - are we there yet - grow...2006 qualitative strategies conference   uni durham - are we there yet - grow...
2006 qualitative strategies conference uni durham - are we there yet - grow...
Christopher Thorn
 
2005 studying qualitative research expert to novice and back again - uni durham
2005 studying qualitative research expert to novice and back again - uni durham 2005 studying qualitative research expert to novice and back again - uni durham
2005 studying qualitative research expert to novice and back again - uni durham
Christopher Thorn
 
2005 scale math and science partnership research and evaluation team mis and...
2005 scale math and science partnership  research and evaluation team mis and...2005 scale math and science partnership  research and evaluation team mis and...
2005 scale math and science partnership research and evaluation team mis and...
Christopher Thorn
 
2004 national science foundation knowledge management and network collaborati...
2004 national science foundation knowledge management and network collaborati...2004 national science foundation knowledge management and network collaborati...
2004 national science foundation knowledge management and network collaborati...
Christopher Thorn
 
2002 it in educational management organic school info-systems-decision making...
2002 it in educational management organic school info-systems-decision making...2002 it in educational management organic school info-systems-decision making...
2002 it in educational management organic school info-systems-decision making...
Christopher Thorn
 
2002 aera making decision support systems useful in the classroom
2002 aera making decision support systems useful in the classroom2002 aera making decision support systems useful in the classroom
2002 aera making decision support systems useful in the classroom
Christopher Thorn
 
2001 wisconsin school boards association issues in building data and inform...
2001 wisconsin school boards association   issues in building data and inform...2001 wisconsin school boards association   issues in building data and inform...
2001 wisconsin school boards association issues in building data and inform...
Christopher Thorn
 
2000 nces management info systems conference knowledge management for educa...
2000 nces management info systems conference   knowledge management for educa...2000 nces management info systems conference   knowledge management for educa...
2000 nces management info systems conference knowledge management for educa...
Christopher Thorn
 
2012 tif3 measuring principal effectiveness data capacity and quality consi...
2012 tif3 measuring principal effectiveness   data capacity and quality consi...2012 tif3 measuring principal effectiveness   data capacity and quality consi...
2012 tif3 measuring principal effectiveness data capacity and quality consi...
Christopher Thorn
 

More from Christopher Thorn (20)

2015 Carnegie Pathways Spotlight
2015 Carnegie Pathways Spotlight2015 Carnegie Pathways Spotlight
2015 Carnegie Pathways Spotlight
 
Thorn ODE BHK Talk 2013 09-16 handout
Thorn ODE BHK Talk 2013 09-16 handoutThorn ODE BHK Talk 2013 09-16 handout
Thorn ODE BHK Talk 2013 09-16 handout
 
2012 carnegie foundation the accidental revolution-teacher accountability val...
2012 carnegie foundation the accidental revolution-teacher accountability val...2012 carnegie foundation the accidental revolution-teacher accountability val...
2012 carnegie foundation the accidental revolution-teacher accountability val...
 
2011 data quality challenges when implementing classroom value added models
2011 data quality challenges when implementing classroom value added models2011 data quality challenges when implementing classroom value added models
2011 data quality challenges when implementing classroom value added models
 
2011 aera data quality and a new policy agenda
2011 aera data quality and a new policy agenda2011 aera data quality and a new policy agenda
2011 aera data quality and a new policy agenda
 
2010 ohio tif meeting creating a comprehensive teacher effectiveness system
2010 ohio tif meeting  creating a comprehensive teacher effectiveness system2010 ohio tif meeting  creating a comprehensive teacher effectiveness system
2010 ohio tif meeting creating a comprehensive teacher effectiveness system
 
2010 nces management information systems conference when world collide
2010 nces  management information systems conference   when world collide2010 nces  management information systems conference   when world collide
2010 nces management information systems conference when world collide
 
2010 eagle co technology presentation
2010 eagle co technology presentation2010 eagle co technology presentation
2010 eagle co technology presentation
 
2010 uw-madison - systems thinking and it leadership
2010   uw-madison - systems thinking and it leadership2010   uw-madison - systems thinking and it leadership
2010 uw-madison - systems thinking and it leadership
 
2008 nces summer data conference making the case for longitudinal data of t...
2008 nces summer data conference   making the case for longitudinal data of t...2008 nces summer data conference   making the case for longitudinal data of t...
2008 nces summer data conference making the case for longitudinal data of t...
 
2006 tuebingen university wcer capabilities - grenzübergänger
2006 tuebingen university   wcer capabilities - grenzübergänger2006 tuebingen university   wcer capabilities - grenzübergänger
2006 tuebingen university wcer capabilities - grenzübergänger
 
2006 qualitative strategies conference uni durham - are we there yet - grow...
2006 qualitative strategies conference   uni durham - are we there yet - grow...2006 qualitative strategies conference   uni durham - are we there yet - grow...
2006 qualitative strategies conference uni durham - are we there yet - grow...
 
2005 studying qualitative research expert to novice and back again - uni durham
2005 studying qualitative research expert to novice and back again - uni durham 2005 studying qualitative research expert to novice and back again - uni durham
2005 studying qualitative research expert to novice and back again - uni durham
 
2005 scale math and science partnership research and evaluation team mis and...
2005 scale math and science partnership  research and evaluation team mis and...2005 scale math and science partnership  research and evaluation team mis and...
2005 scale math and science partnership research and evaluation team mis and...
 
2004 national science foundation knowledge management and network collaborati...
2004 national science foundation knowledge management and network collaborati...2004 national science foundation knowledge management and network collaborati...
2004 national science foundation knowledge management and network collaborati...
 
2002 it in educational management organic school info-systems-decision making...
2002 it in educational management organic school info-systems-decision making...2002 it in educational management organic school info-systems-decision making...
2002 it in educational management organic school info-systems-decision making...
 
2002 aera making decision support systems useful in the classroom
2002 aera making decision support systems useful in the classroom2002 aera making decision support systems useful in the classroom
2002 aera making decision support systems useful in the classroom
 
2001 wisconsin school boards association issues in building data and inform...
2001 wisconsin school boards association   issues in building data and inform...2001 wisconsin school boards association   issues in building data and inform...
2001 wisconsin school boards association issues in building data and inform...
 
2000 nces management info systems conference knowledge management for educa...
2000 nces management info systems conference   knowledge management for educa...2000 nces management info systems conference   knowledge management for educa...
2000 nces management info systems conference knowledge management for educa...
 
2012 tif3 measuring principal effectiveness data capacity and quality consi...
2012 tif3 measuring principal effectiveness   data capacity and quality consi...2012 tif3 measuring principal effectiveness   data capacity and quality consi...
2012 tif3 measuring principal effectiveness data capacity and quality consi...
 

Recently uploaded

RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
IreneSebastianRueco1
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
thanhdowork
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
Assessment and Planning in Educational technology.pptx
Assessment and Planning in Educational technology.pptxAssessment and Planning in Educational technology.pptx
Assessment and Planning in Educational technology.pptx
Kavitha Krishnan
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
Priyankaranawat4
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
TechSoup
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
Celine George
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
adhitya5119
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
Priyankaranawat4
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
tarandeep35
 
Top five deadliest dog breeds in America
Top five deadliest dog breeds in AmericaTop five deadliest dog breeds in America
Top five deadliest dog breeds in America
Bisnar Chase Personal Injury Attorneys
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 

Recently uploaded (20)

RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
RPMS TEMPLATE FOR SCHOOL YEAR 2023-2024 FOR TEACHER 1 TO TEACHER 3
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
Assessment and Planning in Educational technology.pptx
Assessment and Planning in Educational technology.pptxAssessment and Planning in Educational technology.pptx
Assessment and Planning in Educational technology.pptx
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat  Leveraging AI for Diversity, Equity, and InclusionExecutive Directors Chat  Leveraging AI for Diversity, Equity, and Inclusion
Executive Directors Chat Leveraging AI for Diversity, Equity, and Inclusion
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
 
Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
 
Top five deadliest dog breeds in America
Top five deadliest dog breeds in AmericaTop five deadliest dog breeds in America
Top five deadliest dog breeds in America
 
Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 

2008 cecr annual meeting linking data systems to local reforms

  • 1. Linking Data Systems to Local Reforms Dr. Christopher A. Thorn, Assistant Scientist Wisconsin Center for Education Research University of Wisconsin-Madison
  • 2. Core Information System Gaps • Many HR systems do not handle multiple roles well (or at all) • SIS focused on managing student-teacher ratios and scheduling rather than learning • IT and Research offices understaffed and often disconnected from curricular departments • Finance and HR not tied to research agenda • Market for decision support systems lag educational needs – models often don’t fit
  • 3. Data Quality Problems • Poor links between students and teachers – often nonexistent links to subjects taught • Little systematic data on system inputs or on fidelity of implementation • Limited support for performance evaluation systems – framework, rubrics, and process • Quality problems are tied to use. NCLB compliance quality is unacceptable for adult accountability
  • 4. Analytical Gaps in Accountability Systems • VA Models are haaaaaaaaard • Tests given in mid-year complicates assignment of productivity – pre and post in year • Lack of vertical scales complicates measurement of productivity – claims of linearity also an issue • Lack of links to licensure systems complicates assessment of changes in teacher characteristics and efficacy of teacher preparation institutions • Limits of annual data
  • 5. What have been the big surprises? • Districts drop number of initiatives to focus on program quality and evaluation • Unions demanding VA results for equity • National union bringing technical expertise to the table to solve local problems • Talent pool in national vendors thin • New demands for diagnostic assessment • New demands for PD that works