Key Performance Indicators for College & Career Readiness - K12 Congress
1. Key Performance Indicators for
College & Career Readiness
November 18, 2014
Don Tollman – VP, Non-Profit & Foundation
Partnerships - Hobsons
2. Welcome & Overview
• Contextualized Need for KPIs
• Current Research & Thinking About KPIs
• Your Key Performance Indicators
• ED’s College Ratings System
2
4. 4
Clear National Challenges
Only
1/2
of all
undergraduates
complete a
college degree
in six years.
38%
of all U.S.
students take
a remedial course
in their first or
second year.
More than
60%
of jobs will
require a
postsecondary
education.
Students with a
bachelor’s degree
will earn
40%
more in their lifetime
(29% more with
a community
college degree)
than students with
only high school
diplomas.
The U.S. is
9th
in the world
in college
attainment
for the
25-34 year old
population.
5. 5
A Coherent National Goal
Dramatically increase the number/proportion of
U.S. citizens with an undergraduate degree by...
Some variability on how to reach the goal
6. 6
Challenging Macro Forces
Student Expectations (SROI)
Cost of College (Cost of no college)
Global competition
State Revenues
Public Ability/Desire to Pay
Median Family Income
7. Talent Pipeline Now
7 Based on http://www.changemag.org/Archives/Back
Issues/2011/May-June 2011/first-in-the-world-full.html
Education Pipeline
• Importance of transitions
• Need for P-20W collaboration
• Student success should be focus
11. Reliable Sources for KPIs
11
Current Research, for example…
www.completecollege.org/state_data/
Findings:
• Student characteristics are
changing
• Part-time students struggle to
graduate
• Many students take too many
credits
• Poor students and students
of color struggle the most to
graduate
• Remediation isn’t effective at
helping students graduate
14. KPIs for College & Career
• Inputs, process, and outputs
• Non-academic, engagement,
and academic
• Innovative measures and
what stakeholders expect
• What we know matters
Let’s
focus
on:
14
16. BRAINSTORM: KPIs
Goal: Develop a list of college and career
readiness KPIs that will inform YOUR
DISTRICT’S progress (e.g. district, school, class/group,
student and parent)
Student Engagement and Non-Academic, Academic
NOTE: Be sure to consider input, process, and output measures
16
17. PRIORITIZE: KPIs
Goal: Refine the list of college and career
readiness KPIs that will inform YOUR
DISTRICT’S progress
Student engagement, Non-Academic, and Academic
Process: Rank-order in terms of: perceived strength of indicator
(i.e. validity). Think at the student level of success, not school
level.
17
19. Ensuring a Return on Investment
19
“We have not even begun to develop the college
ratings system yet, and we are only in the beginning
stages of soliciting input from a wide range of
stakeholders about the metrics that should or should
not be used in the ratings system…
No later than December of 2014, we’ll use the feedback
we receive to finalize the college ratings system.”
September 20, 2013, Secretary of Education, Arnie Duncan
20. Common ED Approach
20
Focus on student:
• Access
• Affordability
• Outcomes
By way of:
• Innovation
• Carrots
• Future stick
21. Fed’s College Ratings System
21
• November 2013: 4 OPEN FORUMS
• January 22, 2014: Technical Experts Symposium
• December 2014: Final version
• 2015: Implement
• 2018: Results tied to Federal aid (about $150B)
Explore performance measurement as aligned with CCR
This is about data AND its about data about students AND powerful FOR STUDENTS – if we expect student to own their future and engage now, we need to empower them with information about themselves and their options
BE CAREFUL data privacy (personal control over one’s information) and security (information out of the hands of those who would do harm)
Ikeepsafe.org
Jim Seigl (Faifax)” security, safety, compliance AND public perception”
K. Kantor, DOE, 2012
Seems we’ve gotten the BHAG / SMART goal approach down fairly well.
3 years ago -- President Obama’s goal to raise the US college graduation rate from 39% (25-34 yr olds) to 60% by 2020.
Lumina goal: 60% of Americans hold degrees by 2025 – estimate 25M new degrees more than we will at our current rate. Essentially, we need to increase rate of degree production by 5% annually.
College Board: By 2025, 55% proportion of 25-34 yr olds holding an associate degree or more.
AND we have the commitment and intent train rolling
Recently, 500 public colleges signed a commitment to help generate roughly 3.8 million more new degrees than we’re on track to produce if we continue the same productivity of 2011 – just over 1 million degrees last year.
How do harness this intent and focus to increase dramatically degree productivity???
College affordability / unaffordability
From 1992 – 2007 the average price of college has increased over 430%
Median family income has increased only 150%
(National Center for Public Policy in Higher Education)
Students as consumers: students are increasingly educated shoppers, interested in the student return on their investment (SROI) – how will this degree serve me (e.g. $, job, future relevance)?
Fan the flames of China-U.S. competition…
Some say China produced roughly 1.5 M science and math graduates from Chinese Universities (2006)
Scientific output in China (citations in scientific lit) predicted to surpass U.S. in 2013
Chinese R&D investment increased 20% per year since 1999
Academic Preparedness:
1) Academic knowledge and skills necessary to succeed in college-level courses
2) Key cognitive strategies necessary to succeed in college-level courses
Academic Tenacity:
1) Behaviors of active participation and perseverance through adversity
2) Beliefs, attitudes, and values that prioritize success in school and drive student engagement and work
College Knowledge:
1) Knowledge, skills, and behaviors apart from academic content that allow students to successfully access college
2) Knowledge, skills, and behaviors apart from academic content that allow students to succeed once in college
CONTEXTUAL FACTORS:
Educational Policy Context
Demographic Characteristics
Students’ Developmental Trajectories
The ActPoint KPI Performance Management System is an outgrowth of the
Council's Performance Measurement and Benchmarking Project, launched in 2004 that
pioneered the development of key performance indicators to gauge financial, information
technology, business services and human resource operations in big-city school districts.
University of Oregon – David Conley
Student engagement in their future
Course rigor
Tenacity (Angela Duckworth) and perserverence
Dual enrollment
Engagement
What is the formative assessment for student engagement? For college knowledge?
Focus: Affordability, Access, Value
$150B federal dollars to HE each year…
Forums: Consistent with Gallup – Young Invincibles: students rank finding a job and repaying loans as the two most important factors