SlideShare a Scribd company logo
1 of 46
Download to read offline
City Study
2022:
KANSAS CITY
Table of Contents
0 1 R E PORT OVE R VIE W
• About The City Studies Project
• Sectors of Schools
• Research Question and Analyses
• Measure of Academic Performance
Student Subgroup Analysis
Summary of Findings
0 3 APPE N DIX E S
• Acknowledgments
• Types of Charter Schools
• Methods
• Days of Learning
• Full Set of Findings
0 2 R E SE AR CH
F IN DIN G S
• Reading & Math
Overall Kansas City Results
Sector Analysis
• vs. state & comparison
within Kansas City
Charter Subsector Analysis
• Reading
• Math
School-Level Performance by Sector
Research Findings Cont’d.
Black Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
Hispanic Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
Students in Poverty
• all vs. state
• vs. state by sector &
comparison within Kansas City
ELL Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
Special Ed Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
Male Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
Female Students
• all vs. state
• vs. state by sector &
comparison within Kansas City
• Reading
• Math
REPORT OVERVIEW
01
About The City Studies Project
Cohort 1 Cohort 2
The City Studies project examines the performance of schools in select U.S. cities,
including Kansas City. We study the academic progress of students as the measure of
school performance.
O
O
C
C
C
CHARTER SCHOOLS
Public schools operated independently from the
traditional school district, with autonomy in adapting
school designs and held accountable for education
results.
Charter Management Organizations (CMOs)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
Independent Charter Schools
Organizations holding the charter and overseeing the
operation of a single or two charter schools.
SELECTIVE SIGNATURE SCHOOLS
District-run schools with focused themes and
academically selective admission.
OTHER DISTRICT-RUN SCHOOLS
Public schools not belonging to any of above two types.
C
Sectors of Schools
COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
Research Question and Analyses
IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN
KANSAS CITY USING DATA FROM THE SCHOOL YEARS 2015-16
THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS.
Overall performance in
Kansas City schools over
two years.
• The performance of Kansas City
students is benchmarked against the
state average performance,
accounting for student
characteristics.
• The performance of charter school
students and the performance of
signature school students within
Kansas City are then compared to
that of similar traditional public
school (district school) students
within Kansas City.
Performance for Kansas
City charter schools,
Kansas City signature
schools and the rest of
Kansas City Public
schools over two years.
Performance in the 2018-
2019 school year by
school type, race,
poverty status, English
language learner (ELL)
status, special
education status and
gender.
WE MAKE TWO SETS
OF COMPARISONS.
01 02 03
Achievement scores capture what a student knows at a point
in time. They are influenced by students’ prior conditions in
addition to schools’ contributions.
Growth scores indicate how much progress a student makes
from one year to the next. Growth scores allow us to zero in
on the contributions of schools separately from other factors
that affect point-in-time scores.
ACHIEVEMENT VS. GROWTH
We analyze student growth in standard deviation units so
that the results can be assessed for statistical differences.
The full set of findings appear in the Appendix.
In the following graphs of findings, we transform growth
from standard deviation units into days of learning based on
a typical 180-day school year.
IN THIS STUDY WE MEASURE
ACADEMIC PERFORMANCE AS HOW
MUCH GROWTH STUDENTS MAKE FROM
ONE YEAR TO THE NEXT.
Measure of Academic Performance
SPECIAL HANDING OF KANSAS CITY
GROWTH SCORES FOR 2017-18
For the period ending in Spring 2018, we use student test
scores from the 2015-16 school year as starting scores to
calculate student growth because the Missouri test score
data for 2016-17 are incomplete.
RESEARCH FINDINGS
02
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
significantly different at p< 0.05
reading math
Research Findings > Overall Kansas City Results
> Reading & Math
Average One-Year Learning Gains for All Kansas City
Students Compared to the State Average Learning
Gains, by Year and Subject
-50
-25
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Reading for Students in Kansas
City Charter Schools, Kansas City Signature Schools,
and Kansas City District Schools Compared to the
State Average Learning Gains, by Year
significantly different at p< 0.05
charter signature
Research Findings > Sector Analysis
> Reading
VS. STATE & COMPARISON WITHIN KANSAS CITY
charter signature district
Reading
Charter vs. District
Signature vs. District
Charter vs. Signature
'17-'18 '18-'19
Tests of Differences
-50
-25
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Math for Students in Kansas City
Charter Schools, Kansas City Signature Schools, and
Kansas City District Schools Compared to the State
Average Learning Gains, by Year
significantly different at p< 0.05
charter signature district
Research Findings > Sector Analysis
> Math
VS. STATE & COMPARISON WITHIN KANSAS CITY
Math
Charter vs. District
Signature vs. District
Charter vs. Signature
Tests of Differences
'17-'18 '18-'19
signature
0
25
50
75
100
125
150
CMO Charter Schools Independent Charter Schools
Growth
(in
Days
of
Learning)
Relative Learning Gains for Students in Kansas City
CMO-Affiliated Charter Schools and Independent
Kansas City Charter Schools Compared to the
Average Learning Gains for All Student in the State,
by Subject
significantly different at p< 0.05
reading math
Research Findings > Charter Subsector Analysis
> vs. state & comparison within Kansas City
Reading
CMOs vs Independent Charter Schools
Math
CMOs vs Independent Charter Schools
sig
Tests of Differences
-300 -200 -100 0 100 200 300
Growth (in Days of Learning)
Charter
District
Signature
Research Findings > School-Level Performance by Sector
> Reading
-300 -200 -100 0 100 200 300
Growth (in Days of Learning)
Charter
District
Signature
Research Findings > School-Level Performance by Sector
>Math
-50
-25
0
25
50
75
100
125
150
Kansas City Black Students
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Black Students
Compared to the Average Learning Gains of Black
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
Black Students
Kansas City Signature
Black Students
Kansas City District
Black Students
Growth
(in
Days
of
Learning)
Learning Gains for Black Students in Kansas City
Charter Schools, Black Students in Kansas City
Signature Schools, and Black Students in Kansas City
District Schools Compared to the Average Learning
Gains of Black Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Black vs. District Black
Signature Black vs. District Black
Math
Charter Black vs. District Black
Signature Black vs. District Black
Tests of Differences
sig
-50
-25
0
25
50
75
100
125
150
Kansas City Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Hispanic Students
Compared to the Average Learning Gains of Hispanic
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
Hispanic Students
Kansas City Signature
Hispanic Students
Kansas City District
Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for Hispanic Students in Kansas City
Charter Schools, Hispanic Students in Kansas City
Signature Schools, and Hispanic Students in Kansas City
District Schools Compared to the Average Learning Gains of
Hispanic Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Hispanic vs. District Hispanic
Signature Hispanic vs. District Hispanic
Math
Charter Hispanic vs. District Hispanic
Signature Hispanic vs. District Hispanic
Tests of Differences
sig
-50
-25
0
25
50
75
100
125
150
Kansas City Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Students in
Poverty Compared to the Average Learning Gains of
Students in Poverty Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
Students in Poverty
Kansas City Signature
Students in Poverty
Kansas City District
Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for Kansas City Charter School
Students in Poverty, Kansas City Signature School
Students in Poverty, and Kansas City District School
Students in Poverty Compared to the Average
Learning Gains of Students in Poverty Statewide, by
Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Poverty vs. District Poverty
Signature Poverty vs. District Poverty
Math
Charter Poverty vs. District Poverty
Signature Poverty vs. District Poverty
Tests of Differences
sig
-50
-25
0
25
50
75
100
125
150
Kansas City ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for All ELL Students in Kansas City
Compared to the Average Learning Gains of ELL
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
ELL Students
Kansas City Signature
ELL Students
Kansas City District
ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for ELL Students in Kansas City
Charter Schools, ELL Students in Kansas City
Signature Schools, and ELL Students in Kansas City
District Schools Compared to the Average Learning
Gains of ELL Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter ELL vs. District ELL
Signature ELL vs. District ELL
Math
Charter ELL vs. District ELL
Signature ELL vs. District ELL
Tests of Differences
sig
-60
-35
-10
15
40
65
90
115
140
Kansas City Special Ed Students
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Students in Special
Education Compared to the Average Learning Gains of
Students in Special Education Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
ALL VS. STATE
-60
-35
-10
15
40
65
90
115
140
Kansas City Charter
Students in Special Ed.
Kansas City Signature
Students in Special Ed.
Kansas City District
Students in Special Ed.
Growth
(in
Days
of
Learning)
Learning Gains for Kansas City Charter School
Students in Special Ed., Kansas City Signature School
Students in Special Ed., and Kansas City District
School Students in Special Ed. Compared to the
Average Learning Gains of Students in Special Ed.
Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Sped vs. District Sped
Signature Sped vs. District Sped
Math
Charter Sped vs. District Sped
Signature Sped vs. District Sped
Tests of Differences
sig
-50
-25
0
25
50
75
100
125
150
Kansas City Male Students
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Male Students
Compared to the Average Learning Gains of Male
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
Male Students
Kansas City Signature
Male Students
Kansas City District
Male Students
Growth
(in
Days
of
Learning)
Learning Gains for Male Students in Kansas City
Charter Schools, Male Students in Kansas City
Signature Schools, and Male Students in Kansas City
District Schools Compared to the Average Learning
Gains of Male Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Male vs. District Male
Magnet Male vs. District Male
Math
Charter Male vs. District Male
Magnet Male vs. District Male
Tests of Differences
sig
Reading
Charter Male vs. District Male
Signature Male vs. District Male
Math
Charter Male vs. District Male
Signature Male vs. District Male
Tests of Differences
sig
-50
-25
0
25
50
75
100
125
150
Kansas City Female Students
Growth
(in
Days
of
Learning)
Learning Gains for All Kansas City Female Students
Compared to the Average Learning Gains of Female
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
ALL VS. STATE
-50
-25
0
25
50
75
100
125
150
Kansas City Charter
Female Students
Kansas City Signature
Female Students
Kansas City District
Female Students
Growth
(in
Days
of
Learning)
Learning Gains for Female Students in Kansas City Charter
Schools, Female Students in Kansas City Signature
Schools, and Female Students in Kansas City District
Schools Compared to the Average Learning Gains of Female
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY
Reading
Charter Female vs. District Female
Signature Female vs. District Female
Math
Charter Female vs. District Female
Signature Female vs. District Female
Tests of Differences
sig
Summary of Findings
The summary of the findings from the analysis of Kansas City schools is presented here.
APPENDIXES
03
Acknowledgments
Student-level data were
provided by the
Missouri Department of
Elementary & Secondary
Education.
School Smart Kansas City assisted
CREDO with verifying the list of public
schools in Kansas City.
Types of Charter Schools
• With more schools and students than a single charter
school, CMOs have some operational advantages in their
ability to spread administrative fixed costs, thus
providing the possibility of greater efficiency. In
addition, CMOs may be able to support additional
programs and more robust staffing.
• Whether CMOs lead to better student outcomes is a
matter of interest across the country.
OUR ANALYSES OF KANSAS CITY
CHARTER SCHOOLS INCLUDE A
BREAKOUT OF CMOS AND
INDEPENDENT CHARTERS.
There are two types
of charter schools.
CHARTER MANAGEMENT ORGANIZATIONS (CMOS)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
INDEPENDENT CHARTER SCHOOLS
Organization holding the charter and overseeing the
operation of a single charter school. It may run the school
directly or contract with an organization which provides
services to one or two charter schools.
Methods
The annual academic growth of students in Kansas City from
2015-16 to 2018-19, overall and by sector, is benchmarked to
the state average growth, accounting for student
characteristics.
We also explore how one-year growth of Kansas City
students for the period ending in Spring 2019 differs by
school type, race, poverty status, English language learner
status, special education status, and gender.
Days of Learning
While these tools create precise and reliable answers,
they are presented in technical terms that are not
user-friendly to a general audience. To translate the
technical results into terms that are accessible to non-
technical audiences, CREDO developed Days of
Learning.
CREDO USES ADVANCED
TECHNOLOGY AND
SOPHISTICATED STATISTICAL
TOOLS TO MEASURE STUDENTS,
SCHOOLS AND THE EDUCATION
LANDSCAPE.
Think about the students in your state’s public schools. For many of their years
of schooling, they take achievement tests to measure what they know at the end of
the school year. We can identify the average score for each test each year.
Imagine a student who scores exactly at the average in one year, say 4th
grade, and then in the following year, scores exactly at the average again on the 5th-
grade test. The amount of year-to-year learning for that student show us what the
average learning is for all the students who took both tests.
We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th,
and so on.
CREDO uses those annual measures of average learning to represent a typical
year of learning, and equates that to a typical 180-day school year. We say that the
student in our example has gained 180 days of learning.
If a student makes more progress than the average student, we take the
amount of extra achievement and translate it into 180-days of learning plus “X” extra
days. We are creating a measure of student learning as if the student went to school
for 180 days plus X days. The size of “X” depends on how much more the student
learns than the average student — if it’s a lot more, then “X” will be a large number,
and if it’s a small amount more, “X” will be a small number.
The same is true for students who do not learn as much as the average
student. Instead of adding to the 180-days-of-learning average, we subtract from
that base to reflect the smaller-than-average advances that those students realize. In
these cases, the difference leads to numbers such a “165 days of learning” or “152
days of learning”. Against the average standard of 180 days, these smaller days show
that students learned as if they had only attended school for 180 days minus X days
during the school year.
01
02
03
04
05
06
3rd
Grade
4th
Grade
= 180
days
More than 180
days
Less than 180
days
Student
A
Student
A
Overall Kansas City Results
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
K a n s a s C i t y O v e r a l l 2 0 1 7 - 1 8 0.05 28 0.09 50
K a n s a s C i t y O v e r a l l 2 0 1 8 - 1 9 0.03 17 0.07 41
Kansas City School Sectors Compared
to State Average
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.08** 45** 0.15** 87**
C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.08** 48** 0.15** 87**
S i g n a t u r e S c h o o l s 2 0 1 7 - 1 8 0.14* 82* 0.09 53
S i g n a t u r e S c h o o l s 2 0 1 8 - 1 9 0.09 50 0.03 16
O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 -0.03 -19 -0.01 -5
O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 -0.06 -34 -0.02 -15
Comparison of School Sectors within Kansas City
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.11* 63* 0.16* 92*
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.14 82 0.17* 101*
S i g n a t u r e S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.17* 100* 0.10* 57*
S i g n a t u r e S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.14 83 0.05 30
Charter Subsector Analysis
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
K a n s a s C i t y C M O s v s . S t a t e A v e r a g e 0.05* 27* 0.10 59
K a n s a s C i t y I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e 0.12** 72** 0.20 118
K a n s a s C i t y C M O s v s . K a n s a s C i t y I n d e p e n d e n t
C h a r t e r s
-0.08 -45 -0.10 -59
Student Subgroup Analysis> Black Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Black Students
K a n s a s C i t y B l a c k S t u d e n t s O v e r a l l 0.04 24 0.09 52
K a n s a s C i t y C h a r t e r S c h o o l B l a c k S t u d e n t s 0.10** 60** 0.17 100
K a n s a s C i t y S i g n a t u r e S c h o o l B l a c k S t u d e n t s 0.06 33 -0.01 -3
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.05 -29 -0.01 -4
Compared with Black Students in Other District Schools in
Kansas City
K a n s a s C i t y C h a r t e r S c h o o l B l a c k S t u d e n t s 0.15* 89* 0.18 104
K a n s a s C i t y S i g n a t u r e S c h o o l B l a c k S t u d e n t s 0.11 61 0.00 0
Student Subgroup Analysis> Hispanic Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Hispanic Students
K a n s a s C i t y H i s p a n i c S t u d e n t s O v e r a l l 0.01 8 0.04 24
K a n s a s C i t y C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.05 27 0.12* 67*
K a n s a s C i t y S i g n a t u r e S c h o o l H i s p a n i c S t u d e n t s 0.10** 57** 0.02 10
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s -0.07 -39 -0.05 -31
Compared with Hispanic Students in Other District Schools
in Kansas City
K a n s a s C i t y C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.11 66 0.17 98
K a n s a s C i t y S i g n a t u r e S c h o o l H i s p a n i c S t u d e n t s 0.16* 96* 0.07 40
Student Subgroup Analysis> Students in Poverty
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Students in Poverty
K a n s a s C i t y S t u d e n t s i n P o v e r t y O v e r a l l 0.03 16 0.07 42
K a n s a s C i t y C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.08** 49** 0.16* 94*
K a n s a s C i t y S i g n a t u r e S c h o o l S t u d e n t s i n P o v e r t y 0.09 50 0.03 16
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y -0.06 -34 -0.02 -15
Compared with Students in Poverty in Other District
Schools in Kansas City
K a n s a s C i t y C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.14* 83* 0.18* 108*
K a n s a s C i t y S i g n a t u r e S c h o o l S t u d e n t s i n P o v e r t y 0.14* 84* 0.05 30
Student Subgroup Analysis> ELL Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of ELL Students
K a n s a s C i t y E L L S t u d e n t s O v e r a l l -0.02 -14 0.01 8
K a n s a s C i t y C h a r t e r S c h o o l E L L S t u d e n t s 0.03 18 0.09* 52*
K a n s a s C i t y S i g n a t u r e S c h o o l E L L S t u d e n t s 0.05 31 0.05 28
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s -0.09 -55 -0.07 -39
Compared with ELL Students in Other District Schools in
Kansas City
K a n s a s C i t y C h a r t e r S c h o o l E L L S t u d e n t s 0.12 73 0.16 91
K a n s a s C i t y S i g n a t u r e S c h o o l E L L S t u d e n t s 0.15* 86* 0.12 67
Student Subgroup Analysis> Special Ed Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Special Ed Students
K a n s a s C i t y S p e c i a l E d S t u d e n t s O v e r a l l 0.03 14 0.05 30
K a n s a s C i t y C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.10** 56** 0.19* 110*
K a n s a s C i t y S i g n a t u r e S c h o o l S p e c i a l E d S t u d e n t s 0.02 12 0.07 40
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s -0.03 -21 -0.07 -40
Compared with Special Ed Students in Other District
Schools in Kansas City
K a n s a s C i t y C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.13* 76* 0.26** 150**
K a n s a s C i t y S i g n a t u r e S c h o o l S p e c i a l E d S t u d e n t s 0.06 33 0.14 80
Student Subgroup Analysis> Male Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Male Students
K a n s a s C i t y M a l e S t u d e n t s O v e r a l l 0.05 27 0.07 38
K a n s a s C i t y C h a r t e r S c h o o l M a l e S t u d e n t s 0.11** 61** 0.13 76
K a n s a s C i t y S i g n a t u r e S c h o o l M a l e S t u d e n t s 0.11* 65* 0.08 44
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s -0.04 -25 -0.02 -11
Compared with Male Students in Other District Schools in
Kansas City
K a n s a s C i t y C h a r t e r S c h o o l M a l e S t u d e n t s 0.15* 86* 0.15 86
K a n s a s C i t y S i g n a t u r e S c h o o l M a l e S t u d e n t s 0.15* 90* 0.09 54
Student Subgroup Analysis> Female Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Female Students
K a n s a s C i t y F e m a l e S t u d e n t s O v e r a l l 0.01 8 0.08 44
K a n s a s C i t y C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.06 35 0.17* 97*
K a n s a s C i t y S i g n a t u r e S c h o o l F e m a l e S t u d e n t s 0.07 38 -0.01 -6
K a n s a s C i t y O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s -0.08 -45 -0.03 -20
Compared with Female Students in Other District Schools
in Kansas City
K a n s a s C i t y C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.14* 79* 0.20* 117*
K a n s a s C i t y S i g n a t u r e S c h o o l F e m a l e S t u d e n t s 0.14* 82* 0.02 13
THANK YOU

More Related Content

Similar to Kansas_City_slide_deck_FINAL.pdf

Similar to Kansas_City_slide_deck_FINAL.pdf (20)

St_Louis_slide_deck_FINAL.pdf
St_Louis_slide_deck_FINAL.pdfSt_Louis_slide_deck_FINAL.pdf
St_Louis_slide_deck_FINAL.pdf
 
New Orleans
New OrleansNew Orleans
New Orleans
 
Houston slide deck
Houston slide deckHouston slide deck
Houston slide deck
 
batonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdfbatonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdf
 
2022 Newark Chart School City Study
2022 Newark Chart School City Study2022 Newark Chart School City Study
2022 Newark Chart School City Study
 
Denver, CO 2022 - City Study
Denver, CO 2022 - City StudyDenver, CO 2022 - City Study
Denver, CO 2022 - City Study
 
Fort Worth, TX 2021
Fort Worth, TX 2021Fort Worth, TX 2021
Fort Worth, TX 2021
 
2022 Houston Chart School City Study
2022 Houston Chart School City Study2022 Houston Chart School City Study
2022 Houston Chart School City Study
 
memphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdfmemphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdf
 
2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study
 
Kansas City, MO 2019 - City Study
Kansas City, MO 2019 - City StudyKansas City, MO 2019 - City Study
Kansas City, MO 2019 - City Study
 
Washington DC 2019 - City Study
Washington DC 2019 - City StudyWashington DC 2019 - City Study
Washington DC 2019 - City Study
 
Camden NJ 2019 - City Study
Camden NJ 2019 - City StudyCamden NJ 2019 - City Study
Camden NJ 2019 - City Study
 
St. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City StudySt. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City Study
 
San Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City StudySan Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City Study
 
Baton Rouge LA 2019 - City Study
Baton Rouge LA 2019 - City StudyBaton Rouge LA 2019 - City Study
Baton Rouge LA 2019 - City Study
 
Denver 2019 - City Study
Denver 2019 - City StudyDenver 2019 - City Study
Denver 2019 - City Study
 
Indianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City StudyIndianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City Study
 
2010 MCAS Results for Franklin, MA
2010 MCAS Results for Franklin, MA2010 MCAS Results for Franklin, MA
2010 MCAS Results for Franklin, MA
 
Memphis, TN 2019 - City Study
Memphis, TN 2019 - City StudyMemphis, TN 2019 - City Study
Memphis, TN 2019 - City Study
 

Recently uploaded

Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
EADTU
 
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
中 央社
 
SURVEY I created for uni project research
SURVEY I created for uni project researchSURVEY I created for uni project research
SURVEY I created for uni project research
CaitlinCummins3
 

Recently uploaded (20)

PSYPACT- Practicing Over State Lines May 2024.pptx
PSYPACT- Practicing Over State Lines May 2024.pptxPSYPACT- Practicing Over State Lines May 2024.pptx
PSYPACT- Practicing Over State Lines May 2024.pptx
 
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of TransportBasic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
 
UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024
 
male presentation...pdf.................
male presentation...pdf.................male presentation...pdf.................
male presentation...pdf.................
 
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdfFICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
 
How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17
 
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading RoomSternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
 
Đề tieng anh thpt 2024 danh cho cac ban hoc sinh
Đề tieng anh thpt 2024 danh cho cac ban hoc sinhĐề tieng anh thpt 2024 danh cho cac ban hoc sinh
Đề tieng anh thpt 2024 danh cho cac ban hoc sinh
 
ANTI PARKISON DRUGS.pptx
ANTI         PARKISON          DRUGS.pptxANTI         PARKISON          DRUGS.pptx
ANTI PARKISON DRUGS.pptx
 
e-Sealing at EADTU by Kamakshi Rajagopal
e-Sealing at EADTU by Kamakshi Rajagopale-Sealing at EADTU by Kamakshi Rajagopal
e-Sealing at EADTU by Kamakshi Rajagopal
 
Including Mental Health Support in Project Delivery, 14 May.pdf
Including Mental Health Support in Project Delivery, 14 May.pdfIncluding Mental Health Support in Project Delivery, 14 May.pdf
Including Mental Health Support in Project Delivery, 14 May.pdf
 
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
 
Book Review of Run For Your Life Powerpoint
Book Review of Run For Your Life PowerpointBook Review of Run For Your Life Powerpoint
Book Review of Run For Your Life Powerpoint
 
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
 
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjjStl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
 
How to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptxHow to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptx
 
Graduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptxGraduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptx
 
SURVEY I created for uni project research
SURVEY I created for uni project researchSURVEY I created for uni project research
SURVEY I created for uni project research
 
OS-operating systems- ch05 (CPU Scheduling) ...
OS-operating systems- ch05 (CPU Scheduling) ...OS-operating systems- ch05 (CPU Scheduling) ...
OS-operating systems- ch05 (CPU Scheduling) ...
 
Spring gala 2024 photo slideshow - Celebrating School-Community Partnerships
Spring gala 2024 photo slideshow - Celebrating School-Community PartnershipsSpring gala 2024 photo slideshow - Celebrating School-Community Partnerships
Spring gala 2024 photo slideshow - Celebrating School-Community Partnerships
 

Kansas_City_slide_deck_FINAL.pdf

  • 2. Table of Contents 0 1 R E PORT OVE R VIE W • About The City Studies Project • Sectors of Schools • Research Question and Analyses • Measure of Academic Performance Student Subgroup Analysis Summary of Findings 0 3 APPE N DIX E S • Acknowledgments • Types of Charter Schools • Methods • Days of Learning • Full Set of Findings 0 2 R E SE AR CH F IN DIN G S • Reading & Math Overall Kansas City Results Sector Analysis • vs. state & comparison within Kansas City Charter Subsector Analysis • Reading • Math School-Level Performance by Sector Research Findings Cont’d. Black Students • all vs. state • vs. state by sector & comparison within Kansas City Hispanic Students • all vs. state • vs. state by sector & comparison within Kansas City Students in Poverty • all vs. state • vs. state by sector & comparison within Kansas City ELL Students • all vs. state • vs. state by sector & comparison within Kansas City Special Ed Students • all vs. state • vs. state by sector & comparison within Kansas City Male Students • all vs. state • vs. state by sector & comparison within Kansas City Female Students • all vs. state • vs. state by sector & comparison within Kansas City • Reading • Math
  • 4. About The City Studies Project Cohort 1 Cohort 2 The City Studies project examines the performance of schools in select U.S. cities, including Kansas City. We study the academic progress of students as the measure of school performance.
  • 5. O O C C C CHARTER SCHOOLS Public schools operated independently from the traditional school district, with autonomy in adapting school designs and held accountable for education results. Charter Management Organizations (CMOs) Organizations holding the charter and overseeing the operation of at least three charter schools. Independent Charter Schools Organizations holding the charter and overseeing the operation of a single or two charter schools. SELECTIVE SIGNATURE SCHOOLS District-run schools with focused themes and academically selective admission. OTHER DISTRICT-RUN SCHOOLS Public schools not belonging to any of above two types. C Sectors of Schools COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
  • 6. Research Question and Analyses IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN KANSAS CITY USING DATA FROM THE SCHOOL YEARS 2015-16 THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS. Overall performance in Kansas City schools over two years. • The performance of Kansas City students is benchmarked against the state average performance, accounting for student characteristics. • The performance of charter school students and the performance of signature school students within Kansas City are then compared to that of similar traditional public school (district school) students within Kansas City. Performance for Kansas City charter schools, Kansas City signature schools and the rest of Kansas City Public schools over two years. Performance in the 2018- 2019 school year by school type, race, poverty status, English language learner (ELL) status, special education status and gender. WE MAKE TWO SETS OF COMPARISONS. 01 02 03
  • 7. Achievement scores capture what a student knows at a point in time. They are influenced by students’ prior conditions in addition to schools’ contributions. Growth scores indicate how much progress a student makes from one year to the next. Growth scores allow us to zero in on the contributions of schools separately from other factors that affect point-in-time scores. ACHIEVEMENT VS. GROWTH We analyze student growth in standard deviation units so that the results can be assessed for statistical differences. The full set of findings appear in the Appendix. In the following graphs of findings, we transform growth from standard deviation units into days of learning based on a typical 180-day school year. IN THIS STUDY WE MEASURE ACADEMIC PERFORMANCE AS HOW MUCH GROWTH STUDENTS MAKE FROM ONE YEAR TO THE NEXT. Measure of Academic Performance SPECIAL HANDING OF KANSAS CITY GROWTH SCORES FOR 2017-18 For the period ending in Spring 2018, we use student test scores from the 2015-16 school year as starting scores to calculate student growth because the Missouri test score data for 2016-17 are incomplete.
  • 9. 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) significantly different at p< 0.05 reading math Research Findings > Overall Kansas City Results > Reading & Math Average One-Year Learning Gains for All Kansas City Students Compared to the State Average Learning Gains, by Year and Subject
  • 10. -50 -25 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Reading for Students in Kansas City Charter Schools, Kansas City Signature Schools, and Kansas City District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter signature Research Findings > Sector Analysis > Reading VS. STATE & COMPARISON WITHIN KANSAS CITY charter signature district Reading Charter vs. District Signature vs. District Charter vs. Signature '17-'18 '18-'19 Tests of Differences
  • 11. -50 -25 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Math for Students in Kansas City Charter Schools, Kansas City Signature Schools, and Kansas City District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter signature district Research Findings > Sector Analysis > Math VS. STATE & COMPARISON WITHIN KANSAS CITY Math Charter vs. District Signature vs. District Charter vs. Signature Tests of Differences '17-'18 '18-'19 signature
  • 12. 0 25 50 75 100 125 150 CMO Charter Schools Independent Charter Schools Growth (in Days of Learning) Relative Learning Gains for Students in Kansas City CMO-Affiliated Charter Schools and Independent Kansas City Charter Schools Compared to the Average Learning Gains for All Student in the State, by Subject significantly different at p< 0.05 reading math Research Findings > Charter Subsector Analysis > vs. state & comparison within Kansas City Reading CMOs vs Independent Charter Schools Math CMOs vs Independent Charter Schools sig Tests of Differences
  • 13. -300 -200 -100 0 100 200 300 Growth (in Days of Learning) Charter District Signature Research Findings > School-Level Performance by Sector > Reading
  • 14. -300 -200 -100 0 100 200 300 Growth (in Days of Learning) Charter District Signature Research Findings > School-Level Performance by Sector >Math
  • 15. -50 -25 0 25 50 75 100 125 150 Kansas City Black Students Growth (in Days of Learning) Learning Gains for All Kansas City Black Students Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students ALL VS. STATE
  • 16. -50 -25 0 25 50 75 100 125 150 Kansas City Charter Black Students Kansas City Signature Black Students Kansas City District Black Students Growth (in Days of Learning) Learning Gains for Black Students in Kansas City Charter Schools, Black Students in Kansas City Signature Schools, and Black Students in Kansas City District Schools Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Black vs. District Black Signature Black vs. District Black Math Charter Black vs. District Black Signature Black vs. District Black Tests of Differences sig
  • 17. -50 -25 0 25 50 75 100 125 150 Kansas City Hispanic Students Growth (in Days of Learning) Learning Gains for All Kansas City Hispanic Students Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students ALL VS. STATE
  • 18. -50 -25 0 25 50 75 100 125 150 Kansas City Charter Hispanic Students Kansas City Signature Hispanic Students Kansas City District Hispanic Students Growth (in Days of Learning) Learning Gains for Hispanic Students in Kansas City Charter Schools, Hispanic Students in Kansas City Signature Schools, and Hispanic Students in Kansas City District Schools Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Hispanic vs. District Hispanic Signature Hispanic vs. District Hispanic Math Charter Hispanic vs. District Hispanic Signature Hispanic vs. District Hispanic Tests of Differences sig
  • 19. -50 -25 0 25 50 75 100 125 150 Kansas City Students in Poverty Growth (in Days of Learning) Learning Gains for All Kansas City Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty ALL VS. STATE
  • 20. -50 -25 0 25 50 75 100 125 150 Kansas City Charter Students in Poverty Kansas City Signature Students in Poverty Kansas City District Students in Poverty Growth (in Days of Learning) Learning Gains for Kansas City Charter School Students in Poverty, Kansas City Signature School Students in Poverty, and Kansas City District School Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Poverty vs. District Poverty Signature Poverty vs. District Poverty Math Charter Poverty vs. District Poverty Signature Poverty vs. District Poverty Tests of Differences sig
  • 21. -50 -25 0 25 50 75 100 125 150 Kansas City ELL Students Growth (in Days of Learning) Learning Gains for All ELL Students in Kansas City Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students ALL VS. STATE
  • 22. -50 -25 0 25 50 75 100 125 150 Kansas City Charter ELL Students Kansas City Signature ELL Students Kansas City District ELL Students Growth (in Days of Learning) Learning Gains for ELL Students in Kansas City Charter Schools, ELL Students in Kansas City Signature Schools, and ELL Students in Kansas City District Schools Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter ELL vs. District ELL Signature ELL vs. District ELL Math Charter ELL vs. District ELL Signature ELL vs. District ELL Tests of Differences sig
  • 23. -60 -35 -10 15 40 65 90 115 140 Kansas City Special Ed Students Growth (in Days of Learning) Learning Gains for All Kansas City Students in Special Education Compared to the Average Learning Gains of Students in Special Education Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students ALL VS. STATE
  • 24. -60 -35 -10 15 40 65 90 115 140 Kansas City Charter Students in Special Ed. Kansas City Signature Students in Special Ed. Kansas City District Students in Special Ed. Growth (in Days of Learning) Learning Gains for Kansas City Charter School Students in Special Ed., Kansas City Signature School Students in Special Ed., and Kansas City District School Students in Special Ed. Compared to the Average Learning Gains of Students in Special Ed. Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Sped vs. District Sped Signature Sped vs. District Sped Math Charter Sped vs. District Sped Signature Sped vs. District Sped Tests of Differences sig
  • 25. -50 -25 0 25 50 75 100 125 150 Kansas City Male Students Growth (in Days of Learning) Learning Gains for All Kansas City Male Students Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students ALL VS. STATE
  • 26. -50 -25 0 25 50 75 100 125 150 Kansas City Charter Male Students Kansas City Signature Male Students Kansas City District Male Students Growth (in Days of Learning) Learning Gains for Male Students in Kansas City Charter Schools, Male Students in Kansas City Signature Schools, and Male Students in Kansas City District Schools Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Male vs. District Male Magnet Male vs. District Male Math Charter Male vs. District Male Magnet Male vs. District Male Tests of Differences sig Reading Charter Male vs. District Male Signature Male vs. District Male Math Charter Male vs. District Male Signature Male vs. District Male Tests of Differences sig
  • 27. -50 -25 0 25 50 75 100 125 150 Kansas City Female Students Growth (in Days of Learning) Learning Gains for All Kansas City Female Students Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students ALL VS. STATE
  • 28. -50 -25 0 25 50 75 100 125 150 Kansas City Charter Female Students Kansas City Signature Female Students Kansas City District Female Students Growth (in Days of Learning) Learning Gains for Female Students in Kansas City Charter Schools, Female Students in Kansas City Signature Schools, and Female Students in Kansas City District Schools Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students VS. STATE BY SECTOR & COMPARISON WITHIN KANSAS CITY Reading Charter Female vs. District Female Signature Female vs. District Female Math Charter Female vs. District Female Signature Female vs. District Female Tests of Differences sig
  • 29. Summary of Findings The summary of the findings from the analysis of Kansas City schools is presented here.
  • 31. Acknowledgments Student-level data were provided by the Missouri Department of Elementary & Secondary Education. School Smart Kansas City assisted CREDO with verifying the list of public schools in Kansas City.
  • 32. Types of Charter Schools • With more schools and students than a single charter school, CMOs have some operational advantages in their ability to spread administrative fixed costs, thus providing the possibility of greater efficiency. In addition, CMOs may be able to support additional programs and more robust staffing. • Whether CMOs lead to better student outcomes is a matter of interest across the country. OUR ANALYSES OF KANSAS CITY CHARTER SCHOOLS INCLUDE A BREAKOUT OF CMOS AND INDEPENDENT CHARTERS. There are two types of charter schools. CHARTER MANAGEMENT ORGANIZATIONS (CMOS) Organizations holding the charter and overseeing the operation of at least three charter schools. INDEPENDENT CHARTER SCHOOLS Organization holding the charter and overseeing the operation of a single charter school. It may run the school directly or contract with an organization which provides services to one or two charter schools.
  • 33. Methods The annual academic growth of students in Kansas City from 2015-16 to 2018-19, overall and by sector, is benchmarked to the state average growth, accounting for student characteristics. We also explore how one-year growth of Kansas City students for the period ending in Spring 2019 differs by school type, race, poverty status, English language learner status, special education status, and gender.
  • 34. Days of Learning While these tools create precise and reliable answers, they are presented in technical terms that are not user-friendly to a general audience. To translate the technical results into terms that are accessible to non- technical audiences, CREDO developed Days of Learning. CREDO USES ADVANCED TECHNOLOGY AND SOPHISTICATED STATISTICAL TOOLS TO MEASURE STUDENTS, SCHOOLS AND THE EDUCATION LANDSCAPE. Think about the students in your state’s public schools. For many of their years of schooling, they take achievement tests to measure what they know at the end of the school year. We can identify the average score for each test each year. Imagine a student who scores exactly at the average in one year, say 4th grade, and then in the following year, scores exactly at the average again on the 5th- grade test. The amount of year-to-year learning for that student show us what the average learning is for all the students who took both tests. We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th, and so on. CREDO uses those annual measures of average learning to represent a typical year of learning, and equates that to a typical 180-day school year. We say that the student in our example has gained 180 days of learning. If a student makes more progress than the average student, we take the amount of extra achievement and translate it into 180-days of learning plus “X” extra days. We are creating a measure of student learning as if the student went to school for 180 days plus X days. The size of “X” depends on how much more the student learns than the average student — if it’s a lot more, then “X” will be a large number, and if it’s a small amount more, “X” will be a small number. The same is true for students who do not learn as much as the average student. Instead of adding to the 180-days-of-learning average, we subtract from that base to reflect the smaller-than-average advances that those students realize. In these cases, the difference leads to numbers such a “165 days of learning” or “152 days of learning”. Against the average standard of 180 days, these smaller days show that students learned as if they had only attended school for 180 days minus X days during the school year. 01 02 03 04 05 06 3rd Grade 4th Grade = 180 days More than 180 days Less than 180 days Student A Student A
  • 35. Overall Kansas City Results Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g K a n s a s C i t y O v e r a l l 2 0 1 7 - 1 8 0.05 28 0.09 50 K a n s a s C i t y O v e r a l l 2 0 1 8 - 1 9 0.03 17 0.07 41
  • 36. Kansas City School Sectors Compared to State Average Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.08** 45** 0.15** 87** C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.08** 48** 0.15** 87** S i g n a t u r e S c h o o l s 2 0 1 7 - 1 8 0.14* 82* 0.09 53 S i g n a t u r e S c h o o l s 2 0 1 8 - 1 9 0.09 50 0.03 16 O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 -0.03 -19 -0.01 -5 O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 -0.06 -34 -0.02 -15
  • 37. Comparison of School Sectors within Kansas City Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.11* 63* 0.16* 92* C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.14 82 0.17* 101* S i g n a t u r e S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.17* 100* 0.10* 57* S i g n a t u r e S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.14 83 0.05 30
  • 38. Charter Subsector Analysis Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g K a n s a s C i t y C M O s v s . S t a t e A v e r a g e 0.05* 27* 0.10 59 K a n s a s C i t y I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e 0.12** 72** 0.20 118 K a n s a s C i t y C M O s v s . K a n s a s C i t y I n d e p e n d e n t C h a r t e r s -0.08 -45 -0.10 -59
  • 39. Student Subgroup Analysis> Black Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Black Students K a n s a s C i t y B l a c k S t u d e n t s O v e r a l l 0.04 24 0.09 52 K a n s a s C i t y C h a r t e r S c h o o l B l a c k S t u d e n t s 0.10** 60** 0.17 100 K a n s a s C i t y S i g n a t u r e S c h o o l B l a c k S t u d e n t s 0.06 33 -0.01 -3 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.05 -29 -0.01 -4 Compared with Black Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l B l a c k S t u d e n t s 0.15* 89* 0.18 104 K a n s a s C i t y S i g n a t u r e S c h o o l B l a c k S t u d e n t s 0.11 61 0.00 0
  • 40. Student Subgroup Analysis> Hispanic Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Hispanic Students K a n s a s C i t y H i s p a n i c S t u d e n t s O v e r a l l 0.01 8 0.04 24 K a n s a s C i t y C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.05 27 0.12* 67* K a n s a s C i t y S i g n a t u r e S c h o o l H i s p a n i c S t u d e n t s 0.10** 57** 0.02 10 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s -0.07 -39 -0.05 -31 Compared with Hispanic Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.11 66 0.17 98 K a n s a s C i t y S i g n a t u r e S c h o o l H i s p a n i c S t u d e n t s 0.16* 96* 0.07 40
  • 41. Student Subgroup Analysis> Students in Poverty Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Students in Poverty K a n s a s C i t y S t u d e n t s i n P o v e r t y O v e r a l l 0.03 16 0.07 42 K a n s a s C i t y C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.08** 49** 0.16* 94* K a n s a s C i t y S i g n a t u r e S c h o o l S t u d e n t s i n P o v e r t y 0.09 50 0.03 16 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y -0.06 -34 -0.02 -15 Compared with Students in Poverty in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.14* 83* 0.18* 108* K a n s a s C i t y S i g n a t u r e S c h o o l S t u d e n t s i n P o v e r t y 0.14* 84* 0.05 30
  • 42. Student Subgroup Analysis> ELL Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of ELL Students K a n s a s C i t y E L L S t u d e n t s O v e r a l l -0.02 -14 0.01 8 K a n s a s C i t y C h a r t e r S c h o o l E L L S t u d e n t s 0.03 18 0.09* 52* K a n s a s C i t y S i g n a t u r e S c h o o l E L L S t u d e n t s 0.05 31 0.05 28 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s -0.09 -55 -0.07 -39 Compared with ELL Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l E L L S t u d e n t s 0.12 73 0.16 91 K a n s a s C i t y S i g n a t u r e S c h o o l E L L S t u d e n t s 0.15* 86* 0.12 67
  • 43. Student Subgroup Analysis> Special Ed Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Special Ed Students K a n s a s C i t y S p e c i a l E d S t u d e n t s O v e r a l l 0.03 14 0.05 30 K a n s a s C i t y C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.10** 56** 0.19* 110* K a n s a s C i t y S i g n a t u r e S c h o o l S p e c i a l E d S t u d e n t s 0.02 12 0.07 40 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s -0.03 -21 -0.07 -40 Compared with Special Ed Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.13* 76* 0.26** 150** K a n s a s C i t y S i g n a t u r e S c h o o l S p e c i a l E d S t u d e n t s 0.06 33 0.14 80
  • 44. Student Subgroup Analysis> Male Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Male Students K a n s a s C i t y M a l e S t u d e n t s O v e r a l l 0.05 27 0.07 38 K a n s a s C i t y C h a r t e r S c h o o l M a l e S t u d e n t s 0.11** 61** 0.13 76 K a n s a s C i t y S i g n a t u r e S c h o o l M a l e S t u d e n t s 0.11* 65* 0.08 44 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s -0.04 -25 -0.02 -11 Compared with Male Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l M a l e S t u d e n t s 0.15* 86* 0.15 86 K a n s a s C i t y S i g n a t u r e S c h o o l M a l e S t u d e n t s 0.15* 90* 0.09 54
  • 45. Student Subgroup Analysis> Female Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Female Students K a n s a s C i t y F e m a l e S t u d e n t s O v e r a l l 0.01 8 0.08 44 K a n s a s C i t y C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.06 35 0.17* 97* K a n s a s C i t y S i g n a t u r e S c h o o l F e m a l e S t u d e n t s 0.07 38 -0.01 -6 K a n s a s C i t y O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s -0.08 -45 -0.03 -20 Compared with Female Students in Other District Schools in Kansas City K a n s a s C i t y C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.14* 79* 0.20* 117* K a n s a s C i t y S i g n a t u r e S c h o o l F e m a l e S t u d e n t s 0.14* 82* 0.02 13