SlideShare a Scribd company logo
1 of 46
Download to read offline
City Study
2022:
INDIANAPOLIS
Table of Contents
0 1 R E PORT OVE R VIE W
• About The City Studies Project
• Sectors of Schools
• Research Question and Analyses
• Measure of Academic Performance
Student Subgroup Analysis
Summary of Findings
0 3 APPE N DIX E S
• Acknowledgments
• Types of Charter Schools
• Innovation Schools in Indianapolis
• Methods
• Days of Learning
• Full Set of Findings
0 2 R E SE AR CH
F IN DIN G S
• Reading & Math
Overall Indianapolis Results
Sector Analysis
• vs. state & comparison
within Indianapolis
Charter Subsector Analysis
• Reading
• Math
School-Level Performance by Sector
Research Findings Cont’d.
Black Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
Hispanic Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
Students in Poverty
• all vs. state
• vs. state by sector &
comparison within Indianapolis
ELL Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
Special Ed Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
Male Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
Female Students
• all vs. state
• vs. state by sector &
comparison within Indianapolis
• Reading
• Math
REPORT OVERVIEW
01
About The City Studies Project
Cohort 1 Cohort 2
The City Studies project examines the performance of schools in select U.S. cities,
including Indianapolis. We study the academic progress of students as the measure of
school performance.
O
O
C
C
C
CHARTER SCHOOLS
Public schools operated independently from the
traditional school district, with autonomy in adapting
school designs and held accountable for education
results.
Charter Management Organizations (CMOs)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
Independent Charter Schools
Organizations holding the charter and overseeing the
operation of a single or two charter schools.
INNOVATION SCHOOLS
District-managed public schools with a strategic plan
that allows waivers to specific district policies, state
statutes, and collective bargaining agreements with the
goal of improving student outcomes and executing with
excellence a specific model.
OTHER DISTRICT-RUN SCHOOLS
Public schools not belonging to any of above two types.
C
Sectors of Schools
COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
Research Question and Analyses
IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN
INDIANAPOLIS USING DATA FROM THE SCHOOL YEARS 2016-17
THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS.
Overall performance in
Indianapolis schools over
two years.
• The performance of Indianapolis
students is benchmarked against the
state average performance,
accounting for student
characteristics.
• The performance of charter school
students and the performance of
Innovation school students within
Indianapolis are then compared to
that of similar traditional public
school (district school) students
within Indianapolis.
Performance for
Indianapolis charter
schools, Indianapolis
innovation schools and
the rest of Indianapolis
public schools over two
years.
Performance in the 2018-
2019 school year by
school type, race,
poverty status, English
language learner (ELL)
status, special
education status and
gender.
WE MAKE TWO SETS
OF COMPARISONS.
01 02 03
Achievement scores capture what a student knows at a point
in time. They are influenced by students’ prior conditions in
addition to schools’ contributions.
Growth scores indicate how much progress a student makes
from one year to the next. Growth scores allow us to zero in
on the contributions of schools separately from other factors
that affect point-in-time scores.
ACHIEVEMENT VS. GROWTH
We analyze student growth in standard deviation units so
that the results can be assessed for statistical differences.
The full set of findings appear in the Appendix.
In the following graphs of findings, we transform growth
from standard deviation units into days of learning based on
a typical 180-day school year.
IN THIS STUDY WE MEASURE
ACADEMIC PERFORMANCE AS HOW
MUCH GROWTH STUDENTS MAKE FROM
ONE YEAR TO THE NEXT.
Measure of Academic Performance
RESEARCH FINDINGS
02
-100
-75
-50
-25
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
significantly different at p< 0.05
reading math
Research Findings > Overall Indianapolis Results
> Reading & Math
Average One-Year Learning Gains for All Indianapolis
Students Compared to the State Average Learning
Gains, by Year and Subject
-100
-75
-50
-25
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Reading for Students in
Indianapolis Charter Schools, Indianapolis Innovation
Schools, and Indianapolis District Schools Compared
to the State Average Learning Gains, by Year
significantly different at p< 0.05
charter Innovation
Research Findings > Sector Analysis
> Reading
VS. STATE & COMPARISON WITHIN INDIANAPOLIS
charter Innovation district
Reading
Charter vs. District
Innovation vs. District
Charter vs. Innovation
Tests of Differences
'17-'18 '18-'19
-100
-75
-50
-25
0
25
50
75
100
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Math for Students in Indianapolis
Charter Schools, Indianapolis Innovation Schools,
and Indianapolis District Schools Compared to the
State Average Learning Gains, by Year
significantly different at p< 0.05
charter Innovation district
Research Findings > Sector Analysis
> Math
VS. STATE & COMPARISON WITHIN INDIANAPOLIS
Math
Charter vs. District
Innovation vs. District
Charter vs. Innovation
Tests of Differences
'17-'18 '18-'19
-100
-75
-50
-25
0
25
50
75
100
CMO Charter Schools Independent Charter Schools
Growth
(in
Days
of
Learning)
Relative Learning Gains for Students in Indianapolis
CMO-Affiliated Charter Schools and Independent
Indianapolis Charter Schools Compared to the
Average Learning Gains for All Student in the State,
by Subject
significantly different at p< 0.05
reading math
Research Findings > Charter Subsector Analysis
> vs. state & comparison within Indianapolis
Reading
CMOs vs Independent Charter Schools
Math
CMOs vs Independent Charter Schools
sig
Tests of Differences
-400 -300 -200 -100 0 100 200 300 400
Growth (in Days of Learning)
Charter
District
Innovation
Research Findings > School-Level Performance by Sector
> Reading
-400 -300 -200 -100 0 100 200 300 400
Growth (in Days of Learning)
Charter
District
Innovation
Research Findings > School-Level Performance by Sector
>Math
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Black Students
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Black Students
Compared to the Average Learning Gains of Black
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Black Students
Indianapolis
Innovation
Black Students
Indianapolis District
Black Students
Growth
(in
Days
of
Learning)
Learning Gains for Black Students in Indianapolis
Charter Schools, Black Students in Indianapolis
Innovation Schools, and Black Students in Indianapolis
District Schools Compared to the Average Learning
Gains of Black Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Black vs. District Black
Innovation Black vs. District Black
Math
Charter Black vs. District Black
Innovation Black vs. District Black
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Hispanic Students
Compared to the Average Learning Gains of Hispanic
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Hispanic Students
Indianapolis
Innovation
Hispanic Students
Indianapolis District
Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for Hispanic Students in Indianapolis
Charter Schools, Hispanic Students in Indianapolis
Innovation Schools, and Hispanic Students in Indianapolis
District Schools Compared to the Average Learning Gains of
Hispanic Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Hispanic vs. District Hispanic
Innovation Hispanic vs. District Hispanic
Math
Charter Hispanic vs. District Hispanic
Innovation Hispanic vs. District Hispanic
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Students in
Poverty Compared to the Average Learning Gains of
Students in Poverty Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Students in Poverty
Indianapolis
Innovation
Students in Poverty
Indianapolis District
Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for Indianapolis Charter School
Students in Poverty, Indianapolis Innovation School
Students in Poverty, and Indianapolis District School
Students in Poverty Compared to the Average
Learning Gains of Students in Poverty Statewide, by
Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Poverty vs. District Poverty
Innovation Poverty vs. District Poverty
Math
Charter Poverty vs. District Poverty
Innovation Poverty vs. District Poverty
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for All ELL Students in Indianapolis
Compared to the Average Learning Gains of ELL
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
ELL Students
Indianapolis Innovation
ELL Students
Indianapolis District
ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for ELL Students in Indianapolis
Charter Schools, ELL Students in Indianapolis
Innovation Schools, and ELL Students in Indianapolis
District Schools Compared to the Average Learning
Gains of ELL Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter ELL vs. District ELL
Innovation ELL vs. District ELL
Math
Charter ELL vs. District ELL
Innovation ELL vs. District ELL
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Special Ed Students
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Students in Special
Education Compared to the Average Learning Gains of
Students in Special Education Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Students in Special Ed.
Indianapolis
Innovation
Students in Special Ed.
Indianapolis District
Students in Special Ed.
Growth
(in
Days
of
Learning)
Learning Gains for Indianapolis Charter School
Students in Special Ed., Indianapolis Innovation
School Students in Special Ed., and Indianapolis
District School Students in Special Ed. Compared to
the Average Learning Gains of Students in Special
Ed. Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Sped vs. District Sped
Innovation Sped vs. District Sped
Math
Charter Sped vs. District Sped
Innovation Sped vs. District Sped
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Male Students
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Male Students
Compared to the Average Learning Gains of Male
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Male Students
Indianapolis Innovation
Male Students
Indianapolis District
Male Students
Growth
(in
Days
of
Learning)
Learning Gains for Male Students in Indianapolis
Charter Schools, Male Students in Indianapolis
Innovation Schools, and Male Students in
Indianapolis District Schools Compared to the
Average Learning Gains of Male Students Statewide,
by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Male vs. District Male
Innovation Male vs. District Male
Math
Charter Male vs. District Male
Innovation Male vs. District Male
Tests of Differences
sig
Reading
Charter Male vs. District Male
Innovation Male vs. District Male
Math
Charter Male vs. District Male
Innovation Male vs. District Male
Tests of Differences
sig
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Female Students
Growth
(in
Days
of
Learning)
Learning Gains for All Indianapolis Female Students
Compared to the Average Learning Gains of Female
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
ALL VS. STATE
-100
-75
-50
-25
0
25
50
75
100
Indianapolis Charter
Female Students
Indianapolis
Innovation
Female Students
Indianapolis District
Female Students
Growth
(in
Days
of
Learning)
Learning Gains for Female Students in Indianapolis Charter
Schools, Female Students in Indianapolis Innovation
Schools, and Female Students in Indianapolis District
Schools Compared to the Average Learning Gains of Female
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS
Reading
Charter Female vs. District Female
Innovation Female vs. District Female
Math
Charter Female vs. District Female
Innovation Female vs. District Female
Tests of Differences
sig
Summary of Findings
The summary of the findings from the analysis of Indianapolis schools is presented here.
APPENDIXES
03
Acknowledgments
Student-level data were
provided by the
Indiana Department of
Education.
The Mind Trust assisted CREDO with
verifying the list of public schools in
Indianapolis.
Types of Charter Schools
• With more schools and students than a single charter
school, CMOs have some operational advantages in their
ability to spread administrative fixed costs, thus
providing the possibility of greater efficiency. In
addition, CMOs may be able to support additional
programs and more robust staffing.
• Whether CMOs lead to better student outcomes is a
matter of interest across the country.
OUR ANALYSES OF INDIANAPOLIS
CHARTER SCHOOLS INCLUDE A
BREAKOUT OF CMOS AND
INDEPENDENT CHARTERS.
There are two types
of charter schools.
CHARTER MANAGEMENT ORGANIZATIONS (CMOS)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
INDEPENDENT CHARTER SCHOOLS
Organization holding the charter and overseeing the
operation of a single charter school. It may run the school
directly or contract with an organization which provides
services to one or two charter schools.
Methods
The annual academic growth of students in Indianapolis
from 2016-17 to 2018-19, overall and by sector, is
benchmarked to the state average growth, accounting for
student characteristics.
We also explore how one-year growth of Indianapolis
students for the period ending in Spring 2019 differs by
school type, race, poverty status, English language learner
status, special education status, and gender.
Days of Learning
While these tools create precise and reliable answers,
they are presented in technical terms that are not
user-friendly to a general audience. To translate the
technical results into terms that are accessible to non-
technical audiences, CREDO developed Days of
Learning.
CREDO USES ADVANCED
TECHNOLOGY AND
SOPHISTICATED STATISTICAL
TOOLS TO MEASURE STUDENTS,
SCHOOLS AND THE EDUCATION
LANDSCAPE.
Think about the students in your state’s public schools. For many of their years
of schooling, they take achievement tests to measure what they know at the end of
the school year. We can identify the average score for each test each year.
Imagine a student who scores exactly at the average in one year, say 4th
grade, and then in the following year, scores exactly at the average again on the 5th-
grade test. The amount of year-to-year learning for that student show us what the
average learning is for all the students who took both tests.
We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th,
and so on.
CREDO uses those annual measures of average learning to represent a typical
year of learning, and equates that to a typical 180-day school year. We say that the
student in our example has gained 180 days of learning.
If a student makes more progress than the average student, we take the
amount of extra achievement and translate it into 180-days of learning plus “X” extra
days. We are creating a measure of student learning as if the student went to school
for 180 days plus X days. The size of “X” depends on how much more the student
learns than the average student — if it’s a lot more, then “X” will be a large number,
and if it’s a small amount more, “X” will be a small number.
The same is true for students who do not learn as much as the average
student. Instead of adding to the 180-days-of-learning average, we subtract from
that base to reflect the smaller-than-average advances that those students realize. In
these cases, the difference leads to numbers such a “165 days of learning” or “152
days of learning”. Against the average standard of 180 days, these smaller days show
that students learned as if they had only attended school for 180 days minus X days
during the school year.
01
02
03
04
05
06
3rd
Grade
4th
Grade
= 180
days
More than 180
days
Less than 180
days
Student
A
Student
A
Overall Indianapolis Results
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
I n d i a n a p o l i s O v e r a l l 2 0 1 7 - 1 8 -0.07** -42** -0.05* -31*
I n d i a n a p o l i s O v e r a l l 2 0 1 8 - 1 9 -0.05* -30* -0.06* -33*
Indianapolis School Sectors Compared
to State Average
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.05 30 0.05 31
C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.02 12 0.08 47
I n n o v a t i o n S c h o o l s 2 0 1 7 - 1 8 -0.07* -44* -0.06 -37
I n n o v a t i o n S c h o o l s 2 0 1 8 - 1 9 -0.02 -13 -0.04 -22
O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 -0.11** -68** -0.09** -52**
O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 -0.09** -52** -0.12** -69**
Comparison of School Sectors within Indianapolis
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.17 97 0.14 82
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.11 64 0.2* 116*
I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.04 24 0.03 14
I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.07 38 0.08 47
Charter Subsector Analysis
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
I n d i a n a p o l i s C M O s v s . S t a t e A v e r a g e 0.04 23 0.07* 41*
I n d i a n a p o l i s I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e -0.04 -24 0.00 1
I n d i a n a p o l i s C M O s v s . I n d i a n a p o l i s I n d e p e n d e n t
C h a r t e r s
0.08 46 0.07 40
Student Subgroup Analysis> Black Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Black Students
I n d i a n a p o l i s B l a c k S t u d e n t s O v e r a l l -0.05* -31* -0.06* -33*
I n d i a n a p o l i s C h a r t e r S c h o o l B l a c k S t u d e n t s 0.03 15 0.09* 54*
I n d i a n a p o l i s I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.00 -2 -0.02 -11
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.12** -71** -0.15** -91**
Compared with Black Students in Other District Schools in
Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l B l a c k S t u d e n t s 0.15** 86** 0.25** 144**
I n d i a n a p o l i s I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.12 69 0.14 80
Student Subgroup Analysis> Hispanic Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Hispanic Students
I n d i a n a p o l i s H i s p a n i c S t u d e n t s O v e r a l l -0.05* -31* -0.07** -42**
I n d i a n a p o l i s C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.05 27 0.08 46
I n d i a n a p o l i s I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s -0.06 -35 -0.09* -54*
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s -0.08** -46** -0.11** -64**
Compared with Hispanic Students in Other District Schools
in Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.12* 73* 0.19* 109*
I n d i a n a p o l i s I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.02 11 0.02 10
Student Subgroup Analysis> Students in Poverty
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Students in Poverty
I n d i a n a p o l i s S t u d e n t s i n P o v e r t y O v e r a l l -0.03 -19 -0.04 -23
I n d i a n a p o l i s C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.03 19 0.09* 51*
I n d i a n a p o l i s I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y -0.01 -4 -0.03 -16
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y -0.07** -44** -0.10** -62**
Compared with Students in Poverty in Other District
Schools in Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.11** 63** 0.19** 112**
I n d i a n a p o l i s I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.07 40 0.08 45
Student Subgroup Analysis> ELL Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of ELL Students
I n d i a n a p o l i s E L L S t u d e n t s O v e r a l l -0.06** -36** -0.05 -32
I n d i a n a p o l i s C h a r t e r S c h o o l E L L S t u d e n t s 0.05 27 0.10 56
I n d i a n a p o l i s I n n o v a t i o n S c h o o l E L L S t u d e n t s -0.04 -25 -0.09 -55
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s -0.10** -57** -0.08** -48**
Compared with ELL Students in Other District Schools in
Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l E L L S t u d e n t s 0.14 83 0.18 103
I n d i a n a p o l i s I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.05 31 -0.01 -8
Student Subgroup Analysis> Special Ed Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Special Ed Students
I n d i a n a p o l i s S p e c i a l E d S t u d e n t s O v e r a l l -0.02 -11 -0.08** -46**
I n d i a n a p o l i s C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.01 6 0.08 46
I n d i a n a p o l i s I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.03 14 -0.10 -59
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s -0.04 -25 -0.12** -73**
Compared with Special Ed Students in Other District
Schools in Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.05** 30** 0.20 118
I n d i a n a p o l i s I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.07 38 0.02 13
Student Subgroup Analysis> Male Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Male Students
I n d i a n a p o l i s M a l e S t u d e n t s O v e r a l l -0.05* -31* -0.07** -39**
I n d i a n a p o l i s C h a r t e r S c h o o l M a l e S t u d e n t s 0.02 10 0.07 41
I n d i a n a p o l i s I n n o v a t i o n S c h o o l M a l e S t u d e n t s -0.02 -12 -0.05 -31
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s -0.09** -53** -0.12** -71**
Compared with Male Students in Other District Schools in
Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l M a l e S t u d e n t s 0.11 62 0.19 112
I n d i a n a p o l i s I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.07 41 0.07 40
Student Subgroup Analysis> Female Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Female Students
I n d i a n a p o l i s F e m a l e S t u d e n t s O v e r a l l -0.05* -28* -0.05* -27*
I n d i a n a p o l i s C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.03 15 0.09** 54**
I n d i a n a p o l i s I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s -0.03 -16 -0.02 -12
I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s -0.09** -51** -0.11** -67**
Compared with Female Students in Other District Schools
in Indianapolis
I n d i a n a p o l i s C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.11* 66* 0.20* 120*
I n d i a n a p o l i s I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.06 35 0.09 54
THANK YOU

More Related Content

Similar to Indianapolis_slide_deck_FINAL_20220601.pdf

Wyoming Accountability in Education Act - 1/16/14 Presentation
Wyoming Accountability in Education Act - 1/16/14 PresentationWyoming Accountability in Education Act - 1/16/14 Presentation
Wyoming Accountability in Education Act - 1/16/14 Presentation
Jay Harnack
 

Similar to Indianapolis_slide_deck_FINAL_20220601.pdf (20)

Houston slide deck
Houston slide deckHouston slide deck
Houston slide deck
 
Newark, NJ 2021
Newark, NJ 2021Newark, NJ 2021
Newark, NJ 2021
 
memphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdfmemphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdf
 
2022 Austin Chart School City Study
2022 Austin Chart School City Study2022 Austin Chart School City Study
2022 Austin Chart School City Study
 
2022 Newark Chart School City Study
2022 Newark Chart School City Study2022 Newark Chart School City Study
2022 Newark Chart School City Study
 
Washington DC. City Study 2022
Washington DC. City Study 2022Washington DC. City Study 2022
Washington DC. City Study 2022
 
2022 Houston Chart School City Study
2022 Houston Chart School City Study2022 Houston Chart School City Study
2022 Houston Chart School City Study
 
DC_slide_deck_FINAL (1).pdf
DC_slide_deck_FINAL (1).pdfDC_slide_deck_FINAL (1).pdf
DC_slide_deck_FINAL (1).pdf
 
batonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdfbatonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdf
 
Indianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City StudyIndianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City Study
 
2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study
 
Denver 2019 - City Study
Denver 2019 - City StudyDenver 2019 - City Study
Denver 2019 - City Study
 
Key Performance Indicators for College & Career Readiness - K12 Congress
Key Performance Indicators for College & Career Readiness - K12 CongressKey Performance Indicators for College & Career Readiness - K12 Congress
Key Performance Indicators for College & Career Readiness - K12 Congress
 
St. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City StudySt. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City Study
 
Golden Triangle Plus 1
Golden Triangle Plus 1Golden Triangle Plus 1
Golden Triangle Plus 1
 
Kansas City, MO 2019 - City Study
Kansas City, MO 2019 - City StudyKansas City, MO 2019 - City Study
Kansas City, MO 2019 - City Study
 
Washington DC 2019 - City Study
Washington DC 2019 - City StudyWashington DC 2019 - City Study
Washington DC 2019 - City Study
 
Key Performance Indicators for College & Career Readiness - AASA East Coast C...
Key Performance Indicators for College & Career Readiness - AASA East Coast C...Key Performance Indicators for College & Career Readiness - AASA East Coast C...
Key Performance Indicators for College & Career Readiness - AASA East Coast C...
 
San Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City StudySan Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City Study
 
Wyoming Accountability in Education Act - 1/16/14 Presentation
Wyoming Accountability in Education Act - 1/16/14 PresentationWyoming Accountability in Education Act - 1/16/14 Presentation
Wyoming Accountability in Education Act - 1/16/14 Presentation
 

More from Center for Research on Education Outcomes (CREDO)

More from Center for Research on Education Outcomes (CREDO) (7)

Charter School Performance in Rhode Island
Charter School Performance in Rhode IslandCharter School Performance in Rhode Island
Charter School Performance in Rhode Island
 
Charter survey final deck
Charter survey final deck Charter survey final deck
Charter survey final deck
 
Memphis, TN 2019 - City Study
Memphis, TN 2019 - City StudyMemphis, TN 2019 - City Study
Memphis, TN 2019 - City Study
 
New Orleans, LA 2019 - City Study
New Orleans, LA 2019 - City StudyNew Orleans, LA 2019 - City Study
New Orleans, LA 2019 - City Study
 
Baton Rouge LA 2019 - City Study
Baton Rouge LA 2019 - City StudyBaton Rouge LA 2019 - City Study
Baton Rouge LA 2019 - City Study
 
Buffalo NY 2019 - City Study
Buffalo NY 2019 - City StudyBuffalo NY 2019 - City Study
Buffalo NY 2019 - City Study
 
Camden NJ 2019 - City Study
Camden NJ 2019 - City StudyCamden NJ 2019 - City Study
Camden NJ 2019 - City Study
 

Recently uploaded

Spellings Wk 4 and Wk 5 for Grade 4 at CAPS
Spellings Wk 4 and Wk 5 for Grade 4 at CAPSSpellings Wk 4 and Wk 5 for Grade 4 at CAPS
Spellings Wk 4 and Wk 5 for Grade 4 at CAPS
AnaAcapella
 
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdfContoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
cupulin
 
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
EADTU
 
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
中 央社
 
SPLICE Working Group: Reusable Code Examples
SPLICE Working Group:Reusable Code ExamplesSPLICE Working Group:Reusable Code Examples
SPLICE Working Group: Reusable Code Examples
Peter Brusilovsky
 

Recently uploaded (20)

COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of TransportBasic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
 
When Quality Assurance Meets Innovation in Higher Education - Report launch w...
When Quality Assurance Meets Innovation in Higher Education - Report launch w...When Quality Assurance Meets Innovation in Higher Education - Report launch w...
When Quality Assurance Meets Innovation in Higher Education - Report launch w...
 
Spellings Wk 4 and Wk 5 for Grade 4 at CAPS
Spellings Wk 4 and Wk 5 for Grade 4 at CAPSSpellings Wk 4 and Wk 5 for Grade 4 at CAPS
Spellings Wk 4 and Wk 5 for Grade 4 at CAPS
 
Including Mental Health Support in Project Delivery, 14 May.pdf
Including Mental Health Support in Project Delivery, 14 May.pdfIncluding Mental Health Support in Project Delivery, 14 May.pdf
Including Mental Health Support in Project Delivery, 14 May.pdf
 
Observing-Correct-Grammar-in-Making-Definitions.pptx
Observing-Correct-Grammar-in-Making-Definitions.pptxObserving-Correct-Grammar-in-Making-Definitions.pptx
Observing-Correct-Grammar-in-Making-Definitions.pptx
 
UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024UChicago CMSC 23320 - The Best Commit Messages of 2024
UChicago CMSC 23320 - The Best Commit Messages of 2024
 
8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital Management8 Tips for Effective Working Capital Management
8 Tips for Effective Working Capital Management
 
Graduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptxGraduate Outcomes Presentation Slides - English (v3).pptx
Graduate Outcomes Presentation Slides - English (v3).pptx
 
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdfContoh Aksi Nyata Refleksi Diri ( NUR ).pdf
Contoh Aksi Nyata Refleksi Diri ( NUR ).pdf
 
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
 
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading RoomSternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
Sternal Fractures & Dislocations - EMGuidewire Radiology Reading Room
 
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes GuàrdiaPersonalisation of Education by AI and Big Data - Lourdes Guàrdia
Personalisation of Education by AI and Big Data - Lourdes Guàrdia
 
AIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.pptAIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.ppt
 
Improved Approval Flow in Odoo 17 Studio App
Improved Approval Flow in Odoo 17 Studio AppImproved Approval Flow in Odoo 17 Studio App
Improved Approval Flow in Odoo 17 Studio App
 
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽會考英聽
 
male presentation...pdf.................
male presentation...pdf.................male presentation...pdf.................
male presentation...pdf.................
 
How to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptxHow to Manage Website in Odoo 17 Studio App.pptx
How to Manage Website in Odoo 17 Studio App.pptx
 
SPLICE Working Group: Reusable Code Examples
SPLICE Working Group:Reusable Code ExamplesSPLICE Working Group:Reusable Code Examples
SPLICE Working Group: Reusable Code Examples
 
How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17
 

Indianapolis_slide_deck_FINAL_20220601.pdf

  • 2. Table of Contents 0 1 R E PORT OVE R VIE W • About The City Studies Project • Sectors of Schools • Research Question and Analyses • Measure of Academic Performance Student Subgroup Analysis Summary of Findings 0 3 APPE N DIX E S • Acknowledgments • Types of Charter Schools • Innovation Schools in Indianapolis • Methods • Days of Learning • Full Set of Findings 0 2 R E SE AR CH F IN DIN G S • Reading & Math Overall Indianapolis Results Sector Analysis • vs. state & comparison within Indianapolis Charter Subsector Analysis • Reading • Math School-Level Performance by Sector Research Findings Cont’d. Black Students • all vs. state • vs. state by sector & comparison within Indianapolis Hispanic Students • all vs. state • vs. state by sector & comparison within Indianapolis Students in Poverty • all vs. state • vs. state by sector & comparison within Indianapolis ELL Students • all vs. state • vs. state by sector & comparison within Indianapolis Special Ed Students • all vs. state • vs. state by sector & comparison within Indianapolis Male Students • all vs. state • vs. state by sector & comparison within Indianapolis Female Students • all vs. state • vs. state by sector & comparison within Indianapolis • Reading • Math
  • 4. About The City Studies Project Cohort 1 Cohort 2 The City Studies project examines the performance of schools in select U.S. cities, including Indianapolis. We study the academic progress of students as the measure of school performance.
  • 5. O O C C C CHARTER SCHOOLS Public schools operated independently from the traditional school district, with autonomy in adapting school designs and held accountable for education results. Charter Management Organizations (CMOs) Organizations holding the charter and overseeing the operation of at least three charter schools. Independent Charter Schools Organizations holding the charter and overseeing the operation of a single or two charter schools. INNOVATION SCHOOLS District-managed public schools with a strategic plan that allows waivers to specific district policies, state statutes, and collective bargaining agreements with the goal of improving student outcomes and executing with excellence a specific model. OTHER DISTRICT-RUN SCHOOLS Public schools not belonging to any of above two types. C Sectors of Schools COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
  • 6. Research Question and Analyses IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN INDIANAPOLIS USING DATA FROM THE SCHOOL YEARS 2016-17 THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS. Overall performance in Indianapolis schools over two years. • The performance of Indianapolis students is benchmarked against the state average performance, accounting for student characteristics. • The performance of charter school students and the performance of Innovation school students within Indianapolis are then compared to that of similar traditional public school (district school) students within Indianapolis. Performance for Indianapolis charter schools, Indianapolis innovation schools and the rest of Indianapolis public schools over two years. Performance in the 2018- 2019 school year by school type, race, poverty status, English language learner (ELL) status, special education status and gender. WE MAKE TWO SETS OF COMPARISONS. 01 02 03
  • 7. Achievement scores capture what a student knows at a point in time. They are influenced by students’ prior conditions in addition to schools’ contributions. Growth scores indicate how much progress a student makes from one year to the next. Growth scores allow us to zero in on the contributions of schools separately from other factors that affect point-in-time scores. ACHIEVEMENT VS. GROWTH We analyze student growth in standard deviation units so that the results can be assessed for statistical differences. The full set of findings appear in the Appendix. In the following graphs of findings, we transform growth from standard deviation units into days of learning based on a typical 180-day school year. IN THIS STUDY WE MEASURE ACADEMIC PERFORMANCE AS HOW MUCH GROWTH STUDENTS MAKE FROM ONE YEAR TO THE NEXT. Measure of Academic Performance
  • 9. -100 -75 -50 -25 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) significantly different at p< 0.05 reading math Research Findings > Overall Indianapolis Results > Reading & Math Average One-Year Learning Gains for All Indianapolis Students Compared to the State Average Learning Gains, by Year and Subject
  • 10. -100 -75 -50 -25 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Reading for Students in Indianapolis Charter Schools, Indianapolis Innovation Schools, and Indianapolis District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter Innovation Research Findings > Sector Analysis > Reading VS. STATE & COMPARISON WITHIN INDIANAPOLIS charter Innovation district Reading Charter vs. District Innovation vs. District Charter vs. Innovation Tests of Differences '17-'18 '18-'19
  • 11. -100 -75 -50 -25 0 25 50 75 100 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Math for Students in Indianapolis Charter Schools, Indianapolis Innovation Schools, and Indianapolis District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter Innovation district Research Findings > Sector Analysis > Math VS. STATE & COMPARISON WITHIN INDIANAPOLIS Math Charter vs. District Innovation vs. District Charter vs. Innovation Tests of Differences '17-'18 '18-'19
  • 12. -100 -75 -50 -25 0 25 50 75 100 CMO Charter Schools Independent Charter Schools Growth (in Days of Learning) Relative Learning Gains for Students in Indianapolis CMO-Affiliated Charter Schools and Independent Indianapolis Charter Schools Compared to the Average Learning Gains for All Student in the State, by Subject significantly different at p< 0.05 reading math Research Findings > Charter Subsector Analysis > vs. state & comparison within Indianapolis Reading CMOs vs Independent Charter Schools Math CMOs vs Independent Charter Schools sig Tests of Differences
  • 13. -400 -300 -200 -100 0 100 200 300 400 Growth (in Days of Learning) Charter District Innovation Research Findings > School-Level Performance by Sector > Reading
  • 14. -400 -300 -200 -100 0 100 200 300 400 Growth (in Days of Learning) Charter District Innovation Research Findings > School-Level Performance by Sector >Math
  • 15. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Black Students Growth (in Days of Learning) Learning Gains for All Indianapolis Black Students Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students ALL VS. STATE
  • 16. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Black Students Indianapolis Innovation Black Students Indianapolis District Black Students Growth (in Days of Learning) Learning Gains for Black Students in Indianapolis Charter Schools, Black Students in Indianapolis Innovation Schools, and Black Students in Indianapolis District Schools Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Black vs. District Black Innovation Black vs. District Black Math Charter Black vs. District Black Innovation Black vs. District Black Tests of Differences sig
  • 17. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Hispanic Students Growth (in Days of Learning) Learning Gains for All Indianapolis Hispanic Students Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students ALL VS. STATE
  • 18. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Hispanic Students Indianapolis Innovation Hispanic Students Indianapolis District Hispanic Students Growth (in Days of Learning) Learning Gains for Hispanic Students in Indianapolis Charter Schools, Hispanic Students in Indianapolis Innovation Schools, and Hispanic Students in Indianapolis District Schools Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Hispanic vs. District Hispanic Innovation Hispanic vs. District Hispanic Math Charter Hispanic vs. District Hispanic Innovation Hispanic vs. District Hispanic Tests of Differences sig
  • 19. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Students in Poverty Growth (in Days of Learning) Learning Gains for All Indianapolis Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty ALL VS. STATE
  • 20. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Students in Poverty Indianapolis Innovation Students in Poverty Indianapolis District Students in Poverty Growth (in Days of Learning) Learning Gains for Indianapolis Charter School Students in Poverty, Indianapolis Innovation School Students in Poverty, and Indianapolis District School Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Poverty vs. District Poverty Innovation Poverty vs. District Poverty Math Charter Poverty vs. District Poverty Innovation Poverty vs. District Poverty Tests of Differences sig
  • 21. -100 -75 -50 -25 0 25 50 75 100 Indianapolis ELL Students Growth (in Days of Learning) Learning Gains for All ELL Students in Indianapolis Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students ALL VS. STATE
  • 22. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter ELL Students Indianapolis Innovation ELL Students Indianapolis District ELL Students Growth (in Days of Learning) Learning Gains for ELL Students in Indianapolis Charter Schools, ELL Students in Indianapolis Innovation Schools, and ELL Students in Indianapolis District Schools Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter ELL vs. District ELL Innovation ELL vs. District ELL Math Charter ELL vs. District ELL Innovation ELL vs. District ELL Tests of Differences sig
  • 23. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Special Ed Students Growth (in Days of Learning) Learning Gains for All Indianapolis Students in Special Education Compared to the Average Learning Gains of Students in Special Education Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students ALL VS. STATE
  • 24. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Students in Special Ed. Indianapolis Innovation Students in Special Ed. Indianapolis District Students in Special Ed. Growth (in Days of Learning) Learning Gains for Indianapolis Charter School Students in Special Ed., Indianapolis Innovation School Students in Special Ed., and Indianapolis District School Students in Special Ed. Compared to the Average Learning Gains of Students in Special Ed. Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Sped vs. District Sped Innovation Sped vs. District Sped Math Charter Sped vs. District Sped Innovation Sped vs. District Sped Tests of Differences sig
  • 25. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Male Students Growth (in Days of Learning) Learning Gains for All Indianapolis Male Students Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students ALL VS. STATE
  • 26. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Male Students Indianapolis Innovation Male Students Indianapolis District Male Students Growth (in Days of Learning) Learning Gains for Male Students in Indianapolis Charter Schools, Male Students in Indianapolis Innovation Schools, and Male Students in Indianapolis District Schools Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Male vs. District Male Innovation Male vs. District Male Math Charter Male vs. District Male Innovation Male vs. District Male Tests of Differences sig Reading Charter Male vs. District Male Innovation Male vs. District Male Math Charter Male vs. District Male Innovation Male vs. District Male Tests of Differences sig
  • 27. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Female Students Growth (in Days of Learning) Learning Gains for All Indianapolis Female Students Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students ALL VS. STATE
  • 28. -100 -75 -50 -25 0 25 50 75 100 Indianapolis Charter Female Students Indianapolis Innovation Female Students Indianapolis District Female Students Growth (in Days of Learning) Learning Gains for Female Students in Indianapolis Charter Schools, Female Students in Indianapolis Innovation Schools, and Female Students in Indianapolis District Schools Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students VS. STATE BY SECTOR & COMPARISON WITHIN INDIANAPOLIS Reading Charter Female vs. District Female Innovation Female vs. District Female Math Charter Female vs. District Female Innovation Female vs. District Female Tests of Differences sig
  • 29. Summary of Findings The summary of the findings from the analysis of Indianapolis schools is presented here.
  • 31. Acknowledgments Student-level data were provided by the Indiana Department of Education. The Mind Trust assisted CREDO with verifying the list of public schools in Indianapolis.
  • 32. Types of Charter Schools • With more schools and students than a single charter school, CMOs have some operational advantages in their ability to spread administrative fixed costs, thus providing the possibility of greater efficiency. In addition, CMOs may be able to support additional programs and more robust staffing. • Whether CMOs lead to better student outcomes is a matter of interest across the country. OUR ANALYSES OF INDIANAPOLIS CHARTER SCHOOLS INCLUDE A BREAKOUT OF CMOS AND INDEPENDENT CHARTERS. There are two types of charter schools. CHARTER MANAGEMENT ORGANIZATIONS (CMOS) Organizations holding the charter and overseeing the operation of at least three charter schools. INDEPENDENT CHARTER SCHOOLS Organization holding the charter and overseeing the operation of a single charter school. It may run the school directly or contract with an organization which provides services to one or two charter schools.
  • 33. Methods The annual academic growth of students in Indianapolis from 2016-17 to 2018-19, overall and by sector, is benchmarked to the state average growth, accounting for student characteristics. We also explore how one-year growth of Indianapolis students for the period ending in Spring 2019 differs by school type, race, poverty status, English language learner status, special education status, and gender.
  • 34. Days of Learning While these tools create precise and reliable answers, they are presented in technical terms that are not user-friendly to a general audience. To translate the technical results into terms that are accessible to non- technical audiences, CREDO developed Days of Learning. CREDO USES ADVANCED TECHNOLOGY AND SOPHISTICATED STATISTICAL TOOLS TO MEASURE STUDENTS, SCHOOLS AND THE EDUCATION LANDSCAPE. Think about the students in your state’s public schools. For many of their years of schooling, they take achievement tests to measure what they know at the end of the school year. We can identify the average score for each test each year. Imagine a student who scores exactly at the average in one year, say 4th grade, and then in the following year, scores exactly at the average again on the 5th- grade test. The amount of year-to-year learning for that student show us what the average learning is for all the students who took both tests. We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th, and so on. CREDO uses those annual measures of average learning to represent a typical year of learning, and equates that to a typical 180-day school year. We say that the student in our example has gained 180 days of learning. If a student makes more progress than the average student, we take the amount of extra achievement and translate it into 180-days of learning plus “X” extra days. We are creating a measure of student learning as if the student went to school for 180 days plus X days. The size of “X” depends on how much more the student learns than the average student — if it’s a lot more, then “X” will be a large number, and if it’s a small amount more, “X” will be a small number. The same is true for students who do not learn as much as the average student. Instead of adding to the 180-days-of-learning average, we subtract from that base to reflect the smaller-than-average advances that those students realize. In these cases, the difference leads to numbers such a “165 days of learning” or “152 days of learning”. Against the average standard of 180 days, these smaller days show that students learned as if they had only attended school for 180 days minus X days during the school year. 01 02 03 04 05 06 3rd Grade 4th Grade = 180 days More than 180 days Less than 180 days Student A Student A
  • 35. Overall Indianapolis Results Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g I n d i a n a p o l i s O v e r a l l 2 0 1 7 - 1 8 -0.07** -42** -0.05* -31* I n d i a n a p o l i s O v e r a l l 2 0 1 8 - 1 9 -0.05* -30* -0.06* -33*
  • 36. Indianapolis School Sectors Compared to State Average Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.05 30 0.05 31 C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.02 12 0.08 47 I n n o v a t i o n S c h o o l s 2 0 1 7 - 1 8 -0.07* -44* -0.06 -37 I n n o v a t i o n S c h o o l s 2 0 1 8 - 1 9 -0.02 -13 -0.04 -22 O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 -0.11** -68** -0.09** -52** O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 -0.09** -52** -0.12** -69**
  • 37. Comparison of School Sectors within Indianapolis Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.17 97 0.14 82 C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.11 64 0.2* 116* I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.04 24 0.03 14 I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.07 38 0.08 47
  • 38. Charter Subsector Analysis Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g I n d i a n a p o l i s C M O s v s . S t a t e A v e r a g e 0.04 23 0.07* 41* I n d i a n a p o l i s I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e -0.04 -24 0.00 1 I n d i a n a p o l i s C M O s v s . I n d i a n a p o l i s I n d e p e n d e n t C h a r t e r s 0.08 46 0.07 40
  • 39. Student Subgroup Analysis> Black Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Black Students I n d i a n a p o l i s B l a c k S t u d e n t s O v e r a l l -0.05* -31* -0.06* -33* I n d i a n a p o l i s C h a r t e r S c h o o l B l a c k S t u d e n t s 0.03 15 0.09* 54* I n d i a n a p o l i s I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.00 -2 -0.02 -11 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.12** -71** -0.15** -91** Compared with Black Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l B l a c k S t u d e n t s 0.15** 86** 0.25** 144** I n d i a n a p o l i s I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.12 69 0.14 80
  • 40. Student Subgroup Analysis> Hispanic Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Hispanic Students I n d i a n a p o l i s H i s p a n i c S t u d e n t s O v e r a l l -0.05* -31* -0.07** -42** I n d i a n a p o l i s C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.05 27 0.08 46 I n d i a n a p o l i s I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s -0.06 -35 -0.09* -54* I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s -0.08** -46** -0.11** -64** Compared with Hispanic Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.12* 73* 0.19* 109* I n d i a n a p o l i s I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.02 11 0.02 10
  • 41. Student Subgroup Analysis> Students in Poverty Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Students in Poverty I n d i a n a p o l i s S t u d e n t s i n P o v e r t y O v e r a l l -0.03 -19 -0.04 -23 I n d i a n a p o l i s C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.03 19 0.09* 51* I n d i a n a p o l i s I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y -0.01 -4 -0.03 -16 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y -0.07** -44** -0.10** -62** Compared with Students in Poverty in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.11** 63** 0.19** 112** I n d i a n a p o l i s I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.07 40 0.08 45
  • 42. Student Subgroup Analysis> ELL Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of ELL Students I n d i a n a p o l i s E L L S t u d e n t s O v e r a l l -0.06** -36** -0.05 -32 I n d i a n a p o l i s C h a r t e r S c h o o l E L L S t u d e n t s 0.05 27 0.10 56 I n d i a n a p o l i s I n n o v a t i o n S c h o o l E L L S t u d e n t s -0.04 -25 -0.09 -55 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s -0.10** -57** -0.08** -48** Compared with ELL Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l E L L S t u d e n t s 0.14 83 0.18 103 I n d i a n a p o l i s I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.05 31 -0.01 -8
  • 43. Student Subgroup Analysis> Special Ed Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Special Ed Students I n d i a n a p o l i s S p e c i a l E d S t u d e n t s O v e r a l l -0.02 -11 -0.08** -46** I n d i a n a p o l i s C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.01 6 0.08 46 I n d i a n a p o l i s I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.03 14 -0.10 -59 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s -0.04 -25 -0.12** -73** Compared with Special Ed Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.05** 30** 0.20 118 I n d i a n a p o l i s I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.07 38 0.02 13
  • 44. Student Subgroup Analysis> Male Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Male Students I n d i a n a p o l i s M a l e S t u d e n t s O v e r a l l -0.05* -31* -0.07** -39** I n d i a n a p o l i s C h a r t e r S c h o o l M a l e S t u d e n t s 0.02 10 0.07 41 I n d i a n a p o l i s I n n o v a t i o n S c h o o l M a l e S t u d e n t s -0.02 -12 -0.05 -31 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s -0.09** -53** -0.12** -71** Compared with Male Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l M a l e S t u d e n t s 0.11 62 0.19 112 I n d i a n a p o l i s I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.07 41 0.07 40
  • 45. Student Subgroup Analysis> Female Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Female Students I n d i a n a p o l i s F e m a l e S t u d e n t s O v e r a l l -0.05* -28* -0.05* -27* I n d i a n a p o l i s C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.03 15 0.09** 54** I n d i a n a p o l i s I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s -0.03 -16 -0.02 -12 I n d i a n a p o l i s O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s -0.09** -51** -0.11** -67** Compared with Female Students in Other District Schools in Indianapolis I n d i a n a p o l i s C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.11* 66* 0.20* 120* I n d i a n a p o l i s I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.06 35 0.09 54