SlideShare a Scribd company logo
1 of 47
Download to read offline
City Study
2022:
DENVER
Table of Contents
0 1 R E PORT OVE R VIE W
• About The City Studies Project
• Sectors of Schools
• Research Question and Analyses
• Measure of Academic Performance
Student Subgroup Analysis
Summary of Findings
0 3 APPE N DIX E S
• Acknowledgments
• Types of Charter Schools
• Innovation Schools in Denver
• Methods
• Days of Learning
• Full Set of Findings
0 2 R E SE AR CH
F IN DIN G S
• Reading & Math
Overall Denver Results
Sector Analysis
• vs. state & comparison
within Denver
Charter Subsector Analysis
• Reading
• Math
School-Level Performance by Sector
Research Findings Cont’d.
Black Students
• all vs. state
• vs. state by sector &
comparison within Denver
Hispanic Students
• all vs. state
• vs. state by sector &
comparison within Denver
Students in Poverty
• all vs. state
• vs. state by sector &
comparison within Denver
ELL Students
• all vs. state
• vs. state by sector &
comparison within Denver
Special Ed Students
• all vs. state
• vs. state by sector &
comparison within Denver
Male Students
• all vs. state
• vs. state by sector &
comparison within Denver
Female Students
• all vs. state
• vs. state by sector &
comparison within Denver
• Reading
• Math
REPORT OVERVIEW
01
About The City Studies Project
Cohort 1 Cohort 2
The City Studies project examines the performance of schools in select U.S. cities,
including Denver. We study the academic progress of students as the measure of school
performance.
O
O
C
C
C
CHARTER SCHOOLS
Public schools operated independently from the
traditional school district, with autonomy in adapting
school designs and held accountable for education
results.
Charter Management Organizations (CMOs)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
Independent Charter Schools
Organizations holding the charter and overseeing the
operation of a single or two charter schools.
I-ZONE INNOVATION SCHOOLS
An innovation zone is a group of public innovation
schools that share common interests and seek additional
flexibility
OTHER DISTRICT-RUN SCHOOLS
Public schools not belonging to any of above two types.
District-run innovation schools are included in this
category.
C
Sectors of Schools
COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
Research Question and Analyses
IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN
DENVER USING DATA FROM THE SCHOOL YEARS 2016-17
THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS.
Overall performance in
Denver schools over two
years.
• The performance of Denver students
is benchmarked against the state
average performance, accounting for
student characteristics.
• The performance of charter school
students and the performance of
Innovation school students within
Denver are then compared to that of
similar traditional public school
(district school) students within
Denver.
Performance for Denver
charter schools, Denver
innovation schools and
the rest of Denver
public schools over two
years.
Performance in the 2018-
2019 school year by
school type, race,
poverty status, English
language learner (ELL)
status, special
education status and
gender.
WE MAKE TWO SETS
OF COMPARISONS.
01 02 03
Achievement scores capture what a student knows at a point
in time. They are influenced by students’ prior conditions in
addition to schools’ contributions.
Growth scores indicate how much progress a student makes
from one year to the next. Growth scores allow us to zero in
on the contributions of schools separately from other factors
that affect point-in-time scores.
ACHIEVEMENT VS. GROWTH
We analyze student growth in standard deviation units so
that the results can be assessed for statistical differences.
The full set of findings appear in the Appendix.
In the following graphs of findings, we transform growth
from standard deviation units into days of learning based on
a typical 180-day school year.
IN THIS STUDY WE MEASURE
ACADEMIC PERFORMANCE AS HOW
MUCH GROWTH STUDENTS MAKE FROM
ONE YEAR TO THE NEXT.
Measure of Academic Performance
RESEARCH FINDINGS
02
0
25
50
75
100
125
150
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
significantly different at p< 0.05
reading math
Research Findings > Overall Denver Results
> Reading & Math
Average One-Year Learning Gains for All Denver
Students Compared to the State Average Learning
Gains, by Year and Subject
0
25
50
75
100
125
150
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Reading for Students in Denver
Charter Schools, Denver Innovation Schools, and
Denver District Schools Compared to the State
Average Learning Gains, by Year
significantly different at p< 0.05
charter Innovation
Research Findings > Sector Analysis
> Reading
VS. STATE & COMPARISON WITHIN DENVER
charter Innovation district
Reading
Charter vs. District
Innovation vs. District
Charter vs. Innovation
Tests of Differences
'17-'18 '18-'19
0
25
50
75
100
125
150
SY 2017-2018 SY 2018-2019
Growth
(in
Days
of
Learning)
Learning Gains in Math for Students in Denver
Charter Schools, Denver Innovation Schools, and
Denver District Schools Compared to the State
Average Learning Gains, by Year
significantly different at p< 0.05
charter Innovation district
Research Findings > Sector Analysis
> Math
VS. STATE & COMPARISON WITHIN DENVER
Math
Charter vs. District
Innovation vs. District
Charter vs. Innovation
Tests of Differences
'17-'18 '18-'19
0
25
50
75
100
CMO Charter Schools Independent Charter Schools
Growth
(in
Days
of
Learning)
Relative Learning Gains for Students in Denver CMO-
Affiliated Charter Schools and Independent Denver
Charter Schools Compared to the Average Learning
Gains for All Student in the State, by Subject
significantly different at p< 0.05
reading math
Research Findings > Charter Subsector Analysis
> vs. state & comparison within Denver
Reading
CMOs vs Independent Charter Schools
Math
CMOs vs Independent Charter Schools
sig
Tests of Differences
-400 -300 -200 -100 0 100 200 300 400
Growth (in Days of Learning)
Charter
District
Innovation
Research Findings > School-Level Performance by Sector
> Reading
-400 -300 -200 -100 0 100 200 300 400
Growth (in Days of Learning)
Charter
District
Innovation
Research Findings > School-Level Performance by Sector
>Math
-50
-25
0
25
50
75
100
Denver Black Students
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Black Students
Compared to the Average Learning Gains of Black
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
ALL VS. STATE
-50
-25
0
25
50
75
100
Denver Charter
Black Students
Denver Innovation
Black Students
Denver District
Black Students
Growth
(in
Days
of
Learning)
Learning Gains for Black Students in Denver Charter
Schools, Black Students in Denver Innovation Schools,
and Black Students in Denver District Schools
Compared to the Average Learning Gains of Black
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Black Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Black vs. District Black
Innovation Black vs. District Black
Math
Charter Black vs. District Black
Innovation Black vs. District Black
Tests of Differences
sig
-50
-25
0
25
50
75
100
Denver Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Hispanic Students
Compared to the Average Learning Gains of Hispanic
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
ALL VS. STATE
-50
-25
0
25
50
75
100
Denver Charter
Hispanic Students
Denver Innovation
Hispanic Students
Denver District
Hispanic Students
Growth
(in
Days
of
Learning)
Learning Gains for Hispanic Students in Denver Charter
Schools, Hispanic Students in Denver Innovation Schools,
and Hispanic Students in Denver District Schools Compared
to the Average Learning Gains of Hispanic Students
Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Hispanic Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Hispanic vs. District Hispanic
Innovation Hispanic vs. District Hispanic
Math
Charter Hispanic vs. District Hispanic
Innovation Hispanic vs. District Hispanic
Tests of Differences
sig
0
25
50
75
100
Denver Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Students in Poverty
Compared to the Average Learning Gains of Students
in Poverty Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
ALL VS. STATE
0
25
50
75
100
Denver Charter
Students in Poverty
Denver Innovation
Students in Poverty
Denver District
Students in Poverty
Growth
(in
Days
of
Learning)
Learning Gains for Denver Charter School Students in
Poverty, Denver Innovation School Students in
Poverty, and Denver District School Students in
Poverty Compared to the Average Learning Gains of
Students in Poverty Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Students in Poverty
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Poverty vs. District Poverty
Innovation Poverty vs. District Poverty
Math
Charter Poverty vs. District Poverty
Innovation Poverty vs. District Poverty
Tests of Differences
sig
0
25
50
75
100
Denver ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for All ELL Students in Denver
Compared to the Average Learning Gains of ELL
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
ALL VS. STATE
0
25
50
75
100
Denver Charter
ELL Students
Denver Innovation
ELL Students
Denver District
ELL Students
Growth
(in
Days
of
Learning)
Learning Gains for ELL Students in Denver Charter
Schools, ELL Students in Denver Innovation Schools,
and ELL Students in Denver District Schools
Compared to the Average Learning Gains of ELL
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> ELL Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter ELL vs. District ELL
Innovation ELL vs. District ELL
Math
Charter ELL vs. District ELL
Innovation ELL vs. District ELL
Tests of Differences
sig
0
25
50
75
100
Denver Special Ed Students
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Students in Special
Education Compared to the Average Learning Gains of
Students in Special Education Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
ALL VS. STATE
0
25
50
75
100
Denver Charter
Students in Special Ed.
Denver Innovation
Students in Special Ed.
Denver District
Students in Special Ed.
Growth
(in
Days
of
Learning)
Learning Gains for Denver Charter School Students in
Special Ed., Denver Innovation School Students in
Special Ed., and Denver District School Students in
Special Ed. Compared to the Average Learning Gains
of Students in Special Ed. Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Special Ed Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Sped vs. District Sped
Innovation Sped vs. District Sped
Math
Charter Sped vs. District Sped
Innovation Sped vs. District Sped
Tests of Differences
sig
0
25
50
75
100
Denver Male Students
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Male Students
Compared to the Average Learning Gains of Male
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
ALL VS. STATE
0
25
50
75
100
Denver Charter
Male Students
Denver Innovation
Male Students
Denver District
Male Students
Growth
(in
Days
of
Learning)
Learning Gains for Male Students in Denver Charter
Schools, Male Students in Denver Innovation Schools,
and Male Students in Denver District Schools
Compared to the Average Learning Gains of Male
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Male Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Male vs. District Male
Innovation Male vs. District Male
Math
Charter Male vs. District Male
Innovation Male vs. District Male
Tests of Differences
sig
Reading
Charter Male vs. District Male
Innovation Male vs. District Male
Math
Charter Male vs. District Male
Innovation Male vs. District Male
Tests of Differences
sig
0
25
50
75
100
Denver Female Students
Growth
(in
Days
of
Learning)
Learning Gains for All Denver Female Students
Compared to the Average Learning Gains of Female
Students Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
ALL VS. STATE
0
25
50
75
100
Denver Charter
Female Students
Denver Innovation
Female Students
Denver District
Female Students
Growth
(in
Days
of
Learning)
Learning Gains for Female Students in Denver Charter
Schools, Female Students in Denver Innovation Schools,
and Female Students in Denver District Schools Compared
to the Average Learning Gains of Female Students
Statewide, by Subject
significantly different at p< 0.05
reading math
Research Findings > Student Subgroup Analysis
> Female Students
VS. STATE BY SECTOR & COMPARISON WITHIN DENVER
Reading
Charter Female vs. District Female
Innovation Female vs. District Female
Math
Charter Female vs. District Female
Innovation Female vs. District Female
Tests of Differences
sig
Summary of Findings
The summary of the findings from the analysis of Denver schools is presented here.
APPENDIXES
03
Acknowledgments
Student-level data were
provided by the
Colorado Department of
Education.
RootED Denver assisted CREDO with
verifying the list of public schools in
Denver.
Types of Charter Schools
• With more schools and students than a single charter
school, CMOs have some operational advantages in their
ability to spread administrative fixed costs, thus
providing the possibility of greater efficiency. In
addition, CMOs may be able to support additional
programs and more robust staffing.
• Whether CMOs lead to better student outcomes is a
matter of interest across the country.
OUR ANALYSES OF DENVER CHARTER
SCHOOLS INCLUDE A BREAKOUT OF
CMOS AND INDEPENDENT CHARTERS.
There are two types
of charter schools.
CHARTER MANAGEMENT ORGANIZATIONS (CMOS)
Organizations holding the charter and overseeing the
operation of at least three charter schools.
INDEPENDENT CHARTER SCHOOLS
Organization holding the charter and overseeing the
operation of a single charter school. It may run the school
directly or contract with an organization which provides
services to one or two charter schools.
Innovation Schools in Denver
are designated by Denver Public Schools to have
additional flexibility in their operation.
The public innovation schools in Innovation Zone
(IZONE) are included as the innovation category in
our analysis.
DENVER INNOVATION SCHOOLS
https://portfolio.dpsk12.org/dps-family-of-schools
LEARN MORE AT
There are two types of
innovation schools in Denver:
DISTRICT-RUN INNOVATION SCHOOLS
District-managed public schools with a strategic plan that
allows waivers to specific district policies, state statutes,
and collective bargaining agreements with the goal of
improving student outcomes and executing with excellence
a specific model. In study, district run innovation schools
are included in the district school category.
INNOVATION ZONE (IZONE)
A group of public innovation schools that share common
interests and seek additional flexibility
Methods
The annual academic growth of students in Denver from
2016-17 to 2018-19, overall and by sector, is benchmarked
to the state average growth, accounting for student
characteristics.
We also explore how one-year growth of Denver students for
the period ending in Spring 2019 differs by school type,
race, poverty status, English language learner status,
special education status, and gender.
Days of Learning
While these tools create precise and reliable answers,
they are presented in technical terms that are not
user-friendly to a general audience. To translate the
technical results into terms that are accessible to non-
technical audiences, CREDO developed Days of
Learning.
CREDO USES ADVANCED
TECHNOLOGY AND
SOPHISTICATED STATISTICAL
TOOLS TO MEASURE STUDENTS,
SCHOOLS AND THE EDUCATION
LANDSCAPE.
Think about the students in your state’s public schools. For many of their years
of schooling, they take achievement tests to measure what they know at the end of
the school year. We can identify the average score for each test each year.
Imagine a student who scores exactly at the average in one year, say 4th
grade, and then in the following year, scores exactly at the average again on the 5th-
grade test. The amount of year-to-year learning for that student show us what the
average learning is for all the students who took both tests.
We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th,
and so on.
CREDO uses those annual measures of average learning to represent a typical
year of learning, and equates that to a typical 180-day school year. We say that the
student in our example has gained 180 days of learning.
If a student makes more progress than the average student, we take the
amount of extra achievement and translate it into 180-days of learning plus “X” extra
days. We are creating a measure of student learning as if the student went to school
for 180 days plus X days. The size of “X” depends on how much more the student
learns than the average student — if it’s a lot more, then “X” will be a large number,
and if it’s a small amount more, “X” will be a small number.
The same is true for students who do not learn as much as the average
student. Instead of adding to the 180-days-of-learning average, we subtract from
that base to reflect the smaller-than-average advances that those students realize. In
these cases, the difference leads to numbers such a “165 days of learning” or “152
days of learning”. Against the average standard of 180 days, these smaller days show
that students learned as if they had only attended school for 180 days minus X days
during the school year.
01
02
03
04
05
06
3rd
Grade
4th
Grade
= 180
days
More than 180
days
Less than 180
days
Student
A
Student
A
Overall Denver Results
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
D e n v e r O v e r a l l 2 0 1 7 - 1 8 0.05** 31** 0.10** 57**
D e n v e r O v e r a l l 2 0 1 8 - 1 9 0.06** 35** 0.06** 32**
Denver School Sectors Compared
to State Average
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.06* 35* 0.12** 71**
C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.09** 54** 0.10** 60**
I n n o v a t i o n S c h o o l s 2 0 1 7 - 1 8 0.19** 110** 0.23** 132**
I n n o v a t i o n S c h o o l s 2 0 1 8 - 1 9 0.11* 66* 0.10 56
O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.03 18 0.07** 41**
O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.04** 23** 0.03 17
Comparison of School Sectors within Denver
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.03 16 0.05 30
C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.05* 30* 0.07* 43*
I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.16* 92* 0.16 91
I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.07 42 0.07 39
Charter Subsector Analysis
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
D e n v e r C M O s v s . S t a t e A v e r a g e 0.09** 54** 0.12** 73**
D e n v e r I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e 0.09** 54** 0.04 23
D e n v e r C M O s v s . D e n v e r I n d e p e n d e n t C h a r t e r s 0.00 0 0.09 50
Student Subgroup Analysis> Black Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Black Students
D e n v e r B l a c k S t u d e n t s O v e r a l l 0.02 11 0.02 13
D e n v e r C h a r t e r S c h o o l B l a c k S t u d e n t s 0.10** 58** 0.12** 71**
D e n v e r I n n o v a t i o n S c h o o l B l a c k S t u d e n t s -0.01 -9 -0.01 -5
D e n v e r O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.02 -12 -0.03 -16
Compared with Black Students in Other District Schools in
Denver
D e n v e r C h a r t e r S c h o o l B l a c k S t u d e n t s 0.12** 69** 0.15** 87**
D e n v e r I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.01 2 0.02 11
Student Subgroup Analysis> Hispanic Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Hispanic Students
D e n v e r H i s p a n i c S t u d e n t s O v e r a l l 0.04** 21** 0.05** 26**
D e n v e r C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.07** 43** 0.09** 53**
D e n v e r I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.10* 59* 0.08 44
D e n v e r O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s 0.01 5 0.02 10
Compared with Hispanic Students in Other District Schools
in Denver
D e n v e r C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.07* 38* 0.07* 43*
D e n v e r I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.09 54 0.06 34
Student Subgroup Analysis> Students in Poverty
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Students in Poverty
D e n v e r S t u d e n t s i n P o v e r t y O v e r a l l 0.04** 23** 0.05** 27**
D e n v e r C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.08** 49** 0.10** 61**
D e n v e r I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.08 46 0.05 27
D e n v e r O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y 0.01 5 0.02 10
Compared with Students in Poverty in Other District
Schools in Denver
D e n v e r C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.07** 43** 0.09** 51**
D e n v e r I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.07 40 0.03 17
Student Subgroup Analysis> ELL Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of ELL Students
D e n v e r E L L S t u d e n t s O v e r a l l 0.05** 27** 0.04* 23*
D e n v e r C h a r t e r S c h o o l E L L S t u d e n t s 0.07** 40** 0.06* 36*
D e n v e r I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.12 67 0.04 24
D e n v e r O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s 0.03 15 0.03 16
Compared with ELL Students in Other District Schools in
Denver
D e n v e r C h a r t e r S c h o o l E L L S t u d e n t s 0.04 24 0.03 20
D e n v e r I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.09* 52* 0.01 8
Student Subgroup Analysis> Special Ed Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Special Ed Students
D e n v e r S p e c i a l E d S t u d e n t s O v e r a l l 0.05** 31** 0.06** 37**
D e n v e r C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.11** 67** 0.10** 56**
D e n v e r I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.03 14 0.04 22
D e n v e r O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s 0.03* 18* 0.05** 31**
Compared with Special Ed Students in Other District
Schools in Denver
D e n v e r C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.08** 48** 0.04 24
D e n v e r I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s -0.01 -5 -0.02 -9
Student Subgroup Analysis> Male Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Male Students
D e n v e r M a l e S t u d e n t s O v e r a l l 0.06** 35** 0.05** 31**
D e n v e r C h a r t e r S c h o o l M a l e S t u d e n t s 0.09** 50** 0.10** 56**
D e n v e r I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.09 54 0.07 43
D e n v e r O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s 0.05** 26** 0.03* 17*
Compared with Male Students in Other District Schools in
Denver
D e n v e r C h a r t e r S c h o o l M a l e S t u d e n t s 0.04 24 0.07** 38**
D e n v e r I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.05 28 0.04 25
Student Subgroup Analysis> Female Students
Significant at p < 0.05*
Significant at p < 0.01**
R E A D I N G M A T H
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
S t a n d a r d
D e v i a t i o n
D a y s o f
L e a r n i n g
Compared with Statewide Average of Female Students
D e n v e r F e m a l e S t u d e n t s O v e r a l l 0.06** 35** 0.06** 34**
D e n v e r C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.10** 57** 0.11** 64**
D e n v e r I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.13* 78* 0.12 70
D e n v e r O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s 0.04* 20* 0.03 15
Compared with Female Students in Other District Schools
in Denver
D e n v e r C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.06* 36* 0.08* 48*
D e n v e r I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.10 57 0.09 54
THANK YOU

More Related Content

Similar to Denver, CO 2022 - City Study

Similar to Denver, CO 2022 - City Study (20)

DC_slide_deck_FINAL (1).pdf
DC_slide_deck_FINAL (1).pdfDC_slide_deck_FINAL (1).pdf
DC_slide_deck_FINAL (1).pdf
 
memphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdfmemphis_slide_deck_FINAL_20220429.pdf
memphis_slide_deck_FINAL_20220429.pdf
 
Washington DC. City Study 2022
Washington DC. City Study 2022Washington DC. City Study 2022
Washington DC. City Study 2022
 
Austin slide deck
Austin slide deckAustin slide deck
Austin slide deck
 
Houston slide deck
Houston slide deckHouston slide deck
Houston slide deck
 
2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study2022 Fort Worth Charter School City Study
2022 Fort Worth Charter School City Study
 
St_Louis_slide_deck_FINAL.pdf
St_Louis_slide_deck_FINAL.pdfSt_Louis_slide_deck_FINAL.pdf
St_Louis_slide_deck_FINAL.pdf
 
Denver 2019 - City Study
Denver 2019 - City StudyDenver 2019 - City Study
Denver 2019 - City Study
 
batonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdfbatonrouge_slide_deck_FINAL_20220429.pdf
batonrouge_slide_deck_FINAL_20220429.pdf
 
2022 Houston Chart School City Study
2022 Houston Chart School City Study2022 Houston Chart School City Study
2022 Houston Chart School City Study
 
2022 Austin Chart School City Study
2022 Austin Chart School City Study2022 Austin Chart School City Study
2022 Austin Chart School City Study
 
Washington DC 2019 - City Study
Washington DC 2019 - City StudyWashington DC 2019 - City Study
Washington DC 2019 - City Study
 
New Orleans, LA 2019 - City Study
New Orleans, LA 2019 - City StudyNew Orleans, LA 2019 - City Study
New Orleans, LA 2019 - City Study
 
Memphis, TN 2019 - City Study
Memphis, TN 2019 - City StudyMemphis, TN 2019 - City Study
Memphis, TN 2019 - City Study
 
Indianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City StudyIndianapolis, IN 2019 - City Study
Indianapolis, IN 2019 - City Study
 
St. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City StudySt. Louis, MO 2019 - City Study
St. Louis, MO 2019 - City Study
 
Kansas City, MO 2019 - City Study
Kansas City, MO 2019 - City StudyKansas City, MO 2019 - City Study
Kansas City, MO 2019 - City Study
 
Presentation by Duval County Public Schools Superintendent Dr. Nikolai Vitti ...
Presentation by Duval County Public Schools Superintendent Dr. Nikolai Vitti ...Presentation by Duval County Public Schools Superintendent Dr. Nikolai Vitti ...
Presentation by Duval County Public Schools Superintendent Dr. Nikolai Vitti ...
 
San Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City StudySan Antonio, TX 2019 - City Study
San Antonio, TX 2019 - City Study
 
School_Quality_Guide_2014_EMS_X125
School_Quality_Guide_2014_EMS_X125School_Quality_Guide_2014_EMS_X125
School_Quality_Guide_2014_EMS_X125
 

Recently uploaded

SPLICE Working Group: Reusable Code Examples
SPLICE Working Group:Reusable Code ExamplesSPLICE Working Group:Reusable Code Examples
SPLICE Working Group: Reusable Code Examples
Peter Brusilovsky
 

Recently uploaded (20)

Trauma-Informed Leadership - Five Practical Principles
Trauma-Informed Leadership - Five Practical PrinciplesTrauma-Informed Leadership - Five Practical Principles
Trauma-Informed Leadership - Five Practical Principles
 
ANTI PARKISON DRUGS.pptx
ANTI         PARKISON          DRUGS.pptxANTI         PARKISON          DRUGS.pptx
ANTI PARKISON DRUGS.pptx
 
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUMDEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
DEMONSTRATION LESSON IN ENGLISH 4 MATATAG CURRICULUM
 
The Story of Village Palampur Class 9 Free Study Material PDF
The Story of Village Palampur Class 9 Free Study Material PDFThe Story of Village Palampur Class 9 Free Study Material PDF
The Story of Village Palampur Class 9 Free Study Material PDF
 
ESSENTIAL of (CS/IT/IS) class 07 (Networks)
ESSENTIAL of (CS/IT/IS) class 07 (Networks)ESSENTIAL of (CS/IT/IS) class 07 (Networks)
ESSENTIAL of (CS/IT/IS) class 07 (Networks)
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Improved Approval Flow in Odoo 17 Studio App
Improved Approval Flow in Odoo 17 Studio AppImproved Approval Flow in Odoo 17 Studio App
Improved Approval Flow in Odoo 17 Studio App
 
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjjStl Algorithms in C++ jjjjjjjjjjjjjjjjjj
Stl Algorithms in C++ jjjjjjjjjjjjjjjjjj
 
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdfFICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
FICTIONAL SALESMAN/SALESMAN SNSW 2024.pdf
 
AIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.pptAIM of Education-Teachers Training-2024.ppt
AIM of Education-Teachers Training-2024.ppt
 
SPLICE Working Group: Reusable Code Examples
SPLICE Working Group:Reusable Code ExamplesSPLICE Working Group:Reusable Code Examples
SPLICE Working Group: Reusable Code Examples
 
Spring gala 2024 photo slideshow - Celebrating School-Community Partnerships
Spring gala 2024 photo slideshow - Celebrating School-Community PartnershipsSpring gala 2024 photo slideshow - Celebrating School-Community Partnerships
Spring gala 2024 photo slideshow - Celebrating School-Community Partnerships
 
An overview of the various scriptures in Hinduism
An overview of the various scriptures in HinduismAn overview of the various scriptures in Hinduism
An overview of the various scriptures in Hinduism
 
How To Create Editable Tree View in Odoo 17
How To Create Editable Tree View in Odoo 17How To Create Editable Tree View in Odoo 17
How To Create Editable Tree View in Odoo 17
 
male presentation...pdf.................
male presentation...pdf.................male presentation...pdf.................
male presentation...pdf.................
 
Observing-Correct-Grammar-in-Making-Definitions.pptx
Observing-Correct-Grammar-in-Making-Definitions.pptxObserving-Correct-Grammar-in-Making-Definitions.pptx
Observing-Correct-Grammar-in-Making-Definitions.pptx
 
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
24 ĐỀ THAM KHẢO KÌ THI TUYỂN SINH VÀO LỚP 10 MÔN TIẾNG ANH SỞ GIÁO DỤC HẢI DƯ...
 
Analyzing and resolving a communication crisis in Dhaka textiles LTD.pptx
Analyzing and resolving a communication crisis in Dhaka textiles LTD.pptxAnalyzing and resolving a communication crisis in Dhaka textiles LTD.pptx
Analyzing and resolving a communication crisis in Dhaka textiles LTD.pptx
 
How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17How to Send Pro Forma Invoice to Your Customers in Odoo 17
How to Send Pro Forma Invoice to Your Customers in Odoo 17
 
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of TransportBasic Civil Engineering notes on Transportation Engineering & Modes of Transport
Basic Civil Engineering notes on Transportation Engineering & Modes of Transport
 

Denver, CO 2022 - City Study

  • 2. Table of Contents 0 1 R E PORT OVE R VIE W • About The City Studies Project • Sectors of Schools • Research Question and Analyses • Measure of Academic Performance Student Subgroup Analysis Summary of Findings 0 3 APPE N DIX E S • Acknowledgments • Types of Charter Schools • Innovation Schools in Denver • Methods • Days of Learning • Full Set of Findings 0 2 R E SE AR CH F IN DIN G S • Reading & Math Overall Denver Results Sector Analysis • vs. state & comparison within Denver Charter Subsector Analysis • Reading • Math School-Level Performance by Sector Research Findings Cont’d. Black Students • all vs. state • vs. state by sector & comparison within Denver Hispanic Students • all vs. state • vs. state by sector & comparison within Denver Students in Poverty • all vs. state • vs. state by sector & comparison within Denver ELL Students • all vs. state • vs. state by sector & comparison within Denver Special Ed Students • all vs. state • vs. state by sector & comparison within Denver Male Students • all vs. state • vs. state by sector & comparison within Denver Female Students • all vs. state • vs. state by sector & comparison within Denver • Reading • Math
  • 4. About The City Studies Project Cohort 1 Cohort 2 The City Studies project examines the performance of schools in select U.S. cities, including Denver. We study the academic progress of students as the measure of school performance.
  • 5. O O C C C CHARTER SCHOOLS Public schools operated independently from the traditional school district, with autonomy in adapting school designs and held accountable for education results. Charter Management Organizations (CMOs) Organizations holding the charter and overseeing the operation of at least three charter schools. Independent Charter Schools Organizations holding the charter and overseeing the operation of a single or two charter schools. I-ZONE INNOVATION SCHOOLS An innovation zone is a group of public innovation schools that share common interests and seek additional flexibility OTHER DISTRICT-RUN SCHOOLS Public schools not belonging to any of above two types. District-run innovation schools are included in this category. C Sectors of Schools COMMUNITIES MAY HAVE UP TO THREE SECTORS OF SCHOOLS
  • 6. Research Question and Analyses IN THIS REPORT WE EXAMINE ACADEMIC PERFORMANCE IN DENVER USING DATA FROM THE SCHOOL YEARS 2016-17 THROUGH 2018-19. THERE ARE THREE LEVELS OF ANALYSIS. Overall performance in Denver schools over two years. • The performance of Denver students is benchmarked against the state average performance, accounting for student characteristics. • The performance of charter school students and the performance of Innovation school students within Denver are then compared to that of similar traditional public school (district school) students within Denver. Performance for Denver charter schools, Denver innovation schools and the rest of Denver public schools over two years. Performance in the 2018- 2019 school year by school type, race, poverty status, English language learner (ELL) status, special education status and gender. WE MAKE TWO SETS OF COMPARISONS. 01 02 03
  • 7. Achievement scores capture what a student knows at a point in time. They are influenced by students’ prior conditions in addition to schools’ contributions. Growth scores indicate how much progress a student makes from one year to the next. Growth scores allow us to zero in on the contributions of schools separately from other factors that affect point-in-time scores. ACHIEVEMENT VS. GROWTH We analyze student growth in standard deviation units so that the results can be assessed for statistical differences. The full set of findings appear in the Appendix. In the following graphs of findings, we transform growth from standard deviation units into days of learning based on a typical 180-day school year. IN THIS STUDY WE MEASURE ACADEMIC PERFORMANCE AS HOW MUCH GROWTH STUDENTS MAKE FROM ONE YEAR TO THE NEXT. Measure of Academic Performance
  • 9. 0 25 50 75 100 125 150 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) significantly different at p< 0.05 reading math Research Findings > Overall Denver Results > Reading & Math Average One-Year Learning Gains for All Denver Students Compared to the State Average Learning Gains, by Year and Subject
  • 10. 0 25 50 75 100 125 150 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Reading for Students in Denver Charter Schools, Denver Innovation Schools, and Denver District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter Innovation Research Findings > Sector Analysis > Reading VS. STATE & COMPARISON WITHIN DENVER charter Innovation district Reading Charter vs. District Innovation vs. District Charter vs. Innovation Tests of Differences '17-'18 '18-'19
  • 11. 0 25 50 75 100 125 150 SY 2017-2018 SY 2018-2019 Growth (in Days of Learning) Learning Gains in Math for Students in Denver Charter Schools, Denver Innovation Schools, and Denver District Schools Compared to the State Average Learning Gains, by Year significantly different at p< 0.05 charter Innovation district Research Findings > Sector Analysis > Math VS. STATE & COMPARISON WITHIN DENVER Math Charter vs. District Innovation vs. District Charter vs. Innovation Tests of Differences '17-'18 '18-'19
  • 12. 0 25 50 75 100 CMO Charter Schools Independent Charter Schools Growth (in Days of Learning) Relative Learning Gains for Students in Denver CMO- Affiliated Charter Schools and Independent Denver Charter Schools Compared to the Average Learning Gains for All Student in the State, by Subject significantly different at p< 0.05 reading math Research Findings > Charter Subsector Analysis > vs. state & comparison within Denver Reading CMOs vs Independent Charter Schools Math CMOs vs Independent Charter Schools sig Tests of Differences
  • 13. -400 -300 -200 -100 0 100 200 300 400 Growth (in Days of Learning) Charter District Innovation Research Findings > School-Level Performance by Sector > Reading
  • 14. -400 -300 -200 -100 0 100 200 300 400 Growth (in Days of Learning) Charter District Innovation Research Findings > School-Level Performance by Sector >Math
  • 15. -50 -25 0 25 50 75 100 Denver Black Students Growth (in Days of Learning) Learning Gains for All Denver Black Students Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students ALL VS. STATE
  • 16. -50 -25 0 25 50 75 100 Denver Charter Black Students Denver Innovation Black Students Denver District Black Students Growth (in Days of Learning) Learning Gains for Black Students in Denver Charter Schools, Black Students in Denver Innovation Schools, and Black Students in Denver District Schools Compared to the Average Learning Gains of Black Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Black Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Black vs. District Black Innovation Black vs. District Black Math Charter Black vs. District Black Innovation Black vs. District Black Tests of Differences sig
  • 17. -50 -25 0 25 50 75 100 Denver Hispanic Students Growth (in Days of Learning) Learning Gains for All Denver Hispanic Students Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students ALL VS. STATE
  • 18. -50 -25 0 25 50 75 100 Denver Charter Hispanic Students Denver Innovation Hispanic Students Denver District Hispanic Students Growth (in Days of Learning) Learning Gains for Hispanic Students in Denver Charter Schools, Hispanic Students in Denver Innovation Schools, and Hispanic Students in Denver District Schools Compared to the Average Learning Gains of Hispanic Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Hispanic Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Hispanic vs. District Hispanic Innovation Hispanic vs. District Hispanic Math Charter Hispanic vs. District Hispanic Innovation Hispanic vs. District Hispanic Tests of Differences sig
  • 19. 0 25 50 75 100 Denver Students in Poverty Growth (in Days of Learning) Learning Gains for All Denver Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty ALL VS. STATE
  • 20. 0 25 50 75 100 Denver Charter Students in Poverty Denver Innovation Students in Poverty Denver District Students in Poverty Growth (in Days of Learning) Learning Gains for Denver Charter School Students in Poverty, Denver Innovation School Students in Poverty, and Denver District School Students in Poverty Compared to the Average Learning Gains of Students in Poverty Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Students in Poverty VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Poverty vs. District Poverty Innovation Poverty vs. District Poverty Math Charter Poverty vs. District Poverty Innovation Poverty vs. District Poverty Tests of Differences sig
  • 21. 0 25 50 75 100 Denver ELL Students Growth (in Days of Learning) Learning Gains for All ELL Students in Denver Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students ALL VS. STATE
  • 22. 0 25 50 75 100 Denver Charter ELL Students Denver Innovation ELL Students Denver District ELL Students Growth (in Days of Learning) Learning Gains for ELL Students in Denver Charter Schools, ELL Students in Denver Innovation Schools, and ELL Students in Denver District Schools Compared to the Average Learning Gains of ELL Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > ELL Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter ELL vs. District ELL Innovation ELL vs. District ELL Math Charter ELL vs. District ELL Innovation ELL vs. District ELL Tests of Differences sig
  • 23. 0 25 50 75 100 Denver Special Ed Students Growth (in Days of Learning) Learning Gains for All Denver Students in Special Education Compared to the Average Learning Gains of Students in Special Education Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students ALL VS. STATE
  • 24. 0 25 50 75 100 Denver Charter Students in Special Ed. Denver Innovation Students in Special Ed. Denver District Students in Special Ed. Growth (in Days of Learning) Learning Gains for Denver Charter School Students in Special Ed., Denver Innovation School Students in Special Ed., and Denver District School Students in Special Ed. Compared to the Average Learning Gains of Students in Special Ed. Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Special Ed Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Sped vs. District Sped Innovation Sped vs. District Sped Math Charter Sped vs. District Sped Innovation Sped vs. District Sped Tests of Differences sig
  • 25. 0 25 50 75 100 Denver Male Students Growth (in Days of Learning) Learning Gains for All Denver Male Students Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students ALL VS. STATE
  • 26. 0 25 50 75 100 Denver Charter Male Students Denver Innovation Male Students Denver District Male Students Growth (in Days of Learning) Learning Gains for Male Students in Denver Charter Schools, Male Students in Denver Innovation Schools, and Male Students in Denver District Schools Compared to the Average Learning Gains of Male Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Male Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Male vs. District Male Innovation Male vs. District Male Math Charter Male vs. District Male Innovation Male vs. District Male Tests of Differences sig Reading Charter Male vs. District Male Innovation Male vs. District Male Math Charter Male vs. District Male Innovation Male vs. District Male Tests of Differences sig
  • 27. 0 25 50 75 100 Denver Female Students Growth (in Days of Learning) Learning Gains for All Denver Female Students Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students ALL VS. STATE
  • 28. 0 25 50 75 100 Denver Charter Female Students Denver Innovation Female Students Denver District Female Students Growth (in Days of Learning) Learning Gains for Female Students in Denver Charter Schools, Female Students in Denver Innovation Schools, and Female Students in Denver District Schools Compared to the Average Learning Gains of Female Students Statewide, by Subject significantly different at p< 0.05 reading math Research Findings > Student Subgroup Analysis > Female Students VS. STATE BY SECTOR & COMPARISON WITHIN DENVER Reading Charter Female vs. District Female Innovation Female vs. District Female Math Charter Female vs. District Female Innovation Female vs. District Female Tests of Differences sig
  • 29. Summary of Findings The summary of the findings from the analysis of Denver schools is presented here.
  • 31. Acknowledgments Student-level data were provided by the Colorado Department of Education. RootED Denver assisted CREDO with verifying the list of public schools in Denver.
  • 32. Types of Charter Schools • With more schools and students than a single charter school, CMOs have some operational advantages in their ability to spread administrative fixed costs, thus providing the possibility of greater efficiency. In addition, CMOs may be able to support additional programs and more robust staffing. • Whether CMOs lead to better student outcomes is a matter of interest across the country. OUR ANALYSES OF DENVER CHARTER SCHOOLS INCLUDE A BREAKOUT OF CMOS AND INDEPENDENT CHARTERS. There are two types of charter schools. CHARTER MANAGEMENT ORGANIZATIONS (CMOS) Organizations holding the charter and overseeing the operation of at least three charter schools. INDEPENDENT CHARTER SCHOOLS Organization holding the charter and overseeing the operation of a single charter school. It may run the school directly or contract with an organization which provides services to one or two charter schools.
  • 33. Innovation Schools in Denver are designated by Denver Public Schools to have additional flexibility in their operation. The public innovation schools in Innovation Zone (IZONE) are included as the innovation category in our analysis. DENVER INNOVATION SCHOOLS https://portfolio.dpsk12.org/dps-family-of-schools LEARN MORE AT There are two types of innovation schools in Denver: DISTRICT-RUN INNOVATION SCHOOLS District-managed public schools with a strategic plan that allows waivers to specific district policies, state statutes, and collective bargaining agreements with the goal of improving student outcomes and executing with excellence a specific model. In study, district run innovation schools are included in the district school category. INNOVATION ZONE (IZONE) A group of public innovation schools that share common interests and seek additional flexibility
  • 34. Methods The annual academic growth of students in Denver from 2016-17 to 2018-19, overall and by sector, is benchmarked to the state average growth, accounting for student characteristics. We also explore how one-year growth of Denver students for the period ending in Spring 2019 differs by school type, race, poverty status, English language learner status, special education status, and gender.
  • 35. Days of Learning While these tools create precise and reliable answers, they are presented in technical terms that are not user-friendly to a general audience. To translate the technical results into terms that are accessible to non- technical audiences, CREDO developed Days of Learning. CREDO USES ADVANCED TECHNOLOGY AND SOPHISTICATED STATISTICAL TOOLS TO MEASURE STUDENTS, SCHOOLS AND THE EDUCATION LANDSCAPE. Think about the students in your state’s public schools. For many of their years of schooling, they take achievement tests to measure what they know at the end of the school year. We can identify the average score for each test each year. Imagine a student who scores exactly at the average in one year, say 4th grade, and then in the following year, scores exactly at the average again on the 5th- grade test. The amount of year-to-year learning for that student show us what the average learning is for all the students who took both tests. We do that calculation for every grade the state tests: 4th to 5th, 5th to 6th, and so on. CREDO uses those annual measures of average learning to represent a typical year of learning, and equates that to a typical 180-day school year. We say that the student in our example has gained 180 days of learning. If a student makes more progress than the average student, we take the amount of extra achievement and translate it into 180-days of learning plus “X” extra days. We are creating a measure of student learning as if the student went to school for 180 days plus X days. The size of “X” depends on how much more the student learns than the average student — if it’s a lot more, then “X” will be a large number, and if it’s a small amount more, “X” will be a small number. The same is true for students who do not learn as much as the average student. Instead of adding to the 180-days-of-learning average, we subtract from that base to reflect the smaller-than-average advances that those students realize. In these cases, the difference leads to numbers such a “165 days of learning” or “152 days of learning”. Against the average standard of 180 days, these smaller days show that students learned as if they had only attended school for 180 days minus X days during the school year. 01 02 03 04 05 06 3rd Grade 4th Grade = 180 days More than 180 days Less than 180 days Student A Student A
  • 36. Overall Denver Results Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g D e n v e r O v e r a l l 2 0 1 7 - 1 8 0.05** 31** 0.10** 57** D e n v e r O v e r a l l 2 0 1 8 - 1 9 0.06** 35** 0.06** 32**
  • 37. Denver School Sectors Compared to State Average Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s 2 0 1 7 - 1 8 0.06* 35* 0.12** 71** C h a r t e r S c h o o l s 2 0 1 8 - 1 9 0.09** 54** 0.10** 60** I n n o v a t i o n S c h o o l s 2 0 1 7 - 1 8 0.19** 110** 0.23** 132** I n n o v a t i o n S c h o o l s 2 0 1 8 - 1 9 0.11* 66* 0.10 56 O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.03 18 0.07** 41** O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.04** 23** 0.03 17
  • 38. Comparison of School Sectors within Denver Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.03 16 0.05 30 C h a r t e r S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.05* 30* 0.07* 43* I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 7 - 1 8 0.16* 92* 0.16 91 I n n o v a t i o n S c h o o l s v s . O t h e r D i s t r i c t S c h o o l s 2 0 1 8 - 1 9 0.07 42 0.07 39
  • 39. Charter Subsector Analysis Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g D e n v e r C M O s v s . S t a t e A v e r a g e 0.09** 54** 0.12** 73** D e n v e r I n d e p e n d e n t C h a r t e r s v s . S t a t e A v e r a g e 0.09** 54** 0.04 23 D e n v e r C M O s v s . D e n v e r I n d e p e n d e n t C h a r t e r s 0.00 0 0.09 50
  • 40. Student Subgroup Analysis> Black Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Black Students D e n v e r B l a c k S t u d e n t s O v e r a l l 0.02 11 0.02 13 D e n v e r C h a r t e r S c h o o l B l a c k S t u d e n t s 0.10** 58** 0.12** 71** D e n v e r I n n o v a t i o n S c h o o l B l a c k S t u d e n t s -0.01 -9 -0.01 -5 D e n v e r O t h e r D i s t r i c t S c h o o l B l a c k S t u d e n t s -0.02 -12 -0.03 -16 Compared with Black Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l B l a c k S t u d e n t s 0.12** 69** 0.15** 87** D e n v e r I n n o v a t i o n S c h o o l B l a c k S t u d e n t s 0.01 2 0.02 11
  • 41. Student Subgroup Analysis> Hispanic Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Hispanic Students D e n v e r H i s p a n i c S t u d e n t s O v e r a l l 0.04** 21** 0.05** 26** D e n v e r C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.07** 43** 0.09** 53** D e n v e r I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.10* 59* 0.08 44 D e n v e r O t h e r D i s t r i c t S c h o o l H i s p a n i c S t u d e n t s 0.01 5 0.02 10 Compared with Hispanic Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l H i s p a n i c S t u d e n t s 0.07* 38* 0.07* 43* D e n v e r I n n o v a t i o n S c h o o l H i s p a n i c S t u d e n t s 0.09 54 0.06 34
  • 42. Student Subgroup Analysis> Students in Poverty Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Students in Poverty D e n v e r S t u d e n t s i n P o v e r t y O v e r a l l 0.04** 23** 0.05** 27** D e n v e r C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.08** 49** 0.10** 61** D e n v e r I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.08 46 0.05 27 D e n v e r O t h e r D i s t r i c t S c h o o l S t u d e n t s i n P o v e r t y 0.01 5 0.02 10 Compared with Students in Poverty in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l S t u d e n t s i n P o v e r t y 0.07** 43** 0.09** 51** D e n v e r I n n o v a t i o n S c h o o l S t u d e n t s i n P o v e r t y 0.07 40 0.03 17
  • 43. Student Subgroup Analysis> ELL Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of ELL Students D e n v e r E L L S t u d e n t s O v e r a l l 0.05** 27** 0.04* 23* D e n v e r C h a r t e r S c h o o l E L L S t u d e n t s 0.07** 40** 0.06* 36* D e n v e r I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.12 67 0.04 24 D e n v e r O t h e r D i s t r i c t S c h o o l E L L S t u d e n t s 0.03 15 0.03 16 Compared with ELL Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l E L L S t u d e n t s 0.04 24 0.03 20 D e n v e r I n n o v a t i o n S c h o o l E L L S t u d e n t s 0.09* 52* 0.01 8
  • 44. Student Subgroup Analysis> Special Ed Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Special Ed Students D e n v e r S p e c i a l E d S t u d e n t s O v e r a l l 0.05** 31** 0.06** 37** D e n v e r C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.11** 67** 0.10** 56** D e n v e r I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s 0.03 14 0.04 22 D e n v e r O t h e r D i s t r i c t S c h o o l S p e c i a l E d S t u d e n t s 0.03* 18* 0.05** 31** Compared with Special Ed Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l S p e c i a l E d S t u d e n t s 0.08** 48** 0.04 24 D e n v e r I n n o v a t i o n S c h o o l S p e c i a l E d S t u d e n t s -0.01 -5 -0.02 -9
  • 45. Student Subgroup Analysis> Male Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Male Students D e n v e r M a l e S t u d e n t s O v e r a l l 0.06** 35** 0.05** 31** D e n v e r C h a r t e r S c h o o l M a l e S t u d e n t s 0.09** 50** 0.10** 56** D e n v e r I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.09 54 0.07 43 D e n v e r O t h e r D i s t r i c t S c h o o l M a l e S t u d e n t s 0.05** 26** 0.03* 17* Compared with Male Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l M a l e S t u d e n t s 0.04 24 0.07** 38** D e n v e r I n n o v a t i o n S c h o o l M a l e S t u d e n t s 0.05 28 0.04 25
  • 46. Student Subgroup Analysis> Female Students Significant at p < 0.05* Significant at p < 0.01** R E A D I N G M A T H S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g S t a n d a r d D e v i a t i o n D a y s o f L e a r n i n g Compared with Statewide Average of Female Students D e n v e r F e m a l e S t u d e n t s O v e r a l l 0.06** 35** 0.06** 34** D e n v e r C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.10** 57** 0.11** 64** D e n v e r I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.13* 78* 0.12 70 D e n v e r O t h e r D i s t r i c t S c h o o l F e m a l e S t u d e n t s 0.04* 20* 0.03 15 Compared with Female Students in Other District Schools in Denver D e n v e r C h a r t e r S c h o o l F e m a l e S t u d e n t s 0.06* 36* 0.08* 48* D e n v e r I n n o v a t i o n S c h o o l F e m a l e S t u d e n t s 0.10 57 0.09 54