The document discusses the Bell program aimed at improving academic achievement for children in under-resourced communities through summer and after-school programs. It highlights the importance of addressing summer learning loss which affects disadvantaged students significantly compared to their middle-income peers. Additionally, it outlines challenges in measuring the success of a playable technology program and proposes solutions for better assessment and curriculum improvement.

1. 0
Evaluating Success:
HIVE Playable Technology Project
January 13, 2016

2. Our Vision is for All
Children to Excel
• MISSION:
Transform the academic achievements, self-
confidence, and life trajectories of children living in
under-resourced communities.
• APPROACH:
BELL partners with schools and community
organizations to combine resources and leverages
time in the summer and after school to improve
student achievement.
15
School Partners
3,500
Scholars Served (2015)

3. Summer Learning Loss
66%
of the academic achievement gap between
disadvantaged students and their higher-income
peers in 8th grade can be traced to unequal
access to summer learning
opportunities.
+1 Month
Middle-Income Students Gain
Academic Skills in the Summer
-2 Months
Disadvantaged Students Lose
Academic Skills in the Summer
Reading Achievement, Middle - Income Student
Reading Achievement, Disadvantaged Student
Source: National Summer Learning Association

4. Evaluation at BELL

5. Why Measure?
Short term impact on student’s basic math and
literacy skills
Effectiveness of curriculum
Effectiveness of teachers and program staff
Engagement of parents/guardians and students with
learning
What students like and don't like
How to improve

6. Assessment & Evaluation
QUANTITATIVE TOOLS
STAR Enterprise Assessments
Scholar Management System
(Salesforce.com)
Independent Evidence
QUALITATIVE TOOLS
Parent Survey
Teacher Survey
Quality Monitoring System
A rigorous, independent evaluation
of BELL Summer found strong
evidence that the program increases
scholars’ academic skills and
parental engagement.

7. Challenges:
Measuring Success of Playable Technology Program
1. How to test students
for improvement in
specific curricular
concepts? For
example, problem
solving or
implementing
hypothesis.
2. How to gauge
student’s engagement
with STEM enrichment
program?

8. Solutions:
• CONTROL GROUP COMPARISON
• ENHANCE CURRENT MEASURING
TOOLS
• ARRANGE CIRRICULUM GOALS
AROUND PRE-DETERMINED
CONCEPTS

9. Sample Updated Survey:
1. HowmuchdidyouenjoythePlayableTechenrichmentclass? Not at all Alittlebit Some Quitea bit
Atremendous
amount
2. Howmuchdidyoulearnabout buildingwearableinterfacesthis
summer?
Almost
Nothing
Alittlebit Some Quitea bit
Atremendous
amount
3. Didyoufindtheplayabletechcourseeasyordifficult? Veryeasy
Somewhat
easy
Both easy
and difficult
Somewhat
difficult
Verydifficult
Think about each sentenceand put an Xin theboxthat matcheshowyou feel about it. Yes Maybe No
4. Wouldyoutakeanotherclassinvolvingcoding?
5. Wouldyoutellyourfriendstotakea classonwearabletechnology?
6. Wouldyouwanttodocodingasa jobwhenyougrowup?
7. WhatwasyourfavoritepartaboutthePlayableTechnologyclass? __________________________________________________
8. Whataresomeprojectsyouworkedonduringthe PlayableTechnologyclass? __________________________________________________

10. Enhanced Curriculum :
The Scientific Method
We plan to adapt the
curriculum to reflect the
scientific method. The scientific
method provides clear
guidelines for instructors to
gauge student comprehension
of basic curricular concepts
that are not captured through
the STAR assessment tool.

11. Thank You!
10