Recommended
More Related Content
Viewers also liked
Similar to West London Zone: Shared measurement system
Similar to West London Zone: Shared measurement system (20)
Recently uploaded
Recently uploaded (20)
West London Zone: Shared measurement system
- 1. Data Emily Barran, Project Officer Rosario Piazza, Policy & Research Officer 1
- 2. Our findings from delivery organisations 2 Data Collection Org 1 Org 2 Org 3 Org 4 Org 5 Org 6 Org 7 Org 8 What data do you collect? Personal Demographic Attendance Academic Behavioural How is it collected? Referral/application form Register Intake/mid-way/exit assessment Questionnaire/survey Case files Who provides it? Frontline worker Parent Beneficiary Teacher Admin staff Why is the data collected? Case management Internal evaluation External evaluation Funder/contract requirements When is the data collected? Intake Exit Academic timetable Through programme delivery Post-engagement Evaluation What analysis is performed internally? Impact on academic performance Behavioural trends Comparison analysis of cohort Programme evaluation External evaluation? Systems How is the data stored? Bespoke system Off-the-shelf CRM/database Statutory system Excel Paper Data sharing Do you share data with any other organisations? Aggregated Individual Informal Informal Informal
- 3. Data management and measurement 3 Planning Collection Sharing Processing Aggregating Measurement Reporting Reflection Partners and backbone agree timings and data points to be collected Partners collect agreed personal, demographic and indicator data from children and young people at beginning and end of programme (or at regular intervals) Partners send data to backbone Backbone checks data Backbone adds data to master record spreadsheet Backbone runs analysis on the aggregated data to track progress towards collective outcomes and evaluation Backbone produces data visualisation dashboards and shares findings with partners, community & funders Partners and backbone review results and share feedback on the process
- 4. Name: Arman Berwari Gender: Male DoB: 20/02/2006 Age: 9 Ethnicity: Kurdish First Language: Kurdish Religion: Sunni Islam Address: Flat 2, Newall Court, Heathstan Road, Shepherd's Bush W12 0SQ School: Wormholt Park Statutory Provision: FSM, School Clothing, School Transport and SEN provision (Action) Father: Unknown Mother: Ajwan Berwari (born in 1987), moved to England in 2005 Siblings profile: One older sister, Lalereng (age 11, born 17/04/2004) EAL, FSM, no SEN provision Economic Participation: Low Socio-Economic participation (NS-SeC) Early Home Learning Environment: Was recorded as Low-Intensity EHLE Household Composition: Overcrowded - 1 bedroom council flat, 3 residents IDACI: 3,589 IMD: 3,064 Employment Index: 4,862 Income Deprivation: 2,231 IMDs Top Rank: 32,482 Individual child dashboard (Fictional for illustration purposes only) Source: School data, School census, Housing Register, Census and IMD DEMOGRAPHICS
- 5. Individual child dashboard (Summary snapshot of some indicators, fictional for illustration purposes only) ACADEMIC PERFORMANCE LEARNING & DEVELOPMENT EYFS Profile: Was recorded as : ‘Not yet reaching level of development (emerging) Phonics Test: 22/40 KS1: Achieved Level 2 in English, did not achieve Level 2 in Writing and Maths KS2: Currently working towards Level 3 Source: School data DEVELOPMENTAL MILESTONES Executive Functioning: 0 20 40 60 80 100 Inhibition Shift Emotional Control Behavioural Regulation Index Initiation Working memory Planning/Organization Organization of Materials Self-Monitoring Metacognition Index Global Executive Composite Speech & Language, Numeracy & Literacy: HEALTH CHECKLIST HEALTH & WELLBEING Nutrition: Yes No Bottlefed EY Breakfast-Club GREEN: in average range; ORANGE: at risk Immunisation: Due (child's age) Completed? 2, 3, 4 & 36 months 2, 4 & 12 months 2 & 3 months 3 & 12 months 2, 3 & 4 years 1 & 3 years RELATIONSHIPS & BEHAVIOUR EMOTIONAL WELLBEING School attendance: 50% 60% 70% 80% 90% 100% Autumn Spring Summer Engagement with learning: 50% 60% 70% 80% 90% 100% Autumn Spring Summer Weight: Height Weight Birth 18/19.4 6.5/7.3 Age 2: 28.7/29.2 19.8/20.4 Age 5: 40/39.5 34/34 Year 11: 53/52.5 62/62 Year 1 Year 2 Year 3 Year 4 Year 5 Speech & Language Numeracy & Literacy Expected Level 0 1 2 3 4 5 6 7 8 9 10 Emotional Symptoms Conduct Problems Hyperactivity/Inattention Peer Relationship Problems Prosocial Behaviour SDQ score COMMUNITY PARTICIPATION Engagement with sport: Teacher’s feedback: Some reports of lack of attention and engagement with learning. Counselling and professional support may be required to support prosocial behaviour and age appropriate emotional development. Source: EYFS Profile/School data Source: External social sector provider Source: External social sector provider Source: External social sector provider Physical Activity: After school football club by external provider Source: Children's Centre, Local GP and Department of Health Source: School data Source: Teacher’s quantitative assessment Source: External social sector provider Source: School arts programme Engagement with arts: 0% 50% 100% Autumn Winter Spring Summer Attendance Progression Resilience 0% 20% 40% 60% 80% 100% Autumn Winter Spring Summer Attendance Engagement Progression Parental feedback: Mother reports working hard to read together every evening but struggling to engage. Enthused by positive engagement with sport and upwards trend in progression.
- 6. Cohort analytics (Fictional for illustration purposes only) Name Age Ethnicity EAL FSM SEN KS1 KS2 School Attendance School Engagement Arman Berwari 9 Kurdish Rima Anderson 14 White and Asian Kulane Ibráhim 13 Black African Clare Johnson 11 White 0 1 2 3 Reading Writing English Maths Science KS1 KS1 Expected Level 0 1 2 3 Reading Writing English Maths Science KS1 KS1 Expected Level 0 1 2 3 Reading Writing English Maths Science KS1 KS1 Expected Level 0 1 2 3 4 Reading Writing English Maths Science KS1 KS1 Expected Level 0 1 2 3 4 Reading Writing English Maths Science KS2 KS2 Expected Level 0 1 2 3 4 Reading Writing English Maths Science KS2 KS2 Expected Level 0 1 2 3 4 Reading Writing English Maths Science KS2 KS2 Expected Level 0 1 2 3 4 Reading Writing English Maths Science KS2 KS2 Expected Level 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer 50% 60% 70% 80% 90% 100% Autumn Spring Summer Source: School data 77% 49% 70% 76% 80% 23% 51% 30% 24% 20% 0% 20% 40% 60% 80% 100% Reading Writing English Maths Science KS1 Level 2 or + KS1 Level 1 or - Percentage of students who failed and achieved at KS1 64% 60% 62% 77% 77% 36% 40% 38% 23% 23% 0% 20% 40% 60% 80% 100% Reading Writing English Maths Science KS2 Level 4 or + KS2 Level 3 or - Percentage of students who failed and achieved at KS2 22% 27% 24% 15% 3% 23% 25% 21% 13% 4% 0% 10% 20% 30% EAL FSM Action Action Plus Statement of Need KS1 Level 1 or - KS2 Level 3 or - Percentage of students who failed at KS1 and KS2 by characteristics
Editor's Notes
- Emily: I met with delivery partners to explore how they collect, process and analyse data to inform how we would proceed towards trying to achieve shared measurement. Ross: I have been working with data at LBHF to analyse needs and indicators of needs for children in White City and north LBHF
- Our exploration shows no continuity. If there was continuity there would be solid green lines for these questions across all organisations, and there aren’t any. So we have listened and decided that when we first start with our pilot, which Louisa will explain to you, we will simply take data from our delivery partners in excel spreadsheets via email, and we will process it and conduct our first attempt at shared measurement in excel. There isn’t an out-of-the-box technology solution to data sharing when everyone is using different systems. Key is to get the process right – tested and refined as a group. Try and change that as little as possible. Technology later, hopefully after the pilot, but when the time is right.
- Our suggestion for a process is 8 steps: Planning: We will only be asking ‘the minimum amount’ of data from partners in the pilot – the three key things we need from you in a common framework that we all agree to track the outcomes we agree Collection: during and at the start/end of delivery (Timing?) Sharing: Partners to share data (in csv files) with the backbone Process & aggregating: where technology will be a real help Measurement – minimum requirements at first: Tracking outcomes Referral triggers Reporting: to partners, funders, (children?), public (quarterly & annual results) Reflection: opportunity throughout to reflect on the process & results, give feedback, plan changes Start again – constant communication NB we will only be asking for e.g. 3? key pieces of data to show us outcomes we need to track – what is realistic re basic child baseline info, then info for tracking outcomes??
- As well as looking at deliver partners data collection and management systems, I have been working closely, 2 days per week, with the LBHF xxx team. I have been allowed to work on site to analyse educational data so as to understand the key indicators of poor educational attainment. This has helped us to piece together how we can best assess and support children through their lives. This is an illustration of how we hope to construct an individual dashboard on each WLZ child. [pick out a couple of points including EYFS so as to click through]
- As well as looking at deliver partners data collection and management systems, I have been working closely, 2 days per week, with the LBHF xxx team. I have been allowed to work on site to analyse educational data so as to understand the key indicators of poor educational attainment. This has helped us to piece together how we can best assess and support children through their lives. This is an illustration of how we hope to construct an individual dashboard on each WLZ child. [pick out a couple of points including EYFS so as to click through]
- These individual dashboards will enable overall analysis of our cohorts of children and comparisions wthin the cohort. Explain slide. There will be hurdles to overcome with data protection but our pilot schools/centres are keen to work with us and with parents to gain consent to enable this level of analysis.