Presentation from the Kingston Data Hack Day June 2018

1. Using Kobo Toolbox to collect
Feedback Data
Pros and Cons

2. A brief summary of what MAN&BOY do:
• Provide camps and courses to cohorts of 12 families (camps)
• 8 families (courses)
• Support families who are struggling in particular boys aged 9-12 years
in transition
• Look at some key markers that may help a relationship to grow and
for families to support themselves in the “struggle”
• Follow up events

3. What we try and find out at the start:
• Family context at enrolment
• 2 issues are scaled 1-10 (with narrative)
• Man asked questions about relationship with the boy – scaled 1-10
During the programme:
Boy’s self esteem questions (8 questions)
Both are asked questions about:
• Relationship
• Communication
• Aspiration

4. What we want to know at the end:
• Over 12 months how the issues scores change (and narrative)
• End of course how the man feels now about the relationship and
communication with the boy. Have either built aspiration for the
future?
• How does the boy feel about his self esteem – measured with a short
Robson Questionnaire.
• General feedback – quality control, team reflection, improvements for
next time.

5. How do we do this?
• Kobo toolbox to collect the data
• Excel spreadsheets to manipulate the data
• Summary tool (Excel summary) to report the data
• Support from Family Therapists and Psychologists from Kingston
University, in writing our therapeutic questions.

6. What do we use it for?
• To plot and research how a boy and a family interact during the
programme.
• Relationship and bond (improve or decline)
• Communication and aspiration improve (or decline) over their
involvement with MAN&BOY
• To improve the programme
• To inform funders

7. Live demonstration of KOBO
• Input to tablets on and offline (offline problematic) using Enteko
smart paper, through the MAN&BOY website or app (for offline)
• Questionnaires easy to build but take time (user training)
• When it works it’s quick and easy, results in are in one place ready to
download, easy to keep anon GDPR friendly!
• Basic text available but not easy to add graphics for ease of use for
those with literacy needs, therefore:
• Does not lend itself to quality narrative feedback.
• Results culminate in raw data on KOBO – format has to be
manipulated in Excel (can be time consuming)

8. Raw data looks like this – (A KOBO table)

9. Data is manipulated manually
• Data manipulated in Excel charts
• Transposed into usable format
• Is summarised and aggregated
• Any data quality issues are resolved at this stage, i.e. those who do
not complete both surveys, only use complete data
• Data manipulated in Excel no front end reporting tool is used.

10. Creating Net Promotor Scores and
Aggregating Results: Staging table
Relationship Building Course Spring 2016
Adults Young People
How well did you get on with him?
Before the course 4 2 4 4 3 2 4 2 3 5 3 4
After the course 5 5 5 4 5 3 5 5 5 5 5 5
1 3 1 0 2 1 1 3 2 0 2 1
How well did you talk together?
Before the course 4 2 4 3 3 3 3 2 4 4 2 3
After the course 5 4 5 4 4 4 5 4 5 5 4 5
1 2 1 1 1 1 2 2 1 1 2 2
How well did you understand what made him tick?
Before the course 4 3 4 3 2 2 5 3 3 2 1 4
After the course 5 3 5 4 4 3 5 3 4 3 3 4
1 0 1 1 2 1 0 0 1 1 2 0
How well did he listen to you?
Before the course 3 2 3 3 3 2 4 2 5 3 2 4
After the course 5 4 4 4 4 2 5 4 5 4 3 5
2 2 1 1 1 0 1 2 0 1 1 1
How well did you listen to him?
Before the course 4 1 3 3 2 3 5 2 3 3 3 3
After the course 5 3 5 4 4 4 5 3 5 4 5 4
1 2 2 1 2 1 0 1 2 1 2 1
How well did you really know him?
Before the course 4 4 4 3 4 2 5 0 3 4 2 0
After the course 5 5 5 4 4 3 5 0 4 4 4 0
1 1 1 1 0 1 0 0 1 0 2 0
Please answer the following questions using the following scale: 3 is highest level of improvement.
HOW MUCH HAS THIS COURSE:
Improved your relationship with him 3 3 3 2 3 2 3 3 3 2 3 2
Helped you understand him better 3 3 3 2 2 2 3 3 3 2 3 3
Helped you listen to him better 3 3 3 2 3 2 3 2 3 3 3 3
Helped you talk to him better 3 2 3 3 3 2 3 3 3 3 3 2
Helped you stay calmer with him 3 3 2 1 3 3 3 2 2 1 2 3
Increased your confidence in dealing with him 3 3 3 3 3 2 3 3 3 2 2 3
Made you feel you want to spend more time with him 3 3 3 1 3 2 3 3 3 3 3 3
Made you feel you want to work harder at school 2 2 3 3 1 2
Inspired you to want to do something positive in the future 3 3 3 2 3 2 3 3 3 3 3 3
Please complete the following questions below about the person who came with you on the course using the following scale
A simple formula
creates a net
promotor score

11. Man&Boy Courses (June 2015 - April 2016) Outcome Scores for the 66 people (33 families) Supported
Net Improvement Scores
(After Course - Before Course)
Improved
by 4
Improved
by 3
Improved
by 2
Improved
by 1
Improved No change
Improved or
No change
Worstened No Score given
0 6 20 30 56 10 66 0 0
0% 9% 30% 45% 85% 15% 100% 0% 0%
0 5 21 33 59 6 65 0 1
0% 8% 32% 50% 89% 9% 98% 0% 2%
1 7 19 22 49 15 64 0 2
2% 11% 29% 33% 74% 23% 97% 0% 3%
1 1 22 24 48 15 63 2 1
2% 2% 33% 36% 73% 23% 95% 3% 2%
2 4 17 26 49 16 65 0 1
3% 6% 26% 39% 74% 24% 98% 0% 2%
0 1 12 29 42 22 64 0 2
0% 2% 18% 44% 64% 33% 97% 0% 3%
How much has this Course: A great deal A great deal % A little
A great deal/
A little %
Not at all Not at all %
Improved your relationship with him 42 66% 22 34%
Helped you understand him better 34 53% 30 47%
Helped you listen to him better 43 67% 21 33%
Helped you talk to him better 44 69% 20 31%
Helped you stay calmer with him 34 54% 21 33% 8 13%
Increased your confidence in dealing with him 39 61% 23 36% 2 3%
Made you feel you want to spend more time with him 54 84% 7 11% 3 5%
Made you feel you want to work harder at school 13 42% 13 42% 5 16%
Inspired you to want to do something positive in the future 48 76% 15 24%
How well did you really know him?
How well did you get on with him?
How well did you talk together?
How well did you understand what made him tick?
How well did he listen to you?
How well did you listen to him?
But the results are pretty helpful to us!