SlideShare a Scribd company logo
SQA Adapted Digital Question Papers: The story so far….   Paul D. Nisbet CALL Scotland  University of Edinburgh
Adapted Digital Papers 2006 (pilot) 2007 (pilot) 2008 2009 2010 Number of centres 8 12 46 73 Number of candidates 34 80 204 422 Number of requests 65 265 514 1,167 1,962 Number of candidates / centre 4.25 6.67 4.27 5.78 Number of requests / candidates 1.91 2.50 2.51 2.76
Requests for Adapted Digital Papers 2006-2010
2009 requests by local authority Authority Requests Authority Requests Fife Council 149 The Moray Council 31 The City of Edinburgh 122 Highland Council 22 Falkirk 97 Shetland Islands Council 18 Dumfries and Galloway 89 North Ayrshire Council 16 Aberdeenshire 65 North Lanarkshire Council 15 Dundee City 62 Renfrewshire Council 13 South Ayrshire 60 East Dunbartonshire Council 7 Perth & Kinross 59 East Renfrewshire Council 4 Aberdeen City 52 Midlothian Council 4 West Lothian 45 Western Isles Council 2 City of Glasgow 42 East Ayrshire Council 1 Scottish Borders 41 South Lanarkshire Council 1 Argyll and Bute 38 Stirling 36 FE Colleges 21 Inverclyde 33 Independent Secondary Schools 22
2009 requests by schools 2009 Centres Requests Local Authority Queen Anne High School  122 Fife  The Royal High School  82 City of Edinburgh  Bo'ness Academy  68 Stranraer Academy  62 Dumfries & Galloway  Prestwick Academy  60 South Ayrshire  Kinross High School  59 Perth & Kinross  Mintlaw Academy  48 Aberdeenshire Ashcraig School  37 Glasgow City  Campbeltown Grammar School  37 Argyll & Bute  Peebles High School  35 Scottish Borders  Aboyne Academy 34 Aberdeenshire  St Columba's High School (Gourock)  33 Inverclyde  St Paul's RC Academy  32 Dundee City  Holy Rood High School  30 City of Edinburgh  Buckie High School  29 Moray
2009 requests by subject  (subjects with requests > 10) Subject Number of requests Subject Number of requests English 284 French 39 Biology 98 Modern Studies 37 History 92 Physical Education 36 Computing Studies 91 Mathematics 29 Geography 76 Business Management 28 Chemistry 50 Drama 28 Craft & Design 50 Home Economics 22 Administration 48 Mathematics: Maths 1, 2 and 3 12 Physics 42 German 11
Reasons for requesting ADPs, 2009
Pupils’ comments 2006 & 2007 Prefer it to using a scribe. Easier to give answers. Easy to do. You can see both the questions and the text at the same time. Enjoyed using it! I would prefer to have split screens so that I could see questions and tables together instead of having to refer to another page.
Pupils’ comments 2006 & 2007 Papers are simpler to use. You do not have to fiddle about with different papers. By switching windows, you can see both the question and the text at the same time. Because it is much easier to use than a reader
Staff evaluations 2006 trials
Pupils’ results with digital papers ,[object Object],[object Object],[object Object]
Reliability ,[object Object],[object Object]
Accommodation ,[object Object]
% of AA candidates using ADPs  (12 schools 2006-08)
2008 requests to support writing (46 centres using ADPs) “ We really appreciate this format of exam paper. The pupils are generally much happier to be independent rather than depend on scribes and readers. This year all our S3 and S4s sat the SG English examination at the same time. If we had had to provide readers and/or scribes for this we would not have been able to staff it.”
Support for writing 2007-08 (12 centres using ADPs)
Support for reading (data from 18 centres in 2008)
Text-reading software 2007-2008
Use of readers 2007-2008
Cost analysis: School ‘H’ English Standard Grade, 5 pupils using ADPs instead of reader/scribes Rooms Time Reader/scribe time Reading General 5 1 hour 5 hours Reading Credit 5 1 hour 5 hours Writing F/G/C 5 1.5 hours 7.5 hours Total 15 3.5 hours/ pupil 17.5 hours
School ‘H’ Standard Grade: digital papers for 5 pupils ,[object Object],[object Object],[object Object],[object Object],[object Object]
School ‘H’  readers/scribes vs. digital School H buys in all readers/scribes at £25 per half day.  The school saved £1000 by using ADPs in 2008. * Cost calculated at £20/hour Readers / scribes Digital Papers Saving Staff hours 17.5 7.15 10 hours Staff cost @ £25/half day £250 £143 * £107 Staff cost @ £20/hour £350 £143 £207 Staff cost @ £200/day £1000 £143 £857 Rooms 5 1 4 rooms
Costs of readers/scribes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

Similar to SQA Adapted Digital Question Papers - the story so far...

Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docxSheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
bjohn46
 
Teachers in Digital Age
Teachers in Digital AgeTeachers in Digital Age
Teachers in Digital Age
Nives Kreuh
 
S2-S3 Learner Review Process Jan 2015
S2-S3 Learner Review Process Jan 2015S2-S3 Learner Review Process Jan 2015
S2-S3 Learner Review Process Jan 2015
tynecastlehigh
 
Oct 11 admin meeting
Oct 11 admin meetingOct 11 admin meeting
Oct 11 admin meeting
David Juce
 

Similar to SQA Adapted Digital Question Papers - the story so far... (20)

naac sample.pptx
naac sample.pptxnaac sample.pptx
naac sample.pptx
 
Yr 10 evening 1015 2
Yr 10 evening 1015 2Yr 10 evening 1015 2
Yr 10 evening 1015 2
 
Ishii presentation
Ishii presentationIshii presentation
Ishii presentation
 
Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docxSheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
Sheet1Item Price# of ItemsTotal PriceCups$1.896$11.34Plates$1.506$.docx
 
Using quizlet flashcards to study vocabulary
Using quizlet flashcards to study vocabularyUsing quizlet flashcards to study vocabulary
Using quizlet flashcards to study vocabulary
 
CPD Model (AJK) ,.pptx
CPD Model (AJK) ,.pptxCPD Model (AJK) ,.pptx
CPD Model (AJK) ,.pptx
 
International Comparative Studies in School Digitalization
International Comparative Studies in School DigitalizationInternational Comparative Studies in School Digitalization
International Comparative Studies in School Digitalization
 
Chaitanyas academy info
Chaitanyas academy infoChaitanyas academy info
Chaitanyas academy info
 
Core Content Coaching Grade 6 Motion & Speed 14-15
Core Content Coaching Grade 6 Motion & Speed 14-15Core Content Coaching Grade 6 Motion & Speed 14-15
Core Content Coaching Grade 6 Motion & Speed 14-15
 
Teachers in the Digital Age
Teachers in the Digital AgeTeachers in the Digital Age
Teachers in the Digital Age
 
Teachers in Digital Age
Teachers in Digital AgeTeachers in Digital Age
Teachers in Digital Age
 
Year 10 curriculum evening 2016
Year 10 curriculum evening 2016Year 10 curriculum evening 2016
Year 10 curriculum evening 2016
 
AIP-Quality.docx
AIP-Quality.docxAIP-Quality.docx
AIP-Quality.docx
 
Transforming the Silent "E" in STEM - Engaging Educators to Encourage Enginee...
Transforming the Silent "E" in STEM - Engaging Educators to Encourage Enginee...Transforming the Silent "E" in STEM - Engaging Educators to Encourage Enginee...
Transforming the Silent "E" in STEM - Engaging Educators to Encourage Enginee...
 
A Proposed PST Model for Enhancing E-Learning Experiences
A Proposed PST Model for Enhancing E-Learning ExperiencesA Proposed PST Model for Enhancing E-Learning Experiences
A Proposed PST Model for Enhancing E-Learning Experiences
 
Ryedale School GCSE Information Evening
Ryedale School GCSE Information EveningRyedale School GCSE Information Evening
Ryedale School GCSE Information Evening
 
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
 
S2-S3 Learner Review Process Jan 2015
S2-S3 Learner Review Process Jan 2015S2-S3 Learner Review Process Jan 2015
S2-S3 Learner Review Process Jan 2015
 
AISSMS COE LIBRARY - PPT FOR NACC Visit
AISSMS COE LIBRARY - PPT FOR NACC Visit AISSMS COE LIBRARY - PPT FOR NACC Visit
AISSMS COE LIBRARY - PPT FOR NACC Visit
 
Oct 11 admin meeting
Oct 11 admin meetingOct 11 admin meeting
Oct 11 admin meeting
 

Recently uploaded

Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
plant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated cropsplant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated crops
parmarsneha2
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 

Recently uploaded (20)

Danh sách HSG Bộ môn cấp trường - Cấp THPT.pdf
Danh sách HSG Bộ môn cấp trường - Cấp THPT.pdfDanh sách HSG Bộ môn cấp trường - Cấp THPT.pdf
Danh sách HSG Bộ môn cấp trường - Cấp THPT.pdf
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
NLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptxNLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptx
 
plant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated cropsplant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated crops
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.pptBasic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
Benefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational ResourcesBenefits and Challenges of Using Open Educational Resources
Benefits and Challenges of Using Open Educational Resources
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
B.ed spl. HI pdusu exam paper-2023-24.pdf
B.ed spl. HI pdusu exam paper-2023-24.pdfB.ed spl. HI pdusu exam paper-2023-24.pdf
B.ed spl. HI pdusu exam paper-2023-24.pdf
 

SQA Adapted Digital Question Papers - the story so far...

  • 1. SQA Adapted Digital Question Papers: The story so far…. Paul D. Nisbet CALL Scotland University of Edinburgh
  • 2. Adapted Digital Papers 2006 (pilot) 2007 (pilot) 2008 2009 2010 Number of centres 8 12 46 73 Number of candidates 34 80 204 422 Number of requests 65 265 514 1,167 1,962 Number of candidates / centre 4.25 6.67 4.27 5.78 Number of requests / candidates 1.91 2.50 2.51 2.76
  • 3. Requests for Adapted Digital Papers 2006-2010
  • 4. 2009 requests by local authority Authority Requests Authority Requests Fife Council 149 The Moray Council 31 The City of Edinburgh 122 Highland Council 22 Falkirk 97 Shetland Islands Council 18 Dumfries and Galloway 89 North Ayrshire Council 16 Aberdeenshire 65 North Lanarkshire Council 15 Dundee City 62 Renfrewshire Council 13 South Ayrshire 60 East Dunbartonshire Council 7 Perth & Kinross 59 East Renfrewshire Council 4 Aberdeen City 52 Midlothian Council 4 West Lothian 45 Western Isles Council 2 City of Glasgow 42 East Ayrshire Council 1 Scottish Borders 41 South Lanarkshire Council 1 Argyll and Bute 38 Stirling 36 FE Colleges 21 Inverclyde 33 Independent Secondary Schools 22
  • 5. 2009 requests by schools 2009 Centres Requests Local Authority Queen Anne High School 122 Fife The Royal High School 82 City of Edinburgh Bo'ness Academy 68 Stranraer Academy 62 Dumfries & Galloway Prestwick Academy 60 South Ayrshire Kinross High School 59 Perth & Kinross Mintlaw Academy 48 Aberdeenshire Ashcraig School 37 Glasgow City Campbeltown Grammar School 37 Argyll & Bute Peebles High School 35 Scottish Borders Aboyne Academy 34 Aberdeenshire St Columba's High School (Gourock) 33 Inverclyde St Paul's RC Academy 32 Dundee City Holy Rood High School 30 City of Edinburgh Buckie High School 29 Moray
  • 6. 2009 requests by subject (subjects with requests > 10) Subject Number of requests Subject Number of requests English 284 French 39 Biology 98 Modern Studies 37 History 92 Physical Education 36 Computing Studies 91 Mathematics 29 Geography 76 Business Management 28 Chemistry 50 Drama 28 Craft & Design 50 Home Economics 22 Administration 48 Mathematics: Maths 1, 2 and 3 12 Physics 42 German 11
  • 8. Pupils’ comments 2006 & 2007 Prefer it to using a scribe. Easier to give answers. Easy to do. You can see both the questions and the text at the same time. Enjoyed using it! I would prefer to have split screens so that I could see questions and tables together instead of having to refer to another page.
  • 9. Pupils’ comments 2006 & 2007 Papers are simpler to use. You do not have to fiddle about with different papers. By switching windows, you can see both the question and the text at the same time. Because it is much easier to use than a reader
  • 11.
  • 12.
  • 13.
  • 14. % of AA candidates using ADPs (12 schools 2006-08)
  • 15. 2008 requests to support writing (46 centres using ADPs) “ We really appreciate this format of exam paper. The pupils are generally much happier to be independent rather than depend on scribes and readers. This year all our S3 and S4s sat the SG English examination at the same time. If we had had to provide readers and/or scribes for this we would not have been able to staff it.”
  • 16. Support for writing 2007-08 (12 centres using ADPs)
  • 17. Support for reading (data from 18 centres in 2008)
  • 19. Use of readers 2007-2008
  • 20. Cost analysis: School ‘H’ English Standard Grade, 5 pupils using ADPs instead of reader/scribes Rooms Time Reader/scribe time Reading General 5 1 hour 5 hours Reading Credit 5 1 hour 5 hours Writing F/G/C 5 1.5 hours 7.5 hours Total 15 3.5 hours/ pupil 17.5 hours
  • 21.
  • 22. School ‘H’ readers/scribes vs. digital School H buys in all readers/scribes at £25 per half day. The school saved £1000 by using ADPs in 2008. * Cost calculated at £20/hour Readers / scribes Digital Papers Saving Staff hours 17.5 7.15 10 hours Staff cost @ £25/half day £250 £143 * £107 Staff cost @ £20/hour £350 £143 £207 Staff cost @ £200/day £1000 £143 £857 Rooms 5 1 4 rooms
  • 23.

Editor's Notes

  1. Main point here is that the schools that tried them for real in 2006 wanted more in 2007, and requests for 2008 are up again.
  2. These have been very popular in schools: many pupils prefer them to scribes and readers; staff like them because you need far fewer rooms, staff and invigilators, SQA like them because pupils are more independent.
  3. Reasons why pupils needed digital papers in 2007 – the most common reason is because of specific learning difficulties.
  4. Comments from pupils who used the papers in exams in 2006
  5. Comments from pupils in 2006
  6. Staff evaluations in 2006 – staff felt pupils were more confident, independent, motivated and skilled with DPs than with other methods like readers/scribes (as we would expect given that the pupils chose to use the DPs in preference to other methods)
  7. ADPs don’t appear to give unfair advantage, or disadvantage
  8. PDF is pretty reliable. Still computers though, so need to plan, prepare, check, and have contingency arrangements
  9. Fewer staff are required than when using readers/scribes
  10. If we look at the different requests for ways to support pupils with reading difficulties across the 12 schools, though, we see that readers still dominate. A small number of exam entries were completed using text reader software (TRS) but there’s a long way to go before we can replace readers with ICT (if indeed, this is possible or in the best interests of the candidates).
  11. Here’s a wee cost analysis of School H in 2007. 5 pupils sat SG English using DPs, and used TTS as well as typed their answers. This is an estimate of how much staff time would have been needed with readers/scribes. – 11.25 hours (and 11.25 hours worth of invigilator), and 15 rooms.
  12. Here’s what was actually needed for the DPs – OK we could ague about the time – could be more, could be less. 5.25 for invigilator as well. 1 room at a time instead of 5
  13. Cost comparison. School H buys in their reader/scribes so this is real money. They pay their reader/scribes £25 per half day – not per hour – so it depends on when the exams are during the day. Overall in 2008, School H had pupils using digital papers with text to speech for 57 separate papers instead of using reader/scribes. Cost saving depends on what staff cost. If it’s hourly, I’ve estimated the hourly rate at £20/hour to include employers costs. School H pay £200/day for supply cover if it was SfL staff reading/scribing who needed covered. May be more or less depending on whether the staff are teachers or support staff.
  14. And nationally, it’s a bit shocking – is this really the best, most cost effective way to support pupils with reading and writing difficulties when there are clearly better, more independent and cheaper options?