Creating interactive digital books for the transition from secondary to undergraduate mathematics

Christian Bokhove
Christian BokhoveAssociate Professor in Mathematics Education at University of Southampton
CREATING INTERACTIVE DIGITAL
BOOKS FOR THE TRANSITION FROM
SECONDARY TO UNDERGRADUATE
MATHEMATICS
CADGME
12 September 2023
Dr Christian Bokhove
Professor in Mathematics Education
Southampton Education School
University of Southampton
Prof Christian Bokhove Dr Ben Davies
Context: challenging transition
• Students’ transition from
secondary to university
mathematics
(e.g., Gueudet, 2008)
Free 60-page book
A-level degree (16-18y)
Undergraduate maths
at a research-
intensive university
SMP materials
• From the 1960s to 90s, the School Mathematics
Project (SMP) was iconic in English
mathematics education originating at the
University of Southampton (Thwaites, 2012).
• Textbooks with strong teacher input.
• In the 80-90s the majority of English schools
used SMP.
• But after exam board reforms popularity went
down. Last series appeared around 2002.
• The charity gave all the copyrights back to us.
1000s of books, >10 different languages as well.
• This provides enormous opportunities.
So, we have….
• Ready-made high quality instructional materials for almost
every topic 8-18 yr olds. This should not be
underestimated, because development time for this is
enormous.
• The content includes specific books with A-level content.
• Knowledge and skills about the opportunities for digital
books, which include interaction and feedback (e.g.
Bokhove & Drijvers, 2012; Bokhove, 2017), as Intelligent
Tutoring Systems (Kulik & Fletcher, 2016).
This project brings these three things together.
This project
• Collaborative development of three workbooks, on content
selected in consultation with >10 local teachers, and colleagues
from the Department of Mathematics (Community of Interest,
Fisher).
• Adopted an iterative design-based research approach to
development, with multiple opportunities for feedback and
improvement.
• Interactive elements of the workbook will be implemented using
STACK (System for Teaching and Assessment using a Computer
algebra kernel).
Iterations of systematic design cycles
(Plomp, 2013)
Software - STACK
• STACK is an open-source online assessment system for
mathematics and STEM, designed by Chris Sangwin
(Edinburgh) and colleagues. It is available for Moodle,
ILIAS and as an integration through LTI.
• Features include:
• Algebraic answers.
• Separate validation and assessment
• Randomisation
• Language support
• Open source
• Specific feedback
• Part of the quiz module.
• See https://stack-assessment.org/
Outcomes
• Three interactive workbooks in Moodle..
• Each covers one unit of study from the A-level
mathematics curriculum and will comprise instructional
materials (SMP) and a collection of quizzes.
• Each quiz features automated feedback bespoke to the
students’ (algebraic or numeric) input. Storing student
results.
• These features are created in co-creation with teachers.
For example, teacher and student input for feedback
design (i.e. Bokhove, 2010).
• After that, use with students,
and analyse these data.  ongoing
Creating interactive digital books for the transition from secondary to undergraduate mathematics
Teachers chose from the book
Creating interactive digital books for the transition from secondary to undergraduate mathematics
Creating interactive digital books for the transition from secondary to undergraduate mathematics
Creating interactive digital books for the transition from secondary to undergraduate mathematics
Creating interactive digital books for the transition from secondary to undergraduate mathematics
Randomisation
Worked example
Feedback
• Question text
• General feedback
• Question note
• Possible answers
• Potential response tree – can be quite elaborate.
• “Choose any two points you found above and try to derive
the equation for the line.”
• If it is easier, you can try to get the equation in the form
(y=mx+c) first and then rearrange to the required form.”
Further thoughts
• Expand the statistical methods with the data – already
use classical test theory and IRT, but also include
sequence analysis and learning analytics methods.
• This server also used by maths who don’t mind that these
are called ‘quizzes’ – however, we prefer they are part of
‘digital books’ – own server.
• Further use students, analyse these data.  ongoing
• The technology to do this has been around for a few
decades e.g. Mavrikis’ Wallis, STACK, DME and many
other platforms. Maybe the combination of AI and existing
computer algebra systems (WolframAlpha, Maxima) will
give the field an impulse.
THANK YOU
QUESTIONS
Christian Bokhove Dr Ben Davies
Selected references
Gueudet, G. (2008). Investigating the secondary–tertiary transition. Educational studies in
mathematics, 67(3), 237-254. https://doi.org/10.1007/s10649-007-9100-6
Bokhove, C. (2010). Implementing Feedback in a Digital Tool for Symbol Sense. International
Journal for Technology in Mathematics Education, 17(3), 121-126.
Bokhove, C. (2017). Using Technology for Digital Mathematics Textbooks: More than the Sum
of the Parts. International Journal for Technology in Mathematics Education, 24(3), 107-114.
Bokhove, C., & Drijvers, P. (2012). Effects of a digital intervention on the development of
algebraic expertise. Computers & Education, 58(1), 197–208.
https://doi.org/10.1016/j.compedu.2011.08.010
Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: a meta-
analytic review. Review of educational research, 86(1), 42-78.
https://doi.org/10.3102/0034654315581420
Plomp, T. (2013). Educational design research. Part A: An introduction. SLO. Retrieved from
https://slo.nl/publish/pages/4474/educational-design-research-part-a.pdf
Thwaites, B. (2012). The School Mathematics Project. Exeter: Short Run Press Limited.
1 of 21

Recommended

Using technology for maths teaching and learning: instructional design, digit... by
Using technology for maths teaching and learning: instructional design, digit...Using technology for maths teaching and learning: instructional design, digit...
Using technology for maths teaching and learning: instructional design, digit...Christian Bokhove
440 views48 slides
Using technology for maths teaching and learning: instructional design, digit... by
Using technology for maths teaching and learning: instructional design, digit...Using technology for maths teaching and learning: instructional design, digit...
Using technology for maths teaching and learning: instructional design, digit...Christian Bokhove
440 views48 slides
Methodological innovation for mathematics education research by
Methodological innovation for mathematics education researchMethodological innovation for mathematics education research
Methodological innovation for mathematics education researchChristian Bokhove
231 views65 slides
Methodological innovation for mathematics education research by
Methodological innovation for mathematics education researchMethodological innovation for mathematics education research
Methodological innovation for mathematics education researchChristian Bokhove
231 views65 slides
Digital examination, forms and tools for aggregation of information and cogni... by
Digital examination, forms and tools for aggregation of information and cogni...Digital examination, forms and tools for aggregation of information and cogni...
Digital examination, forms and tools for aggregation of information and cogni...Johan Thorbiörnson
255 views29 slides
Digital examination, forms and tools for aggregation of information and cogni... by
Digital examination, forms and tools for aggregation of information and cogni...Digital examination, forms and tools for aggregation of information and cogni...
Digital examination, forms and tools for aggregation of information and cogni...Johan Thorbiörnson
255 views29 slides

More Related Content

Similar to Creating interactive digital books for the transition from secondary to undergraduate mathematics

Using technology to support mathematics education and research by
Using technology to support mathematics education and researchUsing technology to support mathematics education and research
Using technology to support mathematics education and research Christian Bokhove
633 views51 slides
Using technology to support mathematics education and research by
Using technology to support mathematics education and researchUsing technology to support mathematics education and research
Using technology to support mathematics education and research Christian Bokhove
633 views51 slides
Public Lecture Hong Kong University, 18 November 2015 by
Public Lecture Hong Kong University, 18 November 2015Public Lecture Hong Kong University, 18 November 2015
Public Lecture Hong Kong University, 18 November 2015Christian Bokhove
346 views38 slides
Public Lecture Hong Kong University, 18 November 2015 by
Public Lecture Hong Kong University, 18 November 2015Public Lecture Hong Kong University, 18 November 2015
Public Lecture Hong Kong University, 18 November 2015Christian Bokhove
346 views38 slides
Assessing Students and Tutors with Learning Analytics Dashboards by
Assessing Students and Tutors with Learning Analytics DashboardsAssessing Students and Tutors with Learning Analytics Dashboards
Assessing Students and Tutors with Learning Analytics DashboardsEADTU
2.7K views49 slides
Assessing Students and Tutors with Learning Analytics Dashboards by
Assessing Students and Tutors with Learning Analytics DashboardsAssessing Students and Tutors with Learning Analytics Dashboards
Assessing Students and Tutors with Learning Analytics DashboardsEADTU
2.7K views49 slides

Similar to Creating interactive digital books for the transition from secondary to undergraduate mathematics(20)

Using technology to support mathematics education and research by Christian Bokhove
Using technology to support mathematics education and researchUsing technology to support mathematics education and research
Using technology to support mathematics education and research
Christian Bokhove633 views
Using technology to support mathematics education and research by Christian Bokhove
Using technology to support mathematics education and researchUsing technology to support mathematics education and research
Using technology to support mathematics education and research
Christian Bokhove633 views
Public Lecture Hong Kong University, 18 November 2015 by Christian Bokhove
Public Lecture Hong Kong University, 18 November 2015Public Lecture Hong Kong University, 18 November 2015
Public Lecture Hong Kong University, 18 November 2015
Christian Bokhove346 views
Public Lecture Hong Kong University, 18 November 2015 by Christian Bokhove
Public Lecture Hong Kong University, 18 November 2015Public Lecture Hong Kong University, 18 November 2015
Public Lecture Hong Kong University, 18 November 2015
Christian Bokhove346 views
Assessing Students and Tutors with Learning Analytics Dashboards by EADTU
Assessing Students and Tutors with Learning Analytics DashboardsAssessing Students and Tutors with Learning Analytics Dashboards
Assessing Students and Tutors with Learning Analytics Dashboards
EADTU2.7K views
Assessing Students and Tutors with Learning Analytics Dashboards by EADTU
Assessing Students and Tutors with Learning Analytics DashboardsAssessing Students and Tutors with Learning Analytics Dashboards
Assessing Students and Tutors with Learning Analytics Dashboards
EADTU2.7K views
MyMathLab Case Study - Kingston University UK by Pearson Australia
MyMathLab Case Study - Kingston University UKMyMathLab Case Study - Kingston University UK
MyMathLab Case Study - Kingston University UK
Pearson Australia446 views
MyMathLab Case Study - Kingston University UK by Pearson Australia
MyMathLab Case Study - Kingston University UKMyMathLab Case Study - Kingston University UK
MyMathLab Case Study - Kingston University UK
Pearson Australia446 views
Teaching and Learning Analytics for the Classroom Teacher by Demetrios G. Sampson
Teaching and Learning Analytics  for the Classroom TeacherTeaching and Learning Analytics  for the Classroom Teacher
Teaching and Learning Analytics for the Classroom Teacher
Teaching and Learning Analytics for the Classroom Teacher by Demetrios G. Sampson
Teaching and Learning Analytics  for the Classroom TeacherTeaching and Learning Analytics  for the Classroom Teacher
Teaching and Learning Analytics for the Classroom Teacher
Educational Question Routing in Online Student Communities by Jakub Macina
 Educational Question Routing in Online Student Communities Educational Question Routing in Online Student Communities
Educational Question Routing in Online Student Communities
Jakub Macina834 views
Educational Question Routing in Online Student Communities by Jakub Macina
 Educational Question Routing in Online Student Communities Educational Question Routing in Online Student Communities
Educational Question Routing in Online Student Communities
Jakub Macina834 views
Seminar University of Loughborough: Using technology to support mathematics e... by Christian Bokhove
Seminar University of Loughborough: Using technology to support mathematics e...Seminar University of Loughborough: Using technology to support mathematics e...
Seminar University of Loughborough: Using technology to support mathematics e...
Christian Bokhove549 views
Seminar University of Loughborough: Using technology to support mathematics e... by Christian Bokhove
Seminar University of Loughborough: Using technology to support mathematics e...Seminar University of Loughborough: Using technology to support mathematics e...
Seminar University of Loughborough: Using technology to support mathematics e...
Christian Bokhove549 views

More from Christian Bokhove

Can data from largescale assessments ever be useful For mathematics education? by
Can data from largescale assessments ever be useful For mathematics education?Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?Christian Bokhove
3 views42 slides
Research on school inspections: What do we know? by
Research on school inspections: What do we know?Research on school inspections: What do we know?
Research on school inspections: What do we know?Christian Bokhove
31 views29 slides
Master mathematics teachers: What do Chinese primary schools look like? by
Master mathematics teachers: What do Chinese primary schools look like?Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?Christian Bokhove
52 views30 slides
The role of non-cognitive factors in science achievement: an analysis of PISA... by
The role of non-cognitive factors in science achievement: an analysis of PISA...The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...Christian Bokhove
10 views19 slides
Multilevel modelling of Chinese primary children’s metacognitive strategies i... by
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Christian Bokhove
4 views15 slides
Cryptography by
CryptographyCryptography
CryptographyChristian Bokhove
12 views31 slides

More from Christian Bokhove(20)

Can data from largescale assessments ever be useful For mathematics education? by Christian Bokhove
Can data from largescale assessments ever be useful For mathematics education?Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?
Research on school inspections: What do we know? by Christian Bokhove
Research on school inspections: What do we know?Research on school inspections: What do we know?
Research on school inspections: What do we know?
Master mathematics teachers: What do Chinese primary schools look like? by Christian Bokhove
Master mathematics teachers: What do Chinese primary schools look like?Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?
The role of non-cognitive factors in science achievement: an analysis of PISA... by Christian Bokhove
The role of non-cognitive factors in science achievement: an analysis of PISA...The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...
Multilevel modelling of Chinese primary children’s metacognitive strategies i... by Christian Bokhove
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Help-seeking in an online maths environment: A sequence analysis of log files by Christian Bokhove
Help-seeking in an online maths environment: A sequence analysis of log filesHelp-seeking in an online maths environment: A sequence analysis of log files
Help-seeking in an online maths environment: A sequence analysis of log files
Learning loss and learning inequalities during the covid-19 pandemic: an anal... by Christian Bokhove
Learning loss and learning inequalities during the covid-19 pandemic: an anal...Learning loss and learning inequalities during the covid-19 pandemic: an anal...
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
The challenge of proof in the transition from A-level mathematics to university by Christian Bokhove
The challenge of proof in the transition from A-level mathematics to universityThe challenge of proof in the transition from A-level mathematics to university
The challenge of proof in the transition from A-level mathematics to university
How can we develop expansive, research-informed ITE ? by Christian Bokhove
How can we develop expansive, research-informed ITE ?How can we develop expansive, research-informed ITE ?
How can we develop expansive, research-informed ITE ?
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs by Christian Bokhove
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
Proof by induction in Calculus: Investigating first-year students’ examinatio... by Christian Bokhove
Proof by induction in Calculus: Investigating first-year students’ examinatio...Proof by induction in Calculus: Investigating first-year students’ examinatio...
Proof by induction in Calculus: Investigating first-year students’ examinatio...
Christian Bokhove146 views
Evidence informed: Waar is de Bijsluiter? by Christian Bokhove
Evidence informed: Waar is de Bijsluiter?Evidence informed: Waar is de Bijsluiter?
Evidence informed: Waar is de Bijsluiter?
Christian Bokhove413 views
Roundtable slides RiTE Paderborn 24/9/2021 by Christian Bokhove
Roundtable slides RiTE Paderborn 24/9/2021Roundtable slides RiTE Paderborn 24/9/2021
Roundtable slides RiTE Paderborn 24/9/2021
Christian Bokhove156 views
Structural Topic Modelling of Ofsted Documents by Christian Bokhove
Structural Topic Modelling of Ofsted DocumentsStructural Topic Modelling of Ofsted Documents
Structural Topic Modelling of Ofsted Documents
Christian Bokhove122 views
Learning loss and learning inequalities during the Covid-19 pandemic: an anal... by Christian Bokhove
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Christian Bokhove273 views
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C... by Christian Bokhove
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
Christian Bokhove205 views
Portfolio - just some things I'm working on - July 2021 by Christian Bokhove
Portfolio - just some things I'm working on - July 2021Portfolio - just some things I'm working on - July 2021
Portfolio - just some things I'm working on - July 2021
Christian Bokhove140 views

Recently uploaded

Nico Baumbach IMR Media Component by
Nico Baumbach IMR Media ComponentNico Baumbach IMR Media Component
Nico Baumbach IMR Media ComponentInMediaRes1
425 views2 slides
Education and Diversity.pptx by
Education and Diversity.pptxEducation and Diversity.pptx
Education and Diversity.pptxDrHafizKosar
107 views16 slides
NS3 Unit 2 Life processes of animals.pptx by
NS3 Unit 2 Life processes of animals.pptxNS3 Unit 2 Life processes of animals.pptx
NS3 Unit 2 Life processes of animals.pptxmanuelaromero2013
102 views16 slides
Chemistry of sex hormones.pptx by
Chemistry of sex hormones.pptxChemistry of sex hormones.pptx
Chemistry of sex hormones.pptxRAJ K. MAURYA
119 views38 slides
STERILITY TEST.pptx by
STERILITY TEST.pptxSTERILITY TEST.pptx
STERILITY TEST.pptxAnupkumar Sharma
114 views9 slides
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1} by
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}DR .PALLAVI PATHANIA
234 views195 slides

Recently uploaded(20)

Nico Baumbach IMR Media Component by InMediaRes1
Nico Baumbach IMR Media ComponentNico Baumbach IMR Media Component
Nico Baumbach IMR Media Component
InMediaRes1425 views
Education and Diversity.pptx by DrHafizKosar
Education and Diversity.pptxEducation and Diversity.pptx
Education and Diversity.pptx
DrHafizKosar107 views
NS3 Unit 2 Life processes of animals.pptx by manuelaromero2013
NS3 Unit 2 Life processes of animals.pptxNS3 Unit 2 Life processes of animals.pptx
NS3 Unit 2 Life processes of animals.pptx
manuelaromero2013102 views
Chemistry of sex hormones.pptx by RAJ K. MAURYA
Chemistry of sex hormones.pptxChemistry of sex hormones.pptx
Chemistry of sex hormones.pptx
RAJ K. MAURYA119 views
Narration ppt.pptx by TARIQ KHAN
Narration  ppt.pptxNarration  ppt.pptx
Narration ppt.pptx
TARIQ KHAN110 views
Class 10 English lesson plans by TARIQ KHAN
Class 10 English  lesson plansClass 10 English  lesson plans
Class 10 English lesson plans
TARIQ KHAN239 views
Structure and Functions of Cell.pdf by Nithya Murugan
Structure and Functions of Cell.pdfStructure and Functions of Cell.pdf
Structure and Functions of Cell.pdf
Nithya Murugan317 views
7 NOVEL DRUG DELIVERY SYSTEM.pptx by Sachin Nitave
7 NOVEL DRUG DELIVERY SYSTEM.pptx7 NOVEL DRUG DELIVERY SYSTEM.pptx
7 NOVEL DRUG DELIVERY SYSTEM.pptx
Sachin Nitave56 views
Community-led Open Access Publishing webinar.pptx by Jisc
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptx
Jisc69 views
JiscOAWeek_LAIR_slides_October2023.pptx by Jisc
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
Jisc72 views
AI Tools for Business and Startups by Svetlin Nakov
AI Tools for Business and StartupsAI Tools for Business and Startups
AI Tools for Business and Startups
Svetlin Nakov89 views
OEB 2023 Co-learning To Speed Up AI Implementation in Courses.pptx by Inge de Waard
OEB 2023 Co-learning To Speed Up AI Implementation in Courses.pptxOEB 2023 Co-learning To Speed Up AI Implementation in Courses.pptx
OEB 2023 Co-learning To Speed Up AI Implementation in Courses.pptx
Inge de Waard165 views
Scope of Biochemistry.pptx by shoba shoba
Scope of Biochemistry.pptxScope of Biochemistry.pptx
Scope of Biochemistry.pptx
shoba shoba121 views
Use of Probiotics in Aquaculture.pptx by AKSHAY MANDAL
Use of Probiotics in Aquaculture.pptxUse of Probiotics in Aquaculture.pptx
Use of Probiotics in Aquaculture.pptx
AKSHAY MANDAL81 views
The basics - information, data, technology and systems.pdf by JonathanCovena1
The basics - information, data, technology and systems.pdfThe basics - information, data, technology and systems.pdf
The basics - information, data, technology and systems.pdf
JonathanCovena177 views

Creating interactive digital books for the transition from secondary to undergraduate mathematics

  • 1. CREATING INTERACTIVE DIGITAL BOOKS FOR THE TRANSITION FROM SECONDARY TO UNDERGRADUATE MATHEMATICS CADGME 12 September 2023 Dr Christian Bokhove Professor in Mathematics Education Southampton Education School University of Southampton
  • 2. Prof Christian Bokhove Dr Ben Davies
  • 3. Context: challenging transition • Students’ transition from secondary to university mathematics (e.g., Gueudet, 2008) Free 60-page book A-level degree (16-18y) Undergraduate maths at a research- intensive university
  • 4. SMP materials • From the 1960s to 90s, the School Mathematics Project (SMP) was iconic in English mathematics education originating at the University of Southampton (Thwaites, 2012). • Textbooks with strong teacher input. • In the 80-90s the majority of English schools used SMP. • But after exam board reforms popularity went down. Last series appeared around 2002. • The charity gave all the copyrights back to us. 1000s of books, >10 different languages as well. • This provides enormous opportunities.
  • 5. So, we have…. • Ready-made high quality instructional materials for almost every topic 8-18 yr olds. This should not be underestimated, because development time for this is enormous. • The content includes specific books with A-level content. • Knowledge and skills about the opportunities for digital books, which include interaction and feedback (e.g. Bokhove & Drijvers, 2012; Bokhove, 2017), as Intelligent Tutoring Systems (Kulik & Fletcher, 2016). This project brings these three things together.
  • 6. This project • Collaborative development of three workbooks, on content selected in consultation with >10 local teachers, and colleagues from the Department of Mathematics (Community of Interest, Fisher). • Adopted an iterative design-based research approach to development, with multiple opportunities for feedback and improvement. • Interactive elements of the workbook will be implemented using STACK (System for Teaching and Assessment using a Computer algebra kernel). Iterations of systematic design cycles (Plomp, 2013)
  • 7. Software - STACK • STACK is an open-source online assessment system for mathematics and STEM, designed by Chris Sangwin (Edinburgh) and colleagues. It is available for Moodle, ILIAS and as an integration through LTI. • Features include: • Algebraic answers. • Separate validation and assessment • Randomisation • Language support • Open source • Specific feedback • Part of the quiz module. • See https://stack-assessment.org/
  • 8. Outcomes • Three interactive workbooks in Moodle.. • Each covers one unit of study from the A-level mathematics curriculum and will comprise instructional materials (SMP) and a collection of quizzes. • Each quiz features automated feedback bespoke to the students’ (algebraic or numeric) input. Storing student results. • These features are created in co-creation with teachers. For example, teacher and student input for feedback design (i.e. Bokhove, 2010). • After that, use with students, and analyse these data.  ongoing
  • 18. • Question text • General feedback • Question note • Possible answers • Potential response tree – can be quite elaborate. • “Choose any two points you found above and try to derive the equation for the line.” • If it is easier, you can try to get the equation in the form (y=mx+c) first and then rearrange to the required form.”
  • 19. Further thoughts • Expand the statistical methods with the data – already use classical test theory and IRT, but also include sequence analysis and learning analytics methods. • This server also used by maths who don’t mind that these are called ‘quizzes’ – however, we prefer they are part of ‘digital books’ – own server. • Further use students, analyse these data.  ongoing • The technology to do this has been around for a few decades e.g. Mavrikis’ Wallis, STACK, DME and many other platforms. Maybe the combination of AI and existing computer algebra systems (WolframAlpha, Maxima) will give the field an impulse.
  • 21. Selected references Gueudet, G. (2008). Investigating the secondary–tertiary transition. Educational studies in mathematics, 67(3), 237-254. https://doi.org/10.1007/s10649-007-9100-6 Bokhove, C. (2010). Implementing Feedback in a Digital Tool for Symbol Sense. International Journal for Technology in Mathematics Education, 17(3), 121-126. Bokhove, C. (2017). Using Technology for Digital Mathematics Textbooks: More than the Sum of the Parts. International Journal for Technology in Mathematics Education, 24(3), 107-114. Bokhove, C., & Drijvers, P. (2012). Effects of a digital intervention on the development of algebraic expertise. Computers & Education, 58(1), 197–208. https://doi.org/10.1016/j.compedu.2011.08.010 Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: a meta- analytic review. Review of educational research, 86(1), 42-78. https://doi.org/10.3102/0034654315581420 Plomp, T. (2013). Educational design research. Part A: An introduction. SLO. Retrieved from https://slo.nl/publish/pages/4474/educational-design-research-part-a.pdf Thwaites, B. (2012). The School Mathematics Project. Exeter: Short Run Press Limited.

Editor's Notes

  1. In the United Kingdom, many students struggle in their transition from secondary school mathematics to undergraduate mathematics. It is not always possible to remediate deficiencies in mathematical knowledge within a school setting. At the same time, we know that Intelligent Tutoring Systems can aid students in acquiring, practicing, and assessing mathematical content. In this paper, we will present interactive workbooks created at our institution, that cover units of study from the secondary A-level mathematics curriculum, comprising a series of technical expositions and a modular collection of quizzes. Each quiz addresses content equivalent of at most two classroom lessons and features automated feedback bespoke to the students’ (algebraic or numeric) input. The ‘digital books’ make use of a Computer Algebra System to provide automated feedback. The development of the books is a collaborative process in a ‘Community of Interest’ with local secondary teachers, developers recruited from local departments, and the Southampton Education School. An iterative design-based research approach was adopted for the development, with multiple opportunities for feedback and improvement. After initial prototyping, a teacher focus group will attend a follow-up session where they are invited to review the materials and to make suggestions or requests before implementing them with their students later in the year. We present preliminary reflections on the results of our reflective design-based process, and discuss how this process contributes to both better digital books and research insights.