SlideShare a Scribd company logo
1 of 16
Download to read offline
An Analysis of Interactive
Feature Use in Two
Ebooks
Barbara Ericson
School of Information, University of Michigan
barbarer@umich.edu
Ebook Development
u Brad Miller and David Runam
created Runestone - 2011
u Platform for interactive
ebooks
u "Democratizing textbooks for
the 21st century."
u 18 free ebooks on Runestone
u Serves 25,000 learners a day
u http://runestoneinteractive.o
rg/pages/library.html
First Runestone Study
u Added executable code
and the Python tutor to
uHow to Think Like a
Computer Scientist
u 90% of the undergraduate
students wanted to use
an interactive ebook in
another class
Advanced Placement Ebooks
u CS Principles (course for non-
majors)
u Variables, loops, conditionals,
functions in Python
u Teacher and student version
u http://tinyurl.com/StudentCSP-new
u http://tinyurl.com/TeacherCSP-new
u CS A (course for majors)
u OO programming in Java, recursion,
arrays, lists
u Student version
u http://tinyurl.com/JavaReview-new
Educational Psychology
Principles
u Worked examples plus
practice
u Multiple modalities
u Audio Tour
u Low cognitive load
practice
u Multiple-choice
u Fill-in-the-blank
u Parsons problems
u Clickable area
Audio Tour
Worked
Example
Practice
Parsons
problem
Prior Research
u Usability
u Compared to CS Circles and Zyante
u Usage
u What features are used more and less?
u More users attempts Parsons than near-by multiple-choice
u Usage dropped from the start to the end of each chapter
Research on Parsons Problems
u Parsons vs fix and write code
u Parsons are more efficient
u No significant difference in learning gains
u Invented two types of adaptation
u Intra-problem
u Reduce difficulty if learner is struggling on current problem
u Inter-problem
u Modify next problem based on learner performance on previous problem
u Tested adaptive vs non-adaptive Parsons
u Parsons more efficient than writing code
u No significant difference in learning gains
u Higher learning gains for adaptive than control group
u Teachers mostly preferred adaptive Parsons
Research Questions
u How did usage change across the chapters?
u What is the usage level of:
uShort Answer
uClickable Area
u What was the most common incorrect state
for a Parsons problem?
Log File Analysis - CSA
• Usage drops across the
book
• Till practice exams
• Usage drops across
chapters
• Till exercises
• Fewer users run code
• If no practice after
• More users attempt
Parsons than code
exercises
Log File Analysis - CSP
• Usage drops across
the book
• Till practice exams
• Usage drops across
chapters
• Till exercises
Short-Answer Questions
Open-ended questions
• What is an array
like?
• What questions do
you have about
arrays?
Usage of Short Answer and Clickable Area
More short answers
than expected
• Off task – Pony
• Incorrect – like a
bag
• Classifying the
answers now
Clickable Area - Table
Clickable Area – Code
More users answered
clickable code than
ran the code
Most Common Error in a Parsons Problem
• 60% moved
namelist.add in the
loop before the
increment
• 52% moved
namelist.add in the
loop after the
increment
Summary
u Usage tends to drop from the start to the end of each
ebook
u Until practice exams
u Usage tends to drop from the start to the end of each
chapter
u Until end of chapter exercises
u Short answer and clickable code had high usage rates
u Should be studied more
u Log file data can suggest problems to review
u Could identify misconceptions

More Related Content

More from Sergey Sosnovsky

Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...Sergey Sosnovsky
 
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for EducationYAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for EducationSergey Sosnovsky
 
Automatic Question Generation for Evidence-based Online Courseware Engineering
Automatic Question Generation for Evidence-based Online Courseware EngineeringAutomatic Question Generation for Evidence-based Online Courseware Engineering
Automatic Question Generation for Evidence-based Online Courseware EngineeringSergey Sosnovsky
 
Reading Comprehension Quiz Generation using Generative Pre-trained Transformers
Reading Comprehension Quiz Generation using Generative Pre-trained TransformersReading Comprehension Quiz Generation using Generative Pre-trained Transformers
Reading Comprehension Quiz Generation using Generative Pre-trained TransformersSergey Sosnovsky
 
Mathematical Language Processing via Tree Embeddings
Mathematical Language Processing via Tree EmbeddingsMathematical Language Processing via Tree Embeddings
Mathematical Language Processing via Tree EmbeddingsSergey Sosnovsky
 
Contextual Definition Generation
Contextual Definition GenerationContextual Definition Generation
Contextual Definition GenerationSergey Sosnovsky
 
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...Sergey Sosnovsky
 
Generation of Assessment Questions from Textbooks Enriched with Knowledge Models
Generation of Assessment Questions from Textbooks Enriched with Knowledge ModelsGeneration of Assessment Questions from Textbooks Enriched with Knowledge Models
Generation of Assessment Questions from Textbooks Enriched with Knowledge ModelsSergey Sosnovsky
 
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...Sergey Sosnovsky
 
Dental TutorBot: Exploitation of Dental Textbooks for Automated Learning
Dental TutorBot: Exploitation of Dental Textbooks for Automated LearningDental TutorBot: Exploitation of Dental Textbooks for Automated Learning
Dental TutorBot: Exploitation of Dental Textbooks for Automated LearningSergey Sosnovsky
 
Using Programmed Instruction to Help Students Engage with eTextbook Content
Using Programmed Instruction to Help Students Engage with eTextbook Content Using Programmed Instruction to Help Students Engage with eTextbook Content
Using Programmed Instruction to Help Students Engage with eTextbook Content Sergey Sosnovsky
 
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...Sergey Sosnovsky
 
Interlingua: Linking Textbooks Across Different Languages
Interlingua: Linking Textbooks Across Different Languages Interlingua: Linking Textbooks Across Different Languages
Interlingua: Linking Textbooks Across Different Languages Sergey Sosnovsky
 
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...Sergey Sosnovsky
 
What’s a Textbook? Envisioning the 21st Century K-12 Text
What’s a Textbook? Envisioning the 21st Century K-12 TextWhat’s a Textbook? Envisioning the 21st Century K-12 Text
What’s a Textbook? Envisioning the 21st Century K-12 TextSergey Sosnovsky
 
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...Sergey Sosnovsky
 
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...Sergey Sosnovsky
 
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...Sergey Sosnovsky
 
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...Sergey Sosnovsky
 

More from Sergey Sosnovsky (20)

Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
 
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for EducationYAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
 
Automatic Question Generation for Evidence-based Online Courseware Engineering
Automatic Question Generation for Evidence-based Online Courseware EngineeringAutomatic Question Generation for Evidence-based Online Courseware Engineering
Automatic Question Generation for Evidence-based Online Courseware Engineering
 
Reading Comprehension Quiz Generation using Generative Pre-trained Transformers
Reading Comprehension Quiz Generation using Generative Pre-trained TransformersReading Comprehension Quiz Generation using Generative Pre-trained Transformers
Reading Comprehension Quiz Generation using Generative Pre-trained Transformers
 
Mathematical Language Processing via Tree Embeddings
Mathematical Language Processing via Tree EmbeddingsMathematical Language Processing via Tree Embeddings
Mathematical Language Processing via Tree Embeddings
 
Contextual Definition Generation
Contextual Definition GenerationContextual Definition Generation
Contextual Definition Generation
 
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
 
Generation of Assessment Questions from Textbooks Enriched with Knowledge Models
Generation of Assessment Questions from Textbooks Enriched with Knowledge ModelsGeneration of Assessment Questions from Textbooks Enriched with Knowledge Models
Generation of Assessment Questions from Textbooks Enriched with Knowledge Models
 
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
 
Dental TutorBot: Exploitation of Dental Textbooks for Automated Learning
Dental TutorBot: Exploitation of Dental Textbooks for Automated LearningDental TutorBot: Exploitation of Dental Textbooks for Automated Learning
Dental TutorBot: Exploitation of Dental Textbooks for Automated Learning
 
What's in a textbook
What's in a textbookWhat's in a textbook
What's in a textbook
 
Using Programmed Instruction to Help Students Engage with eTextbook Content
Using Programmed Instruction to Help Students Engage with eTextbook Content Using Programmed Instruction to Help Students Engage with eTextbook Content
Using Programmed Instruction to Help Students Engage with eTextbook Content
 
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
 
Interlingua: Linking Textbooks Across Different Languages
Interlingua: Linking Textbooks Across Different Languages Interlingua: Linking Textbooks Across Different Languages
Interlingua: Linking Textbooks Across Different Languages
 
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...
Student Modeling with Automatic Knowledge Component Extraction for Adaptive T...
 
What’s a Textbook? Envisioning the 21st Century K-12 Text
What’s a Textbook? Envisioning the 21st Century K-12 TextWhat’s a Textbook? Envisioning the 21st Century K-12 Text
What’s a Textbook? Envisioning the 21st Century K-12 Text
 
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...
BBookX: Creating Semi-Automated Textbooks to Support Student Learning and Dec...
 
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...
PASTEL: Evidence-based Learning Engineering Method to Create Intelligent Onli...
 
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...
Interactive and Personalized Activity eBooks for Learning to Read: The iRead ...
 
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...
An Overview of Recent Developments in Intelligent e-Textbooks and Reading Ana...
 

Recently uploaded

Sulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesSulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesVijayaLaxmi84
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxkarenfajardo43
 
DiskStorage_BasicFileStructuresandHashing.pdf
DiskStorage_BasicFileStructuresandHashing.pdfDiskStorage_BasicFileStructuresandHashing.pdf
DiskStorage_BasicFileStructuresandHashing.pdfChristalin Nelson
 
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...Osopher
 
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...Nguyen Thanh Tu Collection
 
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...Nguyen Thanh Tu Collection
 
6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroomSamsung Business USA
 
How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17Celine George
 
Objectives n learning outcoms - MD 20240404.pptx
Objectives n learning outcoms - MD 20240404.pptxObjectives n learning outcoms - MD 20240404.pptx
Objectives n learning outcoms - MD 20240404.pptxMadhavi Dharankar
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...DhatriParmar
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptxDhatriParmar
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Celine George
 
4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptxmary850239
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...DhatriParmar
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQuiz Club NITW
 
4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptxmary850239
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationdeepaannamalai16
 

Recently uploaded (20)

Sulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their usesSulphonamides, mechanisms and their uses
Sulphonamides, mechanisms and their uses
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
 
DiskStorage_BasicFileStructuresandHashing.pdf
DiskStorage_BasicFileStructuresandHashing.pdfDiskStorage_BasicFileStructuresandHashing.pdf
DiskStorage_BasicFileStructuresandHashing.pdf
 
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...
Healthy Minds, Flourishing Lives: A Philosophical Approach to Mental Health a...
 
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...
CHUYÊN ĐỀ ÔN THEO CÂU CHO HỌC SINH LỚP 12 ĐỂ ĐẠT ĐIỂM 5+ THI TỐT NGHIỆP THPT ...
 
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...
31 ĐỀ THI THỬ VÀO LỚP 10 - TIẾNG ANH - FORM MỚI 2025 - 40 CÂU HỎI - BÙI VĂN V...
 
Chi-Square Test Non Parametric Test Categorical Variable
Chi-Square Test Non Parametric Test Categorical VariableChi-Square Test Non Parametric Test Categorical Variable
Chi-Square Test Non Parametric Test Categorical Variable
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom
 
How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17
 
Objectives n learning outcoms - MD 20240404.pptx
Objectives n learning outcoms - MD 20240404.pptxObjectives n learning outcoms - MD 20240404.pptx
Objectives n learning outcoms - MD 20240404.pptx
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17
 
prashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Professionprashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Profession
 
4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx4.11.24 Poverty and Inequality in America.pptx
4.11.24 Poverty and Inequality in America.pptx
 
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
Blowin' in the Wind of Caste_ Bob Dylan's Song as a Catalyst for Social Justi...
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
 
4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentation
 

An Analysis of Interactive Feature Use in Two Ebooks

  • 1. An Analysis of Interactive Feature Use in Two Ebooks Barbara Ericson School of Information, University of Michigan barbarer@umich.edu
  • 2. Ebook Development u Brad Miller and David Runam created Runestone - 2011 u Platform for interactive ebooks u "Democratizing textbooks for the 21st century." u 18 free ebooks on Runestone u Serves 25,000 learners a day u http://runestoneinteractive.o rg/pages/library.html
  • 3. First Runestone Study u Added executable code and the Python tutor to uHow to Think Like a Computer Scientist u 90% of the undergraduate students wanted to use an interactive ebook in another class
  • 4. Advanced Placement Ebooks u CS Principles (course for non- majors) u Variables, loops, conditionals, functions in Python u Teacher and student version u http://tinyurl.com/StudentCSP-new u http://tinyurl.com/TeacherCSP-new u CS A (course for majors) u OO programming in Java, recursion, arrays, lists u Student version u http://tinyurl.com/JavaReview-new
  • 5. Educational Psychology Principles u Worked examples plus practice u Multiple modalities u Audio Tour u Low cognitive load practice u Multiple-choice u Fill-in-the-blank u Parsons problems u Clickable area Audio Tour Worked Example Practice Parsons problem
  • 6. Prior Research u Usability u Compared to CS Circles and Zyante u Usage u What features are used more and less? u More users attempts Parsons than near-by multiple-choice u Usage dropped from the start to the end of each chapter
  • 7. Research on Parsons Problems u Parsons vs fix and write code u Parsons are more efficient u No significant difference in learning gains u Invented two types of adaptation u Intra-problem u Reduce difficulty if learner is struggling on current problem u Inter-problem u Modify next problem based on learner performance on previous problem u Tested adaptive vs non-adaptive Parsons u Parsons more efficient than writing code u No significant difference in learning gains u Higher learning gains for adaptive than control group u Teachers mostly preferred adaptive Parsons
  • 8. Research Questions u How did usage change across the chapters? u What is the usage level of: uShort Answer uClickable Area u What was the most common incorrect state for a Parsons problem?
  • 9. Log File Analysis - CSA • Usage drops across the book • Till practice exams • Usage drops across chapters • Till exercises • Fewer users run code • If no practice after • More users attempt Parsons than code exercises
  • 10. Log File Analysis - CSP • Usage drops across the book • Till practice exams • Usage drops across chapters • Till exercises
  • 11. Short-Answer Questions Open-ended questions • What is an array like? • What questions do you have about arrays?
  • 12. Usage of Short Answer and Clickable Area More short answers than expected • Off task – Pony • Incorrect – like a bag • Classifying the answers now
  • 14. Clickable Area – Code More users answered clickable code than ran the code
  • 15. Most Common Error in a Parsons Problem • 60% moved namelist.add in the loop before the increment • 52% moved namelist.add in the loop after the increment
  • 16. Summary u Usage tends to drop from the start to the end of each ebook u Until practice exams u Usage tends to drop from the start to the end of each chapter u Until end of chapter exercises u Short answer and clickable code had high usage rates u Should be studied more u Log file data can suggest problems to review u Could identify misconceptions