SlideShare a Scribd company logo
1 of 17
Using Knowledge Graph for Explainable
Recommendation of External Content in Electronic
Textbooks
Behnam Rahdari, Peter Brusilovsky, Khushboo Thaker and Jordan Barria-
Pineda
University of Pittsburgh, PA, USA
History of Textbook
Physical
Textbooks
Electronic
Textbooks
Online
Reading
Systems
…
Print/Paper Digital/Computer Internet/online
• Evolution of Textbooks
• Smart Learning
• Feasibility > reliance of technology rather than only educators
• Personalization > tailored to student’s need
01/17
Close Corpus vs Open Corpus
Section(n) Section(m)
Section(n)
Section(m)
Open Corpus Close Corpus
External Resources Textbook itself
Challenging because of:
• Quality of resources
• Expert-driven knowledge analysis
02/17
Proposed Approach
Recommendations
Student
Model
Textbook
Wikipedia
Addressing the two Challenges:
• Quality of resources
• Using Wikipedia
• Uniform and up-to-date
• Reliable and popular
• Expert-driven knowledge analysis
• Fully automated process
• Real-time recommendation
• Utilizing the student model
03/17
Reading Mirror-Main Interface
1 2 3
1- Relevance Bar
2- Recommendations
3- Explanations
04/17
Reading Mirror- Explanations
Intermediate
Dialog
Explanation
Dialog
05/17
The Knowledge Graph - Overview
1
2
3
Student Model
Wikipedia
Articles
06/17
Knowledge Graph- Wikipedia Entities
Main
Category
Sub-
Category
Article
Article
Sub-
Category
Article
...
...
...
...
Top Category
Subfields of computer science
1,141 categories
47,772 articles
Title, Summary & Full-Text
07/17
Knowledge Graph – Textbook Entities
Textbook
Section
Concept
Concept
Question
Concept
...
...
...
...
• Textbook Content
• Section:
• Includes: Sub-sections
• Questions:
• Connect to a Section
• Concepts:
• Extracted From the text
Automatic Extraction
+
Manual Indexing by Experts
08/17
Knowledge Graph- Student Model
Student
read
Section
Section
Answer
Question
...
...
...
...
• Input < Student Activity
• Output > Student Performance
• Comprehension Factor Analysis framework (CFM)
• Reading behavior
• Question Answering
• Each Student Presented as a single Node in the graph
• Knowledge: Connection to a Concept
• What section/question
• When
09/17
Recommendation Approach
Obtained
Knowledge
Partial
Knowledge
Missing
Knowledge
Required Knowledge
Useful
Knowledge
• Required Knowledge
• For Section :
• All Concepts in the Section
• For Question :
• All Concepts in Question
+
• All Concepts in Section
• Real-Tile Calculation
• Cypher Query Language
• Relevancy Metric (concept & Articles)
• Lucene Search
10/17
Assessment – Data & Baseline
• Real Classroom Data
• Information Retrieval
• Semester-Long Logs
• E-Textbook:
• 43 Sections
• 75 Questions
• 22 Students (9494 interactions)
• Baseline:
• Recommendations based on the content of Sections/Questions
11/17
Assessment - Ranking Quality Measurement
Discounted Cumulative Gain
• Takes into account both:
• the relevance score
• the order of items in the recommendations list
• Uniform Relevance Score in both systems (Experimental and Baseline)
12/17
Assessment - Overall Expected Knowledge Value
• Comparison of Average DCG among sections and questions
• Higher DCG in all cases
• Average of 23.29% higher among all sections
• Average of 30.27% higher among all questions
0
25
50
75
100
261
263
265
267
269
271
273
275
277
279
281
307
309
311
313
315
325
327
329
331
333
335
337
339
341
387
389
391
393
396
398
400
402
404
408
410
412
414
δ Baseline Proposed
0
25
50
75
100
1.1
1.4
4.2
4.4
4.6
5.2
6.1
6.3
8.1
8.3
8.5
8.7
9.2
12.4
13.2
13.4
13.6
14.2
14.4
14.6
16.2
16.4
δ Baseline Proposed
13/17
Assessment - Overall Expected Knowledge Value
• Difference between DCG among:
• Left: Students/Sections
• Right: Students/Questions
• Different Students require different Recommendations
14/17
Assessment - Predicting User's Knowledge Requirements
• Jumping-Back behavior
• In average 17.27% of all students’ Interactions
• How two approaches predict the concepts in target sections/questions
15/17
Summary & Future Works
• A novel approach :
• Generate personalized recommendations of external content for
online electronic textbooks.
• Combining Textbook Content and Student Model
• Predicts:
• Missing knowledge components
• Jumping-back behavior
• Future Works:
• Real-time recommendation during the semester
• Adding more factors: difficulty of learning concepts, forgetting factor, etc.
16/17

More Related Content

What's hot

Don't Forget the Middle Child: What Graduate Students Need From the Universit...
Don't Forget the Middle Child: What Graduate Students Need From the Universit...Don't Forget the Middle Child: What Graduate Students Need From the Universit...
Don't Forget the Middle Child: What Graduate Students Need From the Universit...Lucinda Rush
 
Investigation into reuse of OER for online language teaching
Investigation into reuse of OER for online language teachingInvestigation into reuse of OER for online language teaching
Investigation into reuse of OER for online language teachingGlobal OER Graduate Network
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...CITE
 
Understanding Students' Engagement with Personalised Feedback Messages
Understanding Students' Engagement with Personalised Feedback MessagesUnderstanding Students' Engagement with Personalised Feedback Messages
Understanding Students' Engagement with Personalised Feedback MessagesHamideh Iraj
 
University Library Navigation Resource
University Library Navigation ResourceUniversity Library Navigation Resource
University Library Navigation ResourceDeeAnna77
 
Attendance and student performance arp (1)
Attendance and student performance arp (1)Attendance and student performance arp (1)
Attendance and student performance arp (1)Cindy Paynter
 
Blackboard Learning Analytics Research Update
Blackboard Learning Analytics Research UpdateBlackboard Learning Analytics Research Update
Blackboard Learning Analytics Research UpdateJohn Whitmer, Ed.D.
 
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"CITE
 
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...Blackboard APAC
 
Overview of PredictED
Overview of PredictEDOverview of PredictED
Overview of PredictEDMark Brown
 
Lange & Hanz - What do university students want to know?: Re-evaluating infor...
Lange & Hanz - What do university students want to know?: Re-evaluating infor...Lange & Hanz - What do university students want to know?: Re-evaluating infor...
Lange & Hanz - What do university students want to know?: Re-evaluating infor...IL Group (CILIP Information Literacy Group)
 
E-Learn 2007 - PowerPoint Games in K-12 e-Learning Environments
E-Learn 2007 - PowerPoint Games in K-12 e-Learning EnvironmentsE-Learn 2007 - PowerPoint Games in K-12 e-Learning Environments
E-Learn 2007 - PowerPoint Games in K-12 e-Learning EnvironmentsMichael Barbour
 
Banff Open Education Global Conference
Banff Open Education Global ConferenceBanff Open Education Global Conference
Banff Open Education Global ConferenceDavid Ernst
 
Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"CITE
 
Why can't students get the resources they need results from a real availabili...
Why can't students get the resources they need results from a real availabili...Why can't students get the resources they need results from a real availabili...
Why can't students get the resources they need results from a real availabili...NASIG
 
OER Mills jan2019
OER Mills jan2019OER Mills jan2019
OER Mills jan2019cacgoodwin
 
Genomics Education Partnership presentation at NU Fall Assembly
Genomics Education Partnership presentation at NU Fall AssemblyGenomics Education Partnership presentation at NU Fall Assembly
Genomics Education Partnership presentation at NU Fall AssemblyAna Maria Slingluff-Barral
 
Alise2014 30 40 d7
Alise2014 30 40 d7Alise2014 30 40 d7
Alise2014 30 40 d7Sarah Sutton
 
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...KISK FF MU
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"CITE
 

What's hot (20)

Don't Forget the Middle Child: What Graduate Students Need From the Universit...
Don't Forget the Middle Child: What Graduate Students Need From the Universit...Don't Forget the Middle Child: What Graduate Students Need From the Universit...
Don't Forget the Middle Child: What Graduate Students Need From the Universit...
 
Investigation into reuse of OER for online language teaching
Investigation into reuse of OER for online language teachingInvestigation into reuse of OER for online language teaching
Investigation into reuse of OER for online language teaching
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
 
Understanding Students' Engagement with Personalised Feedback Messages
Understanding Students' Engagement with Personalised Feedback MessagesUnderstanding Students' Engagement with Personalised Feedback Messages
Understanding Students' Engagement with Personalised Feedback Messages
 
University Library Navigation Resource
University Library Navigation ResourceUniversity Library Navigation Resource
University Library Navigation Resource
 
Attendance and student performance arp (1)
Attendance and student performance arp (1)Attendance and student performance arp (1)
Attendance and student performance arp (1)
 
Blackboard Learning Analytics Research Update
Blackboard Learning Analytics Research UpdateBlackboard Learning Analytics Research Update
Blackboard Learning Analytics Research Update
 
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
 
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
 
Overview of PredictED
Overview of PredictEDOverview of PredictED
Overview of PredictED
 
Lange & Hanz - What do university students want to know?: Re-evaluating infor...
Lange & Hanz - What do university students want to know?: Re-evaluating infor...Lange & Hanz - What do university students want to know?: Re-evaluating infor...
Lange & Hanz - What do university students want to know?: Re-evaluating infor...
 
E-Learn 2007 - PowerPoint Games in K-12 e-Learning Environments
E-Learn 2007 - PowerPoint Games in K-12 e-Learning EnvironmentsE-Learn 2007 - PowerPoint Games in K-12 e-Learning Environments
E-Learn 2007 - PowerPoint Games in K-12 e-Learning Environments
 
Banff Open Education Global Conference
Banff Open Education Global ConferenceBanff Open Education Global Conference
Banff Open Education Global Conference
 
Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"
 
Why can't students get the resources they need results from a real availabili...
Why can't students get the resources they need results from a real availabili...Why can't students get the resources they need results from a real availabili...
Why can't students get the resources they need results from a real availabili...
 
OER Mills jan2019
OER Mills jan2019OER Mills jan2019
OER Mills jan2019
 
Genomics Education Partnership presentation at NU Fall Assembly
Genomics Education Partnership presentation at NU Fall AssemblyGenomics Education Partnership presentation at NU Fall Assembly
Genomics Education Partnership presentation at NU Fall Assembly
 
Alise2014 30 40 d7
Alise2014 30 40 d7Alise2014 30 40 d7
Alise2014 30 40 d7
 
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...
Antun Matanovic, Ivana Manojlovic: Scientific Papers in the Field of Informat...
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"
 

Similar to Using Knowledge Graph for Explainable Recommendation in E-Textbooks

It Can Be Done! Planning and Process for Successful Collection Management Pro...
It Can Be Done! Planning and Process for Successful Collection Management Pro...It Can Be Done! Planning and Process for Successful Collection Management Pro...
It Can Be Done! Planning and Process for Successful Collection Management Pro...Charleston Conference
 
Test Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsTest Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsSarah Joy Arnold
 
Test Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsTest Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsSarah Joy Arnold
 
Learning Module Design
Learning Module DesignLearning Module Design
Learning Module Designmjforder
 
Post-it Up: Qualitative Data Analysis of a Test Fest
Post-it Up: Qualitative Data Analysis of a Test FestPost-it Up: Qualitative Data Analysis of a Test Fest
Post-it Up: Qualitative Data Analysis of a Test FestSarah Joy Arnold
 
Seiler Miil & Lepik - Student centred active learning approach in an online i...
Seiler Miil & Lepik - Student centred active learning approach in an online i...Seiler Miil & Lepik - Student centred active learning approach in an online i...
Seiler Miil & Lepik - Student centred active learning approach in an online i...IL Group (CILIP Information Literacy Group)
 
Assessment = Improved Teaching and Learning: Using Rubrics to Measure Inform...
Assessment = Improved Teaching and Learning:  Using Rubrics to Measure Inform...Assessment = Improved Teaching and Learning:  Using Rubrics to Measure Inform...
Assessment = Improved Teaching and Learning: Using Rubrics to Measure Inform...Kathryn Crowe
 
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...UKSG: connecting the knowledge community
 
Ringing the changes: reflections on delivering an information literacy module...
Ringing the changes: reflections on delivering an information literacy module...Ringing the changes: reflections on delivering an information literacy module...
Ringing the changes: reflections on delivering an information literacy module...IL Group (CILIP Information Literacy Group)
 
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...EDEN Digital Learning Europe
 
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...Library Live: Collaborating Towards Heightened Information Literacy & Retenti...
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...Denise Woetzel
 
Measure for Measure: Using collaborative assessment to build stronger informa...
Measure for Measure: Using collaborative assessment to build stronger informa...Measure for Measure: Using collaborative assessment to build stronger informa...
Measure for Measure: Using collaborative assessment to build stronger informa...susangar
 
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Blackboard APAC
 
The User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersThe User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersPeter Brusilovsky
 
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...Cengage Learning
 
Interactions of reading and assessment activities
Interactions of reading and assessment activitiesInteractions of reading and assessment activities
Interactions of reading and assessment activitiesSergey Sosnovsky
 
Prospect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve  adaptive learning modelProspect for learning analytics to achieve  adaptive learning model
Prospect for learning analytics to achieve adaptive learning modelOpen Cyber University of Korea
 
School Net Curriculum implementation
School Net Curriculum implementationSchool Net Curriculum implementation
School Net Curriculum implementationmbarefoot
 
National Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation ExcellenceNational Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation ExcellenceJamie_Patterson
 
QQML Panel 2014: Pratt Institute SILS
QQML Panel 2014: Pratt Institute SILSQQML Panel 2014: Pratt Institute SILS
QQML Panel 2014: Pratt Institute SILSA. M. Kelleher
 

Similar to Using Knowledge Graph for Explainable Recommendation in E-Textbooks (20)

It Can Be Done! Planning and Process for Successful Collection Management Pro...
It Can Be Done! Planning and Process for Successful Collection Management Pro...It Can Be Done! Planning and Process for Successful Collection Management Pro...
It Can Be Done! Planning and Process for Successful Collection Management Pro...
 
Test Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsTest Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-its
 
Test Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-itsTest Fest and the Tale of Too Many Post-its
Test Fest and the Tale of Too Many Post-its
 
Learning Module Design
Learning Module DesignLearning Module Design
Learning Module Design
 
Post-it Up: Qualitative Data Analysis of a Test Fest
Post-it Up: Qualitative Data Analysis of a Test FestPost-it Up: Qualitative Data Analysis of a Test Fest
Post-it Up: Qualitative Data Analysis of a Test Fest
 
Seiler Miil & Lepik - Student centred active learning approach in an online i...
Seiler Miil & Lepik - Student centred active learning approach in an online i...Seiler Miil & Lepik - Student centred active learning approach in an online i...
Seiler Miil & Lepik - Student centred active learning approach in an online i...
 
Assessment = Improved Teaching and Learning: Using Rubrics to Measure Inform...
Assessment = Improved Teaching and Learning:  Using Rubrics to Measure Inform...Assessment = Improved Teaching and Learning:  Using Rubrics to Measure Inform...
Assessment = Improved Teaching and Learning: Using Rubrics to Measure Inform...
 
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...
Usage, Engagement and Impact: Evaluating the usage of and measuring impact an...
 
Ringing the changes: reflections on delivering an information literacy module...
Ringing the changes: reflections on delivering an information literacy module...Ringing the changes: reflections on delivering an information literacy module...
Ringing the changes: reflections on delivering an information literacy module...
 
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...
Digital Skills Gap Peer Learning Activity - Analysis of usage of LMS activiti...
 
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...Library Live: Collaborating Towards Heightened Information Literacy & Retenti...
Library Live: Collaborating Towards Heightened Information Literacy & Retenti...
 
Measure for Measure: Using collaborative assessment to build stronger informa...
Measure for Measure: Using collaborative assessment to build stronger informa...Measure for Measure: Using collaborative assessment to build stronger informa...
Measure for Measure: Using collaborative assessment to build stronger informa...
 
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...
 
The User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersThe User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the Users
 
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...
Redesigning a Computer Concepts Course Using SAM and SAM Training - Course Te...
 
Interactions of reading and assessment activities
Interactions of reading and assessment activitiesInteractions of reading and assessment activities
Interactions of reading and assessment activities
 
Prospect for learning analytics to achieve adaptive learning model
Prospect for learning analytics to achieve  adaptive learning modelProspect for learning analytics to achieve  adaptive learning model
Prospect for learning analytics to achieve adaptive learning model
 
School Net Curriculum implementation
School Net Curriculum implementationSchool Net Curriculum implementation
School Net Curriculum implementation
 
National Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation ExcellenceNational Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation Excellence
 
QQML Panel 2014: Pratt Institute SILS
QQML Panel 2014: Pratt Institute SILSQQML Panel 2014: Pratt Institute SILS
QQML Panel 2014: Pratt Institute SILS
 

Recently uploaded

Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfUmakantAnnand
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 

Recently uploaded (20)

Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.Compdf
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 

Using Knowledge Graph for Explainable Recommendation in E-Textbooks

  • 1. Using Knowledge Graph for Explainable Recommendation of External Content in Electronic Textbooks Behnam Rahdari, Peter Brusilovsky, Khushboo Thaker and Jordan Barria- Pineda University of Pittsburgh, PA, USA
  • 2. History of Textbook Physical Textbooks Electronic Textbooks Online Reading Systems … Print/Paper Digital/Computer Internet/online • Evolution of Textbooks • Smart Learning • Feasibility > reliance of technology rather than only educators • Personalization > tailored to student’s need 01/17
  • 3. Close Corpus vs Open Corpus Section(n) Section(m) Section(n) Section(m) Open Corpus Close Corpus External Resources Textbook itself Challenging because of: • Quality of resources • Expert-driven knowledge analysis 02/17
  • 4. Proposed Approach Recommendations Student Model Textbook Wikipedia Addressing the two Challenges: • Quality of resources • Using Wikipedia • Uniform and up-to-date • Reliable and popular • Expert-driven knowledge analysis • Fully automated process • Real-time recommendation • Utilizing the student model 03/17
  • 5. Reading Mirror-Main Interface 1 2 3 1- Relevance Bar 2- Recommendations 3- Explanations 04/17
  • 7. The Knowledge Graph - Overview 1 2 3 Student Model Wikipedia Articles 06/17
  • 8. Knowledge Graph- Wikipedia Entities Main Category Sub- Category Article Article Sub- Category Article ... ... ... ... Top Category Subfields of computer science 1,141 categories 47,772 articles Title, Summary & Full-Text 07/17
  • 9. Knowledge Graph – Textbook Entities Textbook Section Concept Concept Question Concept ... ... ... ... • Textbook Content • Section: • Includes: Sub-sections • Questions: • Connect to a Section • Concepts: • Extracted From the text Automatic Extraction + Manual Indexing by Experts 08/17
  • 10. Knowledge Graph- Student Model Student read Section Section Answer Question ... ... ... ... • Input < Student Activity • Output > Student Performance • Comprehension Factor Analysis framework (CFM) • Reading behavior • Question Answering • Each Student Presented as a single Node in the graph • Knowledge: Connection to a Concept • What section/question • When 09/17
  • 11. Recommendation Approach Obtained Knowledge Partial Knowledge Missing Knowledge Required Knowledge Useful Knowledge • Required Knowledge • For Section : • All Concepts in the Section • For Question : • All Concepts in Question + • All Concepts in Section • Real-Tile Calculation • Cypher Query Language • Relevancy Metric (concept & Articles) • Lucene Search 10/17
  • 12. Assessment – Data & Baseline • Real Classroom Data • Information Retrieval • Semester-Long Logs • E-Textbook: • 43 Sections • 75 Questions • 22 Students (9494 interactions) • Baseline: • Recommendations based on the content of Sections/Questions 11/17
  • 13. Assessment - Ranking Quality Measurement Discounted Cumulative Gain • Takes into account both: • the relevance score • the order of items in the recommendations list • Uniform Relevance Score in both systems (Experimental and Baseline) 12/17
  • 14. Assessment - Overall Expected Knowledge Value • Comparison of Average DCG among sections and questions • Higher DCG in all cases • Average of 23.29% higher among all sections • Average of 30.27% higher among all questions 0 25 50 75 100 261 263 265 267 269 271 273 275 277 279 281 307 309 311 313 315 325 327 329 331 333 335 337 339 341 387 389 391 393 396 398 400 402 404 408 410 412 414 δ Baseline Proposed 0 25 50 75 100 1.1 1.4 4.2 4.4 4.6 5.2 6.1 6.3 8.1 8.3 8.5 8.7 9.2 12.4 13.2 13.4 13.6 14.2 14.4 14.6 16.2 16.4 δ Baseline Proposed 13/17
  • 15. Assessment - Overall Expected Knowledge Value • Difference between DCG among: • Left: Students/Sections • Right: Students/Questions • Different Students require different Recommendations 14/17
  • 16. Assessment - Predicting User's Knowledge Requirements • Jumping-Back behavior • In average 17.27% of all students’ Interactions • How two approaches predict the concepts in target sections/questions 15/17
  • 17. Summary & Future Works • A novel approach : • Generate personalized recommendations of external content for online electronic textbooks. • Combining Textbook Content and Student Model • Predicts: • Missing knowledge components • Jumping-back behavior • Future Works: • Real-time recommendation during the semester • Adding more factors: difficulty of learning concepts, forgetting factor, etc. 16/17