Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Using AI to understand everyday learning on the Web


Published on

Invited talk at Digital Enlightenment Forum, Brussels, 9 November 2018

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Using AI to understand everyday learning on the Web

  1. 1. Using AI to understand everyday learning on the Web Prof. Dr. Stefan Dietze GESIS / Heinrich Heine University (Germany) 08.11.2018, Digital Enlightenment Forum, 8 November 2018, Brussels
  2. 2. Learning on the Web 08/11/18 2Stefan Dietze
  3. 3. Learning Resources on the Web? - LinkedUp Catalog Dataset Catalog/Registry  “LinkedUp” (FP7 project): L3S, OU, OKFN, Elsevier, Exact Learning Solutions  Publishing and curation of educational/learning resources according to Linked Data principles  Largest collection of Linked Data about learning resources (approx. 50 datasets, 50 M resources) 08/11/18 3Stefan Dietze
  4. 4. 08/11/18 4Stefan Dietze  Anything can be a learning resource (when used for „informal, „just in time“, micro-learning)  The activity makes the difference (not the resource): i.e. how a resource is being used  Challenges: o How to detect „learning“? o How to detect learning-specific notions such as „competence“, „learning performance“ etc?  Learning Analytics in online/non-learning environments? o Activity streams (e.g. Twitter), o Social graphs (and their evolution), o Behavioural traces (mouse movements, keystrokes) o ... Analytics for everyday (online) learning? (as opposed to “education”) Figure courtesy of Mathieu d‘Aquin
  5. 5. 08/11/18 5Stefan Dietze Analytics for everyday (online) learning? (as opposed to “education”)  AFEL: H2020 project (since 12/2015) aimed at understanding/supporting learning in social Web environments  SALIENT: Leibniz project with various German research labs and educational organisations  Learning efficiently on the Web = finding reliable and relevant information for a particular topic/learning need  „Learning to learn“ = supporting learners/users to find information efficiently Figure courtesy of Mathieu d‘Aquin
  6. 6. 08/11/18 6Stefan Dietze Learning while searching the Web (“Search As Learning”)? Challenges & results  Detecting coherent search missions?  Detecting learning throughout search? detecting “informational” search missions (as opposed to “transactional” or “navigational” missions [Broder, 2002]) o Search mission detection with average F1 score 75% (experiments based on AOL query logs, [CHIIR19])  How competent is the user? – Predict/understand knowledge state of users in absence of assessment data  How well does a user achieve his/her learning goal/information need? - Predict knowledge gain throughout search missions o Correlation of user behavior (queries, browsing, mouse traces, etc) with user knowledge gain/state in various search tasks [CHIIR18] o Prediction of knowledge gain/state through supervised models [SIGIR18, WWW19]
  7. 7. Predicting knowledge gain/state of user during search? 08/11/18 7Stefan Dietze  Prediction through supervised machine learning models (after 10-fold cross-validation)  KG prediction performance  Feature importance (KG prediction) Ran Yu, Ujwal Gadiraju, Peter Holtz, Markus Rokicki, Philipp Kemkes and Stefan Dietze. Analyzing Knowledge Gain of Users in Informational Search Sessions on the Web. ACM SIGIR 2018. Key findings  User knowledge gain / state can be predicted from user behavior during search missions  In particular browsing behavior and queries of importance  Ongoing work: investigating resource features (e.g. document complexity, analytic/emotional language tone, multimodality of resources) as additional signals  Turning such models into actual applications => SALIENT & AFEL project
  8. 8. 08/11/18 8Stefan Dietze Outlook: supporting learning in online platforms  Search as part of domain-specific and cross-domain online platforms (“bringing learning analytics to platforms where users learn on daily basis”)  Examples (SALIENT & AFEL project) o Didacatalia – social online community of approx. 200.000 users o gesisDataSearch search of > 100.000 research datasets in the social sciences o Social Sciences Open Access Repository (SSOAR) – online archive of social sciences literature o TIB AV Portal – lecture videos and tutorials provided by the German National Library of Science & Technology
  9. 9. 08/11/18 9Stefan Dietze