This document summarizes an event about the ImREAL project, which aims to create more authentic and engaging simulated learning environments by incorporating user-generated social media content. It discusses how the project extracts structured information from unstructured digital traces to enhance simulated environments and learner models. Specifically, it presents approaches to 1) organize social media content using ontologies, 2) semantically browse and explore aggregated content, 3) augment learner models through automated dialogue, and 4) develop a reusable framework called MaSCoT to support these capabilities. The document invites attendees to demonstrations of technologies developed for these approaches.

1. I-Know EU Day – 4 Sep 2013 University of Leeds
Immersive Reflective Experience-based
Adaptive Learning
http://www.imreal-project.eu/

2. I-Know EU Day – 4 Sep 2013 University of Leeds
Partners

3. I-Know EU Day – 4 Sep 2013 University of Leeds
Key Problem
Simulated environments for learning are disconnected from the real-world
Learning experience Simulation design
Wants
- Effectiveness
- Engagement
- Motivation
- Meta-cognition
Needs
- Authenticity
- Diversity
-Timeliness
- Cost-effectiveness
Simulated
Environment
for Learning
Lots of experiences on Social Media

4. I-Know EU Day – 4 Sep 2013 University of Leeds
ImREAL: The Approach
User generated content can provide a source for simulator enrichment
Learning experience Simulation designSimulated
Environment
for Learning
- Exploits ontologies and linked data
- Focuses on interpersonal communication and cultural diversity
- Intelligent services for content aggregation, user and context
modelling, and meta-cognitive scaffolding

5. I-Know EU Day – 4 Sep 2013 University of Leeds
Simulated
Environment
for Learning
Project Strata

6. I-Know EU Day – 4 Sep 2013 University of Leeds
Making Sense of Digital Trace to
Augmenting User Modelling
Vania Dimitrova, Lydia Lau,
Dhaval Thakker, Ronald Denaux,
& Dimoklis Despotakis
School of Computing,
University of Leeds

7. I-Know EU Day – 4 Sep 2013 University of Leeds
MaSCot Process :
Making Sense of Collective Content
Semantic
query
digital
traces
Semantic
augmentation
Focus
extraction
AMOn+
& other
ontologies
Browsing &
interaction
I-CAW
Viewpoint
exploration
ViewS
Microscope

8. I-Know EU Day – 4 Sep 2013 University of Leeds
Challenge 1
Structure, link, organise collective content from ill-
defined domains (e.g. interpersonal
communications).
This involved:
• Application and development of Activity Theory as
a heuristic tool to understand and represent ill-
defined domains.
• An underpinning ontology Activity Model Ontology
for interpersonal communications (AMOn) and
extended it with cultural aspects (AMOn+).
http://imash.leeds.ac.uk/ontologies/amon

9. I-Know EU Day – 4 Sep 2013 University of Leeds
AMOn+
http://imash.leeds.ac.uk/ontologies/amon/LODE%20outputs/CulturalAspects.owl.htm

10. I-Know EU Day – 4 Sep 2013 University of Leeds
Challenge 2
Exploit semantics to enable intuitive exploration of
the collective content.
This involved:
• Development of technology and algorithms for
aggregating, organising and linking digital traces from
multiple sources to support browsing, search and
understanding.
• A semantic data browser, Intelligent Content Assembly
Workbench (I-CAW), with semantic augmentation and
query services.
• A tool for exploring viewpoints in user generated content -
ViewS microscope.

11. I-Know EU Day – 4 Sep 2013 University of Leeds
I-CAW: Semantic Browser
Focus Concept
Facts
Social
Content
Eye Contact is Body Language

12. I-Know EU Day – 4 Sep 2013 University of Leeds
Semantic Nudges for Learning
Nervous is a negative
emotion, you may also
look at positive emotions
like clam.
Click here to see examples
with calm.

13. I-Know EU Day – 4 Sep 2013 University of Leeds
ViewS: Viewpoint Analysis
Clusters show
learner attention
WNAffect mental state entities, ALL episodes
Hot topics to focus
on (e.g. extend
feedback)
Depth vs breath
(abstract vs
concrete
concepts)

14. I-Know EU Day – 4 Sep 2013 University of Leeds
Gateway to Comments: WNAffect
Example user comments: positive and negative emotions
User Comment
[Happiness] I think that everyone should simply order whatever they prefer. It may take more time, but
the important is for everyone to be satisfied.
[Warmheartedness] A warm greeting is always catchy even when in formal situations like a business
meeting.
[Annoyance] When you take the wrong dish or when you don't even know WHAT are you eating, the
dinner can turn to an endless pain quickly.
[Disgust] A one-language menu is always a kind of nightmare. I ordered several time a disgusting plate,
just because I didn't understand what was written.
[Dislike] I ask all what they like to order for a drink, because there could be person, who don't like
alcohol, so I ask, if anyone is interested by wine or something else, before order the drinks.

15. I-Know EU Day – 4 Sep 2013 University of Leeds
Process to Augment User Model
Dialogue for Modelling Cultural Exposure using Linked Data
Initial User Model
• Visited Countries
• Estimated Cultural
Exposure
Social Web
Sensors
Perico Dialogue Agent
Cultural Fact
Extractor
Quiz Generator
User Profile
GeneratorDialogue Planner
Updated User Model
• Verified Visited
Countries
• Enhanced Cultural
Exposure Score
AMOn+

16. I-Know EU Day – 4 Sep 2013 University of Leeds
Challenge 3
Exploit both Social and Linked data to bootstrap
learner competency models of ill-defined domains
(e.g. intercultural awareness).
This involved:
• Estimating implicit knowledge from Social Media
traces (e.g. visited countries) and using this as an
indicator of learner competency
• Extracting a knowledge base of domain-relevant
facts from DBpedia
• Automatic interaction with the learner in a dialogue
to verify and refine learner competency model.

17. I-Know EU Day – 4 Sep 2013 University of Leeds
Sample Dialogue with Perico

18. I-Know EU Day – 4 Sep 2013 University of Leeds
Sample Dialogue with Perico

19. I-Know EU Day – 4 Sep 2013 University of Leeds
Challenge 4
Enable external applications to capitalise on the
diversity and richness of collective content.
This involved:
• MaSCoT (Making Sense of Collective Content) - a
loosely coupled infrastructure designed for re-
usability of services and collected content.

20. I-Know EU Day – 4 Sep 2013 University of Leeds
MaSCoT Framework
Linked dataOntologies Content
Data
CorporaUser model
Semantic Linking
Semantic tagging EnrichmentUser model update
Semantic querying
Reasoning
Nudging engineViewpoints engineDialogue planner
comparing
reflecting
connecting selectingorganising
Interface
dialogue search browse explorevisualise

21. I-Know EU Day – 4 Sep 2013 University of Leeds
Making Sense of Digital Trace to
Augmenting User Modelling
Come to our demonstrations
Thursday afternoon
For
AMOn+, I-CAW, ViewS microscope & Perico