JTEL15 Workshop Slides for Adaptive Video for Supporting Informal Learning at the Workplace, in the Learning Layers project context

1. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
1 This slide deck is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
Informal Learning at the Workplace
via Adaptive Video
Milos Kravcik, Petru Nicolaescu,
Aarij Siddiqui, Ralf Klamma
Advanced Community Information Systems (ACIS)
RWTH Aachen University, Germany
lastname@dbis.rwth-aachen.de
11th Joint European Summer School on
Technology Enhanced Learning (JTEL 2015)
July 6-10
Ischia, Italy

2. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
2
Workshop Learning Outcomes
• Understand nuts & bolts of informal learning
• Understand how outcomes of collaborative work at
workplace can be used to scaffold informal learning
• Apply adaptive video strategies to support learning
• Apply your own ideas for personalization

3. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
3
Agenda
 Motivation
 Aims of Learning Layers Project
 Semantic Video Annotation
 Adaptive Video Presentation
 Task in Groups
 Presentations

4. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
4
Motivation
 Discussions with stakeholders revealed requirements that
can be solved by using multimedia in workplace scenarios
 How to support informal learning at the workplace by video
annotation and video adaptation techniques?
 Challenge: select scenes relevant in a particular context and
present them accordingly

5. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
5
Workplace Learning
 Workplace learning is mostly informal
– No set objective in terms of learning outcomes
– Not intentional from the learner’s standpoint
 It maintains important principles of education
– Authenticity, Engagement, Demonstration
 Domain knowledge of experts is often ill-structured
– Content complexity
– Irregularity of application contexts
 Cognitive Flexibility Theory (Spiro & Jehng, 1990)
– ability to spontaneously restructure one's knowledge, in many ways,
in adaptive response to radically changing situational demands
Spiro, R. J., & Jehng, J. C. (1990). Cognitive flexibility and hypertext: Theory and technology for the nonlinear and multidimensional traversal of complex subject
matter. Cognition, education, and multimedia: Exploring ideas in high technology, 205.

6. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
6
EU FP7 Learning Layers Project
 How can we scale up video
tagging to support informal
learning at the work place
 Objectives
– Mobile creation of videos
with learning materials
(physical-digital world)
– Tag the non-obvious for
informal learning in
communities (social media
layer)
– Scaffold meaningful learning
by exploiting semantic
tagging information (social
semantic layer)
 Two regional clusters
– Construction (Germany)
– Healthcare (UK) http://learning-layers.eu/

7. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
7
Video Annotation: Sevianno 2.0
 Annotation types: Place, Object, Agent, Concept, Event
 Simple (textual) annotations

8. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
8
Multimedia Metadata User Interface

9. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
9
Multimedia Annotation System
Architecture
 3-tier architecture
 Cloud-enabled
solutions
 Advantages
– Separation of
concerns
– Scalability
– Rapid development &
deployment
– Application
customization

10. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
10
Use-Case
Adaptive Video Presentation
 A Web-based video adaptation tool
– Informal learning support
– Adaptive video presentation based on
– User profile (preferences)
– Collaboratively created video annotations
 Objective
– Choose relevant segments from different videos to form
an adaptive video, personalized for a particular user

11. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
11
Model of Adaptive Learning
Aroyo, L., Dolog, P., Houben, G. J., Kravcik, M., Naeve, A., Nilsson, M., & Wild, F. (2006). Interoperability in personalized adaptive learning.
Educational Technology & Society, 9(2), 4-18.

12. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
12
Adaptive Video Presentation
 Aim: adapt annotated videos according to the current
demands & meta-data on Content, User, Context
 FOSP Method to specify adaptation strategies
– Filter: take only relevant components (segments)
– Order: order them accordingly
– Select: choose from alternative representations
– Present: responsive design
Damjanovic, V. & Kravcik, M. (2007). Using Emotional Intelligence in Personalized Adaptation.
In V. Sugumaran (Ed.), Intelligent Information Technologies: Concepts, Methodologies, Tools, and Applications (pp. 1716-1742). IGI Publishing.

13. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
13
Video Adaptation in Vaptor
Filtered based on user’s
language preferences
Ranked for relevance,
based on user’s
interests, location,
duration, …
Extracts annotations
based on the search
query

14. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
14
DEMO

15. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
15
TASK

16. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
16
Task: Adaptation Strategies
 Team up
 Choose a scenario for applying video adaptation
– E.g. Construction, Healthcare
– Keep in mind the learning objective
 Specify a video adaptation strategy for learning
– Situational context
– User information needed
– How to acquire the information
– What users should specify (explicit info)
– What can automatically collected (implicit info)
– Video presentation
– How to filter & prioritize information
– How to present (any important UI concerns)

17. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
17
Relevant Information
 User profile information => User Metadata
 Video annotations (type, content) => Video Metadata
 Contextual information (location, weather) => Context
 Adaptation strategies => Adaptive Presentation
– Filter: select relevant segments
– Order: rank information according to different criteria
– Select: choose most suitable representation (media,
perspective)
– Present: responsive design (parallel vs. sequential)

18. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
18
Presentations
Top concepts get featured on Learning Layers blog

19. Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
19
Now: Photo Shooting Time!