The European Technology Enhanced Learning Landscape

8th Joint European Summer School on
Technology Enhanced Learning (JTEL)
May 20-25, 2012
Estoril, Portugal

TeLLNet

The European Technology Enhanced
Learning Landscape

Michael Derntl and Ralf Klamma
RWTH Aachen University
Advanced Community Information Systems (ACIS)
{derntl,klamma}@dbis.rwth-aachen.de

Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-1 This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

Advanced Community Information Systems
(ACIS)

TeLLNet

Web Engineering Responsive
Community

Web Analytics
Open
Visualization
Community
and
Information
Simulation
Systems

Community Community
Support Analytics

Requirements
Prof. Dr. M. Jarke
I5-MD-0512-2
Engineering

Motivation:
TEL as a Research Community
Observable change of communication
TeLLNet
– New events: EC-TEL, JTEL Summer School, Professional Training
Facts, Alpine-Rendezvous, …
– New journals: IEEE Transactions on Learning Technologies,
Journal of Technology Enhanced Learning, …
– New media: Blogs, Twitter, Facebook, LinkedIn, …
Funding situation in FP 6 – FP 7
– Several NoE: KALEIDOSCOPE, PROLEARN, STELLAR, GALA
– Overcoming fragmentation: What happened so far?
– Driving excellence: What should happen?
Tools for the TEL community
Prof. Dr. M. Jarke
I5-MD-0512-3
– Online, Open Source, Open Access

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-4

Research Context

TeLLNet

Mapping and roadmapping for TEL
Understanding the current TEL landscape
Strong and weak signals for change at different levels
Different data sources
Different methods, e.g. Delphi, Community modeling,
Text analysis, Social Network Analysis, etc.
Prof. Dr. M. Jarke
I5-MD-0512-5

TEL Mediabase –
Data Sources Overview

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-6

TEL Publications

TeLLNet
Published paper represents (finished) research work
Points of interest
– Venue analysis important TEL venues
– Co-authorships collaboration networks
– Paper topics
Data set:
– DBLP Bibliography integrated with CiteSeerX

Prof. Dr. M. Jarke
I5-MD-0512-7

TEL Publication Venues – Approach

TeLLNet
Seed venue: ECTEL
Author overlap := fraction of authors of the smaller venue
who also have paper(s) in the other (larger) venue
Identify venues that have at least 10% author “overlap”
with ECTEL; repeat

Prof. Dr. M. Jarke
I5-MD-0512-8

TEL Publication Venues

TeLLNet

Artificial
Intelligence

HCI

Web /
Hypermedia
61 nodes, 209 edges
Avg. Degree = 6.8
Lehrstuhl Informatik 5 Diameter = 4
Prof. Dr. M. Jarke
Avg. Path len = 2.2
I5-MD-0512-9 Clustering = .49

TEL Publication Venues

TeLLNet
Strong role of conferences in
– Dissemination of results
– Shaping and maintaining the TEL community

Example co-authorship networks:

Prof. Dr. M. Jarke
I5-MD-0512-10 Pham, Derntl, Klamma: Development Patterns of Scientific Communities in Technology Enhanced Learning. ET&S (in press)

TEL Conference Communities –
Current State

TeLLNet
TEL conferences exhibit mixed patterns
– Some moving towards focused topology
– Some stuck in the bonding/emergence phase

Prof. Dr. M. Jarke
I5-MD-0512-11 Pham, Derntl, Klamma: Development Patterns of Scientific Communities in Technology Enhanced Learning. ET&S (in press)

TEL Communities –
Analysis Tool: AERCS
Returning authors
TeLLNet

Co-Authorship – Largest Component

Prof. Dr. M. Jarke
I5-MD-0512-12 http://tiny.cc/aercs

Top Authors by # Venues
Number of distinct Author # Venues # Papers ICALT ECTEL
TeLLNet Peter Brusilovsky 20 65 X X
venues, where author
Kinshuk 18 89 X X
has published Vladan Devedzic 18 38 X X
Arthur C. Graesser 17 50 X
Yoneo Yano 16 56 X
Requirement: Wolfgang Nejdl 16 55 X X
ICALT … most central venue Paul De Bra 16 41 X X
ECTEL … seed venue Kenneth R. Koedinger 15 93 X
Maria Grigoriadou 15 42 X
Gordon I. McCalla 15 35 X
Caution! Daniel D. Suthers 15 31 X
Gerhard Fischer 15 31 X
Lora Aroyo 15 29 X
Claude Frasson 14 72 X X
Toshio Okamoto 14 70 X
Prof. Dr. M. Jarke
I5-MD-0512-13

Top Authors’ Paper Titles 2005+

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-14

Top Authors’ Paper Titles 2005+

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-15

Authors’ Topics –
All JTEL Participants

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-16

Authors’ Topics –
JTEL Instructors vs Students

TeLLNet
Instructors

Students
Prof. Dr. M. Jarke
I5-MD-0512-17

TEL Projects

TeLLNet
Project as a funded collaborative R&D effort
Important role in the R&D value chain

Points of interest
– Organizational collaboration
– Progression of consortia
– Impact on the landscape

Prof. Dr. M. Jarke
I5-MD-0512-18

TeLLNet

Main
source:
EC
project
fact
Prof. Dr. M. Jarke
sheets
I5-MD-0512-19

Data Set
Progr. Call # Projects (acronyms)
Call 2005 4 CITER, JEM, MACE, MELT
TeLLNet
Call 2006 7 COSMOS, EdReNe, EUROGENE, eVip, Intergeo, KeyToNature, Organic.Edunet
ECP
Call 2007 3 ASPECT, iCOPER, EduTubePlus
Call 2008 5 LiLa, Math-Bridge, mEducator, OpenScienceResources, OpenScout
IST-2002- CONNECT, E-LEGI, ICLASS, KALEIDOSCOPE, LEACTIVEMATH, PROLEARN,
8
2.3.1.12a TELCERT, UNFOLD
IST-2004- APOSDLE, ARGUNAUT, ATGENTIVE, COOPER, ECIRCUS, ELEKTRA, I-MAESTRO,
FP6 2.4.10b
14
KP-LAB, L2C, LEAD, PALETTE, PROLIX, RE.MATH, TENCOMPETENCE
IST-2004- ARISE, CALIBRATE, ELU, EMAPPS.COM, ICAMP, LOGOS, LT4EL, MGBL, UNITE,
10
2.4.13c VEMUS
ICT-2007.4.1d 6 80DAYS, GRAPPLE, IDSPACE, LTFLL, MATURE, SCY
ICT-2007.4.3d 7 COSPATIAL, DYNALEARN, INTELLEO, ROLE, STELLAR, TARGET, XDELIA
FP7
ALICE, ARISTOTELE, ECUTE, GALA, IMREAL, ITEC, METAFORA, MIROR,
ICT-2009.4.2b 13
MIRROR, NEXT-TELL, SIREN, TEL-MAP, TERENCE

Total: 77
(Information Systems) a … Technology-enhanced learning and access to cultural heritage” c … Strengthening the Integration of the ICT research effort in an Enlarged Europe”
Prof. Dr. M. Jarke b … Technology-Enhanced Learning d … Digital libraries and technology-enhanced learning”
I5-MD-0512-20

TEL Projects as Social Networks
Projects Organizations
TeLLNet

Project consortium progression
Nodes: Projects
Edges: Overlap of consortia (directed, weighted)

Organizational collaboration
Nodes: Organizations
Edges: Collaboration in multiple projects (undirected, weighted)

Bipartite
Nodes: Projects, Organizations
Edges: Consortium memberships
Prof. Dr. M. Jarke
I5-MD-0512-21

Project Consortium Progression
“TEL Projects History”

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-22

Cross-Programme Collaboration Ties
FP7

Strong ties
ALICE
SIREN
MATURE ARISTOTELE

TeLLNet
NEXT-TELL IMREAL
ECUTE TARGET
MIROR

among FP6, COSPATIAL

INTELLEO MIRROR
GALA
80DAYS

METAFORA

FP7 and ECP
DYNALEARN
GRAPPLEIDSPACE
XDELIA SCY
ROLE

TERENCE

STELLAR

ITEC
TEL-MAP
eContentplus LTFLL
LiLa eViP

FP6
I-MAESTRO
mEducator
ECIRCUS
MACE

EdReNe KeyToNature APOSDLE

UNFOLD
OpenScout
COOPER
ASPECT
JEM Math-Bridge

TELCERT RE.MATH
iCOPER
EUROGENE

PROLEARN
MELT KALEIDOSCOPE CONNECT

EduTubePlus Intergeo
COSMOS MGBL ARGUNAUTARISE
ELEKTRA
PROLIX
Organic.Edunet

TENCOMPETENCE
OpenScienceResources
CITER E-LEGI UNITE LEACTIVEMATH

PALETTE
LT4EL ICLASS

VEMUS
ICAMP ELU
KP-LAB

Lehrstuhl Informatik 5 L2C
LEAD
LOGOS
Prof. Dr. M. Jarke CALIBRATE
ATGENTIVE
EMAPPS.COM
I5-MD-0512-23

Project Impact on the Landscape
Measure impact of project consortium members on
TeLLNet
sustaining and shaping the social TEL project ties after
the project start.
Variables:
… successor projects of p starting m months after p
… all potential successor projects of p
… consortium members of p Cumulative fraction of successor
Successor projects
projects filled up with p's members
relative to opportunity
Impact:
∩
∙
∈
Prof. Dr. M. Jarke
I5-MD-0512-24 Derntl, Klamma: The European TEL projects community from an SNA perspective. ECTEL 2012 (submitted)

Project Impact – Ranking
# Project Runtime m€ Type ROI
TeLLNet 1 PROLEARN 2004-07 6.01 FP6 NoE 22 past networks of excellence
All 43 69 0.47 2.83
2 KALEIDOSCOPE
All programmes 9.35
2004-07 FP6 NoE 83 among69 11 ranks.
55 top 0.14 1.27
represented, with FP6
3 GRAPPLE 2008-11 3.85 FP7 IP 15 two inaugural 0.25 on top
The 15 28 NoEs 0.96
strongest
4 MACE 2006-09 3.15 ECP CEP 13 19 41 0.31 0.96
5 TELCERT 2004-06 1.80 FP6 STREP 9 21 69 0.53 0.95
6 iCOPER 2008-11 4.80 ECP BPN 23 13 25 0.16 0.75
7 E-LEGI 2004-07 5.95 FP6 UNFOLD has best impact 0.12
IP 22 31 69 0.72
for money
8 PROLIX 2005-09 7.65 FP6 IP 19 19 49 0.09 0.71
9 UNFOLD 2004-05 0.66 FP6 CSA 4 13 69 1.07 0.71
10 ROLE 2009-13 6.60 FP7 IP 16 10 18 0.08 0.56
11 STELLAR 2009-12 4.99 FP7 NoE 16 9 18 0.11 0.53
12 LTFLL running projects in
Two 2008-11 2.85 FP7 STREP 11 10 28 0.18 0.52
13 COOPER the list 2005-07 1.95 FP6 STREP 8 11 49 0.26 0.51
14 ICLASS 2004-08 12.59 FP6 IP 17 20 69 0.04 0.49
Lehrstuhl Informatik 5 15 ARGUNAUT 2005-08 1.63 FP6 STREP 7 12 49 0.30 0.49
Prof. Dr. M. Jarke
I5-MD-0512-25

Running Projects
# Project End m€ Type ROI
TeLLNet 1 ROLE 2013-01-31 6.60 FP7 IP 16 10 18 0.08 0.56
2 STELLAR 2012-05-31 4.99 FP7 NoE 16 9 18 0.11 0.53
3 TARGET 2012-07-31 6.79 FP7 IP 15 8 18 0.06 0.41
4 ALICE 2012-05-31 1.80 FP7 STREP 5 3 9 0.15 0.27
5 MIRROR 2014-06-30 6.45 FP7 IP 15 3 4 0.02 0.15
6 OpenScout 2012-08-31 2.80 ECP TP 18 4 13 0.05 0.14
7 OpenScienceResources 2012-05-31 2.60 ECP TP 20 2 14 0.01 0.01

Also running: ARISTOTELE, ECUTE, GALA, IMREAL, ITEC, METAFORA, MIROR, NEXT-TELL,
SIREN, TEL-MAP, TERENCE

Prof. Dr. M. Jarke
I5-MD-0512-26

Organizational Collaboration Ties

TeLLNet
600+ organizations, 9K+ collaboration ties

FP7 project partners map

Prof. Dr. M. Jarke
I5-MD-0512-27

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-28

Most Frequent Collaborators

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-29

Projects Space @
LearningFrontiers.eu

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-30

Projects Space @

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-31

Projects Space @

TeLLNet

Prof. Dr. M. Jarke
I5-MD-0512-32

TEL Blogosphere
Collection of blogs and entries
TeLLNet
Crawled nightly and fed into DB
Backwards retrieval beyond feed limits
Kickoff in 2006 (PROLEARN)
1,000 929 450,000
TEL Blogs
900 All Blogs 400,000
TEL Entries
800 All Entries 382,618 350,000
700
300,000
600

# Blog Entries
# Blogs

250,000
500
200,000
400
288 150,000
300

200 72,849 100,000

100 50,000
(Information Systems) 0 0
Prof. Dr. M. Jarke
I5-MD-0512-33
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012

Blogosphere Model

TeLLNet

has Comment
N
1

Entry entry_urls URL
N N
N 1
1

Burst source_entries actor_url Tag
N is_a
1 N
1 1

Source is_a
Actor actor_tag
N
1 1

Prof. Dr. M. Jarke
I5-MD-0512-34

The European Technology Enhanced Learning Landscape

The European Technology Enhanced Learning Landscape

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (16)

Similar to The European Technology Enhanced Learning Landscape

Similar to The European Technology Enhanced Learning Landscape (19)

Recently uploaded

Recently uploaded (20)

The European Technology Enhanced Learning Landscape