Learning Analytics
Community Exchange
Dr Doug Clow
Institute of Educational Technology, The Open University, UK
@dougclow
dougclow.org
doug.clow@open.ac.uk
2
2
CC-BY – You are free to:
copy, share, adapt, or re-mix;
photograph, film, or broadcast;
blog, live-blog, or post video of
this presentation provided that:
You attribute the work to its author and respect the rights and
licences associated with its components.
www.laceproject.eu
4
Photo (CC)-BY Karsten Seiferlin https://flic.kr/p/aqnnhq
• The project
• Videos and publications
• Evaluation Framework
• Privacy and Ethics
• Interoperability
• Evidence Hub
• Visions of the Future
• Policy
• Future
the project
The LACE project
6
K12 Workplace
HEI Community-building through events &
communication channels/social media
(cross-disciplinary HEI, K12, Workplace)
 Technology transfer & best practice
 Organized many events, and contributed to
more (tutorials, workshops, conferences,
etc.)
European support action aimed at integrating communities working on LA from schools,
workplace and universities
Organisational Structure
7
Maren
WP3
(OUNL)
Peter, WP4, (SKOL)
Fabrizio, WP5, (ITS)
Hendrik,
Marcus
WP9
(OUNL)
Rebecca, WP8, (OUUK)
Adam
WP7
(CETIS)
Sally, WP1, (ATiT)
Brian
WP2
(CETIS)
Doug, WP6,
(OUUK)
PO: Liina Maria Munari
Dai WP7 (CETIS)
… and more partners
Mathy
Vanbuel
(ATiT)
Mehrnoosh
Vahdat
(ITS)
Christina Smart
(CETIS) Simone
Naso
(ITS)
Tore Hoel
(HIOA)
Weiqin
Chen
(HIOA)
Erwin Bomas
(Kennisnet)
Eva Szalma
(EDEN)
Li Yuan
(CETIS)
David Sherlock
(CETIS)
Wietse van Bruggen
(Kennisnet)
Marco
Paini
(ITS)
9
This project has received funding from the European Union’s Seventh
Framework Programme for research, technological development and
demonstration under grant agreement no 619424.
10
K12 Workplace
HE
State of the art by sector
• Awareness
raising
• Less solutions
& little use
• Vendor
interests
• High demand
on privacy
• No systematic
use of data
• Widespread interest (Management, Researchers, Teachers)
• Some substantive take-up
• More reporting data than taking action on data
• Probably most advanced sector
• Bridging ind.
communities
• KPIs
• Continuous
improvement
& need for LA
• Process
standardisation
videos and publications
12http://www.laceproject.eu/videos/
evaluation framework
(framework of
quality indicators)
14
15
16
privacy and ethics
18
Workshops
EP4LA
Briefing papers
19
20
21
interoperability
23
• D7.1 Compilation of Learning Analytics
Interoperability Studies
• D7.2 Data Sharing Requirements and
Roadmap
• D7.3 Compilation of Learning Analytics
Interoperability Studies
• D7.4 Learning Analytics Interoperability:
Requirements, Specifications and Adoption
evidence hub
Evidence Hub – evidence.laceproject.eu
Learning analytics:
A. Improve learning outcomes.
B. Improve learning support and teaching
(including retention, completion and
progression).
C. Are taken up and used widely
(including deployment at scale).
D. Are used in an ethical way.
25
Evidence Hub – Entries as at Aug 2016
Sector Europe North
America
Othe
r
No
location
Total
Schools 7 9 1 21 38
Universities 12 11 6 32 61
Workplace 1 0 0 11 12
Informal 1 0 1 4 6
Cross-sector 3 0 1 3 7
Total 24 20 9 71 124
26
NB A technical issue with the LAK16 data import means that many entries
with valid countries are rendering as ‘No location’. This is will be fixed soon.
Evidence Hub – Evidence Flow map
27
Evidence Hub – Map of Evidence
28
Evidence Hub – analysis of evidence
• Almost all evidence is positive – publication bias?
– Except for D: Ethics
29
visions of the future
Photo CC BY-NC-ND J Sibiga Photography https://flic.kr/p/8jkiNi
Eight Visions of the Future
1. Learners are monitored
by their learning
environments
2. Learners’ personal data
are tracked
3. Analytics are rarely used
4. Learners control their
own data
5. Open systems are widely
adopted
6. Learning analytics are
essential tools
7. Analytics help learners
make the right choices
8. Analytics have largely
replaced teachers
31
Photo CC BY-SA Beau Considine https://flic.kr/p/m6Vqih
Themes in Visions of the Future
• Affect
• Alienation
• Complexity
• Cost
• Ethics
• Experience
• Pedagogy
• Power
• Privacy
• Regulation
• Standards
• Temporality
• Validity
32
policy
Brussels Briefing for Policymakers
34
LAEP: Pressing policy issues for the future
• Strategy
• Research and development
– pedagogies
– address strategic objectives
– technologies
– frameworks
• Infrastructure and Capability
• Context
• Standards
• Skills
• Outreach
35
the future
Learning Analytics
Community Exchange
www.laceproject.eu
Learning Analytics
Community Europe
www.laceproject.eu
Thanks to:
People:
• LACE at the OU: Rebecca Ferguson, Andrew Brasher,
Bart Rientes, Simon Cross, Linda Norwood Michelle
Bailey, Rebecca Wilson, Evaghn De Souza, Natalie
Eggleston, Oliver Millard, Gary Elliot-Citigottis.
• LACE project partners: CETIS (Bolton), OUNL,
Skolverket, HIOA, Kennisnet, ITS, ATiT.
Funders:
• LACE: European Commission 619424-FP7-ICT-2013-11
“Learning Analytics Community Exchange” by Doug Clow,
Institute of Educational Technology, The Open University,
was presented at the 8th UK Learning Analytics Network
Meeting, The Open University, 2nd November 2016.
@dougclow
dougclow.org
doug.clow@open.ac.uk
This work was undertaken as part of the LACE Project, supported by the European Commission Seventh
Framework Programme, grant 619424.
These slides are provided under the Creative Commons Attribution Licence:
http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms.
www.laceproject.eu
@laceproject
40
cc licensed ( BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/

Learning Analytics Community Exchange

  • 1.
    Learning Analytics Community Exchange DrDoug Clow Institute of Educational Technology, The Open University, UK @dougclow dougclow.org doug.clow@open.ac.uk
  • 2.
    2 2 CC-BY – Youare free to: copy, share, adapt, or re-mix; photograph, film, or broadcast; blog, live-blog, or post video of this presentation provided that: You attribute the work to its author and respect the rights and licences associated with its components.
  • 3.
  • 4.
    4 Photo (CC)-BY KarstenSeiferlin https://flic.kr/p/aqnnhq • The project • Videos and publications • Evaluation Framework • Privacy and Ethics • Interoperability • Evidence Hub • Visions of the Future • Policy • Future
  • 5.
  • 6.
    The LACE project 6 K12Workplace HEI Community-building through events & communication channels/social media (cross-disciplinary HEI, K12, Workplace)  Technology transfer & best practice  Organized many events, and contributed to more (tutorials, workshops, conferences, etc.) European support action aimed at integrating communities working on LA from schools, workplace and universities
  • 7.
    Organisational Structure 7 Maren WP3 (OUNL) Peter, WP4,(SKOL) Fabrizio, WP5, (ITS) Hendrik, Marcus WP9 (OUNL) Rebecca, WP8, (OUUK) Adam WP7 (CETIS) Sally, WP1, (ATiT) Brian WP2 (CETIS) Doug, WP6, (OUUK) PO: Liina Maria Munari Dai WP7 (CETIS)
  • 8.
    … and morepartners Mathy Vanbuel (ATiT) Mehrnoosh Vahdat (ITS) Christina Smart (CETIS) Simone Naso (ITS) Tore Hoel (HIOA) Weiqin Chen (HIOA) Erwin Bomas (Kennisnet) Eva Szalma (EDEN) Li Yuan (CETIS) David Sherlock (CETIS) Wietse van Bruggen (Kennisnet) Marco Paini (ITS)
  • 9.
    9 This project hasreceived funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619424.
  • 10.
    10 K12 Workplace HE State ofthe art by sector • Awareness raising • Less solutions & little use • Vendor interests • High demand on privacy • No systematic use of data • Widespread interest (Management, Researchers, Teachers) • Some substantive take-up • More reporting data than taking action on data • Probably most advanced sector • Bridging ind. communities • KPIs • Continuous improvement & need for LA • Process standardisation
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
    23 • D7.1 Compilationof Learning Analytics Interoperability Studies • D7.2 Data Sharing Requirements and Roadmap • D7.3 Compilation of Learning Analytics Interoperability Studies • D7.4 Learning Analytics Interoperability: Requirements, Specifications and Adoption
  • 24.
  • 25.
    Evidence Hub –evidence.laceproject.eu Learning analytics: A. Improve learning outcomes. B. Improve learning support and teaching (including retention, completion and progression). C. Are taken up and used widely (including deployment at scale). D. Are used in an ethical way. 25
  • 26.
    Evidence Hub –Entries as at Aug 2016 Sector Europe North America Othe r No location Total Schools 7 9 1 21 38 Universities 12 11 6 32 61 Workplace 1 0 0 11 12 Informal 1 0 1 4 6 Cross-sector 3 0 1 3 7 Total 24 20 9 71 124 26 NB A technical issue with the LAK16 data import means that many entries with valid countries are rendering as ‘No location’. This is will be fixed soon.
  • 27.
    Evidence Hub –Evidence Flow map 27
  • 28.
    Evidence Hub –Map of Evidence 28
  • 29.
    Evidence Hub –analysis of evidence • Almost all evidence is positive – publication bias? – Except for D: Ethics 29
  • 30.
  • 31.
    Photo CC BY-NC-NDJ Sibiga Photography https://flic.kr/p/8jkiNi Eight Visions of the Future 1. Learners are monitored by their learning environments 2. Learners’ personal data are tracked 3. Analytics are rarely used 4. Learners control their own data 5. Open systems are widely adopted 6. Learning analytics are essential tools 7. Analytics help learners make the right choices 8. Analytics have largely replaced teachers 31
  • 32.
    Photo CC BY-SABeau Considine https://flic.kr/p/m6Vqih Themes in Visions of the Future • Affect • Alienation • Complexity • Cost • Ethics • Experience • Pedagogy • Power • Privacy • Regulation • Standards • Temporality • Validity 32
  • 33.
  • 34.
    Brussels Briefing forPolicymakers 34
  • 35.
    LAEP: Pressing policyissues for the future • Strategy • Research and development – pedagogies – address strategic objectives – technologies – frameworks • Infrastructure and Capability • Context • Standards • Skills • Outreach 35
  • 36.
  • 37.
  • 38.
  • 39.
    Thanks to: People: • LACEat the OU: Rebecca Ferguson, Andrew Brasher, Bart Rientes, Simon Cross, Linda Norwood Michelle Bailey, Rebecca Wilson, Evaghn De Souza, Natalie Eggleston, Oliver Millard, Gary Elliot-Citigottis. • LACE project partners: CETIS (Bolton), OUNL, Skolverket, HIOA, Kennisnet, ITS, ATiT. Funders: • LACE: European Commission 619424-FP7-ICT-2013-11
  • 40.
    “Learning Analytics CommunityExchange” by Doug Clow, Institute of Educational Technology, The Open University, was presented at the 8th UK Learning Analytics Network Meeting, The Open University, 2nd November 2016. @dougclow dougclow.org doug.clow@open.ac.uk This work was undertaken as part of the LACE Project, supported by the European Commission Seventh Framework Programme, grant 619424. These slides are provided under the Creative Commons Attribution Licence: http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms. www.laceproject.eu @laceproject 40
  • 41.
    cc licensed (BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/