Automatic Authentication of Students at an Interactive Learning-Video Platform

S C I E N C E P A S S I O N T E C H N O L O G Y
www.tugraz.at
Automatic Authentication of
Students at an Interactive
Learning-Video Platform
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl
Educational Technology - TU Graz
June 26, 2019

2
Content
1. Introduction
2. LIVE: Interactive Video Platform
3. Automatic Authentication
4. Course Design
5. Evaluation
6. Discussion
7. Outlook & Conclusion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

3
Graz University of Technology
Educational Technology
Working Group Sustainable Construction, Institute of
Technology and Testing of Construction Materials
Europe, Austria, Graz
http://www.tugraz.at
June 26, 2019

4
Introduction
June 26, 2019

5
Introduction
Motivation
authentication required for attendance monitoring and
assessment
many positive effects of compulsory attendance
compulsory attendance at online videos needs a
detailed monitoring and additional safety parameters
to ensure the accuracy
June 26, 2019

6
Introduction
Why Interactions?
help to ensure the accuracy of attendance monitoring
missing interactions are leading to passive learners
and to a much more surﬁcial work
avoid that learners become tired or annoyed
increase the attention and the contribution
feedback for teachers:
Is it possible for the learners to follow the content?
Is the speed appropriate?
...
June 26, 2019

7
Introduction
Research Question
a video platform was used for some years with
manual authentication
now automatic authentication through the learning
platform of the university is possible
evaluating the automatic authentication at a platform
for learning-videos in combination with interactive
components
June 26, 2019

8
LIVE: Interactive Video Platform
Interactive Video Platform
LIVE: Live Interaction in Virtual learning
Environments
https://live.learninglab.tugraz.at/
June 26, 2019

9
Interactive Components in Videos
different methods of interaction:
automatically asked questions and captchas
asking questions to the lecturer
asking text-based questions to the attendees
multiple-choice questions at pre-deﬁned positions
post video polls
analysis features for the teacher
June 26, 2019

10
Video is Interrupted by a MC-Question
June 26, 2019

11
Attendance Monitoring
registered and authenticated users
for each student who attends a video the following
values are recorded
Absolute time of joining (e.g. 2018-05-11
13:45:27)
Relative time of joining (e.g. 00:00)
Absolute time of leaving (e.g. 2018-05-11
13:48:49)
Relative time of leaving (e.g. 03:22)
June 26, 2019

12
Timeline Analysis
June 26, 2019

13
List of All Attendees
June 26, 2019

14
User Details
June 26, 2019

15
Calculation of an Attention-Level
calculation of an attention-level which is based on the
reaction-times of the attendees to the interactions
maxim: if the attendee reacts slower the
attention-level decreases
result ranges from 0% (completely absent) to 100%
(fully attentive)
June 26, 2019

16
Automatic Authentication
June 26, 2019

17
Learning Tools Interoperability (LTI)
a standard of the IMS Global Learning Consortium to
connect learning applications
one platform could use content offered by a second
platform
entities:
student
learning platform (LTI consumer): moodle,
TeachCenter, ...
learning tool (LTI provider): LIVE, ...
June 26, 2019

18
LTI Authentication at a Tool through a Platform
June 26, 2019

19
Developed LTI Tools
for the Django-Web-Framework
MIT license
Django LTI Provider with Authentication
https://github.com/wachjose88/django-lti-provider-
auth
Local LTI Consumer
https://github.com/wachjose88/local-lti-consumer
June 26, 2019

20
Course Design
Course Design
June 26, 2019

21
Course Design
Setting
course: “Building Materials Basics - Laboratory
Practicals”
bachelor program: “Civil Engineering Sciences and
Construction Management”
large number of students in summer term
8 subjects of practical demonstrations
16 groups (two groups/videos per subject)
each group is responsible for ﬁlming one
demonstration
small number of students in winter term
videos of the summer term are used
June 26, 2019

22
Course Design
Flow of Events
June 26, 2019

23
Evaluation
Evaluation
June 26, 2019

24
Evaluation
before automatic authentication
students had to register manually at LIVE
had to use a username which was assigned by
the teacher
8% (12 out of 150) did not use the assigned
username and received a negative grade
with automatic authentication
no technical problems
no unidentiﬁable students
June 26, 2019

25
Evaluation
Multiple-Choice Questions
June 26, 2019

26
Evaluation
Multiple-Choice Questions by Subject
June 26, 2019

27
Evaluation
Multiple-Choice Questions
high correctness rate at all subjects
more problems at
Aggregate
Hardened Concrete 1 and 2
June 26, 2019

28
Evaluation
Proposed Multiple-Choice Questions
June 26, 2019

29
Evaluation
31 out of 121 students submitted multiple-choice
questions for all subjects
not many questions were congruent with the
questions of the teacher
if questions of the teacher were submitted, these
questions were among the best
June 26, 2019

30
Discussion
Discussion
June 26, 2019

31
Discussion
General
students show a better grade point average after than
before using LIVE
reduced workload of the teacher
students could focus on the content of the videos and
not on administrative tasks like using an assigned
username
June 26, 2019

32
Discussion
Learning Approach
high correctness rate at the questions because
students could watch the videos multiple times
students reported that they worked according this
workﬂow:
1. watching the videos
2. answering the multiple-choice questions
3. re-reading the teaching materials, if the student
was uncertain about the answer
4. re-watching the videos
5. answering the multiple-choice question with
additional knowledge
June 26, 2019

33
Discussion
broad range of proposed questions
could help to identify the interests of the students
adapt lecture accordingly
June 26, 2019

34
Outlook & Conclusion
June 26, 2019

35
Outlook
the lecture is anchored in the bachelor program for
the next years
it will be held again in this form
minor adaptions according the proposed questions
June 26, 2019

36
Conclusion
automatic authentication through a third-party
learning platform
a web-platform records the time of watching of each
individual student and adds some interactive
components
students were asked to submit questions which
helped them understand the lecture content to identify
topics of interest
June 26, 2019

37
Thank you!
Questions?
Josef Wachtler, josef.wachtler@tugraz.at
Marco Scherz, marco.scherz@tugraz.at
Martin Ebner, martin.ebner@tugraz.at
Maria Grandl, maria.grandl@tugraz.at
Graz University of Technology
Educational Technology
M¨unzgrabenstraße 36/I, A-8010 Graz
http://elearningblog.tugraz.at
June 26, 2019

Automatic Authentication of Students at an Interactive Learning-Video Platform

More Related Content

Similar to Automatic Authentication of Students at an Interactive Learning-Video Platform

More from Martin Ebner

Recently uploaded

Automatic Authentication of Students at an Interactive Learning-Video Platform