1. S C I E N C E P A S S I O N T E C H N O L O G Y
www.tugraz.at
Automatic Authentication of
Students at an Interactive
Learning-Video Platform
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl
Educational Technology - TU Graz
June 26, 2019

2. 2
Content
1. Introduction
2. LIVE: Interactive Video Platform
3. Automatic Authentication
4. Course Design
5. Evaluation
6. Discussion
7. Outlook & Conclusion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

3. 3
Graz University of Technology
Educational Technology
Working Group Sustainable Construction, Institute of
Technology and Testing of Construction Materials
Europe, Austria, Graz
http://www.tugraz.at
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

4. 4
Introduction
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

5. 5
Introduction
Motivation
authentication required for attendance monitoring and
assessment
many positive effects of compulsory attendance
compulsory attendance at online videos needs a
detailed monitoring and additional safety parameters
to ensure the accuracy
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

6. 6
Introduction
Why Interactions?
help to ensure the accuracy of attendance monitoring
missing interactions are leading to passive learners
and to a much more surficial work
avoid that learners become tired or annoyed
increase the attention and the contribution
feedback for teachers:
Is it possible for the learners to follow the content?
Is the speed appropriate?
...
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

7. 7
Introduction
Research Question
a video platform was used for some years with
manual authentication
now automatic authentication through the learning
platform of the university is possible
evaluating the automatic authentication at a platform
for learning-videos in combination with interactive
components
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

8. 8
LIVE: Interactive Video Platform
Interactive Video Platform
LIVE: Live Interaction in Virtual learning
Environments
https://live.learninglab.tugraz.at/
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

9. 9
LIVE: Interactive Video Platform
Interactive Components in Videos
different methods of interaction:
automatically asked questions and captchas
asking questions to the lecturer
asking text-based questions to the attendees
multiple-choice questions at pre-defined positions
post video polls
analysis features for the teacher
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

10. 10
LIVE: Interactive Video Platform
Video is Interrupted by a MC-Question
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

11. 11
LIVE: Interactive Video Platform
Attendance Monitoring
registered and authenticated users
for each student who attends a video the following
values are recorded
Absolute time of joining (e.g. 2018-05-11
13:45:27)
Relative time of joining (e.g. 00:00)
Absolute time of leaving (e.g. 2018-05-11
13:48:49)
Relative time of leaving (e.g. 03:22)
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

12. 12
LIVE: Interactive Video Platform
Timeline Analysis
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

13. 13
LIVE: Interactive Video Platform
List of All Attendees
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

14. 14
LIVE: Interactive Video Platform
User Details
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

15. 15
LIVE: Interactive Video Platform
Calculation of an Attention-Level
calculation of an attention-level which is based on the
reaction-times of the attendees to the interactions
maxim: if the attendee reacts slower the
attention-level decreases
result ranges from 0% (completely absent) to 100%
(fully attentive)
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

16. 16
Automatic Authentication
Automatic Authentication
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

17. 17
Automatic Authentication
Learning Tools Interoperability (LTI)
a standard of the IMS Global Learning Consortium to
connect learning applications
one platform could use content offered by a second
platform
entities:
student
learning platform (LTI consumer): moodle,
TeachCenter, ...
learning tool (LTI provider): LIVE, ...
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

18. 18
Automatic Authentication
LTI Authentication at a Tool through a Platform
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

19. 19
Automatic Authentication
Developed LTI Tools
for the Django-Web-Framework
MIT license
Django LTI Provider with Authentication
https://github.com/wachjose88/django-lti-provider-
auth
Local LTI Consumer
https://github.com/wachjose88/local-lti-consumer
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

20. 20
Course Design
Course Design
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

21. 21
Course Design
Setting
course: “Building Materials Basics - Laboratory
Practicals”
bachelor program: “Civil Engineering Sciences and
Construction Management”
large number of students in summer term
8 subjects of practical demonstrations
16 groups (two groups/videos per subject)
each group is responsible for filming one
demonstration
small number of students in winter term
videos of the summer term are used
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

22. 22
Course Design
Flow of Events
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

23. 23
Evaluation
Evaluation
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

24. 24
Evaluation
Automatic Authentication
before automatic authentication
students had to register manually at LIVE
had to use a username which was assigned by
the teacher
8% (12 out of 150) did not use the assigned
username and received a negative grade
with automatic authentication
no technical problems
no unidentifiable students
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

25. 25
Evaluation
Multiple-Choice Questions
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

26. 26
Evaluation
Multiple-Choice Questions by Subject
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

27. 27
Evaluation
Multiple-Choice Questions
high correctness rate at all subjects
more problems at
Aggregate
Hardened Concrete 1 and 2
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

28. 28
Evaluation
Proposed Multiple-Choice Questions
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

29. 29
Evaluation
Proposed Multiple-Choice Questions
31 out of 121 students submitted multiple-choice
questions for all subjects
not many questions were congruent with the
questions of the teacher
if questions of the teacher were submitted, these
questions were among the best
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

30. 30
Discussion
Discussion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

31. 31
Discussion
General
students show a better grade point average after than
before using LIVE
reduced workload of the teacher
students could focus on the content of the videos and
not on administrative tasks like using an assigned
username
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

32. 32
Discussion
Learning Approach
high correctness rate at the questions because
students could watch the videos multiple times
students reported that they worked according this
workflow:
1. watching the videos
2. answering the multiple-choice questions
3. re-reading the teaching materials, if the student
was uncertain about the answer
4. re-watching the videos
5. answering the multiple-choice question with
additional knowledge
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

33. 33
Discussion
Proposed Multiple-Choice Questions
broad range of proposed questions
could help to identify the interests of the students
adapt lecture accordingly
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

34. 34
Outlook & Conclusion
Outlook & Conclusion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

35. 35
Outlook & Conclusion
Outlook
the lecture is anchored in the bachelor program for
the next years
it will be held again in this form
minor adaptions according the proposed questions
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

36. 36
Outlook & Conclusion
Conclusion
automatic authentication through a third-party
learning platform
a web-platform records the time of watching of each
individual student and adds some interactive
components
students were asked to submit questions which
helped them understand the lecture content to identify
topics of interest
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019

37. 37
Thank you!
Questions?
Josef Wachtler, josef.wachtler@tugraz.at
Marco Scherz, marco.scherz@tugraz.at
Martin Ebner, martin.ebner@tugraz.at
Maria Grandl, maria.grandl@tugraz.at
Graz University of Technology
Educational Technology
M¨unzgrabenstraße 36/I, A-8010 Graz
http://elearningblog.tugraz.at
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019