LectureSight (http://lecturesight.org) is an open source OSGI application that uses OpenCL to analyze a video stream in real-time and track the presenter by controlling a PTZ camera. This presentation from the Opencast 2018 Conference in Vienna presents recent improvements to LectureSight from the University of Manchester and University of Cape Town.

1. ||
Stephen Marquard, University of Cape Town
Stuart Phillipson, University of Manchester
Vienna, February 2018
14/02/2018 1
LectureSight is awesome and getting better!

2. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 2
Overview
LectureSight at University of Manchester
LectureSight at University of Cape Town
What’s new in LectureSight:
• More committers
• New documentation
• Improved UI
• Pan & Tilt operator
• Easier calibration
• Better tracking
• Metrics
• Galicaster plugin
• Dashboard

3. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 3
LectureSight at University of Manchester
(Demo video from Manchester)

4. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 4
LectureSight at University of Cape Town
Around 18 larger venues equipped, in daily use
Axis 5915 PTZ Cameras
Logitech and Raspberry Pi overview cameras
Some difficulties:
• Overview cameras become misaligned
• Overview cameras not positioned optimally
• Calibration sometimes not accurate
• “Distracted” tracking (presenter not in frame)
• Poor performance in very low light conditions
• USB/CAT5 extender and RPi camera issues
• Some venues need tilting as well as pan

5. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 5
More committers
• Ben Wulff (creator, now at Fraunhofer)
• James Perrin (UoM)
• Stephen Marquard (UCT)
We will review and merge your pull request promptly 

6. || 14/02/2018 6
New documentation: docs.lecturesight.org

7. || 14/02/2018 7
Improved UI
PTZ Camera Control
now shows:
• Overview image as
background
• PTZ Camera field of
view
• Position of the
tracked object, target
camera position and
actual camera
position
Much easier to verify
that calibration and
configuration is correct.

8. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 8
Pan & Tilt Operator
Contributed by Manchester
Camera now tracks vertically as well as horizontally

9. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 9
Easier calibration
Calibration uses spline
interpolation and is also more
accurate.
Pick 3 to 5 fixed points on
the overview image, and
place markers on them in the
Scene Profile Editor.
Set camera presets to the
same points in the Axis 5915
web UI.
Restart LectureSight.
Voila! You’re (mostly) done.

10. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 10

11. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 11
Better tracking
Tracking persistence has been improved, so the tracker remains
on an object for longer, and is therefore less distracted by transient
movements elsewhere in the image (for example on projector
screens, or encoding artefacts).
Preference is given to tracked objects which have moved some
distance since initial detection (real people)

12. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 12
Metrics
LectureSight will
create a metrics
JSON file for each
session (from start to
stop of recording, if
using the CA’s
recording calendar)
Use metrics to
identify poor tracking
performance.
Use the Galicaster
plugin to attach the
metrics to the OC
mediapackage.

13. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 13
Galicaster plugin
Activates and deactivates LectureSight when recordings are
started and stopped manually in Galicaster
Attaches the LectureSight metrics file to the Opencast
mediapackage.

14. || 14/02/2018 14
Dashboard

15. || 14/02/2018First name Surname (edit via “Insert” > “Header & Footer”) 15
Get LectureSight
http://docs.lecturesight.org/
http://bitbucket.org/bwulff/lecturesight/ (latest: 0.3-sprint)
https://opencast.jira.com/projects/LS/issues
Dashboard:
https://bitbucket.org/cilt/lecturesight-overview
Galicaster plugin:
https://bitbucket.org/cilt/matterhorn_ansible/raw/master/templates/lecturesight.py