[DSC Adria 23] Sead Delalic Smart acceleration of video lectures.pdf
•
0 likes•5 views
Video lectures represent one of the most important sources of knowledge. Viewers tend to view the video lecture as soon as possible, but at the same time to master the material. Most video platforms offer up to 2x linear video acceleration, where each segment is accelerated exactly 2x. We will talk about a smart ways to speed up video lectures, where the ultimate goal is to use the history of video views to get a video that is twice as short, emphasize the important parts and remove the less important parts. Several approaches will be described, as well as the results of experiments that showed that nonlinear acceleration gives better quality results compared to linear acceleration.
Recommended
Recommended
More Related Content
Similar to [DSC Adria 23] Sead Delalic Smart acceleration of video lectures.pdf
Similar to [DSC Adria 23] Sead Delalic Smart acceleration of video lectures.pdf (20)
More from DataScienceConferenc1
More from DataScienceConferenc1 (20)
Recently uploaded
Recently uploaded (20)
[DSC Adria 23] Sead Delalic Smart acceleration of video lectures.pdf
- 1. Smart acceleration of video lectures Data Science Conference Adria | Zagreb 2023 Sead Delalić, PhD | University of Sarajevo
- 2. Agenda
- 4. Agenda Introduction & Motivation Similar researches
- 5. Agenda Introduction & Motivation Similar researches Implemented approaches
- 6. Agenda Introduction & Motivation Similar researches Implemented approaches Experiment & Results
- 7. Agenda Introduction & Motivation Similar researches Implemented approaches Experiment & Results Future work & Conclusion
- 8. Sead Delalić
- 9. Sead Delalić ● PhD in Computer Science ○ University of Sarajevo ○ Optimization, Data mining, AI
- 10. Sead Delalić ● PhD in Computer Science ○ University of Sarajevo ○ Optimization, Data mining, AI ● Assistant Professor ○ Faculty of Science, University of Sarajevo ● AI Consultant/Engineer ○ 5+ years of experience in AI industry ● 25+ research/scientific paper
- 12. Introduction
- 15. Introduction Online platforms Video platforms Large amounts of data
- 16. Video & Learning platforms
- 17. Video & Learning platforms Video lectures
- 18. Video & Learning platforms Video lectures MOOC
- 19. Video & Learning platforms Video lectures MOOC User interactions
- 21. Remarks
- 22. Remarks Students watch video lectures in short segments
- 23. Remarks Students watch video lectures in short segments Attention span decreases with video length
- 24. Remarks Students watch video lectures in short segments Attention span decreases with video length Repetitive content
- 25. Remarks Students watch video lectures in short segments Attention span decreases with video length Repetitive content Engagement correlates with better performance
- 26. Research of interest “How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014
- 27. Research of interest “How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014 Lecture duration should be limited to 6 minutes
- 28. Research of interest “How video production affects student engagement: An empirical study of mooc videos” Guo et al, 2014 Lecture duration should be limited to 6 minutes Shorter lectures lead to greater interest
- 29. How do we solve this problem?
- 30. Video Acceleration & Content Skipping
- 31. Video Acceleration & Content Skipping Linear acceleration
- 32. Video Acceleration & Content Skipping Linear acceleration Up to 2x
- 33. Video Acceleration & Content Skipping Linear acceleration Up to 2x Skipping
- 34. Video Acceleration & Content Skipping Linear acceleration Up to 2x Skipping Can we do something smarter?
- 35. Non-linear acceleration of video lectures
- 36. Non-linear acceleration of video lectures Smart acceleration of video lectures
- 38. Silence Removal
- 39. Silence Removal
- 40. Silence Removal Removing silence during audio playback
- 41. Silence Removal Removing silence during audio playback Eliminating pauses in speech
- 42. Silence Removal Removing silence during audio playback Eliminating pauses in speech Removing matching frames from a video
- 46. The initial results Video shortened up to 40%
- 47. The initial results Video shortened up to 40% Resulting video is harder to follow
- 48. The initial results Video shortened up to 40% Resulting video is harder to follow The pauses are there for a reason
- 51. Viewing history-based acceleration Viewing history data
- 52. Viewing history-based acceleration Viewing history data Number of viewers at each moment
- 53. Viewing history-based acceleration Viewing history data Number of viewers at each moment Several issues and observations “Understanding in-video dropouts and interaction peaks inonline lecture videos”, Kim et al., 2014
- 55. 55.2% of viewers do not watch the video to completion
- 56. 55.2% of viewers do not watch the video to completion 36.6% of viewers abandon the video within the first 3 seconds
- 57. 55.2% of viewers do not watch the video to completion 36.6% of viewers abandon the video within the first 3 seconds Meaningful peaks
- 60. Experiment
- 61. Experiment
- 64. Experiment Online platform 100 participants Four video types - Original video - Linear (L) - Silence Removal (SR) - Viewing history-based acceleration (HB)
- 67. Initial Results
- 68. Initial results Original video performs significantly better statistically
- 69. Initial results Original video performs significantly better statistically Linearly accelerated video performs worst
- 70. Initial results Original video performs significantly better statistically Linearly accelerated video performs worst HB acceleration yields significantly better results than silence removal and linear acceleration
- 71. Conclusion & Future work
- 72. New ideas…
- 73. New ideas… Using OpenAI models
- 74. New ideas… Using OpenAI models But not ChatGPT
- 75. New ideas… Using OpenAI models But not (only) ChatGPT
- 76. New ideas… Using OpenAI models But not (only) ChatGPT Whisper for transcription
- 77. New ideas… Using OpenAI models But not (only) chatGPT Whisper for transcription Analyse transcriptions
- 78. More advanced ideas for platforms…
- 79. More advanced ideas for platforms… Tracking user knowledge
- 80. More advanced ideas for platforms… Tracking user knowledge Removing known sections during playback
- 81. Conclusion
- 83. Conclusion Relatively unexplored topic Numerous possibilities and diverse applications
- 84. Smart acceleration of video lectures Data Science Conference Adria | Zagreb 2023 Sead Delalić, PhD | University of Sarajevo