YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

.

.

YALMS Basics

M.Zhanikeev, H.Koide -- maratishe@gmail.com --

YALMS: A Data Structure for Storage and Replay of Multimedia Content -- http://tinyurl.com/marat140116 --

2 /21
2/21

.

.

YALMS Basics
.
YALMS...
.
... stands for

Yet Another Lecture Management System
• a new generaction -- HTML5- and cloud-based LMS 06
•
•
•

one function: video annotation robot 07
another function: Group Drive -- a P2P version of cloud storage 08
high-performance multimedia system based on multicore, SSD, etc. 09

06 M.Zhanikeev+1 "YALMS: Yet Another Lecture Management System" IEICE ET研究会 (2013)
07 M.Zhanikeev+1 "...Automatic Slicing of Screen Capture Video using Slide PDFs" IEICE ET研究会 (2013)
08 M.Zhanikeev+1 "YALMS: A Group Drive API for Cloud-Based Classrooms" IEICE IN研究会 (2013)
09 M.Zhanikeev+1 "...Solid State Drives in Rich Multimedia Content Processing, Storage and Streaming" ITE-MMS研究会 (2013)


3 /21
3/21

.

.

YALMS Roadmap
2013.07・ET研

YALMS: Intro

2013.11・IN研

YALMS.cloud
clouds groupdrive
sync
2013.09・ET研

YALMS.annotation

2014.1・LOIS研

PDF video annotation

YALMS.format

2014.01・ET研

recording
replay storage
multimedia

YALMS.streaming
DASH Adaptive

HTML5

2013.10・ITE-MMS研

YALMS.hiperf
SSD
multicore

YALMS.done!


4 /21
4/21

.

.

YALMS.format : Objectives



5 /21
5/21

.

.

YALMS.format Objectives
single .yalms file
◦ official components: AV for audiovideo, S for slides or screen capture video, C is

1. pack all the contents of a lecture into a

◦ audiovideo, slides, files and versioning, etc.
for files and versioning

2.

replay .yalms files in a browser in standalone mode
◦ directly from .yalms file -- no backend system



6 /21
6/21

.

.

Objectives ... Visuallly
HTML5
Step 1: Record

A
V
YALMS
Robot

Lecturer
Files


Viewers

C

S

Step 2: Add PDF

Long-Term
Storage

YALMS
Robot

S
Lecturer


7 /21
7/21

.

.

YALMS vs... : Related Works



8 /21
8/21

.

.

YALMS.format vs Multimedia System
.
Traditional Multimedia System
.
• powerfull back-end
• HTTP streaming in realtime
.
.
YALMS.format
.
• .yalms file is a binary file -- can be stored anywhere
◦ like in cloud storage
•

.

no streaming, the file is simply traversed using exiting APIs
◦ any RESTful API, cloud storage, local filesystem



9 /21
9/21

.

.

YALMS.format vs SMIL
5:
6:<par>
7:
<video src="joe-video"/>
8:
<text src="http://www.example.com/joe-text"/>
9:
<seq>
10:
<audio src="rtsp://www.example.com/joe-audio"/>
11:
<audio src="tim-audio"/>
12:
</seq>
13:</par>
14:
15:

jow-audio

• close but not enough
• need to pack actual

content into the file

tim-audio

joe-text
joe-video


10 /21
10/21

.

.

YALMS.format in Browser



11 /21
11/21

.

.

HTML5 Functionality
Browser
Abilities

Traditional
JSON, BSON

HTML5
Flash

WebSockets
Adaptive Streaming?

?

Binary
Blob ByteArray

WebWorkers
structuredCopy
New Chrome feature


passByRef
postData( data, [ data])


12 /21
12/21

.

.

HTML5: the SaveAs Function
•

NOTE: JS now natively can save binary chunks to local filesystem



13 /21
13/21

.

.

YALMS.format : Design



14 /21
14/21

.

.

YALMS.format : Design
YALMS
Robot
Step 1: Record

A
V

A
V

•
Step 2: Add PDF

C

S

Watch
Watch
scene
filesystem change


• events are specific to each

content type

X

SE SE
Lecturer

even-driven packing

• events are used to

CE

Lecturer

PE

cut

.YALMS files into
blocks

S
YALMS.format

Annotation


15 /21
15/21

.

.

YALMS.format : Events
1.

SE : screen capture events
◦ screen capture is video, so -- scene changes

2.

CE : binary file diffs
◦ there are

3.

LibXDiff 15 and Xdelta 16, the latter is preferred

PE : page events -- replaces SE
◦ blocks based on page changes

15

"LibXDiff" http://www.xmailserver.org/xdiff.html (2013)

16

"Xdelta Project Page" http://xdelta.org/ (2013)



16 /21
16/21

.

.

1
2
3
4
5

Block border types
Fixed minimal size
Scene change (I-Frame)
Page change
New File(s)
New File Diff(s)

Block
border
Head

Bytes

.YALMS File Design
0
4
8
12
offset

Bits

8

16

24

Block Header Design
seqno

flags

Offset

Block length in bytes
Block 1: type(3) + offset(29)
... (the same for all blocks)
Block 1 (binary data) ...

…

Tail
The First Lecture.yalms

Time

The entire file

17 /21
17/21

.

.

YALMS.format Robot and Screen
Browser

A
V

Get binary
YALMS
Robot
HTML5
File API

CE
SE PE
or

Auto “download file”

Screen

A V
VIDEO

PNG

S
C MISC.

“download” on click


18 /21
18/21

.

.

Wrapup



19 /21
19/21

.

.

Wrapup
working version at 02
• release plan: end of March
•

◦ the entire package will be offered as open source

02 myself "Homepage of the YALMS.format Subproject" https://github.com/maratishe/yalms.format (2013)


20 /21
20/21

.

.

That’s all, thank you ...



21 /21
21/21

.

.

[01] MEXT (2013)
The enPiT Project
http://www.enpit.jp
[02] myself (2013)
Homepage of the YALMS.format Subproject
https://github.com/maratishe/yalms.format
[03] W3C (2013)
Synchronized Multimedia Integration Language (SMIL 3.0)
http://www.w3.org/TR/SMIL/
[04] W3C (2013)
HTML5: W3C Working Draft
http://www.w3.org/TR/html5/
[05] W3C (2013)
File API: W3C Working Draft
www.w3.org/TR/FileAPI


21 /21
21/21

.

.

[06] M.Zhanikeev+1 (2013)
YALMS: Yet Another Lecture Management System
IEICE ET研究会
...Automatic Slicing of Screen Capture Video using Slide PDFs
IEICE ET研究会
YALMS: A Group Drive API for Cloud-Based Classrooms
IEICE IN研究会
...Solid State Drives in Rich Multimedia Content Processing, Storage and Streaming
ITE-MMS研究会
...Content Aggregation in Browsers using Recent Advances in HTML5
COMPSAC


21 /21
21/21

.

.

Experiments with application throughput in a browser with full HTML5 support
IEICE ComEx
[12] H.Pucha+3 (2008)
Adaptive File Transfers for Diverse Environments
USENIX
[13] D.Frey+2 (2012)
Probabilistic Deduplication for Cluster-Based Storage Systems
3rd ACM SoCC
[14] D.Meyer+1 (2012)
A Study of Practical Deduplication
ACM Transactions on Storage (TOS)
[15]

(2013)
LibXDiff
http://www.xmailserver.org/xdiff.html



21 /21
21/21

.

.

[16]

(2013)
Xdelta Project Page
http://xdelta.org/

[17] IETF (2002)
The VCDIFF Generic Differencing and Compression Data Format
RFC3284



21 /21
21/21

YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

Recommended

Recommended

More Related Content

Similar to YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

Similar to YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes (20)

More from Tokyo University of Science

More from Tokyo University of Science (20)

Recently uploaded

Recently uploaded (20)

YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes