• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Digital Media Production - Future Internet
 

Digital Media Production - Future Internet

on

  • 2,488 views

 

Statistics

Views

Total Views
2,488
Views on SlideShare
2,466
Embed Views
22

Actions

Likes
9
Downloads
1
Comments
1

2 Embeds 22

http://www.slideshare.net 20
https://www.linkedin.com 2

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

11 of 1 previous next

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Walaupun presentation ini agak panjang, ianya berbaloi untuk dibaca kerana isi kandungan yang menarik. Saya berminat untuk embed ke dalam website saya, iaitu www.ringtonesz.org/ dan www.lyrics-search.org/

    Ahmad Said.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • SMPTE: Society of Motion Picture and Television Engineers.SMPTE serves its members with the latest technology information and education on a rapidly changing industry. SMPTE also is an accredited and globally-respected industry standards-setting body.
  • In principe: - Automatisch verwerking metadata- Automatisch generatie metadata- Beter indexering en zoeken in (bestaande) meta- & mediadata

Digital Media Production - Future Internet Digital Media Production - Future Internet Presentation Transcript

  • Digital Media Production
  • Research and Development +/- 22 experts
    Member of international associations
    EBU (P/SCAIE, P/MAG, P/NP, P/HDTV,…)
    AMWA, SMPTE, IPTC, W3C
    Deliverables
    Expertise
    Proof of Concept
    Technology transfer
    VRT-medialab
    http://medialab.vrt.be
  • 3
    Overview
    • Background
    • File Based Media Production
    • Media Asset Management
    • Future Internet
  • Front-End
    Back-Office
    Retail
    Creation
    Meta-data
    Essence
    Production
    Distribution
    Digital Media
  • Future Media - Assumptions
    5
    Non-linear Distribution
    IP(<> FM, DAB, DVB) enables seamless integration of live and on-demand
    Software-based Receivers
    API’s and application frameworks enable independant software development
    3rd party integration increasses application intelligence
    Versatile Content
    From mobile, standard-def and high-definition to scalable content
    http://labs.vrt.be/myradio
  • 6
    ‘IP-ICT Acceptance’ Time Line
    SuperNet I
    In production
    SuperNet II
    In production
    SuperNet II 10 Gb
    In production
    Start project
    SuperNet I
    Concept
    SuperNet II
    VRT
    Tapeless
    VRT
    2005
    2001
    2000
    2002
    2003
    2004
    2010
    IBC
    2003
    A’dam
    (NL)
    IBC
    2002
    A’dam
    (NL)
    EBU
    Geneva
    (CH)
    TV World-
    forum
    Montreux
    (CH)
    BBC TV
    Production
    =
    “tapeless”
    Media
    world
    NAB
    2004
    Las Vegas
    (US)
    Olympic
    Games
    2008
    (China)
    AVID
    Boston
    (US)
    • 2000: ‘IP no way’ !!! (broadcasters)
    • 2001: Excuse me, I’m from IT … (checkpoint)
    • 2002: IP will be the ‘future’ network technology for TV production
    • 2003: TV production will be ICT-architecture based !!!
    • 2003: BBC states ‘TV production to be “tapeless” in 2010 (->2008) !!!’
    • 2004: Tapeless-, server- and file- based TV production generally accepted as model
  • 2004...
  • 2004...
  • 9
    Digital Media Production
    Suprastructure – Metadata management
    Production and distribution
    Production and distribution
    Editing
    Mastering
    Media AssetMgnt
    System
    Ingest
    Playout
    Infrastructure - Networks and Storage
    Production Platform
  • 10
    Challenge 1 - Infrastructure
    Suprastructure – Metadata management
    Production and distribution
    Editing
    Mastering
    Media Asset Mgnt
    Ingest
    Playout
    Infrastructure - Networks and Storage
    Production Platform
  • 11
    Challenge 2 – Digital Asset Management
    Meta
    Data
    Meta
    Data
    Communication
    (Information)
    Suprastructure – Metadata management
    Production and distribution
    Infrastructure - Networks and Storage
    Production Platform
  • 12
    Challenge 2 - Digital AssetManagement
    Suprastructure – MetadataMgnt
    Production and distribution
    Infrastructure - Networks and Storage
    Production Platform
  • 13
    Challenge 2 – Digital Asset Management
    ?
  • 14
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • Design requirements – Facts and Figures
    • The network
    • The Hard Disc
    • The File System
  • 15
    File Based Media Production
    Concurrent
    engineering
    Processing
    during
    ingest/transfer
    Browse Clients
    Craft editors
    POST
    Production
    Draft
    Processing
    Subtitling
    Analysis
    INGEST
    RECORD
    PLAY-OUT
    Fibre,
    satellite
    Faster than real-time
    Central storage
    Archiving
    Annotation
    Follow-up
    continuity
    Post-
    sonorisation
    Editor-in-Chief
  • 16
    Principles
    OSI 7 layer model
    Application Layer
    Application Layer
    ?
    Presentation Layer
    Presentation Layer
    Session Layer
    Session Layer
    Transport Layer
    Transport Layer
    Network Layer
    Network Layer
    Data Link Layer
    Data Link Layer
    Physical Layer
    Physical Layer
    Virtual connection
    • Paradigm: File Based media production
    • By using generic technology, the central media infrastructure and the local media specific work-centres should be integrated agnostically from each others technical implementations.
    • The basic technology components or technologicallayers of the architectural model should be deployed in a modular way such that they can be exchanged/ replaced by future technological components without compromising the basic architectural model. (Cfr. OSI model)
  • 17
    Facts and Figures
    Professional
    video quality:
    (5 Mbps – 2,5 Gbps)
    • Uncompressed video (High Definition): 2.5 Gbps
    • Uncompressed video (SDI): 270 Mbps
    • Compressed video (Contribution Q.) (HQ): 50 Mbps
    • Compressed video (Contribution Q.) (news): 8 Mbps
    • Compressed video (Distribution Q.): 5-6 Mbps
    • Browse video (low resolution): 1.5-4 Mbps
    Professional
    audio quality:
    ( 256 kbps – 1.5 Mbps)
    • Uncompressed audio : ~ 1.5 Mbps stream
    • Compressed audio : ~ 256 kbps audio editing: simultaneous 4 streams=> 1 Mbps
  • 18
    Facts and Figures
    Data Sources at VRT
    ~ 400.000 “Video-tapes”
    + 32.500 Video-tapes / year
    =
    ~ 4 PB
    + 800 TB/y
    ~ 1.000.000 Items
    + 100.000 Items / year (=10%)
    ~ 250.000 CD & 40.000 Singles
    + 12.750 CD & 4250 Singles / year
    =
    165 TB
    + 8.5 TB/y
    ~ 2.500.000 Items
    + 130.000 Items / year (=5%)
  • 19
    ~ 200 // H-Res video clients simultaneous access at 500 Mbit/s / client (H-Res video: 50 Mbit/s) (= 10 x 50 Mbit/s / client)
    ~ 3000 // L-Res
    video clients
    Simultaneous access +
    // Throughput ~ 10 GB/s
    Ingest:
    >= 10 feeds simultaneous 10 x faster than real time transcoding -> browse
    key-frame
    Playout
    # hrs H-Res video:
    ~150.000 hrs
    On disk
    Total storage: 4 PetaB (net)
    on-line = on disk
    Hiërarchical storage mgmt.
    (on-line/near-line/off-line)
    near-line = on data-tape
    off-line = on data-tape (shelf)
    Design Requirements
    Media Asset Management
    File-based / (video)tape-less
    media environment
    High Availability
  • 20
    Target architectural model:
    ~ 200 // H-Res video clients simultaneous access at 500 Mbit/s / client (H-Res video: 50 Mbit/s) (= 10 x 50 Mbit/s / client)
    Media
    Application
    Behaviour
    ~ 3000 // L-Res
    video clients
    Simultaneous access +
    // Throughput ~ 10 GB/s
    Ingest:
    >= 10 feeds simultaneous 10 x faster than real time transcoding -> browse
    key-frame
    Playout
    # hrs H-Res video:
    ~150.000 hrs
    On disk
    Total storage: 4 PetaB (net)
    on-line = on disk
    0%
    100%
    Load
    Hiërarchical storage mgmt.
    (on-line/near-line/off-line)
    near-line = on data-tape
    off-line = on data-tape (shelf)
    Media Asset Management
    File-based / (video)tape-less
    media environment
    High Availability
    Design Requirements
  • High Definition Media Production Infrastructure
    Media
    File System
    ( GPFS, AVID-ISIS, Isilon, Omneon Media Grid, XSAN, … )
    Network
    ( Disk network, SAN )
    Hard Disk
    Storage Architecture:
    3 Key Components:
    100 %
    Efficiency
    Geisha results IBC 2009
  • 22
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • Design requirements – Facts and Figures
    • The network
    • The Hard Disc
    • The File System
  • 23
    • At most suitable for an office environment
    • Slow
    • Packet loss
    • No Quality of Service
    • Interruptions are generally accepted
    • Not fault-tolerant
    And not
    • Always available !
    • No loss of data !
    • Perfect quality guaranteed!
    IP is “Best Effort”
    Internet  a most poor implementation of IP
  • 24
    Ethernet - Carrier Sense/Collision Detect
  • 25
    Carrier Sense - Multiple Access / with Collision Detection
    Carrier
    • Shared carrier (coax cable or hub)
    • Half Duplex (exclusively directional)
    • CSMA/CD (collision mechanism)
    Ethernet - Carrier Sense/Collision Detect
  • 26
    > 60 %
    load
    • # collisions takes overhead=> more traffic=> mechanisme is critical!!!=> packet loss=> TCP (L4) slows down the network=> additional traffic and/or delay
    60 %
    load
    #p
    • More collisions => additional traffic=> Larger delays=> Netwerk becomes clearly visible
    • Best fit = equilibrium between nett troughput and #collisions
    t
    30 %
    load
    #p
    t
    collision
    #p
    • Collisions=> Delay=> Netwerk becomes visible sometimes
    5 %
    load
    t
    #p
    t
    “ Anyone gets fair access to the network ”
    by CSMA/CD (collision mechanism)
    Ethernet - Carrier Sense/Collision Detect
  • 27
    100 %
    load
    > 60 %
    load
    95 %
    load
    60 %
    load
    50 %
    load
    30 %
    load
    5 %
    load
    5 %
    load
    Conventional IT network
    Ideal network
    Network Behavior
  • 28
    or
    is this behavior typicalto the way it is
    implemented?
    > 60 %
    load
    Is this behavior
    inherent to IP
    60 %
    load
    30 %
    load
    5 %
    load
    Conventional IT network
    Network Behavior
  • 29
    Point-to-point
    switched ethernet (L2)
    • Full Duplex (bidirectional) traffic possible
    L2 Switch
    • Simultanous access to the network
    shared ethernet (L2)
    “ Anyone gets fair access to the network ”
    by CSMA/CD (collision mechanism)
    But: introduction of delays, visibility of the network, packet loss
    • Every single user has its dedicated link
    Point-to-point switched ethernet
  • 30
    • Delay ???=> L2-‘wirespeed’ switching
    L2 Switch
    • Pakketloss ???=> ‘non-blocking’=> No ‘oversubscription’= any packet going in must come out of the network
    • Collisions !!!!!! Full-Dupplex !!!
    100 % efficiency !
    100 %
    load
    95 %
    load
    50 %
    load
    • No collisions=> No delay=> Netwerk remains invisible
    5 %
    load
    Point-to-point switched ethernet
  • 31
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    L2 Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    If properly configured:
    • No delay
    • Unvisible
    • No pakket loss
    • 100 % efficiency
    Root
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Root
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Root
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    Switch
    shared ethernet (L2)
    L2 Resilience mechanism= SPANNING TREE !!!
    => Failures propagate through the network !!!+ substantial failover+ inefficient use of network paths
    • Delay
    • Visible
    • Pakket loss
    • Max 30% efficiency
    Error resilience – Spanning Tree
  • 32
    L2 Switch
    L3
    Routing
    Switch
    Correct Configuration:
    • No delay
    • Invisible
    • No packet loss
    • 100 % efficiency
    L3
    /L3
    L3
    L3
    L3
    L3
    L3
    L3
    L3
    L3
    L3
    L3
    shared ethernet (L2)
    L3 resilience mechanisme= OSPF Routing Protocol !!!
    => Failure is repaired locally in the network !!!+ short failover (< 5s)
    + all paths are being used
    • Delay
    • Visible
    • Pakket loss
    • Max 30% efficiency
    Error resilience - OSPF
  • 33
    L2 Switch
    Correct Configuration:
    • No delay
    • Invisible
    • No packet loss
    • 100 % efficiency
    • Limited resilience
    Correct Configuration:
    • No delay
    • Invisible
    • No packet loss
    • 100 % efficiency
    • Optimal redundance
    L3 Routing switch
    shared ethernet (L2)
    • Delay
    • Visible
    • Pakket loss
    • Max 30% efficiency
    Media network – L2 switching and L3 routing
  • 34
    Classical IT (IP) Network -> Media IP Network
    100 %
    load
    > 60 %
    load

    60 %
    load
    50 %
    load
    30 %
    load
    5 %
    load
    5 %
    load
    Media IP network
    Classical IT (IP) network
    #p
    t
    #p
    t
    collision
    #p
    t
    #p
    t
  • 35
    Classical IT (IP) Network -> Media IP Network
    100 %
    load
    > 60 %
    load

    60 %
    load
    50 %
    load
    30 %
    load
    5 %
    load
    5 %
    load
    Media IP network
    Classical IT (IP) network
    #p
    t
    #p
    t
    collision
    #p
    t
    #p
    t
    Media Solution
    AVID-ISIS
    • Non-Blocking
    • No Oversubscription
    • L2
  • 36
    Classical IT (IP) Network -> Media IP Network
    > 60 %
    load

    60 %
    load
    30 %
    load
    5 %
    load
    Classical IT (IP) network
    #p
    t
    #p
    L3
    L3
    L3
    L3
    t
    L3
    L3
    L3
    L3
    collision
    #p
    L3
    L3
    t
    #p
    t
    100 %
    load
    50 %
    load
    5 %
    load
    Media IP network
    Media Production Design Requirements:
    Media Solution
    AVID-ISIS
    • Non-Blocking
    • Non-Blocking
    • No Oversubscription
    • No Oversubscription
    • L2
    • L3 – Scalability/Redundancy
  • 37
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • Design requirements – Facts and Figures
    • The network
    • The Hard Disc
    • The File System
  • 38
    4/8 KB segment
    Spindle
    Arm
    Arm pivot
    Sector
    Platters
    Random R/W
    8KB – 128 KB Segments
    Random
    8 KB segments
    Random
    128 KB segments
    Cylinder
    Arm assembly
    Tracks
    Heads
    128 KB segment
    R/W on the Outer Track
    Full Stroke R/W
    8KB – 128 KB Segments
    Outer track
    Full stroke
    8 KB segments
    Full stroke
    128 KB segments
    Inner track
    R/W on the Inner Track
    • Large segment size-> Higher efficiency Hard Disk
    Hard Disk Model
  • 39
    Hard Disk model
    Disk
    Throughput
    15 Krpm calculated results
    10 Krpm calculated results
    128 KB segments
    8 KB segments
    Testresults
    78.2 MB/s
    72.9 MB/s
    71.5 MB/s
    70 MB/s
    66.7 MB/s
    50 MB/s
    50.9 MB/s
    47.6 MB/s
    39.4 MB/s
    35.4 MB/s
    30 MB/s
    16.8 MB/s
    14.8 MB/s
    12.8 MB/s
    12.2 MB/s
    10 MB/s
    9.1 MB/s
    8.9 MB/s
    0.91 MB/s
    0.65 MB/s
    0.92 MB/s
    0.62 MB/s
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    Read load types
    (1)
    Sequential Read
    Outer tracks
    (2)
    Sequential Read
    Inner tracks
    (3)
    Random Read
    Tot. Fragmented disk
    128 KB / 8KB segments
    (4)
    Worst case Read
    Tot. Fragmented disk
    128 KB / 8KB segments
  • 40
    4/8 KB segment
    Spindle
    Arm
    Arm pivot
    Sector
    Platters
    Cylinder
    Arm assembly
    Tracks
    Heads
    128 KB segment
    100+ HD’s
    // Striping:
    • Large segment size-> Higher efficiency Hard Disk
    Media File
    Media File
    Media File
    Media File
    • Fully fragmented: Random access without using any Hard Disk intelligence
    Hard Disk Model
  • 41
    Hard Disk model
    Disk
    Throughput
    15 Krpm calculated results
    10 Krpm calculated results
    128 KB segments
    8 KB segments
    Testresults
    78.2 MB/s
    72.9 MB/s
    71.5 MB/s
    70 MB/s
    66.7 MB/s
    50 MB/s
    50.9 MB/s
    47.6 MB/s
    39.4 MB/s
    35.4 MB/s
    30 MB/s
    16.8 MB/s
    14.8 MB/s
    12.8 MB/s
    12.2 MB/s
    10 MB/s
    9.1 MB/s
    8.9 MB/s
    0.91 MB/s
    0.65 MB/s
    0.92 MB/s
    0.62 MB/s
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    15Krpm – 10 K rpm
    Read load types
    (1)
    Sequential Read
    Outer tracks
    (2)
    Sequential Read
    Inner tracks
    (3)
    Random Read
    Tot. Fragmented disk
    128 KB / 8KB segments
    (4)
    Worst case Read
    Tot. Fragmented disk
    128 KB / 8KB segments
  • 42
    4/8 KB segment
    Spindle
    Arm
    Arm pivot
    Sector
    Platters
    Cylinder
    Arm assembly
    Tracks
    Heads
    128 KB segment
    100+ HD’s
    // Striping:
    • Large segment size-> Higher efficiency Hard Disk
    => 10 MB/s(SCSI/FC HD)
    (6.6MB/s for (S)ATA disk)
    Media File
    Media File
    Media File
    Media File
    • Fully fragmented: Random access without using any Hard Disk intelligence
    Hard Disk Model
  • 43
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • Design requirements – Facts and Figures
    • The network
    • The Hard Disc
    • The File System
  • 44
    X
    SD Media
    Storage
    Storage
    Throughput
    Architecture needs to be “tuned” for media production
    Classical IT
    Storage
    Storage
    Capacity
    Geisha results IBC 2009
  • 45
    Essence
    Media essence
    Media
    Applications
    Media
    Clients
    Media Essence
    Files
    OSI 7 layer model
    File
    File System
    Protocol
    (FTP,NFS,SMB)
    Data
    network
    File I/O Requests
    Application Layer
    Application Layer
    File
    System
    File
    Presentation Layer
    Presentation Layer
    Session Layer
    Session Layer
    LUN
    I/O blocks
    Storage
    Network
    Transport Layer
    Transport Layer
    SCSI
    Protocol
    Block I/O Requests
    Network Layer
    Network Layer
    Data Link Layer
    Data Link Layer
    Storage
    Controller
    LUN
    Physical Layer
    Physical Layer
    Physisal Disk
    Logical
    segments
    Virtual connection
    Disk
    Network
    SCSI
    Protocol
    Segment I/O Requests
    Hard
    Disk
    Physical Disk
    Physical sectors
    Bytes
    Layered Model for Storage Infrastructure
  • 46
    FC-client Based
    File
    servers
    Clients
    FC Network
    Avid-Unity / Quantel /
    SGI-CXFS /
    Thomson GV / …
    Video
    Proprietaire oplossingen
    Schaalbaarheid???
    Media Infrastructure File System
  • 47
    FC-client Based
    IP-client based
    Clients
    Clients
    Clients
    File
    servers
    Clients
    Media IP Network
    IBM-GPFS / SGI-CXFS /
    HP-Lustre / ADIC-Stornext /
    Nexsan / …
    FC Network
    File servers cluster
    Parallel access
    file system
    Avid-Unity / Quantel /
    SGI-CXFS /
    Thomson GV / …
    Video
    SAN
    Proprietaire oplossingen
    Schaalbaarheid???
    MXF-AAF video/audio file
    Media Infrastructure File System
  • 48
    FC-client Based
    IP-client based
    Clients
    Clients
    Clients
    File
    servers
    Clients
    Media IP Network
    IBM-GPFS / SGI-CXFS /
    HP-Lustre / ADIC-Stornext /
    Nexsan / …
    FC Network
    File servers cluster
    GPFS (IBM)
    (General Parallel File System)
    Parallel access
    file system
    Avid-Unity / Quantel /
    SGI-CXFS /
    Thomson GV / …
    Video
    • Storage Capacity
    SAN
    • Parallel Throughput
    Proprietaire oplossingen
    Schaalbaarheid???
    • Scalability
    • Reliability
    MXF-AAF video/audio file
    Media Infrastructure File System
  • 49
    3 x Pinnacle chrome
    connected to GPFS
    1 x AVID
    connected to local storage
    NLE
    NLE
    NLE
    NLE
    ARDCAP
    Playout server
    XP
    2004 - Proof Of Concept - (VRT/IBM)
    VTR
    Admin
    Clients
    (XP)
    PC clients (XP)
    Dart/Easycut/Ardlog/…
    SDI ->
    VTR ->
    VTR
    File ->
    Application server
    + Web server
    +DB2
    ARDCAP
    Ingest system
    XP
    1 Gbit/s
    per client
    SuSE
    SuSE
    -> SDI
    SUPERNET II
    Media Gb Back End
    2x OS8800
    10 Gbit/s
    4x 1 Gbit/s
    per server
    IP
    ARDENC
    Transcoding system
    4 x GPFS i-node x365 (Intel/Linux)
    EDL Conform
    SuSE
    SuSE
    4 CPU
    2 CPU
    2 CPU
    2 CPU
    Tivoli TSM+Client
    x365 (Intel/Linux)
    FC network
    2x MDS9216
    2x 200 MB/s
    per server
    FC
    FC
    4x 200 MB/s
    per storage array
    media-file
    LTO-2
    taperobot
    72 slots
    (14 TB)
    FAStT 900
    84 x 146 GB
    RAID 5
    FAStT 900
    84 x 146 GB
    RAID 5
    GPFS Soft mirror
    10 TB net (400 hrs)
  • 50
    Media
    Applications
    Essence
    Media essence
    Files
    Protocol
    Efficiency
    Over IP network
    File System
    Capability
    I/O blocks
    FC Oversubscription
    Flow Control
    I/O block size vs. segment size
    + CPU limit Controllers
    Logical
    segments
    Segment size vs.
    Efficiency of FC-AL
    Physical sectors
    Disk Segment size
    vs. Disk efficiency
    Media Essence
    Media
    Clients
    File
    IP network
    (SUPERNET II)
    File I/O Requests
    File
    GPFS
    File System
    LUN
    FC Storage
    Network
    Block I/O Requests
    LUN
    DS4500
    Physical Disk
    FC-AL Loops
    DiskNetwork
    Segment I/O Requests
    Physical Disk
    FC
    Hard Disk
    Bytes
    Original Proof of Concept – Standard IT Systems
  • 51
    Media
    Applications
    Essence
    Media essence
    MPx3 PoC
    Media
    Clients
    Files
    Media
    IP Network
    IP
    network
    GPFS
    File System
    GPFS
    I/O blocks
    FC
    SAN
    DS4500
    Standard
    IT
    Storage
    System
    Standard
    IT
    Storage
    System
    Logical
    segments
    FC-AL
    Hard Disk
    Model
    10 MB/s
    FC-
    Hard Disk
    Physical sectors
    Original Proof of Concept – Standard IT Systems
    Media Essence
    Media
    Clients
    File
    File System
    Protocol
    (FTP,NFS,SMB)
    Data
    network
    Optimised
    File I/O Requests
    File
    File
    System
    Optimised
    LUN
    SCSI
    Protocol
    Storage
    Network
    Optimised
    Block I/O Requests
    LUN
    Storage
    Controller
    Physical Disk
    SCSI
    Protocol
    Disk
    Network
    Optimised
    Segment I/O Requests
    Physical Disk
    Hard
    Disk
    Bytes
  • 17 juni 2007 – Go Live
  • 53
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
  • 54
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • Problem Analysis
    • Metadata standards overview
    • Proof of Concepts
  • 55
    Problem 1 – Digital Asset Management
    Meta
    Data
    Meta
    Data
    Communication
    (Information)
    Media Asset Management
    Production and distribution
    Infrastructure - Networks and Storage
    Production Platform
  • 56
    Problem 1 - Digital AssetManagement
    Suprastructure – Metadata Mgnt
    Production and distribution
    Infrastructure - Networks and Storage
    Production Platform
  • 57
    The Solution - Media Asset Management System
    archiefnummer : ALG 20010813 1
    fragmentnummer : 1
    reeks : 1000 ZONNEN EN GARNALEN
    bandnummer : E03024404
    formaat : DBCM
    fragmenttitel : 1000 ZONNEN & GARNALEN
    beeld : KL/PALPLUS
    fragmentduur : 18 20
    tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT
    ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE,
    OVERZICHT ONDERWERPEN
    0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE
    OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE
    GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW
    MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT
    ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER,
    BEPANTING, FOTOALBUM MET VERLOOP WERKEN
    4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN
    WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN,
    RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN
    UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF
    7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM
    INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER
    trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND
    CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO
    SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM;
    PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL;
    VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT;
    LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING;
    BARBECUE; BETONMOLEN; IBM; RECLAMESPOT
    rechthebbende : VRT
    Opzoekscherm FILM Set: 16 Aantal: 1
    blz 1 van 3
    trefwoorden: ibm and vrt
    archiefnummer: -
    uitzendjaar: maand: dag:
    fragmentnummer: fragmentduur:
    reeks:
    formaat: bandnummer:
    aflevering: afleveringsnummer:
    programma: uitzenddatum:
    fragmenttitel:
    tekst:
    kategorie:
    opnamedatum: opnamenummer:
    journalist: rechthebbende:
    SETS
    The strings required for the operation are not defined
    F11 F12 F13 F14 F17 F18 F19 F20 Ent
    Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken
  • Solution 2 - The SearchEngine!
    58
  • Problem 2 - System Integration
    59
    • Assessements
    • Re-use of material assumes a central Media Asset Mgntsystem
    • The system is aware of the production processes
    • APIs supporting metadata standards enable smooth integration
    • A workflow engine manages overall consistency
    • Commercial Media Asset Management systems don’t match these requirements
    • Ad hoc plumbing (“best of breed”) compromises stability and quality of the product
    • The worst-case scenario is ad hoc plumbing by using an Enterprise Service Bus
    Media Asset Mgnt
  • SOA – Some Overstretched Assumptions?
    60
    EBU Production Management Seminar 2009(!)
    • An SOA “has the ability to manage the complexity” (CISCO) but it usually increases it;
    • “The ESB should replace all application specific interfaces by an general purpose abstract interface”(IBM). At the contrary, it should implement some major interfaces without further custom development (NewsML-G2, TVAnytime, Mpeg7,…);
    • It is assumed that “the SOA and the ESB simplify your service portfolio” (e.g. a single video transcoder), but leads to massive overconsumption of IT infrastructure(!);
    Supply Chain Engine
    More, better and structuredmetadataenable the evolutionfrombare system integration to information integration and supplychain optimisation.
  • 61
    Type example
    Correspondent
    (email)
    Archives
    Documentation
    Services
    Web Sites
    EBU Consignment (Superpop – NMS)
    Reuters Consignment
    (NewsML1.1)
    EBU popserver
    (NMS)
    MAM system
    Telex Services – ‘Wires’
    (IPTC7901)
    Lack of effective standards
    • Brittle point to point integrations
    • Redundant information – Overflow
    • Lack of awareness of potentially relevant items
    News Production System
  • However – the production context
    Particular issues in Production
    • Multiple sources of more or less structured metadata;
    • Parallel sources cause dupplicates;
    • International context - multilingual
  • 63
  • 64
    Media Asset Management as a Process
    !
    • Reuse - Electronic and Structured Information are essential
    • One Set of Numbers - A Media Asset Management System enables(!) information integrity
    • Metadata Standards enable(!) interoperability
    • Information integration has priority on application integration(!!!). Semantic technology will enable(!) normalisation of semi-structured information.
    An architecture based on an extensible data-model and a consistent application framework
    (≠ Digitizing analogue and disintegrated information flows)
  • Lessons Learned – Principles of System Integration
    Everything should be made as simple as possible, but not one bit simpler.
  • 66
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • The Problem
    • Metadata standards overview
    • Proof of Concepts
  • 67
    New Products
    (Creativity)
    Bill of Material
    Sales
    (Distribution)
    Product Catalog
    Supply
    (Production)
    Material Master
    Enterprise Resources Planning - Logistieke metadata (APICS)
    • Logistieke metadatais informatie met betrekking tot de ontwikkeling, productie en distributie van het product.
    • APICS (www.apics.org) is een industrieassociatie die het logistiek vocabularium standaardiseert.
    • Implementatie - Logistieke informatie vormt de basis van een ERP systeemen wordt meestel gecommuniceerd als inhoud van een document.
    Sales and Operations Planning
  • 68
    Product Engineering - Beschrijvende metadata (CAD/CAM)
    • Beschrijvende metadatais informatie met betrekking tot de inhoud van het product en ze is meestal het resultaat van een productontwikkelingsproces. Indien mogelijk wordt dit proces geformaliseerd en gebruikt men hiervoor een CAD systeem.
    • Per industrie en per type product zijn er vaak verschillende methodes met bijhorende documentatiestandaarden:
    • Nieuws maakt gebruik van NewsML(www.iptc.org/newsml)
    • Movie Script Markup Language (MSML) is in ontwikkeling
    • Implementatie - In het algemeen is beschrijvende informatie beschikbaar onder de vorm van tekst of grafische modellen (aka scripts en storyboards).
  • 69
    Het archief – Annoteren, indexeren, opzoeken…
    P/META
    Mpeg7
    Feature
    Extraction
    Archive
    System
    • Het archiefsysteem verzamelt alle beschikbare metadata met betrekking tot ruw materiaal of afgewerkte producten. P/META (www.ebu.ch) is origineel ontwikkeld voor deze specifieke toepassing.
    • Wanneer feature extraction algoritmes worden gebruikt om diverse visuele, aurale of conceptuele entiteiten te herkennen, maken we bij voorkeur gebruik van ISO/IEC Mpeg7 (http://en.wikipedia.org/wiki/mpeg7).
    • De documentalist rubriceert en categoriseert de beschikbare items. Hij gebruikt hiervoor meestal termen uit een gecontroleerde lijst en hij kan de de facto standaard Library of Congress Subject Headings (http://authorities.loc.gov) gebruiken.
  • 70
  • 71
    Sales and Distribution – Electronische Programmagids (TVAnytime)
    TV-
    Anytime
    P/META
    Distribution Scheduling System
    • Deelektronische programmagids (EPG)is een onderdeel van het proces ‘Sales and Distribution’ en het is een combinatie van logistieke en inhoudelijke gegevens afkomstig uit het ERP systeem en het productontwikkelingsproces.
    • De EPG informatie wordt meestal gecentraliseerd in een distribution scheduling systeem, en dit publiceert op haar beurt het zendschema naar diverse platformen. We kunnen bijvoorbeeld P/META (www.ebu.ch) recupereren om deze interface te implementeren.
    • Hoewel TV-Anytime (www.tv-anytime.org, genormeerd door ETSI) beschikbaar is om uitzendschema’s te representeren, worden in de praktijk nog steeds voor elk doelplatform proprietaire interfaces ontwikkeld.
  • 72
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
    • The Problem
    • Metadata standards overview
    • Proof of Concept
  • 73
    Video Search
    ?
    • Search federation by system integration
    • Facetted search
    • Integrated application of keywords
    • Intuitive and structured presentation of results
    • Timestamped metadata enables direct random access to audiovisual material
    Search Client
    (Custom Development)
    Legacy Video Library
    (Basisplus)
    Raw Material
    (EBU Superpop)
    Media Asset Management System
    (Ardome)
    Search Engine
    (Lucene/SOLR)
    Actual news items
    (Ardome)
  • 74
    Proof of Concept - The Search Engine
  • 75
    Shot Segmentation and Scene Recognition
  • 76
    Computer Assisted Analysis
  • 77
    Overview
    • Background
    • File-based Media Production
    • Media Asset Management
    • Future Internet
  • A customer can have a car painted any colour that he wants so long as it is black.(Henry Ford)
  • Business as Usual – Live Streaming
    • Radio-player and television software
    • Easy integration – “in series” live transcoding
    Moderate complexity – “iPlayer”
    • On demand complements live offering
    • Product Catalogue - Electronic Programme Guide
    • Major impact – master data power-lifting
    Future Internet…
    • Consistent and transient multi-platform experience
    • Seamless integration of live and on demand
    • Metadata and APIs – 3rd party content enhancement
    Non-linear Distribution
  • In Italy for 30 years under the Borgias they had warfare, terror, murder and bloodshed but they enabled Michelangelo, Leonardo da Vinci and eventually the Renaissance.
    In Switzerland they ‘ve had brotherly love and piece for 500 years and they’ve been able to produce…
  • Porting the radioplayer...
  • Porting the radioplayer...
  • Stats
    • Launch feb 2009
    • Currently over 80.000 installations
    • 3500 users per day
    • Average duration 30 min
  • Production System Virtualisation
  • 86
    From « metadata » to CAD/CAM
    ?
  • 87
    Drama Production
  • 88
    Proof of Concept – Model Driven Development
    Demo
  • 89
    http://medialab.vrt.be
    http://www.limecraft.com
    http://twitter.com/limecraft
    Maarten.verwaest@limecraft.com
  • 90
    Gartner