Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Digital Media Production


Published on

The solution space for professional media producers is fundamentally changing, as well as the requirements induced by the market.

Media have to be available on any device, by non-linear distribution and preferably in high-definition. These requirements translate to the back-office that has to become more agile and to scale out, while improving in terms of performance and stability.

Since it is not probable that conventional IT nor media technology suppliers will be able to take this hurdle - because they can't manage the complexity or because they are not allowed to do so by their shareholders, there is an opportunity for newcomers able to provide a solution.

Published in: Technology
  • Be the first to comment

Digital Media Production

  1. 1. Digital Media Prodution<br />Background, challenges and Opportunities<br />
  2. 2. Table of Content<br />2004 – Background and Objectives<br />2009 – Due Diligence<br />State of the technology<br />Reconciliation of requirements<br />Objectives and Challenges<br />Operational Excellence<br />Scale up<br />Media Asset Management<br />Additional requirements<br />Broadband distribution<br />Supply chain integration<br />Technology trends<br />
  3. 3. 2004...<br />
  4. 4. Background – Proof of Concept<br />
  5. 5. 5<br />4/8 KB segment<br />Spindle<br />Arm<br />Arm pivot<br />Sector<br />Platters<br />Cylinder<br />Arm assembly<br />Tracks<br />Heads<br />128 KB segment<br />100+ HD’s<br />// Striping:<br /><ul><li>Large segment size-> Higher efficiency Hard Disk</li></ul>Media File<br />Media File<br />Media File<br />Media File<br /><ul><li>Fully fragmented: Random access without using any Hard Disk intelligence</li></ul>Hard Disk Model<br />
  6. 6. 6<br />4/8 KB segment<br />Spindle<br />Arm<br />Arm pivot<br />Sector<br />Platters<br />Random R/W <br />8KB – 128 KB Segments<br />Random<br />8 KB segments<br />Random<br />128 KB segments<br />Cylinder<br />Arm assembly<br />Tracks<br />Heads<br />128 KB segment<br />R/W on the Outer Track<br />Full Stroke R/W<br /> 8KB – 128 KB Segments<br />Outer track<br />Full stroke<br />8 KB segments<br />Full stroke<br />128 KB segments<br />Inner track<br />R/W on the Inner Track<br /><ul><li>Large segment size-> Higher efficiency Hard Disk</li></ul>Hard Disk Model<br />
  7. 7. 7<br />Hard Disk Speed<br />Disk<br />Throughput<br />15 Krpm calculated results<br />10 Krpm calculated results<br />128 KB segments<br />8 KB segments<br />Testresults<br />78.2 MB/s<br />72.9 MB/s<br />71.5 MB/s<br />70 MB/s<br />66.7 MB/s<br />=&gt; 10 MB/s(SCSI/FC HD)<br />(6.6MB/s for (S)ATA disk)<br />50 MB/s<br />50.9 MB/s<br />47.6 MB/s<br />39.4 MB/s<br />35.4 MB/s<br />30 MB/s<br />16.8 MB/s<br />14.8 MB/s<br />12.8 MB/s<br />12.2 MB/s<br />10 MB/s<br />9.1 MB/s<br />8.9 MB/s<br />0.91 MB/s<br />0.65 MB/s<br />0.92 MB/s<br />0.62 MB/s<br />15Krpm – 10 K rpm<br />15Krpm – 10 K rpm<br />15Krpm – 10 K rpm<br />15Krpm – 10 K rpm<br />Read load types<br />(1)<br />Sequential Read<br />Outer tracks<br />(2)<br />Sequential Read<br />Inner tracks<br />(3)<br />Random Read<br />Tot. Fragmented disk<br />128 KB / 8KB segments<br />(4)<br />Worst case Read<br />Tot. Fragmented disk<br />128 KB / 8KB segments<br />
  8. 8. Media<br />File System <br />( GPFS, AVID-ISIS, Isilon, Omneon Media Grid, XSAN, … )<br />Network<br />( Disk network, SAN )<br />Hard Disk <br />Storage Performance<br />3 Key Components:<br /> 100 %<br />Efficiency<br />
  9. 9. 9<br />FC-client Based<br />IP-client based<br />Clients<br />Clients<br />Clients<br />File<br />servers<br />Clients<br />Media IP Network<br />IBM-GPFS / SGI-CXFS /<br />HP-Lustre / ADIC-Stornext /<br />Nexsan / …<br />FC Network<br />File servers cluster<br />GPFS (IBM)<br />(General Parallel File System)<br />Parallel access<br />file system<br />Avid-Unity / Quantel / <br />SGI-CXFS /<br />Thomson GV / …<br />Video<br /><ul><li>Storage Capacity</li></ul>SAN<br /><ul><li>Parallel Throughput</li></ul>Proprietaire oplossingen<br />Schaalbaarheid???<br /><ul><li>Scalability
  10. 10. Reliability</li></ul>MXF-AAF video/audio file<br />Media File System<br />
  11. 11. File-based Media Production<br />X<br />SD Media<br />Storage<br />Storage<br />Throughput<br />Architecture needs to be “tuned” for media production <br />Classical IT<br />Storage<br />Storage<br />Capacity<br />
  12. 12. Digital Media Factory Storage Clusters<br />Storage Cluster per Service Level<br />
  13. 13. Go Live - 17 June 2007<br />Concurrent<br />engineering<br />Processing <br />during<br />ingest/transfer<br />Browse Clients<br />Craft editors<br />Draft <br />Processing<br />POST<br />Production<br />Media<br />Asset Mgmt<br />Subtitling <br />Analysis<br />INGEST<br />PLAY-OUT<br />IP network<br />Archiving<br />Annotation<br />8 GB P2 card<br />= 32 min video<br />DV25 (news)<br />Central<br />Storage<br />Follow-up<br />continuity<br />Post-<br />sonorisation<br />Editor-in-Chief<br />Central storage<br />
  14. 14. Online searching, re-viewing and cutting<br />
  15. 15. One-click re-purposing of content<br />
  16. 16. Assertion<br /><ul><li> There is a mismatch between business requirements and state-of-the-art technology;
  17. 17. Media technology suppliers don’t sufficiently understandthe limitations of IT technology and conventional IT suppliers don’t have sufficient understanding of media production;
  18. 18. Proper research and development are essential...</li></li></ul><li>2009 - Reconciliation of Requirements<br /><ul><li>Operational Excellence
  19. 19. Simplify system architecture
  20. 20. Standards implementation
  21. 21. Scale-out
  22. 22. Extend to non-news
  23. 23. Prepare for High-Definition
  24. 24. Production
  25. 25. Supply Chain Automation
  26. 26. Real-time co-production
  27. 27. Non-linear distribution
  28. 28. Integration of live and on demand
  29. 29. Accurate Item-level metadata</li></li></ul><li>Objectives - Back-Office<br />1. Operational Excellence<br /><ul><li>Less applications reduce system integration
  30. 30. Metadata standards replace custom development</li></ul>Master Data Management<br />Production and distribution<br />2. Scale out Infrastructure<br /><ul><li>Better applications reduce file transfers
  31. 31. State-of-the-art technology - Cost reduction</li></ul>Editing<br />Mastering<br />Media Asset Mgnt<br />Ingest<br />Playout<br />Infrastructure – <br />Networks and Storage<br />3. Master Data Management<br /><ul><li>Rationale – Effective(!) re-use
  32. 32. Structured Metadata
  33. 33. Item-level metadata</li></ul>Production Platform<br />
  34. 34. Challenge – Operational Excellence<br />Master Data Management<br />Production and distribution<br />Editing<br />Mastering<br />Media Asset Mgnt<br />Ingest<br />Playout<br />Infrastructure – <br />Networks and Storage<br />Production Platform<br />
  35. 35. System Integration Approach<br /><ul><li>Assumptions
  36. 36. Ad hoc plumbing (“data pump”) is a source of inconsistency;
  37. 37. Collaborative production and re-use of material rely on a single central repository.
  38. 38. Issues
  39. 39. None of the available state-of-the-art production applications have been designed to integrate and neither they have been originally designed for file-based production;
  40. 40. Commercially available MAM systems that lack essential functionality;
  41. 41. While an Enterprise Service Bus is assumed to protect overall consistency and performance, it is sensitive to complexity as well and may become a source of instability on its own.</li></ul>Supply Chain Engine<br />MAMsystem<br /> The level of Operational Excellencethat can be achieved by an Integrated System is determined by the extent to which individual applications have been designed to integrateand by the level of (metadata) standards implementation.<br />
  42. 42. Lessons Learned – Principles of System Integration<br />Everything should be made as simple as possible, but not one bit simpler.<br />
  43. 43. Challenge – Scale out Infrastructure<br />Master Data Management<br />Production and distribution<br />Editing<br />Mastering<br />Media Asset Mgnt<br />Ingest<br />Playout<br />Infrastructure – <br />Networks and Storage<br />Production Platform<br />
  44. 44. High Definition Media Production Infrastructure<br />OT<br />Omneon<br />Omneon<br />Agility<br />IP network<br />IP network<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OP1A<br />OP1A<br />OP1A<br />OP1A<br />OP1A<br />OP1A<br />OP1A<br />OP1A<br />Lres<br />OP1A<br />Lres<br />OP1A<br />OP1A<br />OPAT<br />OPAT<br />OP1A<br />OP1A<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />OPAT<br />Lres<br />Output<br />Ardome<br />OT<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />ENC<br />MCRT<br />MCRT<br />MCRT<br />TSM<br />MCBE<br />MCBE<br />MCBE<br />TSM<br />BUBE<br />BUBE<br />BUBE<br />TSM<br />Polopoly<br />/import<br />//news<br />//feeds<br />/cut<br />Nieuws Playout<br />//lowres<br />//audio<br />MER<br />/wip<br />/sec<br />//sec<br />/archive<br />Data Tape<br />Archive<br />Data Tape<br />Backup<br />MCRT cluster<br />MCBE cluster<br />BUBE cluster<br />TSM2<br />TSM1<br />TSM2<br />TSM1<br />Workflow vs Dataflow:<br />A single Ingest operation causes 36 file transfers!<br />00<br />01<br />02<br />03<br />04<br />05<br />06<br />07<br />08<br />09<br />10<br />11<br />12<br />13<br />14<br />15<br />16<br />17<br />18<br />19<br />20<br />21<br />22<br />23<br />24<br />25<br />26<br />27<br />28<br />29<br />30<br />31<br />32<br />33<br />34<br />35<br />36<br />Browse Clients<br />GMII<br />Encoders<br />DV25<br />D10<br />MAM<br />Opslag<br />//news<br />//feeds<br />/import<br />Opslag<br />/wip<br />/archive<br />Opslag<br />//lowres<br />//audio<br />Opslag<br />/sec<br />Opslag<br />//sec<br />Precut<br />Ardex<br />22<br />
  45. 45. High Definition Media Production Infrastructure<br />High Definition Media Production Infrastructure<br />Introduction: Issues – HD Digital Media Factory<br />OT<br />Omneon<br />Omneon<br />Agility<br />Output<br />OT<br />Polopoly<br />Nieuws Playout<br />MER<br />HD Media Infrastructure Issues<br /><ul><li> Complex Workflow -> Inefficient Dataflows
  46. 46. Increased Storage Capacity Requirements:HD ~= SD x 2 -> HD Storage Architecture???Backup/restore windows HD ~= SD x 2Reconsider# copies– storage protection
  47. 47. Cost:TargetHD ~= SD/4(not counting disk price erosion)
  48. 48. More media-formats:Transcoding becomesbottle-neck!</li></ul>23<br />Geisha results IBC 2009<br />
  49. 49. X<br />HD Media<br />Storage<br />HD Storage Architecture Requirements<br />Storage<br />Throughput<br />X<br />SD Media<br />Storage<br />“Tuned” Fibre Channel Architecture<br />Classical IT<br />Storage<br />Storage<br />Capacity<br />Geisha results IBC 2009<br />
  50. 50. High Definition Media Infrastructure<br />State-of-the-Art <br /><ul><li> Currently 160TB storage capacity (3200 hrs HD) per cluster
  51. 51. Demonstrated troughput 40Gbps
  52. 52. Built-in Disaster Recovery
  53. 53. CAPEX - 2.2€ per GB</li></li></ul><li>Objective 3 – Effective re-use<br />Media Asset Management Issues<br /><ul><li>Production Environment
  54. 54. No upfront selection causes information overload;
  55. 55. Multiple sources of more or less structured metadata;
  56. 56. Parallel sources cause dupplicates;
  57. 57. International context - multilingual</li></ul>Master Data Management<br />Production and distribution<br />Infrastructure – <br />Networks and Storage<br />Production Platform<br />
  58. 58. Objective 3 – Effective re-use<br />Media Asset Management Issues<br /><ul><li>Production Environment
  59. 59. No upfront selection causes information overload;
  60. 60. Multiple sources of more or less structured metadata;
  61. 61. Parallel sources cause dupplicates;
  62. 62. International context - multilingual</li></ul>Master Data Management<br />Production and distribution<br /><ul><li>Professional Requirements
  63. 63. An item is relevant or it is not;
  64. 64. Retrieve all relevant items;
  65. 65. No false positives</li></ul>Infrastructure – <br />Networks and Storage<br /><ul><li>Opportunities
  66. 66. Recognise workflow and trace dependancies;
  67. 67. Integrate with Product Engineering (scripts,...);
  68. 68. Computer Vision techniques may help.</li></ul>Production Platform<br />
  69. 69. The state of the Art…<br />archiefnummer : ALG 20010813 1<br />fragmentnummer : 1 <br />reeks : 1000 ZONNEN EN GARNALEN<br />bandnummer : E03024404<br />formaat : DBCM<br />fragmenttitel : 1000 ZONNEN & GARNALEN<br />beeld : KL/PALPLUS<br />fragmentduur : 18 20 <br />tekst : 0&apos;00&quot; TOERISTISCH REPORTAGEMAGAZINE OVERZICHT <br /> ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE, <br /> OVERZICHT ONDERWERPEN <br /> 0&apos;50&quot; VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE <br /> OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE <br /> GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW <br /> MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT <br /> ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER, <br /> BEPANTING, FOTOALBUM MET VERLOOP WERKEN <br /> 4&apos;00&quot; JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN <br /> WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN, <br /> RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN <br /> UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF <br /> 7&apos;50&quot; DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM <br /> INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER <br />trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND<br /> CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO<br /> SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM; <br /> PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL; <br /> VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT; <br /> LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING; <br /> BARBECUE; BETONMOLEN; IBM; RECLAMESPOT<br />rechthebbende : VRT<br />Opzoekscherm FILM Set: 16 Aantal: 1<br />blz 1 van 3<br /> trefwoorden: ibm and vrt <br /> archiefnummer: - <br /> uitzendjaar: maand: dag: <br /> fragmentnummer: fragmentduur: <br /> reeks: <br /> formaat: bandnummer: <br /> aflevering: afleveringsnummer: <br /> programma: uitzenddatum: <br /> fragmenttitel: <br /> tekst: <br /> kategorie: <br /> opnamedatum: opnamenummer: <br /> journalist: rechthebbende: <br /> SETS <br />The strings required for the operation are not defined <br /> F11 F12 F13 F14 F17 F18 F19 F20 Ent <br />Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken <br />
  70. 70. Shot Segmentation and Scene Recognition<br />
  71. 71. Face recognition and identification<br />
  72. 72. Media Asset Management - Opportunities<br /><ul><li> Professional context - trace dependencies
  73. 73. Scripts contain essential master data – integration with creative processes is a must
  74. 74. Computer Vision does not replace formal annotation, but substantially accelerates the process and increases the accuracy</li></ul>!<br />An integrated data-model and a consistent application framework are the key to production automation and supply chain integration<br />(≠ Digitizing analogue and disintegrated workflows)<br />
  75. 75. Conclusion<br />1. Operational Excellence<br /><ul><li>One set of numbers – reduce the number of apps
  76. 76. Less apps reduce the need for system integration
  77. 77. Replace custom development by proper standards</li></ul>Master Data Management<br />2. Scale out Infrastructure<br /><ul><li>Avoid file transfers
  78. 78. Cheaper systems for cost reduction</li></ul>Production and distribution<br />Editing<br />Mastering<br />Media Asset Mgnt<br />Ingest<br />Playout<br />3. Master Data Management<br /><ul><li>Trace dependancies
  79. 79. Integrate with creative processes
  80. 80. Explore and integrate automatic analysis tools</li></ul>Infrastructure – <br />Networks and Storage<br />Production Platform<br />
  81. 81.
  82. 82. Broadband distribution<br />Data<br />Video<br />Audio<br />Communication<br />(Information)<br />Master Data Management<br />Meta<br />Data<br />Meta<br />Data<br />Production and distribution<br />Infrastructure – <br />Networks and Storage<br />Distribution via DVB, <br />IP or other<br />Production Platform<br />
  83. 83. 2004 – Live Streaming<br />
  84. 84. Xmas 2007 – BBC iPlayer<br />
  85. 85. Broadcast...<br />A customer can have a car painted any colour that he wants so long as it is black.(Henry Ford)<br />
  86. 86. Good, better,... <br />Anywhere<br /><ul><li>“Live streaming”
  87. 87. Radioplayer software application
  88. 88. Quick win – “in series” live transcoding</li></ul>Anytime<br /><ul><li>“Podcast”, “iPlayer”
  89. 89. On demand complements live offering
  90. 90. Major impact – metadata power-lifting </li></ul>?<br />The Ultimate Radio Exp - myRadio<br /><ul><li>Mobile - Anywhere, anytime and impulse-driven
  91. 91. Seamless integration of live and on demand
  92. 92. Cross-platform continuity</li></li></ul><li>The Ultimate Radio Exp(eriment)<br />myRadio @time of writing<br /><ul><li>Excellent quality where possible, lower bit-rate if necessary
  93. 93. Non-linear distribution assumes broadband distribution
  94. 94. Open distribution framework
  95. 95. Http adaptive streaming enables bandwidth-friendly distribution</li></ul><br />
  96. 96. Ongoing – Non-linear distribution<br />Seamless integration of Live and On demand<br /><ul><li>“Bookmark” by tagging
  97. 97. Pause, Back and Fast Forward
  98. 98. Radio search engine
  99. 99. Assemble myRadio</li></ul>TO DO – Track each individual item<br /><ul><li>Audio segmentation
  100. 100. Speech recognition and indexing
  101. 101. Metadata harvesting (!!!)</li></li></ul><li>Business Case for Radio<br />IP Distribution<br />+/- 5.000.000 hours per dag<br />à 128 kbps, 250 TB, 90PB per year<br />à 70.000€ per PB<br />Total – 6.300.000€<br />Vgl. Homepage (<br /><ul><li>2MB
  102. 102. 128 seconden high-def audio(!)</li></li></ul><li>‘Supply Chain Integration’<br />Data<br />Video<br />Audio<br />Information<br />Communication<br />Information<br />Mgnt<br />Production and distribution<br />Distribution to TV, PC and mobile via DVB and IP<br />Media Asset Mgnt<br />Infrastructure<br />(network and storage)<br />
  103. 103. Trend – Production System Virtualisation<br />
  104. 104. Trend - From « metadata » to CAD/CAM<br />?<br />
  105. 105. Proof of Concept - Scoop<br /><br />(search for “scoop”, “ibbt”, “CAD”)<br />
  106. 106. Change...<br />
  107. 107. 47<br /><br /><br /><br />