Barwick video-trial


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Big picture, down to local focus on field corpus tool - audiamus
  • Barwick video-trial

    1. 1. Media madness I: PARADISEC video trial 2006 Linda Barwick Sydney Conservatorium of Music University of Sydney DELAMAN IV, London 2 November 2006
    2. 2. <ul><li>Collaborative digital research resource set up by University of Sydney, University of Melbourne & Australian National University, 2003. (UNE joined 2004) </li></ul>PARADISEC 75% fund ing from Australian Research Council LIEF Scheme (3 successful applications)
    3. 3. Why video? <ul><li>From 1980s, portable battery-powered video cameras increasingly used by fieldworkers </li></ul><ul><li>Primary data for ethnographic studies of gesture, dance, performance, signed language, social interaction </li></ul><ul><li>Highly valued by cultural heritage communities </li></ul>
    4. 4. Threats to video <ul><li>Obsolescence of consumer video formats (VHS, super-8, Hi-8 etc) </li></ul><ul><li>Media deterioration much more advanced that audio media (estimate 15 years) </li></ul><ul><li>Kept in private research collections rather than deposited in archives (hence less than ideal storage conditions, lack of metadata) </li></ul>
    5. 5. Deterrents to digitisation <ul><li>Lack of internationally agreed archival formats and standards for digital video, hence researcher fear of making wrong choice </li></ul><ul><li>Difficulties of storage and management once digitised - huge filesizes difficult to manage on desktop computer </li></ul><ul><li>Lack of user-friendly and robust tools to allow researchers to analyse video data and collaborate </li></ul><ul><li>Ethical and rights obligations - fears of compromising security and anonymity of consultants by outsourcing </li></ul>
    6. 6. Preservation and Digital Sustainability <ul><li>the only way to guarantee sustainability of digital audiovisual media is secure mass storage with well-structured metadata and an ongoing digital migration strategy, using authenticated streaming for access . </li></ul><ul><ul><li>Kevin Bradley, APSR Sustainability Issues Discussion Paper, National Library of Australia, 2005. </li></ul></ul><ul><ul><li>International Association of Sound and Audiovisual Archives (IASA) Guidelines on the Production and Preservation of Digital Audio Objects (IASA-TC04). Aarhus, Denmark: International Association of Sound and Audiovisual Archives (IASA), 2004. </li></ul></ul>
    7. 7. Purposes of trial <ul><li>Feasibility study for video ingestion </li></ul><ul><ul><li>select appropriate standards </li></ul></ul><ul><ul><li>test impact on existing systems </li></ul></ul><ul><ul><li>design archival workflows </li></ul></ul><ul><ul><li>model costs for future funding applications </li></ul></ul><ul><li>Preserve significant collections </li></ul><ul><li>Provide access copies for researchers and communities </li></ul><ul><li>Provide test data for EthnoER online annotation projects </li></ul>
    8. 8. Equipment and data <ul><li>Outsourced ingestion to professional video-maker (Paul Cockram) using Final Cut Pro 4 on Mac computer, ingesting video data from professional decks over firewire 400 cable. </li></ul><ul><li>Video formats tested: VHS, Hi-8, miniDV </li></ul><ul><li>Video files saved on 500GB LaCie firewire drive for transport </li></ul>
    9. 9. Formats and standards adopted for trial <ul><li>Master copy: .dv standard (maximum quality coming across firewire into Final Cut Pro) (saved inside Quicktime .mov wrapper) - approx 15GB per hour </li></ul><ul><ul><li>720x576 pixels, 25 fps, PAL </li></ul></ul><ul><ul><li>Titles: basic metadata plus test signal at beginning of file, “end file” title at end of file. </li></ul></ul><ul><ul><li>No chapter markers unless depositor provides list of timecodes for this purpose </li></ul></ul>
    10. 10. Access copies <ul><li>Also sent to archive because of time taken to process (will review later) </li></ul><ul><li>DVD copy (MPEG 2) - compress item to approx 4GB. Save as muxed .mpg file or disk image .img </li></ul><ul><ul><li>Chapter markers inserted every 5 minutes </li></ul></ul><ul><li>Web copy (.mov or .mp4) </li></ul><ul><ul><li>frame size 320 x 240 (480 x 360) </li></ul></ul><ul><ul><li>30 frames per second </li></ul></ul><ul><ul><li>keyframe every 300 frames </li></ul></ul><ul><ul><li>data rate 40 - 50 KB/sec (320 - 400 kbps) or 100 - 120 KB/sec (800 - 960 kbps) for larger frame sizes. </li></ul></ul>
    11. 11. Issues (1) <ul><li>Damage to videos (dropped frames) may cause stall in ingestion, need to set FCP to tolerate </li></ul><ul><li>Some VHS tapes (1980s) had too many tracking errors to digitise </li></ul><ul><li>Unstable picture (both hi8 and VHS) leads to higher filesize in mpeg-2 (image stabiliser needed?) </li></ul><ul><li>Communication issues with contractor led to wrong filenames being used in titles, hence requiring reprocessing </li></ul><ul><li>Compression to DVD and web copies very slow (8 hours to process a 3-hour file) , ties up machine - better done in-house by batch processing </li></ul>
    12. 12. Issues (2) <ul><li>Data deluge at time of HD shuttle </li></ul><ul><ul><li>500GB needing to be copied onto system - took a day </li></ul></ul><ul><ul><li>swamped storage (ill-prepared) </li></ul></ul><ul><ul><li>server partitions 200GB - not large enough, hence loss of time in copying across partitions </li></ul></ul><ul><ul><li>Backup scripts at Sydney and APAC became out of sync, leading to data not being written to tape in Sydney, or being removed from server before APAC could mirror </li></ul></ul><ul><ul><li>timeconsuming diagnosis and repair, but systems now redesigned </li></ul></ul>
    13. 13. Transcoding for web delivery <ul><li>EthnoER project working with CSIRO’s Annodex platform to deliver streamed video </li></ul><ul><li>Uses Ogg Theora - best transcoded from full-resolution version (currently done by CSIRO) </li></ul><ul><li>Online delivery of annotations via EOPAS (EthnoER online annotation standard) - developed with University of Queensland Vannotea team building on Michel Jacobson’s ITE work (LACITO) </li></ul><ul><li>More details at our December conference! </li></ul>
    14. 14. Costing and feasibility <ul><li>Final report on data trial in preparation - we will post on our website and blog </li></ul><ul><li>Costing only of production (staff time, consumables) - model at this stage does not take into account long-term storage and networking costs, equipment deterioriation </li></ul><ul><li>Funding application for equipment in 2007 unsuccessful - we will regroup </li></ul>
    15. 15. Video data in PARADISEC collection (30/10/06) <ul><li>0.5% of collection files account for 19% of the data volume </li></ul>
    16. 16. Further information: Thanks to: Participating Universities Australian Research Council Australian Partnership for Advanced Computing Australian Partnership for Sustainable Repositories GrangeNet