BURTRE Coexistence of asynchronous preservation processes in archive asset management
1. Coexistence of
(Asynchronous) Preservation Processes
in Archive Asset Management
CREATING
ARCHIVE
INNOVATIONS
Joint Technical Symposium,
September 2019
Silvester Stöger, NOA GmbH
s.stoeger@noa-archive.com
2. What does NOA do?
AAM Archive Asset Management
for long-term media archiving
• To preserve media and metadata
for the long term.
• 7,000 seats worldwide at various broadcasters
and archives.
ATT Archive Transfer Technology
for service providers, broadcasters, archives
• To digitize A/V carriers in the most efficient
and economic way.
• 4.000.000 hours of A/V legacy material
transfered with NOA tools.
4. The change for the Archives…
From… To… in the most economic way.
5. Physical
Archive
Long Term Database
Digital Archive
Storage
Production /
Distribution System
(MAM / PAM)
Migration of
Media &
Metadata
User Interfaces
Workflows managed
by AAM:
API
Selected replication
to cloud
Archive Asset Management (AAM)
9. Carrier Logistics
?
Foundation to a constant throughput
• Archive -> Digitization -> Archive
• Avoid idle workstations / operators
• Traceability of carriers
• Carrier positioning system
• Central logistics space
10. Carrier Registration
Foundation for process management
• Basic carrier description
• UID (obligatory)
• Carrier type (obligatory)
• Title
• Description
• Attach barcodes
?
11. Carrier Preparation
RTV, Ljubljana, Slovenia
Foundation for best possible digitization
• Assess if required
• Clean carriers
• Consolidate physical condition
12. Preservation of Accompanying Materials
Foundation for intellectual content description
• Record metadata of documents
• Scan of documents (envelopes, booklets, cataloguing
cards, cue sheets, etc.)
• Can be transcribed at later stage.
• Virtually preserve the physical integrity of the
carrier
RTVS Bratislava, Slovakia
13. Digitization
YLE, Helsinki, Finland
Atos for ORF, Vienna, Austria
Foundation of digital preservation
• Mostly possible in real time only
• Parallelization of capture stations
• Simplify ingest operator tasks
• Reduce ressources needed
• Record quality analysis information
14. Quality Control
Real-time traces of audio digitization (e.g. Azimuth, Peak Level, Noisefloor, etc.)
RF traces and ISR events to detect video transfer errors
Baseband QC at Atos for ORF, Vienna, Austria
The gatekeeper of the archive
• Quality control on all levels:
• Transfer QC
• Filebased (baseband) QC
• Process QC (maintain professional working environment)
• Use quality information recorded during digitization
16. Business Process
Carrier
Registration
Carrier
Logistics
Preservation of Accompanying
Materials
Carrier
Preparation
Digitization
Quality
Control
Intellectual Content DescriptionSegmentation
Selected Provision to Cloud
Automated Metadata Enrichment & Verification
Preservation Tasks
D
I
S
S
E
M
I
N
A
T
I
O
N
ARCHIVE
TRANSFER
ARCHIVE
ASSET
MANAGE-
MENT
INGEST
17. Content Segmentation
Enable fast and exact access to segments
• Use track markers if available (e.g. CDs)
• Set markers for segmentation
• Intellectual decisions if not obvious (e.g. fades)
• Policy needed
• Ontologies needed
19. Preservation Tasks
Carrier-free but not care-free information!
• Storage migration
• Consistency checks
• Offsite backup
• Disaster recovery strategy
• Etc.
20. Automated Metadata Enrichment & Verification
Deep archive analysis
• Speech to text, face recognition, object detection, etc.
• Enhance search results
• Humans needed to validate:
• profile data for analysis
• generated metadata
21. Selected Provision to Cloud
Feed contemporary distribution platforms
• No direct access to the archive
• Dedicated platforms for final customer
• Select publishable material (rights, quality)
• Chance for montization
22. Sharjah Broadcasting Authority
Implementing a digitization factory and video archive
• Installation 2017
• Long term Archive Asset Management
• Archive format ffv1
• Mathematically lossless
• Open source / no vendor lock
• No patent issues
• No license issues
• Integration to AVID Interplay PAM
23. Sharjah Broadcasting Authority
Initial Situation
• 1“, Umatic, Betacam SP, Digitbeta, etc.
• No barcodes
• Handwritten cue sheets
• No digital catalogue/database
29. Sharjah Broadcasting Authority
Disaster Recovery
• Disaster recovery extension started in 2018
• 2nd location
• Complete essence and database replica
• 3 copies / 2 sites
30. Thank you for your attention!
CREATING
ARCHIVE
INNOVATIONS
Joint Technical Symposium,
September 2019
Silvester Stöger, NOA GmbH
s.stoeger@noa-archive.com
Editor's Notes
Managing Archive Projects for NOA
Last day of joint conferences
Conceptual overview of how projects can be started and run
We all know that the big challenge for TV station and broadcasters … is now to compete with the GAFAM (Google, Amazon, Facebook, Apple, Microsoft) …. TV station need to move from a current linear streaming entertainment… to an OTT transmission where contents need to be resized … pushed … and recommended in order to catch the new generation who are no more watching TV on a TV screen… but on computer, tablets or smartphones.
The new audiovisual productions need to be fast…, cheap…, interactive and well documented … This to be to be easily published on facebook twitter Instagram etc.
Data attached to the program are crucial for “social networks”
For the archives and the archivist… the problem is the same
Archive need to move from archive material with paper of file data base to ….
a digital archive …. giving the possibility to have a direct access to the proper content, that means, to find it quickly… , to see it quickly… , and research it with few clicks.
This is mainly the Job of Media Asset Management that give the possibility to valorize the archive contents :
Reuse of historical contents
Create new contents
Push contents on social networks
YouTube channels
Instagram, twitter, facebook
Give access to publics
Students/researchers
Citizens
World
Who can still imagine that to create a new program in reaction to news or a documentary with some archives materials inlay… that people will ask archivist to do the research of content… request a digitizing of part of the program, do the transcoding in order to be exported to the editing suite ???
No body want to loose time…
We have made several cost comparisons taking “archive questionnaires reply” and current tender specification of on-site digitizing project. The result of these different comparison is very close for all, we took one of this analysis as an example for writing this document: As shown in the below table, we could remark that un-problematic carriers that could be digitized thanks to NOA Archive Transfer Technology represents 92.7% of the video content to digitize, Historical formats representing around 1.9% of the content and film around 7.3% of the total hours to transfer.
We have made several cost comparisons taking “archive questionnaires reply” and current tender specification of on-site digitizing project. The result of these different comparison is very close for all, we took one of this analysis as an example for writing this document: As shown in the below table, we could remark that un-problematic carriers that could be digitized thanks to NOA Archive Transfer Technology represents 92.7% of the video content to digitize, Historical formats representing around 1.9% of the content and film around 7.3% of the total hours to transfer.
But if we consider the quantity that represent these formats in terms of quantity of hours to digitize, we could remarks that these formats only represent a ratio between 10 to 20 % of total volume. This is why these formats are generally handled by large archives institution beside the main workflow. This workflow is often called “Clinic” or “VIP”, and is integrated at the final stage of the main workflow.
Coexisting processes
Complex projects
Lasting many years
Get your archive moving, but keep order!
Know your archive, know your carriers!
Avoid errors during digitization.
Don‘t lose valuable peripheral information!
Capure only once, in best quality possible.
2nd capture
Earlier generation tapes
Be sure highest possible quality was achieved!
(ORF even destroys carriers after digitization as QC level is very high and they trust their process.)
Coexisting processes
Complex projects
Lasting many years
Coexisting processes
Complex projects
Lasting many years
Separate coherent content units!
Use ontologies
Workload 1:5 between digitization and cataloguing
After Migration to the digital domain, preservation is an IT agenda.
If all other tasks are tackled, take a high-tech leap into the future.
And be aware of its potentials and limits!