Your SlideShare is downloading. ×
Microservices_digitalingest_AMIA13
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Microservices_digitalingest_AMIA13

167

Published on

Presentation at #amia13 for Dance Preservation & Digitization Project, Bay Area Video Coalition and Dance Heritage Coalition

Presentation at #amia13 for Dance Preservation & Digitization Project, Bay Area Video Coalition and Dance Heritage Coalition

Published in: Technology, Spiritual
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
167
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • verifySIPcomplianceWhat it does: Upon drag-and-drop action by collection manager, this drop folder runs a bash script to confirm, following receipt of SIP packages from DPDP technicians, whether or not the SIP package is well-formed and includes all the necessary files and directories to move forward with other processes and submitting to Archivematica. Why we use it: Streamlines workflow for collection management, making visual QC confirming existence of files and directories unnecessary upon receipt from technicians.makeaccessWhat it does: Upon drag-and-drop action by collection manager, this drop folder runs a bash script that uses FFmpeg to produce smaller, streamable access files.Why we use it: Streamlines workflow and technicians do not need to have FFmpeg and command line interface expertise to create high-quality access and streaming files. makemetadataWhat it does: Upon drag-and-drop action by collection manager, this drop folder runs mediainfo, FFmpeg, and a digital forensics application. It also adds information about actions on the file to our PREMIS metadata file for each package via a script.Why we use it: This creates preservation metadata essential to long-term preservation of the digital files. Separate from the metadata created by Archivematica, it is specific to audiovisual materials.checksumpackageWhat it does: Upon drag-and-drop action by collection manager, this drop folder creates an .md5 file for the preservation video file. Why we use it: This file confirms that in moving from any one storage service or device to another, the preservation-level file is not corrupt. Applications such as md5 on Mac command line or md5sum on Ubuntu command line may confirm the checksum. uploadaccessWhat it does: Upon drag-and-drop action by collection manager, this drop folder uploads the compressed streaming mp4 file to the Access Point and content management system at <http://archive.danceheritage.org/>. Why we use it: Streamlines workflow so that collection managers do not need expertise in command line interface and maintains specifications for our access files.
  • Transcript

    • 1. Microservices for digital preservation Dance Preservation & Digitization Project AMIA 2013 @laurensx @bavcpreserve
    • 2. Installing Simple config file • https://github.com/bavc/DPDP_Scripts/blob/master/d pdpconfig • Purpose: username and pass for streaming service Microservicewatch • https://github.com/bavc/DPDP_Scripts/blob/master/m icroservicewatch • Purpose: “holds” the scripts Cron • Application to make timed actions on files  Terminal
    • 3. Drop folders
    • 4. Processes
    • 5. What do the drop folders do? • PREMIS events – “premisers” in Github: – https://github.com/bavc/premisers • • • • • • checksumpackage makeaccess makemetadata refiler uploadaccess verifysipcompliance
    • 6. Thank you! laurens@bavc.org @laurensx @bavcpreserve www.bavc.org/preservation Bay Area Video Coalition & Dance Heritage Coalition

    ×