• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Sharing Between Data Repositories
 

Sharing Between Data Repositories

on

  • 1,282 views

Dryad is a generic subject repository that shares author submitted data with other scientific repositories. In a part "how we done it" and part "things to consider" talk, I'll discuss 1) why we chose ...

Dryad is a generic subject repository that shares author submitted data with other scientific repositories. In a part "how we done it" and part "things to consider" talk, I'll discuss 1) why we chose BagIt and OAI-ORE as mechanisms for sharing our data, 2) how we've integrated with TreeBASE -- a subject repository of phylogenetic information), and 3) the possibility of this method of data sharing being adopted by other repositories within the larger DataONE community. There will be cake.

Statistics

Views

Total Views
1,282
Views on SlideShare
1,282
Embed Views
0

Actions

Likes
0
Downloads
11
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Sharing Between Data Repositories Sharing Between Data Repositories Presentation Transcript

    • Sharing Between Data Repositories Kevin S. Clarke ksclarke@nescent.orgThanks to the Dryad Data Repository contributors and funders:Ryan Scherle, Todd J. Vision, Hilmar Lapp (NESCent)Ben Bosman, Mark Diggory, Kevin Van de Velde (@mire, Inc.) NESCent
    • The Bio-Reposphere(Generic Subject Repository) (General Scholarly Repository) (Subject Specific Repository)
    • Generic vs. Specific Repos✔ Easy submission ✔ Complex submission✔ Simple metadata ✔ More useful metadata✔ Data is a “black box” ✔ Well structured data✔ No “orphaned” data ✔ Specific type of data
    • A Dryad Data Package
    • One Possible Workflow
    • “Save the Time of the User” #1
    • “Save the Time of the User” #2
    • Three Simple Steps
    • Case 1: TreeBASE Data Import
    • Harvesting and Web Services OAI-PMH PhyloWS
    • Case 2: Data Uploaded to Dryad
    • Partner Repository Upload
    • BagIt Disseminator (implements DSpace PackageDisseminator) Dryad Application Profile XSLT Dryad Crosswalk PublicationDSpace Dryad Data DryadMetadata Data File Package Dryad Data File Dryad Data FileBag Data from DSpace
    • A BagIt Bag bag-info.txt data bagit.txtmanifest-md5.txt tagmanifest-md5.txt
    • Dryad Data in the Bag datafile-2 dryadpkg.xmldryadfile-2.xml ApineDNA.nexus datafile-1 dryadpub.xmldryadfile-1.xml ApineCYTB.nexus
    • HTTP PUT Handshake TreeBASE URLEmail BagIt Upload
    • Lessons Learned✔ Just enough to get the job done and no more✔ Less local conventions and more “standards”✔ There will always be custom solutions✔ Options are developing quickly in this space
    • Future DirectionsLess reliance on local conventions✔ Plan to use OAI-ORE and Pairtree(s) within BagItOAI-ORE: Because its Linked DataPairtree Filesystem✔ So we can dereference URIs in ORE Resource Maps http://dx.doi.org/doi:10.5061/dryad.8343 URI prefix: http://dx.doi.org/doi:10.5061/dryad. Path: 83/43 83/43/Arctostaphylos.nex
    • Other Interesting DevelopmentsDataONE✔ Distributing data files and metadata✔ May support packages in the future“Dropbox of Bags” or Bag replication network (BagNet?)METS in Bags (in contrast to ORE)
    • The End The cake was a lie
    • ReferencesDryad Code http://dryad.googlecode.comDryad Data Repository http://datadryad.orgBagIt http://en.wikipedia.org/wiki/BagItOAI-ORE Primer http://www.openarchives.org/ore/1.0/primerOAI-ORE in BagIt http://groups.google.com/group/oai-ore/browse_thread/thread/3ebfa7fcb4588048ADMIRAL Data Packages (Planning ORE in BagIt) http://imageweb.zoo.ox.ac.uk/wiki/index.php/ADMIRAL_data_packagesDSpace Packagers https://wiki.duraspace.org/display/DSPACE/PackagerPlugins