More Related Content

Preservation and institutional repositories for the digital arts and humanities

  1. Dorothea Salo University of Wisconsin salo@wisc.edu
  2. Institutional repositories for the digital arts and humanities Dorothea Salo University of Wisconsin salo@wisc.edu
  3. Preservation for the digital arts and humanities Dorothea Salo University of Wisconsin salo@wisc.edu
  4. Dorothea Salo University of Wisconsin salo@wisc.edu Preservation and institutional repositories for the digital arts and humanities
  5. And I said... ... you’re giving me how much time for this?
  6. Environment •As several of you are intimately aware, higher ed is trying to figure out What To Do About Data. •This spells opportunity... IF you can get a seat at the table, and IF you know what to ask for! • Humanists will not be the first people they think of, sadly. •Serious (insoluble?) problem: data diversity • Expect compromise “solutions.” •Do not let IT pros intimidate you. • They do not know everything they think they know.
  7. PICK SOFTWARE LAST. Friendly word of advice: Photo: “Briana Calderon; future educator of america.” http://www.flickr.com/photos/46132085@N03/4703617843/ Arielle Calderon / CC-BY 2.0
  8. IT’S WHAT THE SOFTWARE WON’T DO. It’s not what the software does that’ll kill you. Photo: “Briana Calderon; future educator of america.” http://www.flickr.com/photos/46132085@N03/4703617843/ Arielle Calderon / CC-BY 2.0
  9. DON’T CHASE THE SHINY. Another friendly word of advice: Photo: “Sparkle Texture” http://www.flickr.com/photos/abbylanes/3214921616/ Abby Lane / CC-BY 2.0
  10. it’s much less shiny. In five years... Photo: “Sparkle Texture” http://www.flickr.com/photos/abbylanes/3214921616/ Abby Lane / CC-BY 2.0
  11. it’s not shiny at all. In ten years... Photo: “Sparkle Texture” http://www.flickr.com/photos/abbylanes/3214921616/ Abby Lane / CC-BY 2.0
  12. In twenty years... it’s probably useless.
  13. NOT A SOLUTION: your graduate students •You have a bright, tech-savvy grad student. •She builds an Awesome Tech Thing. •You have no idea how it works. •She graduates. You’re hosed. • Because she didn’t (know how to) build it sustainably... • Because you don’t have any documentation... • Because nobody made contingency plans for it... •I have seen this pattern over and over again. • It’s killed more digital culture and research materials than anything I can think of in academe.
  14. Am I saying “don’t experiment?” •Nah, of course not. •I’m saying “know what an experiment means.” •I’m saying “don’t mistake an experiment for an archive.” •I’m saying “don’t experiment and then expect everybody else to pick up your pieces because you didn’t plan for metadata or preservation.”
  15. That said? •You gotta do what you gotta do. •Some friendly advice: • Know where the exits are. (Can you export your data? In a reusable format?) • When you finish a project, USE that export. • Triply true if you’re relying on the cloud! •Your overriding goal, while a project is in progress: keep your eventual options open! •Long-term... is a totally other kettle of fish.
  16. Your best strategy •The single best strategy for a digital humanist concerned about long-term preservation... •... is to figure out how to make it Somebody Else’s Problem. • Right now, this is hard. I do believe it will get easier. •It’s a lot easier to figure this out from the start than at the end. • Different Somebody Elses will have different things that they want. If you know that from the get-go, you’re much better off.
  17. Institution-internal solutions
  18. Institution-internal solutions •Rolling your own
  19. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it.
  20. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software
  21. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software • e.g. Omeka, Dataverse, ArchivesSpace...
  22. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software • e.g. Omeka, Dataverse, ArchivesSpace... • Better, but not foolproof. Upgrades? Security? Backups?
  23. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software • e.g. Omeka, Dataverse, ArchivesSpace... • Better, but not foolproof. Upgrades? Security? Backups? • Writing plugins/mods = rolling your own. Avoid if possible.
  24. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software • e.g. Omeka, Dataverse, ArchivesSpace... • Better, but not foolproof. Upgrades? Security? Backups? • Writing plugins/mods = rolling your own. Avoid if possible. •Adopting institutional infrastructure
  25. Institution-internal solutions •Rolling your own • Please don’t, if you can possibly avoid it. •Adopting open-source software • e.g. Omeka, Dataverse, ArchivesSpace... • Better, but not foolproof. Upgrades? Security? Backups? • Writing plugins/mods = rolling your own. Avoid if possible. •Adopting institutional infrastructure • Make sure it’ll survive your departure from the institution!
  26. Outside the institution
  27. Outside the institution •Lists of data repositories
  28. Outside the institution •Lists of data repositories • Databib: http://databib.org/
  29. Outside the institution •Lists of data repositories • Databib: http://databib.org/ • re3data: http://re3data.org/
  30. Outside the institution •Lists of data repositories • Databib: http://databib.org/ • re3data: http://re3data.org/ • N.b. you will find less here on the humanities than you would probably prefer. Long story.
  31. Outside the institution •Lists of data repositories • Databib: http://databib.org/ • re3data: http://re3data.org/ • N.b. you will find less here on the humanities than you would probably prefer. Long story. •Figshare
  32. Outside the institution •Lists of data repositories • Databib: http://databib.org/ • re3data: http://re3data.org/ • N.b. you will find less here on the humanities than you would probably prefer. Long story. •Figshare • ... and other web services springing up, e.g. omeka.net
  33. You will be limited by... •Infrastructure your library/IT has already committed to • this is why you want to be in on ground-floor discussions! •Their willingness and ability to tweak, rewrite, or replace it with something suiting your needs •Your willingness and ability to evaluate, install, and maintain a software stack that suits you • ... perhaps indefinitely! •The availability of hosted solutions, and your ability to pay for them (perhaps indefinitely!)
  34. You need to know what the options are like. •Your library and IT folks may well need guidance. At minimum, they need clearly- expressed requirements. •The requirements you give them need to go beyond end-user access, use, and UI. • Back end: getting material in as efficiently as possible, allowing for additions/changes/deletions • Preservation requirements • Data and metadata purity, clarity, preservability, reusability, mashuppability, migratability, standards
  35. Institutional repositories
  36. What’s an IR? •“‘[A]ttics’ (and often fairly empty ones), with random assortments of content of questionable importance” • Brown, Griffiths, Rascoff, “University publishing in a digital age.” Ithaka 2007. http://www.sr.ithaka.org/research- publications/university-publishing-digital-age •A basic digital preservation-and-access platform designed to allow faculty to deposit and describe single PDFs. •Quite commonly available in research libraries or through library consortia. • You probably have one available to you!
  37. IR software •Open source • Fedora Commons: http://fedora-commons.info/ (you’ll need a layer on top of this) • DSpace: http://dspace.org/ • EPrints: http://eprints.org/ •Commercial • ContentDM: http://contentdm.com/ • DigiTool: http://www.exlibrisgroup.com/category/ DigiToolOverview •Hosted • ContentDM: http://contentdm.com/ • BePress: http://bepress.com/
  38. Two minutes! •Find an IR available to you for depositing content.
  39. You can typically expect... •To get in touch with someone in the library to get an account set up, and a space for you to deposit into • Have a collection name and description ready. • Default descriptors, if you have any, also a good idea. • Need access controls? To delegate deposit? Talk about this. •To be able to put materials in on your own, through web forms • To find the deposit process fiddly and annoying •To have material appear on the web right after deposit.
  40. IRs work for... •Small(ish), discrete files that never change • So an Excel-using researcher is just fine with an IR. •Documentation for data held elsewhere •Some IRs can handle static website captures. •Files with uncomplicated IP lives • ... which complicates the “static website” question. •Access restriction may be possible, as may dark archiving; it depends on the IR platform. Expect it to be annoying to implement, though.
  41. IRs don’t work for •Really Big Data • including, sometimes, audio and video • This is less a reflection on IR software than of most IRs being horribly underprovisioned with storage and bandwidth. •Work in progress; files that may change or be updated •Complex digital objects (except static websites) •Digital objects that need interactivity • Even something as simple as video streaming. IRs can’t. •Anything that needs a DOI. (You’ll get a permanent identifier, but it won’t be a DOI.) •Datasets where the researcher wants to vet any potential reusers
  42. Digital libraries
  43. Digital-library software • Omeka, Greenstone (aging), ContentDM... • Again, chances are your library already has some kind of digital-collections software. • Go ask a librarian what it is, and whether you can add material to it! • Also ask if it’s attached to any kind of digitization or metadata-help service. It may not be, but you never know. • If not, there are hosted options • if you’re prepared to pay for them indefinitely. • Designed for image exhibitions • May extend to audio and video, but UI won’t be ideal. • May extend to page-scanned books, but may not. (Omeka is terrible at these.)
  44. Be aware •The digital-preservation underpinnings of this class of software are weak to nonexistent. • It’s designed for exhibiting, not for archiving! • It may also entice you into poor sustainability decisions, such as using web-friendly but lossy JPG as your master image format. Or not making backups. •On the plus side, though, if it’s a library service, the library feels an institutional commitment to the materials in it. • That’s a lot of the preservation battle won, right there.
  45. Emerging solutions •Often involve combining software to attack different parts of the problem • Preservation underlayers: Fedora Commons, microservices • Deposit and management UI: Hydra, Islandora • End-user UI: Hydra, Islandora, Omeka, plugins, mods, etc. •Are still pretty DIY at this point • If your library is doing active development, you’re one of the lucky ones. • The rest of you may have to wait. And lobby.
  46. Archives platforms •Designed for coping with an undifferentiated mess of random digital stuff. • I know, right? Nobody has that problem... •Not usually designed to help other people use or interact with that stuff. • Also, designed for archivists’ ways of thinking. Archivists are humanists, but not all humanists are archivists. • Worth getting a software tour from an archivist! •Archivematica, ArchivesSpace (in beta), Duke Data Accessioner, CollectiveAccess, BitCurator
  47. Data-management platforms •Usually designed for the sciences, not the humanities! • But that doesn’t necessarily mean they won’t work for what you have in mind. • (“E-lab notebooks” will probably feel pretty foreign, though.) •Look at Dataverse Network, http://thedata.org/ •Gigantor lists of everything ever: • http://www.dcc.ac.uk/resources/external/tools-services/ archiving-and-preserving-information • http://dirt.projectbamboo.org/categories/publishing • http://foss4lib.org/packages • Less helpful than you might think; there’s rarely any decision apparatus alongside.
  48. Dorothea’s cantankerous, crabby, cynical, crude, choleric, churlish, other-words-beginning-with-C take on digital humanists working with librarians and IT pros
  49. Neil Gaiman on George R.R. Martin and his eager fans CENSORED CENSORED From: http://journal.neilgaiman.com/2009/05/entitlement-issues.html
  50. Digital humanists: Librarians and IT professionals are not your bitch.CENSORED
  51. Not entirely your fault! •$$$ is a consideration, unfortunately • The sciences have it. Unfortunately. •Your colleagues may have poisoned the well by being prima donnas, even though you’re not! •Different professional-advancement infrastructure •We may just. not. be. ready. • Or the infrastructure we rely on may not be.
  52. DH and libraries should be friends •Involve the library from the outset. • Please do NOT ask us to pick up your messes at the end! • Expect us to have work for you to do, and quality expectations. • Yes, I know that’s how it used to work with analog materials and archivists. Digital is different. •Come to us in groups. • We serve all of campus. We cannot afford to move heaven and earth for any one person. Please don’t be a prima donna! • At minimum, have an idea how what you’re asking will concretely benefit other campus constituencies. •Offer quid pro quo. What’s in it for us? • (Library advocacy in high places is always a good trade.) •Be patient, please. • We don’t turn on a dime.
  53. Will this always work? •Sadly, no. •A good many libraries are just not ready to take digital preservation and DH support seriously. • The presence of a “DH center” in the library is not always proof of serious intent. •Others have been burned before. •Still others are skeptics. •I can’t promise you’ll find help in the library, or with campus IT. I can promise you won’t if you don’t seriously approach them. • (Miriam Posner’s article is a must-read!)
  54. Thanks! Questions?