Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Project to Production: The Web Archiving Service

429 views

Published on

Seneca, Tracy. Project to Production: The Web Archiving Service. Digital Library Federation Forum. Palo Alto, CA. 2010.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Project to Production: The Web Archiving Service

  1. 1. Project to Production: The Web Archiving Service DLF Fall Forum, 2010 Tracy Seneca University of California Curation Center, California Digital Library
  2. 2. Web-at-Risk: 2005-2009University of California Curation Center, California Digital Library
  3. 3. Today:• Whirlwind tour• Project to production• Current / future work• The DLF community University of California Curation Center, California Digital Library
  4. 4. Build unique archives for local research communities Geographically focused archives support local research • Los Angeles • Monterey Bay • Orange County • San Diego • Santa BarbaraTopical archives support specialresearch collections• Guantanamo Bay / Tamiment Library• California Water Districts / WaterResources Center Archives University of California Curation Center, California Digital Library
  5. 5. Archive Ephemeral Content University of California Curation Center, California Digital Library
  6. 6. Analyze Site Change Are there new documents on this site? Are there documents in my archive that have been removed from the live site?University of California Curation Center, California Digital Library
  7. 7. Easy to Use : Simple Workflow University of California Curation Center, California Digital Library
  8. 8. Tailor Capture Settings Focus on site, directory or page Set appropriate frequency University of California Curation Center, California Digital Library
  9. 9. http://was.cdlib.orgUniversity of California Curation Center, California Digital Library
  10. 10. Archive Home PageUniversity of California Curation Center, California Digital Library
  11. 11. Automatic List of Sites University of California Curation Center, California Digital Library
  12. 12. Search Across All Sites or Target Just One University of California Curation Center, California Digital Library
  13. 13. WAS Snapshot: October 2010 Stats: Since January 2007 17 organizations 4,509 sites captured 33,619 captures run 21.7 terabytes 29 archives published University of California Curation Center, California Digital Library
  14. 14. Project to Production• Scale – Infrastructure: ensure continuity of service through server upgrades• Policy – Setting up service agreements University of California Curation Center, California Digital Library
  15. 15. Engage the users(Needs assessment doesn’t stop) University of California Curation Center, California Digital Library
  16. 16. “Production” is not just for us!• How does WAS fit into existing workflows?• Is there a ‘web archivist’? Student workers?Friday November 5th 10-11:30 amCurators from UC San Diego, NYU, Universityof Michigan and UC Berkeley share theirapproaches to web archiving.http://was.cdlib.orgWAS News University of California Curation Center, California Digital Library
  17. 17. Archiving the State of California Learning from the archives California State Agency Sites with robots no robots gone 2% 47% 51%307 sites1363 captures2.7 TBBegan October 2008 University of California Curation Center, California Digital Library
  18. 18. Archiving the Gulf oil spill Improving support for collaboration 527 sites 9288 + captures 1.6 TB Began May 5 University of California Curation Center, California Digital Library
  19. 19. LSU tags relevant sites in DeliciousCDL imports Delicious JSON feed into WAS University of California Curation Center, California Digital Library
  20. 20. Interoperability of CDL Services University of California Curation Center, California Digital Library
  21. 21. University of California Curation Center, California Digital Library
  22. 22. DLF CommunityTools Common issues/developments• WAS • Memento – UC libraries, NYU, Stanford • Policy• Archive-It – Can / should Facebook block – Columbia, Rice, Indiana… government pages from capture?• Other – Library of Congress, North Texas, Los Alamos • Collection • Collaboration • Imagination
  23. 23. In-depth demos: Nov 8th and 16th Workflows discussion: Nov 5th• http://www.facebook.com/webarchiving• http://was.cdlib.org > WAS News University of California Curation Center, California Digital Library

×