Archiving Scottish Government on the web


Published on

Presentation given by Paul Cunnea and Gill Hamilton of National Library of Scotland to staff at the Scottish Parliament Information Centre about the Library's progress in web archiving the Scottish Government website and access to and preservation of Scottish Government electronic publications. March 2010.

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Election Archive, 1999 UKWAC Partner, 2003- IIPC Partner, 2007- Archiving … Scottish Parliament since 2007 Scottish Government since 2007 Other Agencies … Job Done! But … Web crawling limitations Intensive QA Collection level
  • What is it?
  • Hub document XML schema provides the voc & syntax to identify and describe the components that make up a digital (or non-digital) object Specifies location of these components Expresses the structural relationships METS provides an XML schema-based specification for encoding "hub" documents for materials whose content is digital. A "hub" document draws together potentially dispersed but related files and data. METS uses XML to provide a vocabulary and syntax for identifying the digital components that together comprise a digital object, for specifying the location of these components, and for expressing their structural relationships. The digital components comprising a digital object could include the content files, the descriptive metadata, and the administrative metadata. METS can be used for the transfer (SIP in OAIS terms), dissemination (DIP in OAIS terms) and/or archiving (AIP in OAIS terms) of digital objects. The UCB Library will ultimately use it for all three purposes. Flexible standard (some say too flexible) Encode Dos To express the complex links and realtionships between the various associated DO and DO groups. To mananage complext and compound objects relationship to OAIS – designed to fulfil OAIS IP concept Standard for exchange & transmission between repositories Assists in display, archive nad exchange (encapsulates) Can be used to manage the lifecycle of a DO
  • Archiving Scottish Government on the web

    1. 1. Archiving Scottish government on the web Jan Usher Paul Cunnea National Library of Scotland Government Information in the Google Age II 2nd November 2009 Archiving Scottish government on the web Paul Cunnea Gill Hamilton
    2. 2. Summary <ul><li>Background </li></ul><ul><li>Web archiving </li></ul><ul><li>Electronic deposit </li></ul><ul><li>Scottish Government MoU </li></ul><ul><li>Digital Repository development </li></ul><ul><li>Future developments </li></ul>
    3. 3. <ul><li>Founded in 1689 </li></ul><ul><ul><li>(as Advocates Library) </li></ul></ul><ul><li>UK Legal Deposit Library since 1710 </li></ul><ul><ul><li>One of 5 in the UK </li></ul></ul><ul><li>14 million items </li></ul>National Library of Scotland Images courtesy of Visit Scotland
    4. 5. Legal Deposit Act 2003 <ul><li>Regulation for legal deposit of </li></ul><ul><ul><li>Offline content </li></ul></ul><ul><ul><li>Free web </li></ul></ul><ul><ul><li>Commercial content </li></ul></ul><ul><ul><li>Databases </li></ul></ul><ul><li>2011 regulation for free web …? </li></ul><ul><ul><li>DCMS consultation </li></ul></ul>
    5. 6. Digital Content Preserve Access Collect
    6. 7. Archiving Scottish Government on the web Websites Web publications Web archiving Online deposit
    7. 8. Web Archiving DPC
    8. 9. Scottish Government Memorandum of Understanding <ul><li>Shared interest in preservation & access </li></ul><ul><li>Establish a set of protocols </li></ul><ul><li>Regular harvesting of government web site(s) </li></ul><ul><li>Comprehensive collection of individual government publications </li></ul>
    9. 10. SG e-deposit 2007 <ul><li>Good relationship with publisher </li></ul><ul><li>Solution </li></ul><ul><ul><li>RR Donnelly monthly lists </li></ul></ul><ul><ul><li>Archive content from SG website </li></ul></ul><ul><ul><li>Store </li></ul></ul><ul><li>Job Done! </li></ul><ul><li>But … </li></ul>
    10. 11. But ….. Preserve Access Collect Organise
    11. 12. And now ….. Preserve Access Collect Organise
    12. 13. At NLS At
    13. 15. http://main- /
    14. 16.|library/marc/voyager|4306233 http:// /
    15. 17. http:// =1&any= scots+audit&sort -order=ti%2C%2Ddate
    16. 18. brief_results
    17. 19. Next year ….. Preserve Access Collect Organise
    18. 20. How do we do that?
    19. 21. Preservation ain’t rocket science
    20. 22. Consultative Committee for Space Data Systems
    21. 23. Digital repository <ul><li>A group of services that </li></ul><ul><li>follow the OAIS reference model </li></ul><ul><li>ensuring the long-term storage </li></ul><ul><li>and </li></ul><ul><li>preservation of </li></ul><ul><li>digital objects </li></ul><ul><li>in a repository . </li></ul>
    22. 24. Reference model for an open archival information system aka OAIS reference model
    23. 25. Collect Archive (AIP) Disseminate (DIP) Submit (SIP)
    24. 27. M etadata E ncoding and T ransmission S tandard
    25. 28. METS document access administration preservation location structure description
    26. 29. Now and into the future <ul><li>Long haul </li></ul><ul><li>Long term preservation + access key </li></ul><ul><li>Integration with wider digital and print collections </li></ul><ul><li>Legal Deposit regulation 2011 </li></ul><ul><li>Continued collaboration with partners and wider community </li></ul>Reproduced with acknowledgement to Mark Fellows.
    27. 30. DPC
    28. 31. Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect Preserve Access Collect
    29. 32. Thank you Paul Cunnea Digital Collections Manager [email_address] Gill Hamilton Systems Librarian [email_address] National Library of Scotland