Keeping Web Records


Published on

Cassandra Findlay of NSW State Records presentation on Keeping Web records to the Local government Web Network Conference 2009

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Keeping Web Records

  1. 1. Keeping records of your website WE Believe in Community conference Local Government Web Network 20-21 August 2009
  2. 3. About State Records <ul><ul><li>1,553,894 website visits </li></ul></ul><ul><ul><li>55,948 reading room visitors </li></ul></ul><ul><ul><li>25,554 original archives used </li></ul></ul><ul><ul><li>42 community access points to State archives collection across NSW </li></ul></ul><ul><ul><li>395 kilometres of noncurrent records stored at Western Sydney </li></ul></ul><ul><ul><li>59.8 kilometres of standard format archives in custody </li></ul></ul><ul><ul><li>239,876 record items discoverable </li></ul></ul><ul><ul><ul><li>State Records Annual Report 2007-8 </li></ul></ul></ul>
  3. 5. Future Proof <ul><li>Digital records strategy for New South Wales government </li></ul><ul><li>Aims: </li></ul><ul><ul><li>improving digital recordkeeping across government </li></ul></ul><ul><ul><li>implementing a digital archiving facility for New South Wales government </li></ul></ul><ul><li>Products, services: </li></ul><ul><ul><li>Published guidance, standards, updates and training </li></ul></ul><ul><ul><li>Ad hoc advice to public offices including Councils </li></ul></ul>
  4. 6. What is a digital record? <ul><li>Digital information captured at a specific point in time that is kept as evidence of business activity. </li></ul>Why?, Twin Peaks, 2009,
  5. 7. Some digital records are State records <ul><li>That is, digital records that are “..made and kept, or received and kept, by any person in the course of the exercise of official functions in a public office, or for any purpose of a public office, or for the use of a public office.” </li></ul><ul><ul><li>State Records Act 1998, s.3 (1) </li></ul></ul>
  6. 8. Council websites <ul><li>Many official functions of a Council are performed via the Council website </li></ul><ul><li>Much of the information on the website will satisfy the criteria for being State records </li></ul><ul><li>Digital State records must be managed in conformance with the requirements of the Standard on digital recordkeeping </li></ul>
  7. 9. Standard on digital recordkeeping <ul><li>A set of 9 minimum requirements for making and keeping digital records, to ensure Councils have available, authentic, meaningful evidence of their past business: </li></ul><ul><ul><li>minimum requirements for defining which records are saved into digital recordkeeping systems & what these systems’ minimum functionalities must be </li></ul></ul><ul><ul><li>minimum requirements for recordkeeping metadata, and </li></ul></ul><ul><ul><li>minimum requirements for recordkeeping metadata management. </li></ul></ul>
  8. 10. Government 2.0 – depends on recordkeeping! <ul><li>Government 2.0 Issues Paper cites the OECD Principles for public sector information, including: </li></ul><ul><ul><li>5. Integrity . Maximising the integrity and availability of information through the use of best practices in information management. Developing and implementing appropriate safeguards to protect information from unauthorised modification or from intentional or unintentional denial of authorised access to information. </li></ul></ul><ul><ul><li> or http:// . </li></ul></ul>
  9. 11. Ok so how do we do it?
  10. 12. 1. Share responsibility Sharing, Ryancr, 2006,
  11. 13. 2. Tackle high risk business first <ul><li>‘ Man on wire’, 2009 , </li></ul>
  12. 14. 3. Assess website records type/s
  13. 16. 4.Identify the recordkeeping requirements <ul><li>Is there a business / regulatory / societal requirement for a record to be kept? </li></ul><ul><li>How often does this information change? Are all changes required as records? </li></ul><ul><li>What is the risk in not keeping this record? Or keeping some changes but not all? </li></ul><ul><li>Is the information already captured as a record elsewhere? </li></ul><ul><li>Is it necessary to (also) capture the web version as a record? the date when the page was published / taken down, by whom? the page exactly as it looked or just its content? </li></ul><ul><li>How long does the record need to be kept? </li></ul>
  14. 17. 5. Devise an appropriate recordkeeping strategy <ul><li>Consider the recordkeeping requirement, including: </li></ul><ul><ul><li>The type of record needing to be kept </li></ul></ul><ul><ul><li>The rate of change of the information </li></ul></ul><ul><ul><li>Static / dynamic / transactional? </li></ul></ul><ul><ul><li>The retention period </li></ul></ul><ul><ul><li>Risk </li></ul></ul><ul><li>And determine: </li></ul><ul><ul><li>How (technically) to capture the record </li></ul></ul><ul><ul><li>How often to keep a record </li></ul></ul><ul><ul><li>Who is responsible </li></ul></ul><ul><ul><li>Where to keep the record </li></ul></ul>
  15. 18. Options for keeping web records <ul><li>Retain in WCMS – use ‘roll back capabilities’ - short term value, needs to be kept exactly as viewed </li></ul><ul><li>Copy / export documents or pages to an EDRMS – necessary when records are longer term value </li></ul><ul><li>RSS feed to records manager – for frequently updated pages </li></ul><ul><li>Web harvesting – good for ‘snapshots’ – but may miss dynamic content and some pages eg. Heritrix, HTTrack </li></ul><ul><li>Capture transactions at the web server – to save requests and responses including on the fly content. For high risk business. eg Vignette, PageVault </li></ul>
  16. 19. Example 1: Council meeting papers and minutes <ul><li>Long term retention (Required as State archives) </li></ul><ul><li>Possibly already captured in Council recordkeeping system </li></ul><ul><li>Council may need to demonstrate date published to meet s.12 requirements </li></ul><ul><li>Options </li></ul><ul><ul><li>Make a record of uploading of documents, point to records already kept in recordkeeping system </li></ul></ul><ul><ul><li>Also save web published versions to recordkeeping system </li></ul></ul>
  17. 20. Example 2: News updates <ul><li>Mixture of high and low risk information </li></ul><ul><li>Important to keep a record of when item was published in some cases </li></ul><ul><li>Selective capture not easy </li></ul><ul><li>Mixture of short and long term retention periods </li></ul><ul><li>Options: </li></ul><ul><ul><li>RSS feed to records manager </li></ul></ul><ul><ul><li>Automated capture of each version of the news page as published </li></ul></ul>
  18. 21. Example 3: Website transactions <ul><li>Online surveys, forms – where low risk the record may best be made in back end systems (eg change of address). Keep a record of the form and all changes. </li></ul><ul><li>More complex transactions eg interactive maps – if high risk there may be value in capture of interactions (sessions), but will be high cost </li></ul><ul><li>Compromise is to ensure records are kept of the capability and contents and dates in use </li></ul>
  19. 22. ..and finally <ul><li>Don’t forget to ‘Future Proof’ your web records! </li></ul>
  20. 23. Obsolescence <ul><li>Obsolescence can affect hardware, software and even the arrangement of the data in a stored file. </li></ul><ul><li>Obsolescence can occur at an alarmingly fast rate. </li></ul>MAGLEV Train and Rickshaw, Shanghai, Soctech, 2005,
  21. 24. File formats may be superseded MacDraw, FHKE, 2007,
  22. 25. Storage medium may be superseded <ul><li>Magnetic tape </li></ul>Gallery of Obsolete Formats 1, jen-the-librarian, 2007
  23. 26. The device needed to read the medium may no longer be produced Sony Betamax, Nesster, 2009,
  24. 27. Software used to create, manage or access digital content may be superseded Windows 1.0: the MS-DOS executive, Renan Birck, 2007,
  25. 28. Computers themselves are being superseded Old computers, eurlief, 2006,
  26. 29. Vendors merge, emerge and fade <ul><li>GONE </li></ul>
  27. 30. Things can fall apart Broken computer. Miss Rogue, 2007,
  28. 31. Tips for long term accessibility of your web records <ul><ul><li>Use open formats </li></ul></ul><ul><ul><li>Keep records in recordkeeping systems </li></ul></ul><ul><ul><li>Comply with Standard on digital recordkeeping to ensure adequate metadata </li></ul></ul><ul><ul><li>Migrate with care </li></ul></ul><ul><ul><li>Avoid removable media </li></ul></ul>
  29. 32. For more information <ul><li> </li></ul><ul><li> </li></ul><ul><li>Cassie Findlay </li></ul><ul><ul><li>Ph: (02) 8247 8629 </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul>