Measuring your work and reporting your value as we move to Library 2.0 David Feighan Australian Taxation Office Modified version (with more supporting notes) of a presentation given at the VALA2008 conference in Melbourne Australia on Wednesday 6 February 2008 . See http://www.vala.org.au/conf2008.htm for details.

Library 2.0 – reporting value Making sense of Library 2.0 and Web 2.0 Assessing Library 2.0 – State of Play Measuring Library 2.0 – Challenges What to measure Boundaries The pace of change Leveraging off Web 2.0 services and applications Mash up stats Conclusion

Making sense of Library 2.0 and Web 2.0

Assessing Library 2.0 – State of Play

Measuring Library 2.0 – Challenges

What to measure

Boundaries

The pace of change

Leveraging off Web 2.0 services and applications

Mash up stats

Conclusion

Library 2.0 Facilitates flexible design and creative reuse of content, Provides a rich and responsive user experience , and Facilitates COLLABORATION . Murugesan, S. (2007), “Understanding Web 2.0”, IT Pro , July / August 2007, p.34 – 41

Facilitates flexible design and creative reuse of content,

Provides a rich and responsive user experience , and

Facilitates COLLABORATION .

Murugesan, S. (2007), “Understanding Web 2.0”, IT Pro , July / August 2007, p.34 – 41

Library 2.0 “ While the old Web 1.0 was about Web sites, clicks, and ‘eyeballs’, the new Web 2.0 [and by extension Library 2.0] is about communities , participation , and peering .” Tapscott, D. & Williams, A.D., (2007), Wikinomics: How Mass Collaboration Changes Everything , Portfolio, New York, p. 19. But what does this mean? To measure, we first need to understand what it is we are measuring and why.

“ While the old Web 1.0 was about Web sites, clicks, and ‘eyeballs’, the new Web 2.0 [and by extension Library 2.0] is about communities , participation , and peering .”

Tapscott, D. & Williams, A.D., (2007), Wikinomics: How Mass Collaboration Changes Everything , Portfolio, New York, p. 19.

But what does this mean?

To measure, we first need to understand what it is we are measuring and why.

Making sense of Library 2.0 Tag clouds are often used to describe Library / Web 2.0. However, these are often a mish-mash, not that this in itself is a bad thing given much of Web 2.0 is mashed up. But for the purpose of metrics, and grouping like with like, it does not provide clarity or structure. For example in the image above some of these tags relate to principles e.g. “Convergence” and some to “technologies” e.g. RSS.

Making sense of Library 2.0 Source: http://www.informationarchitects.jp The Web Trend Map 2.0 is a 200 web-sites mapping organised for relevance and themes. It was designed by a group of Japanese web designer on the model of Tokyo subway. Again, does not really provide assistance for the purpose of provide a structure for metrics

Making sense of Library 2.0 Consider the growing number of Web 2.0 applications. They all do different things. How do we make sense of this? How do we grab these statistics? Should we even try? How do we organise like with like.

Making sense of Library 2.0 This web 2.0 landscape from the http://www.futureexploration.net/ makes a good attempt of providing structure and grouping like with like.

Making sense of Library 2.0 The Web 2.0 framework by Ross Dawson is useful in that it includes inputs, outputs, mechanisms, and a structure that is useful for building Web 2.0 / Enterprise 2.0 strategies. Can libraries use or adapt this framework? Ross Dawson's blog can be found at www.rossdawsonblog.com .

Making sense of Library 2.0 Source: http://blog.iia.ie/2007/02/04/ In pondering on how to measure Library 2.0, I realise that maybe it was already too late. The technology and world is moving on and now we are talking about…

Making sense of Library 2.0 3.0 Source: http://blog.iia.ie/2007/02/04/ … Web 3.0. So what does this means, how do we keep up? Does Web 3.0 actually exist when some say that Web 2.0 doesn’t exist. If Web 3.0 exists, should we forget about Library 2.0 and move onto thinking about measuring Library 3.0? Why is there so little stuff on Wikipedia about these Web 3.0 applications? Now my head is hurting! Lets take a breath and see where we are today.

Assessing Library 2.0 – State of Play Project Counter [ WHAT ] Standardised Usage Statistics Harvesting Initiative, SUSHI [ HOW ] ISO Standards [ UNIFORMITY ] International Standard ISO/DIS 11620:1998/Amd 1:2003: Information and documentation — Library performance indicators, and International Standard ISO/DIS 2789: Information and documentation —International library statistics”

Project Counter [ WHAT ]

Standardised Usage Statistics Harvesting Initiative, SUSHI [ HOW ]

ISO Standards [ UNIFORMITY ]

International Standard ISO/DIS 11620:1998/Amd 1:2003: Information and documentation — Library performance indicators, and

International Standard ISO/DIS 2789: Information and documentation —International library statistics”

Assessing Library 2.0 – State of Play Association of Research Libraries [one example] MINES for Libraries™ is an online transaction- based survey that collects data on the purpose of use of electronic resources and the demographics of users. The DigiQUAL™ project is modifying and repurposing the existing LibQUAL+™ protocol to assess the services provided by digital libraries. LibQUAL+™ is a rigorously tested Web-based survey that libraries use to solicit, track, understand, and act upon users' opinions of service quality.

Association of Research Libraries [one example]

Assessing Library 2.0 – State of Play However, in mid 2007 there appeared to be very little on Web 2.0 and metrics, let alone Library 2.0 metrics. A search on the http://www.libraryassessment.info blog for the terms: Facebook , Library 2.0 , MySpace , PHP , Social networking , Social networks , Social tag , Tagging , and Web 2.0 Returned no meaningful results.

However, in mid 2007 there appeared to be very little on Web 2.0 and metrics, let alone Library 2.0 metrics.

A search on the http://www.libraryassessment.info blog for the terms:

Facebook , Library 2.0 , MySpace , PHP , Social networking , Social networks , Social tag , Tagging , and Web 2.0

Returned no meaningful results.

Assessing Library 2.0 – State of Play Meanwhile the CAUL Electronic Information Resources Committee (CEIRC) 2007 survey on managing usage statistics found: High level of interest in electronic resource management (ERMs) and online statistics Libraries still forced to work within manual data collection processes that did not necessarily conform to emerging standards and initiatives Source: http://www.caul.edu.au/surveys/usage-statistics2007.doc

Meanwhile the CAUL Electronic Information Resources Committee (CEIRC) 2007 survey on managing usage statistics found:

High level of interest in electronic resource management (ERMs) and online statistics

Libraries still forced to work within manual data collection processes that did not necessarily conform to emerging standards and initiatives

Measuring Library 2.0 - Challenges SO: Where are the boundaries of what we measure and what we don’t? What is work, what is play? If we agree on the boundaries, what do we actually measure? Should different types of libraries take a different approach? How do we measure activity if we have to rely on Web 2.0 application statistics?

SO:

Where are the boundaries of what we measure and what we don’t? What is work, what is play?

If we agree on the boundaries, what do we actually measure?

Should different types of libraries take a different approach?

How do we measure activity if we have to rely on Web 2.0 application statistics?

Measuring Library 2.0 - Challenges And: How do we integrate Library 1.0 and Library 2.0 activities, statistics, and reporting? How do we, or should we, implement industry standards in the fast paced and beta is forever world of Library 2.0? How do we communicate the value of Library / Web 2.0 within the host organisation’s reporting frameworks?

And:

How do we integrate Library 1.0 and Library 2.0 activities, statistics, and reporting?

How do we, or should we, implement industry standards in the fast paced and beta is forever world of Library 2.0?

How do we communicate the value of Library / Web 2.0 within the host organisation’s reporting frameworks?

Measuring Library 2.0 where are the boundaries? Social Library Academic Work Physical Virtual Within our domains, or Third party domains Source: Habib, M “Library 2.0 Academic Library concept map” Library 2.0 Facebook Interest Group, http:// www.facebook.com/group.php?gid =2212848798 accessed 8 September 2007.

Social

Library

Academic

Work

Physical

Virtual

Within our domains, or

Third party domains

Measuring Library 2.0 what do we measure? Blogging Messaging Social networking Tagging Mashups Web logs Source: Habib, M “Library 2.0 Academic Library concept map” Library 2.0 Facebook Interest Group, http:// www.facebook.com/group.php?gid =2212848798 accessed 8 September 2007.

Blogging

Messaging

Social networking

Tagging

Mashups

Web logs

Measuring Library 2.0 how do we relate the what to outputs? Blogging Messaging Social networking Tagging Mashups Web logs Source: Habib, M “Library 2.0 Academic Library concept map” Library 2.0 Facebook Interest Group, http:// www.facebook.com/group.php?gid =2212848798 accessed 8 September 2007.

Blogging

Messaging

Social networking

Tagging

Mashups

Web logs

Measuring Library 2.0 what do we measure or allow? As a school Library Academic Library Public Library Health Library etc, etc Source: Habib, M “Library 2.0 Academic Library concept map” Library 2.0 Facebook Interest Group, http:// www.facebook.com/group.php?gid =2212848798 accessed 8 September 2007.

As a school Library

Academic Library

Public Library

Health Library

etc, etc

Measuring Library 1.0 versus 2.0 Library 1.0 activities: Library catalogues, Host organisation servers, or Vendor services. Library 2.0 activities: Third party social networking services. Content creation activities – blogging. New platforms – Mobile phones. Supported by relatively few sources which the Library / vendors / host organisation control. Supported by many varied and remote applications which May or may not report usage.

Library 1.0 activities:

Library catalogues,

Host organisation servers, or

Vendor services.

Library 2.0 activities:

Third party social networking services.

Content creation activities – blogging.

New platforms – Mobile phones.

Supported by relatively few sources which the

Library / vendors / host organisation control.

Supported by many varied and remote applications which

May or may not report usage.

Measuring Library 2.0 Mc2 proto-Library 2.0 social networking site. Hosted by the State Library of Victoria Library has Control over server and statistics.

Mc2 proto-Library 2.0 social networking site.

Hosted by the State Library of Victoria

Library has Control over server and statistics.

Measuring Library 2.0 Deakin university links catalogue to Facebook social networking site. Metrics and reporting controlled Facebook.

Deakin university links catalogue to Facebook social networking site.

Metrics and reporting controlled Facebook.

The pace of change, consider: The development of Library 1.0 metrics has been time consuming and considered . For example: COUNTER Codes of Practice. ISO 11620 standard [Library performance indicators], and ISO 2789 International library statistics. Association of Research Libraries (ARL) LibQual, DigiQual, MINES. The voting alone on the fourth edition of the ISO 11620 standard took place over a 5-month period between 14 August 2006 and 15 January 2007 How then do statistics work in the fast changing, beta is forever, world of Library 2.0

The development of Library 1.0 metrics has been time consuming and considered . For example:

COUNTER Codes of Practice.

ISO 11620 standard [Library performance indicators], and ISO 2789 International library statistics.

Association of Research Libraries (ARL) LibQual, DigiQual, MINES.

The voting alone on the fourth edition of the ISO 11620 standard took place over a 5-month period between 14 August 2006 and 15 January 2007

How then do statistics work in the fast changing, beta is forever, world of Library 2.0

Reporting 1.0 versus 2.0 Library 1.0 Annual Reports Quarterly Reports Monthly Reports Library 2.0 Annual Reports Quarterly Reports PLUS Real time reporting . This is what many Web 2.0 sites already do. Is the frequency and timeliness of traditional library reporting good enough in the Library 2.0 environment?

Library 1.0

Annual Reports

Quarterly Reports

Monthly Reports

Library 2.0

Annual Reports

Quarterly Reports PLUS

Real time reporting .

This is what many Web 2.0 sites already do.

Real time reporting and openness Web 2.0 opens up the possibility of using Statistics to engage with clients. As participants contributing content they are often develop a sense of ownership and or pride in the their content. Show them how it is used. Respond to the macro trend of increased accountability and transparency.

Web 2.0 opens up the possibility of using Statistics to engage with clients.

As participants contributing content they are often develop a sense of ownership and or pride in the their content.

Show them how it is used.

Respond to the macro trend of increased accountability and transparency.

Web 2.0 analytics Option 1: Google Google Analytics free and best suited for quick and easy applications or for smaller libraries. Google Urchin software (can be placed behind firewalls) better suited for larger libraries with more complex needs. LibraryThing runs on Google Urchin analytics software. GeoTargeting Find out where your visitors come from and identify your most lucrative geographic markets. Site Overlay See traffic and conversion information for every link as you browse your site (no download required). Funnel Visualization Find out which pages result in lost conversions and where your would-be customers go. Trend and Date Slider Compare time periods and select date ranges without losing sight of long term trends.

Web 2.0 analytics Option 1: Google Google Analytics is easy to set up. I set up Google analytics on my Learning 23 Blog. It took me 5 minutes. These figures are low but this is not the point this and the following page show the type of metrics you can harvest.

Web 2.0 analytics Option 1: Google Google Analytics also offers good graphic displays.

Web 2.0 analytics Option 2: Facebook Facebook also offers analytics. These are but two examples. Experiment, see what works for you!

Web 2.0 analytics: LibraryThing

Web 2.0 analytics: LibraryThing To paraphrase Murugesan (2007), what makes these LibraryThing statistics Web 2.0 compliant is that they: provide a rich source of information that is constantly updated, measure and report the harnessing of the LibraryThing user’s collaboration and content creation, and establish a sense of social networking, as the LibraryThing users can relate the macro level statistics against their own individual statistics.

To paraphrase Murugesan (2007), what makes these LibraryThing statistics Web 2.0 compliant is that they:

provide a rich source of information that is constantly updated,

measure and report the harnessing of the LibraryThing user’s collaboration and content creation, and

establish a sense of social networking, as the LibraryThing users can relate the macro level statistics against their own individual statistics.

Library 2.0 Metrics - Conclusion If Library 2.0 is about mash ups, then Library 2.0 statistics will be mashed up . We will consider the ways Library 2.0 statistics fit into our business plans , strategic plans , staff performance agreements , and budgets . We will still need to measure the what people are doing [ quantitative ] against user satisfaction [ qualitative ] We will still continue to report traditional statistics and present these in annual and quarterly and monthly reports, but

If Library 2.0 is about mash ups, then Library 2.0 statistics will be mashed up .

We will consider the ways Library 2.0 statistics fit into our business plans , strategic plans , staff performance agreements , and budgets .

We will still need to measure the what people are doing [ quantitative ] against user satisfaction [ qualitative ]

We will still continue to report traditional statistics and present these in annual and quarterly and monthly reports, but

Library 2.0 Metrics - Conclusion We will explore and integrate more open and real time information for our Library 2.0 participants. To do this we will leverage off the Web 2.0 statistic modules, and We will work to ensure we use the best and most reliable Web 2.0 statistic modules. We will also ensure we continue to develop our own industry statistics and best practices , and Continue to be proactive in the ways we report value to our host organisations.

We will explore and integrate more open and real time information for our Library 2.0 participants.

To do this we will leverage off the Web 2.0 statistic modules, and

We will work to ensure we use the best and most reliable Web 2.0 statistic modules.

We will also ensure we continue to develop our own industry statistics and best practices , and

Continue to be proactive in the ways we report value to our host organisations.

Strategic Opportunities Used strategically, Library 2.0 technologies and reporting could provide us with levers to positively position ourselves within our host organisations by demonstrating real value as we change spaces and move to virtual places.

Used strategically, Library 2.0 technologies and reporting could provide us with levers to positively position ourselves within our host organisations by demonstrating real value as we change spaces and move to virtual places.

Measuring your work and reporting your value as we move to Library 2.0 QUESTIONS