Developing and evaluating online learning resources and understanding online audiences How to make content work for your users Herbert Gallery 29 Oct 2009 Martin Bazley Online experience consultant Martin Bazley & Associates

Martin Bazley Previously Teaching (7 yrs) Science Museum, London, Internet Projects (7yrs) E-Learning Officer, MLA South East (3yrs) Currently Chair of E-Learning Group for Museums Consultancy, websites, training, user testing, evaluation … Martin Bazley & Associates www.martinbazley.com Slides and notes available afterwards

Previously

Teaching (7 yrs)

Science Museum, London, Internet Projects (7yrs)

E-Learning Officer, MLA South East (3yrs)

Currently

Chair of E-Learning Group for Museums

Consultancy, websites, training, user testing, evaluation … Martin Bazley & Associates www.martinbazley.com

Slides and notes available afterwards

www.martinbazley.com Note to self: check stats tomorrow to see if anyone looked up the website

Users don’t always ‘get’ what we are offering: a real–world analogy

Users don’t always ‘get’ what we are offering:

a real–world analogy

Even a slight difference in viewpoints… … can cause real problems for users

In a conflict between visual affordance … … and written instructions visual affordance almost always wins

So what is the point of all this?

So what is the point of all this?

The web is different

The web is different

People use the web differently…

People use the web differently…

… from the way they use books, object labels, magazines, newspapers, information screens, etc

… from the way they use books, object labels, magazines, newspapers, information screens, etc

For most people the web is a predominantly visual medium

For most people the web is a predominantly visual medium

We are all different and some people like to read all the text on a web page before deciding what to do next, even though a lot of it might be pretty redundant but most people – or at least most regular users of the web – scan ( as opposed to reading through them in detail) the web pages they are using, or at least the ones where they are still trying to work out where to go next

We are all different and some people like to read all the text on a web page before deciding what to do next, even though a lot of it might be pretty redundant but most people – or at least most regular users of the web – scan ( as opposed to reading through them in detail) the web pages they are using, or at least the ones where they are still trying to work out where to go next

Users won't read your text thoroughly word-by-word. Exhaustive reading is rare, especially when browsing. Yes, some people will read more, but most won't.

Users won't read your text thoroughly word-by-word. Exhaustive reading is rare, especially when browsing. Yes, some people will read more, but most won't.

The first two paragraphs must state the most important information . There's some hope that users will actually read this material – though they'll probably read more of the first paragraph than the second.

The first two paragraphs must state the most important information . There's some hope that users will actually read this material – though they'll probably read more of the first paragraph than the second.

Start subheadings, paragraphs, and bullet points with information-carrying words that users will notice when scanning down the left side of your content in the final stem of their F-behaviour. They'll read the third word on a line much less often than the first two words.

Start subheadings, paragraphs, and bullet points with information-carrying words that users will notice when scanning down the left side of your content in the final stem of their F-behaviour. They'll read the third word on a line much less often than the first two words.

If they have to work at it for example if they cannot see what they are looking for, or if it doesn’t make sense to them at first glance then most people – or at least many people who do a lot of searching or browsing on the web just decide that this particular site is not for them, and anyway they have a long list of other search results or ideas to try and so they go elsewhere

If they have to work at it for example if they cannot see what they are looking for, or if it doesn’t make sense to them at first glance then most people – or at least many people who do a lot of searching or browsing on the web just decide that this particular site is not for them, and anyway they have a long list of other search results or ideas to try and so they go elsewhere

Exercise: Make this web page better

Exercise: Make this web page better

About website structure, ways people use the web and implications for writing for the web

About website structure, ways people use the web and implications for writing for the web

Certain types of websites impose linear user journeys: TheTrainline.com Cinema ticket bookings Self assessment tax return online

Certain types of websites impose linear user journeys:

TheTrainline.com

Cinema ticket bookings

Self assessment tax return online

In most websites, although there are some linear elements …

In most websites, although there are some linear elements …

… people like to have other pathways available to them…

… people like to have other pathways available to them…

… and most journeys are very non-linear

… and most journeys are very non-linear

Also, most people reach your website via Google Only 5% arrive at your website on the home page

Also, most people reach your website via Google

Only 5% arrive at your website on the home page

Most of the other 95% may not have had your site in mind when searching

Most of the other 95% may not have had your site in mind when searching

30% of them go to home page to ‘try and work out what this site is about’

30% of them go to home page to ‘try and work out what this site is about’

So each page on the site must quickly: engage users and give sense of what site is about – otherwise most will leave

So each page on the site must quickly:

engage users and

give sense of what site is about – otherwise most will leave

‘Writing for the web’ is not just about text…

‘Writing for the web’ is not just about text…

… but also choosing the right images … layouts … graphical look and feel …website structure etc etc

… but also choosing the right images

… layouts

… graphical look and feel

…website structure

etc etc

Key point of paragraph/ section Image clearly related to text Broken into short paras

Home page: key functions Offer overview: Show user what the site offers them Show user what is in the site: The structure at a glance Content highlights or samples Engagement: make user want to continue browsing

Offer overview:

Show user what the site offers them

Show user what is in the site:

The structure at a glance

Content highlights or samples

Engagement:

make user want to continue browsing

Article page: key functions Engage the user – make them want to consume the article Signposting: Show user what else is nearby in the site The structure at a glance Show user what else the site offers them www.mylearning.org/overview.asp?journeyid=73 www.manchestergalleries.org /

Engage the user – make them want to consume the article

Signposting:

Show user what else is nearby in the site

The structure at a glance

Show user what else the site offers them

www.mylearning.org/overview.asp?journeyid=73

www.manchestergalleries.org /

Short video guides http://www.mediabistro.com/guidelines-for-writing-online-12-ondemandvideo.html (sample) http://www.youtube.com/watch?v=AoU2yANNxRs&eurl=http://inside.123-reg.co.uk/archives/video-writing-your-web-copy http://www.youtube.com/watch?v=2C3lDeY6uWc&feature=related (good advice but v slow) Writing web headlines http://www.youtube.com/watch?v=zBg7dJIfHM0

http://www.mediabistro.com/guidelines-for-writing-online-12-ondemandvideo.html (sample)

http://www.youtube.com/watch?v=AoU2yANNxRs&eurl=http://inside.123-reg.co.uk/archives/video-writing-your-web-copy

http://www.youtube.com/watch?v=2C3lDeY6uWc&feature=related (good advice but v slow)

Writing web headlines http://www.youtube.com/watch?v=zBg7dJIfHM0

Website users

Website users Who uses your website? Why would they want to use it? How would they find it? What do they get out of it? What do they dislike about it?

Who uses your website?

Why would they want to use it?

How would they find it?

What do they get out of it?

What do they dislike about it?

How do you get it right for everyone? Answer: You can’t get it right for everyone. You have to make choices, and stick to them: Who is it for? What.. How…

Answer:

You can’t get it right for everyone.

You have to make choices, and stick to them:

Who is it for?

What..

How…

Who for…? What for? How will they use it?

Who for what for ... Who for? (audience) Need to be clear from start mum + 2 children looking for something to do this weekend teachers of yr5/6 in local area with whiteboards men interested in gadgets

Who for? (audience)

Need to be clear from start

mum + 2 children looking for something to do this weekend

teachers of yr5/6 in local area with whiteboards

men interested in gadgets

Who for what for ... What ‘real-world’ outcomes? What will they do as a result of using the site? make a donation plan a visit to a museum buy a train ticket think differently about learning disability

What ‘real-world’ outcomes?

What will they do as a result of using the site?

make a donation

plan a visit to a museum

buy a train ticket

think differently about learning disability

Who for what for ... How will they use it? (user experience) What do they actually do on the site? browse and read articles working alone or in pairs? (learning resources) lean forward or sit back? Browsing, following, searching… Also Where, When and Why ?

How will they use it? (user experience)

What do they actually do on the site?

browse and read articles

working alone or in pairs? (learning resources)

lean forward or sit back?

Browsing, following, searching…

Also Where, When and Why ?

Who for what for ... Website appraisal For each example note first impressions Who is it for? What does it offer them? How will they use it?

Website appraisal

For each example note first impressions

Who is it for?

What does it offer them?

How will they use it?

Using whiteboards http:// www.teachers.tv/ict/whiteboardtips http:// smarttech.com/trainingcenter/tutorials.asp # http:// www.prometheanplanet.com

http:// www.teachers.tv/ict/whiteboardtips

http:// smarttech.com/trainingcenter/tutorials.asp #

http:// www.prometheanplanet.com

Roles of IWB … at different points in the lesson / learning cycle Starter Main Plenary

… at different points in the lesson / learning cycle

Starter

Main

Plenary

Interactive ” means “ lots of things moving on screen, clickable, automatic response, quizzes etc interaction between students, teacher and screen – activities, conversation, cognitive engagement, etc first meaning used mainly by companies trying to market whiteboards, software etc as ‘interactive’ second used mainly by educators

“ lots of things moving on screen, clickable, automatic response, quizzes etc

interaction between students, teacher and screen – activities, conversation, cognitive engagement, etc

first meaning used mainly by companies trying to market whiteboards, software etc as ‘interactive’

second used mainly by educators

Resources for use on whiteboards - examples Ford Madox Brown MAG Tate Tools Museum Network Artworks Museum Network Myths National Portrait Gallery Mary Seacole National Gallery Museum of London Fire of London

Ford Madox Brown MAG

Tate Tools

Museum Network Artworks

Museum Network Myths

National Portrait Gallery Mary Seacole

National Gallery

Museum of London Fire of London

Resources for use on whiteboards - examples Britons at War Wartime in Bedford http://www.movinghere.org.uk/schools/default.htm www.mylearning.org/overview.asp?journeyid =409 www.mylearning.org/overview.asp?journeyid =441

Britons at War

Wartime in Bedford

http://www.movinghere.org.uk/schools/default.htm

www.mylearning.org/overview.asp?journeyid =409

www.mylearning.org/overview.asp?journeyid =441

Devise a whiteboard resource Choose one or two images, and think of how they might be used on a IWB Decide how/where teachers would find this 3. Caption 4. Key question(s) What else will the teacher need? What else will the pupils need? Don’t worry too much about accuracy – just get something on screen

Devise a whiteboard resource

Choose one or two images, and think of how they might be used on a IWB

Decide how/where teachers would find this

3. Caption

4. Key question(s)

What else will the teacher need?

What else will the pupils need?

Don’t worry too much about accuracy – just get something on screen

Websites for different audiences

Websites for different audiences The following tips are based on numerous evaluation sessions numerous user testing sessions talking to other people who use websites talking to other people who make websites

The following tips are based on

numerous evaluation sessions

numerous user testing sessions

talking to other people who use websites

talking to other people who make websites

‘General users’ There is no such thing as a general user Are you a general user?

There is no such thing as a general user

Are you a general user?

Adults/families with general interest What does the site tell me at a glance? genuine enthusiasts = interested whatever the website looks like, and will spend some time looking around it or phone up for more information if required.

What does the site tell me at a glance?

genuine enthusiasts = interested whatever the website looks like, and will spend some time looking around it or phone up for more information if required.

Adults/families with general interest But most will not bother unless something engages them within a few seconds The questions people might like answered within a few seconds of arriving on a museum site probably include:

But most will not bother unless something engages them within a few seconds

The questions people might like answered within a few seconds of arriving on a museum site probably include:

Adults/families with general interest Where is it? Further down the home page it says ‘alongside Middle Wallop airfield’ but I have no idea where that is. a schematic map on every page, or at least on the home page and visit info, would really help in attracting visitors who don’t know the area

Where is it? Further down the home page it says ‘alongside Middle Wallop airfield’ but I have no idea where that is.

a schematic map on every page, or at least on the home page and visit info, would really help in attracting visitors who don’t know the area

Adults/families with general interest What’s the rough cost and roughly how long might I/we want to spend there? This would give me an idea of whether to view it as a place to pop into on the way somewhere or combine it with another attraction; or whether it requires more serious investment of time or money

What’s the rough cost and roughly how long might I/we want to spend there? This would give me an idea of whether to view it as a place to pop into on the way somewhere or combine it with another attraction; or whether it requires more serious investment of time or money

Adults/families with general interest What kind of experience will I get? I know there will be ‘displays’ – it is a museum! but will there be people around to help bring the place alive for me, my spouse, my children or friends? – or are there events, or things to do like dressing up in a pilot’s uniform, or games to play, etc?

What kind of experience will I get? I know there will be ‘displays’ – it is a museum!

but will there be people around to help bring the place alive for me, my spouse, my children or friends?

– or are there events, or things to do like dressing up in a pilot’s uniform, or games to play, etc?

Websites for schools ‘ Serve the National Curriculum’ or ‘extend or enhance’? ‘ enhance’ sounds good but most teachers want : curriculum specific – by all means cross-curricular but with one scheme of work or topic as ‘headline’ (think ‘product byline’) ready-to-use – teachers may want to adapt to their own situation (esp second time round), but most will not have time – offer at least one ready to use version minimal preparation and with time commitment (preparation time and class time) clearly specified flexible/adaptable/extensible where possible

‘ Serve the National Curriculum’ or ‘extend or enhance’?

‘ enhance’ sounds good but most teachers want :

curriculum specific – by all means cross-curricular but with one scheme of work or topic as ‘headline’ (think ‘product byline’)

ready-to-use – teachers may want to adapt to their own situation (esp second time round), but most will not have time – offer at least one ready to use version

minimal preparation and with time commitment (preparation time and class time) clearly specified

flexible/adaptable/extensible where possible

Foundation and KS1 (3-7yrs) Production of materials for this age range is particularly tricky: aim at teachers not children, so… good bank of images, videos or other mainly visual assets think of interactive whiteboards

Production of materials for this age range is particularly tricky:

aim at teachers not children, so…

good bank of images, videos or other mainly visual assets

think of interactive whiteboards

Key Stage 2 ( 7 to 11 years old) keep no of words on each page to a minimum, say 50 in total illustrate key ideas visually as well as verbally and use audio if possible do not assume that the teacher can be over their shoulder at all points – so keep the instructions and processes simple try to use language, images, ideas, and settings that will appeal to the target audience

keep no of words on each page to a minimum, say 50 in total

illustrate key ideas visually as well as verbally and use audio if possible

do not assume that the teacher can be over their shoulder at all points – so keep the instructions and processes simple

try to use language, images, ideas, and settings that will appeal to the target audience

Key Stage 3 ( 11 to 14 years old) For KS2 a cross-curricular approach is OK (for example they may use the same site for Geography and Science) but: At KS3 cater for a single subject (and scheme of work) (Can offer suggestions for cross-curricular working, but remember generally each teacher teachers only one subject each.)

For KS2 a cross-curricular approach is OK (for example they may use the same site for Geography and Science) but:

At KS3 cater for a single subject (and scheme of work)

(Can offer suggestions for cross-curricular working, but remember generally each teacher teachers only one subject each.)

‘ Lifelong learners’ for (non-specialist) interest level think of 12 yr olds Identify a particular audience with specific interests/motivations for using your site then focus on constraints to allow successful design to proceed. (In a formal learning setting constraints often implicit in the course, physical set up etc.)

for (non-specialist) interest level think of 12 yr olds

Identify a particular audience with specific interests/motivations for using your site

then focus on constraints to allow successful design to proceed. (In a formal learning setting constraints often implicit in the course, physical set up etc.)

Specialist researchers Fact-oriented, less graphics and design, more text and specifically relevant images, with good search facility Examples of specialist researchers: HE students and staff experts or enthusiasts in this subject area

Fact-oriented, less graphics and design, more text and specifically relevant images, with good search facility

Examples of specialist researchers:

HE students and staff

experts or enthusiasts in this subject area

Accessibility tips http://www.w3.org/WAI/ Images & animations : Use the alt attribute to describe the function of each visual. Image maps. Use the client-side map and text for hotspots . Multimedia. Provide captioning and transcripts of audio , and descriptions of video . Hypertext links . Use text that makes sense when read out of context. For example, avoid "click here." Frames. Use the noframes element and meaningful titles . Etc, etc. Also: http://diveintoaccessibility.org Illustrates real life implications e.g. Javascript

http://www.w3.org/WAI/

Images & animations : Use the alt attribute to describe the function of each visual.

Image maps. Use the client-side map and text for hotspots .

Multimedia. Provide captioning and transcripts of audio , and descriptions of video .

Hypertext links . Use text that makes sense when read out of context. For example, avoid "click here."

Frames. Use the noframes element and meaningful titles .

Etc, etc. Also:

http://diveintoaccessibility.org

Illustrates real life implications e.g. Javascript

Accessibility A website can achieve AAA level accessibility (www.w3.org/WAI/ ) based on automated tests, and yet be almost unusable by many users

Accessibility

A website can achieve AAA level accessibility (www.w3.org/WAI/ ) based on automated tests, and yet be almost unusable by many users

Improving general usability for a wide range of user types yields the best results. City University audit (2005): 4 out of 8 technical checkpoints that cause the majority of web access problems for disabled users relate to writing and laying out textual content .

Improving general usability for a wide range of user types yields the best results.

City University audit (2005):

4 out of 8 technical checkpoints that cause the majority of web access problems for disabled users relate to writing and laying out textual content .

To improve accessibility: 1. divide blocks of information into more manageable units 2. provide a text equivalent for every non-text element 3. clearly identify the target of each link 4. use the clearest and simplest language appropriate for the site’s content (from enableUK – accessibility specialist)

To improve accessibility:

1. divide blocks of information into more manageable units

2. provide a text equivalent for every non-text element

3. clearly identify the target of each link

4. use the clearest and simplest language appropriate for the site’s content

(from enableUK – accessibility specialist)

Search Engine Optimisation - article

Search Engine Optimisation

- article

Short video guides http://www.mediabistro.com/guidelines-for-writing-online-12-ondemandvideo.html (sample) http://www.youtube.com/watch?v=AoU2yANNxRs&eurl=http://inside.123-reg.co.uk/archives/video-writing-your-web-copy http://www.youtube.com/watch?v=2C3lDeY6uWc&feature=related (good advice but v slow) Writing web headlines http://www.youtube.com/watch?v=zBg7dJIfHM0

http://www.mediabistro.com/guidelines-for-writing-online-12-ondemandvideo.html (sample)

http://www.youtube.com/watch?v=AoU2yANNxRs&eurl=http://inside.123-reg.co.uk/archives/video-writing-your-web-copy

http://www.youtube.com/watch?v=2C3lDeY6uWc&feature=related (good advice but v slow)

Writing web headlines http://www.youtube.com/watch?v=zBg7dJIfHM0

Whiteboard resource exercise We are using Powerpoint (or Word if you prefer) just to summarise your ideas on the board. Don’t spend too long formatting / designing – just focus on what items, text and links would be on screen, and What teacher / pupils would do with them

We are using Powerpoint (or Word if you prefer) just to summarise your ideas on the board.

Don’t spend too long formatting / designing – just focus on

what items, text and links would be on screen, and

What teacher / pupils would do with them

‘templates’ The following slide (Britons at War) is a sample web page – think about how people would get to your whiteboard page(s) The next slide is an outline template for a whiteboard page – edit or ignore this completely. Make sure you have at least something to show on screen

The following slide (Britons at War) is a sample web page – think about how people would get to your whiteboard page(s)

The next slide is an outline template for a whiteboard page – edit or ignore this completely.

Make sure you have at least something to show on screen

Search Adv search Britons at War banner Home Topics Resources Schools area Ways to use this site About this site Search BaW logo Home | About | Links | Contact | Sitemap an online resource for schools NMPFT logo link to home YFA logo link to home Topic: Bombing Thumbnails of photos + films, etc for this topic Link to Photo pages Bombing Rationing Local life Home Guard Women and children Evacuation Guy Fawkes Day 1944 Prisoners of War Whit Sunday in Hyde Park VE Day Brief introduction to Topic: Bombing Asfd Asdf sadf

About this image (caption, copyright, etc) Also key question? Title / heading if needed – otherwise delete this box.

How can we get a sense of who our online visitors are and what they do with our online content? How do we gather data to help us improve what we do? How do we measure success from the user's point of view, and against our own objectives and constraints? For example, how justify investment (or lack of it) in social networks etc?

How can we get a sense of who our online visitors are and what they do with our online content?

How do we gather data to help us improve what we do?

How do we measure success from the user's point of view, and against our own objectives and constraints?

For example, how justify investment (or lack of it) in social networks etc?

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Define audience research goal Analyse data Collect data Use results to guide changes Plan methodology

Reasons for doing audience research: Evaluation Did your project/product/service do what you wanted it to do? Provide information for stakeholders Gauge audience satisfaction

Did your project/product/service do what you wanted it to do?

Provide information for stakeholders

Gauge audience satisfaction

Reasons for doing audience research: Promotion Improve your offer for your target audiences Increase usage Widen access

Improve your offer for your target audiences

Increase usage

Widen access

Reasons for doing audience research: Planning Inform development of a new product/service Inform business planning Prove interest in a related activity

Inform development of a new product/service

Inform business planning

Prove interest in a related activity

Tools available Qualitative – focus groups, “free text” questions in surveys, interviews Quantitative – web statistics, “multiple choice” questions in surveys, visitor tracking Observational – user testing, ethnographic

Qualitative – focus groups, “free text” questions in surveys, interviews

Quantitative – web statistics, “multiple choice” questions in surveys, visitor tracking

Observational – user testing, ethnographic

When to evaluate or test and why Before funding approval – project planning Post-funding - project development Post-project – summative evaluation

Before funding approval – project planning

Post-funding - project development

Post-project – summative evaluation

Testing is an iterative process Testing isn’t something you do once Make something => test it => refine it => test it again

Testing isn’t something you do once

Make something

=> test it

=> refine it

=> test it again

Before funding – project planning *Evaluation of other websites Who for? What for? How use it? etc awareness raising: issues, opportunities contributes to market research possible elements, graphic feel etc *Concept testing check idea makes sense with audience reshape project based on user feedback Focus group Research

*Evaluation of other websites

Who for? What for? How use it? etc

awareness raising: issues, opportunities

contributes to market research

possible elements, graphic feel etc

*Concept testing

check idea makes sense with audience

reshape project based on user feedback

Post-funding - project development *Concept testing refine project outcomes based on feedback from intended users Refine website structure does it work for users? *Evaluate initial look and feel graphics,navigation etc Focus group Focus group One-to-one tasks

*Concept testing

refine project outcomes based on feedback from intended users

Refine website structure

does it work for users?

*Evaluate initial look and feel

graphics,navigation etc

Post-funding - project development 2 *Full evaluation of a draft working version usability AND content: do activities work, how engaging is it, what else could be offered, etc Observation of actual use of website by intended users , using it for intended purpose , in intended context – workplace, classroom, library, home, etc

*Full evaluation of a draft working version

usability AND content: do activities work, how engaging is it, what else could be offered, etc

Video clips Moving Here key ideas not lesson plans etc

Video clips Moving Here key ideas not lesson plans etc

Post-funding - project development 3 Acceptance testing of ‘finished’ website last minute check, minor corrections only often offered by web developers Summative evaluation report for funders, etc learn lessons at project level for next time

Acceptance testing of ‘finished’ website

last minute check, minor corrections only

often offered by web developers

Summative evaluation

report for funders, etc

learn lessons at project level for next time

Website evaluation and testing Need to think ahead a bit: what are you trying to find out? how do you intend to test it? why? what will do you do as a result ? The Why? should drive this process

Need to think ahead a bit:

what are you trying to find out?

how do you intend to test it?

why? what will do you do as a result ?

The Why? should drive this process

User test early Testing one user early on in the project… … is better than testing 50 near the end

Testing one user early on in the project…

… is better than testing 50 near the end

Two usability testing techniques “ Get it” testing - do they understand the purpose, how it works, etc Key task testing ask the user to do something, watch how well they do Ideally, do a bit of each, in that order

“ Get it” testing

- do they understand the purpose, how it works, etc

Key task testing

ask the user to do something, watch how well they do

Ideally, do a bit of each, in that order

User testing – who should do it? The worst person to conduct (or interpret) user testing of your own site is… you! Beware of hearing what you want to hear… Useful to have an external viewpoint First 5mins in a genuine setting tells you 80% of what’s wrong with the site

The worst person to conduct (or interpret) user testing of your own site is…

you!

Beware of hearing what you want to hear…

Useful to have an external viewpoint

First 5mins in a genuine setting tells you 80% of what’s wrong with the site

Understanding online audiences Study conducted for London Museums Hub

Study conducted for London Museums Hub

Geffrye Museum web stats linked with events etc

EM Online collections research by MHM

What we found out Link between websites and physical visits Majority of web use is for planning visits Only about half use the website before visiting the museum Some websites failing to create appropriate impressions of the physical museums, so failing to attract undecided visitors >N Confusion re difference between stored and displayed collections

Link between websites and physical visits

Majority of web use is for planning visits

Only about half use the website before visiting the museum

Some websites failing to create appropriate impressions of the physical museums, so failing to attract undecided visitors >N

Confusion re difference between stored and displayed collections

What we found out Very little use of websites other than for planning the visit, except: Teachers – looking for teaching materials and ideas Families – looking for online games, homework etc Comment re online collection browsing: researching/searching, following, browsing ( MHM)

Very little use of websites other than for planning the visit, except:

Teachers – looking for teaching materials and ideas

Families – looking for online games, homework etc

Comment re online collection browsing: researching/searching, following, browsing ( MHM)

What we found out Very little interest in ‘user generated content’, but… … this may be because most do not yet understand the possibilities, partly because trends moving so quickly. More research required, based on specific proposals

Very little interest in ‘user generated content’, but…

… this may be because most do not yet understand the possibilities, partly because trends moving so quickly. More research required, based on specific proposals

Strengths and weaknesses of different data gathering techniques

Strengths and weaknesses of different data gathering techniques

Data gathering techniques User testing - early in development and again near end Online questionnaires – emailed to people or linked from website Focus groups - best near beginning of project, or at redevelopment stage Visitor surveys - link online and real visits Web stats - useful for long term trends /events etc

User testing - early in development and again near end

Online questionnaires – emailed to people or linked from website

Focus groups - best near beginning of project, or at redevelopment stage

Visitor surveys - link online and real visits

Web stats - useful for long term trends /events etc

Need to distinguish between: Diagnostics – making a project or service better Reporting – to funders, or for advocacy

Need to distinguish between:

Diagnostics – making a project or service better

Reporting

– to funders, or for advocacy

Online questionnaires (+) once set up they gather numerical and qualitative data with no further effort – given time can build up large datasets (+) the datasets can be easily exported and manipulated, can be sampled at various times, and structured queries can yield useful results (–) respondents are self-selected and this will skew results – best to compare with similar data from other sources, like visitor surveys (–) the number and nature of responses may depend on how the online questionnaire is displayed and promoted on the website

(+) once set up they gather numerical and qualitative data with no further effort – given time can build up large datasets

(+) the datasets can be easily exported and manipulated, can be sampled at various times, and structured queries can yield useful results

(–) respondents are self-selected and this will skew results – best to compare with similar data from other sources, like visitor surveys

(–) the number and nature of responses may depend on how the online questionnaire is displayed and promoted on the website

Focus groups (+) can explore specific issues in more depth, yielding rich feedback (+) possible to control participant composition to ensure representative (–) comparatively time-consuming (expensive) to organise and analyse (–) yield qualitative data only - small numbers mean numerical comparisons are unreliable

(+) can explore specific issues in more depth, yielding rich feedback

(+) possible to control participant composition to ensure representative

(–) comparatively time-consuming (expensive) to organise and analyse

(–) yield qualitative data only - small numbers mean numerical comparisons are unreliable

Visitor surveys (+) possible to control participant composition to ensure representative (–) comparatively time-consuming (expensive) to organise and analyse (–) responses can be affected by various factors including interviewer, weather on the day, day of the week, etc, reducing validity of numerical comparisons between museums

(+) possible to control participant composition to ensure representative

(–) comparatively time-consuming (expensive) to organise and analyse

(–) responses can be affected by various factors including interviewer, weather on the day, day of the week, etc, reducing validity of numerical comparisons between museums

Web stats (+) Easy to gather data – can decide what to do with it later (+) Person-independent data generated - it is the interpretation, rather than the data themselves, which is subjective. This means others can review the same data and verify or amend initial conclusions reached

(+) Easy to gather data – can decide what to do with it later

(+) Person-independent data generated - it is the interpretation, rather than the data themselves, which is subjective. This means others can review the same data and verify or amend initial conclusions reached

Web stats (–) Different systems generate different data for the same web activity – for example no of unique visits measured via Google Analytics is generally lower than that derived via server log files (–) Metrics are complicated and require specialist knowledge to appreciate them fully

(–) Different systems generate different data for the same web activity – for example no of unique visits measured via Google Analytics is generally lower than that derived via server log files

(–) Metrics are complicated and require specialist knowledge to appreciate them fully

Web stats (–) As the amount of off-website web activity increases (e.g. Web 2.0 style interactions) the validity of website stats decreases, especially for reporting purposes, but also for diagnostics (–) Agreeing a common format for presentation of data and analysis requires collaborative working to be meaningful

(–) As the amount of off-website web activity increases (e.g. Web 2.0 style interactions) the validity of website stats decreases, especially for reporting purposes, but also for diagnostics

(–) Agreeing a common format for presentation of data and analysis requires collaborative working to be meaningful

What is Web 2.0?

What is Web 2.0?

Web 2.0 … Web 2.0 is a vague label refers to recent trends in attitudes and ways of using the web , not specific technical developments.

Web 2.0 is a vague label

refers to recent trends in attitudes and ways of using the web , not specific technical developments.

Web 2.0 is … A continually evolving spectrum of approaches, embodying User focus Agile development ‘always Beta’ Social trust User generated content ‘ by and for users of a particular group’

A continually evolving spectrum of approaches, embodying

User focus

Agile development

‘always Beta’

Social trust

User generated content ‘ by and for users of a particular group’

Web 2.0 is … A continually evolving raft of technologies (distributed services) Blogs, podcasts, RSS events etc Wikis – collaborative workspaces Mash ups – live data, filtered/combined Social networking (Facebook, Bebo, Linked In etc) Social bookmarking (del.icio.us) social tagging

A continually evolving raft of technologies (distributed services)

Blogs, podcasts, RSS events etc

Wikis – collaborative workspaces

Mash ups – live data, filtered/combined

Social networking (Facebook, Bebo, Linked In etc)

Social bookmarking (del.icio.us)

social tagging

Web 2.0 is … A continually evolving set of companies including Google Yahoo Flickr YouTube del.icio.us Twitter Upcoming etc

A continually evolving set of companies including

Google

Yahoo

Flickr

YouTube

del.icio.us

Twitter

Upcoming

etc

Web 2.0 examples Google – various apps TripAdvisor – wisdom of crowds / social reviewing Flickr example YouTube example Events, other information – wouldn’t it be great if you could just note your information once, and it would appear anywhere on the web where people might want it? => RSS and aggregated databases

Google – various apps

TripAdvisor – wisdom of crowds / social reviewing Flickr example

YouTube example

Events, other information – wouldn’t it be great if you could just note your information once, and it would appear anywhere on the web where people might want it? => RSS and aggregated databases

Martin Bazley 0780 3580 737 www.martinbazley.com More information / advice / ideas

Martin Bazley

0780 3580 737

www.martinbazley.com