Audio presentation of auto-suggest lists Andy Brown Caroline Jay Simon Harper University of Manchester

Question How can dynamic information be presented non-visually?

An Example: the ASL

Auto-Suggest Lists

Making dynamic content accessible Understand if, how and when to present changes Most dynamic content is 'visual' So: How do sighted people use it? What benefits do sighted people get from the updates? How can those benefits be presented non-visually? SASWAT: Web 2.0 SASWAT: Web 2.0 SASWAT: Web 2.0

How do sighted people use it?

What benefits do sighted people get from the updates?

How can those benefits be presented non-visually?

Experiment Eye-tracking study Directed tasks and browsing on the Web Variety of dynamic content ASLs from Google, Yahoo and Kayak 30 participants 90 ASL encounters How do people attend to ASLs?

Eye-tracking study

Directed tasks and browsing on the Web

Variety of dynamic content

ASLs from Google, Yahoo and Kayak

30 participants

90 ASL encounters

Example video

Analysis: AOIs

Number of participants

Time to first fixation

Fixation Count

Fixation duration

Results All participants view the list (but don't always select from it) Suggestions fixated more than the input box Less than half of participants looked below suggestion 3 Higher suggestions received more attention: Suggestion 1: 75% of users for 2.5 fixations of 0.54s Suggestion 3: 39% of users for 1.9 fixations of 0.37s

All participants view the list (but don't always select from it)

Suggestions fixated more than the input box

Less than half of participants looked below suggestion 3

Higher suggestions received more attention:

Implications Users automatically view the suggestions even when they don't select one ⇒ suggestions appear to offer reassurance Not all parts of the update are of equal 'importance' ⇒ so which ARIA politeness setting?

Users automatically view the suggestions even when they don't select one

Not all parts of the update are of equal 'importance'

Non-visual ASL implementation Present suggestions automatically (when users pauses from typing) Rapidly read first 3 suggestions Allow navigation of remainder Stop reading suggestions when user types

Present suggestions automatically

Rapidly read first 3 suggestions

Allow navigation of remainder

Stop reading suggestions when user types

Conclusions Eye tracking can inform us about how updates are used Understanding how updates are useful can suggest audio implementations Proposed solution different from current screen readers Is ARIA sufficient?

Eye tracking can inform us about how updates are used

Understanding how updates are useful can suggest audio implementations

Proposed solution different from current screen readers

Is ARIA sufficient?

Future (ongoing) Work Test ASL implementation Consider other forms of dynamic content Content insertion Calendars Tickers Competing dynamic information Implementation and evaluation

Test ASL implementation

Consider other forms of dynamic content

Content insertion

Calendars

Tickers

Competing dynamic information

Implementation and evaluation

Data, results and detailed technical reports at: http://hcw-eprints.cs.man.ac.uk/ Questions?