Accessmonkey Jeffrey P. Bigham and Richard E. Ladner University of Washington Computer Science & Engineering W4A 2007 Scripting Accessibility

Goals Remove dependence on developers Enable users to improve content Enable users to share improvements More efficient development process Enable developers to leverage improvements Automated improvements as suggestions Introduction

Remove dependence on developers

Enable users to improve content

Enable users to share improvements

More efficient development process

Enable developers to leverage improvements

Automated improvements as suggestions

Accessible Content Production User Influence Choosing and configuring technology Consultation and Lawsuits Introduction

User Influence

Choosing and configuring technology

Consultation and Lawsuits

WebInSight 1 Introduction Making Images Accessible WebInSight

WebInSight (continued) Proxy-based system inadequate Wanted client-based solution Implemented as a Greasemonkey script Alternative text provided for web users Automatic improvement for users Suggestions for developers Other transformations share this property! Introduction

Proxy-based system inadequate

Wanted client-based solution

Implemented as a Greasemonkey script

Alternative text provided for web users

Automatic improvement for users

Suggestions for developers

Other transformations share this property!

Introduction Accessmonkey Example Usage Future Work Outline

Introduction

Accessmonkey

Example Usage

Future Work

Greasemonkey 1 Firefox Extension Allows users to inject custom Javascript Customize look and feel Combine data from multiple sites Alter pages to make them more accessible Desired features Include developers Used in multiple browsers Enable collaboration Accessmonkey [1] Greasemonkey Firefox Extension. http://greasemonkey.mozdev.org

Allows users to inject custom Javascript

Customize look and feel

Combine data from multiple sites

Alter pages to make them more accessible

Desired features

Include developers

Used in multiple browsers

Enable collaboration

Accessmonkey Preserves Greasemonkey Features Multiple browsers and platforms Framework for users and developers Web Developers Separate Interface Edit and save Accessmonkey Scripting Accessibility

Preserves Greasemonkey Features

Multiple browsers and platforms

Framework for users and developers

Web Developers

Separate Interface

Edit and save

Accessmonkey Framework Web developers Suggestions Web users Automatic Accessmonkey

Web developers

Suggestions

Web users

Automatic

Writing Scripts Who can write scripts? Anyone who can write Javascript Those who would directly benefit (and friends) Web Developers Developer interface Implementations provide area Allows users to toggle user/dev mode Accessmonkey

Who can write scripts?

Anyone who can write Javascript

Those who would directly benefit (and friends)

Web Developers

Developer interface

Implementations provide area

Allows users to toggle user/dev mode

More than Manual Annotation Removes dependence on Web Developers Users independently improve content Collaborative Accessibility Harnessing Human Power Amazon Mechanical Turk 1 ESP Game 2 [1] http://www.mturk.com/ [2] von Ahn et al . Labeling Image with a Computer Game . (CHI ‘04). Accessmonkey

Removes dependence on Web Developers

Users independently improve content

Collaborative Accessibility

Harnessing Human Power

Amazon Mechanical Turk 1

ESP Game 2

Introduction Accessmonkey Example Usage Future Work Outline

Introduction

Accessmonkey

Example Usage

Future Work

Example Usage Web users Find/create scripts they want Scripts transform pages automatically Web Developers Find/create scripts they want Use to edit pages Save changes Example Usage

Web users

Find/create scripts they want

Scripts transform pages automatically

Web Developers

Find/create scripts they want

Use to edit pages

Save changes

What else can scripts do? Personalized Edge Services 1 Many simple transformations Context-driven Web Browsing 2 Direct to content that matters Site-specific Scripts Anything! [1] Iaccarino et al. Personalizable edge services for web accessibility. [2] Mahmud et al. CSurf: A Context-Driven Non-Visual Web-Browser.

Personalized Edge Services 1

Many simple transformations

Context-driven Web Browsing 2

Direct to content that matters

Site-specific Scripts

Anything!

Menu: No Style Inefficient to Access

Inefficient to Access

Introduction Accessmonkey Example Usage Future Work Outline

Introduction

Accessmonkey

Example Usage

Future Work

Next Steps WebInSight Access Tools Script Writing Script Discovery Future Work

WebInSight Access Tools

Script Writing

Script Discovery

Easier Script Writing Existing tools Programming-by-Demonstration Web Macros 1 , WebVCR 2 , PLOW 3 , etc. Platypus Not targeted for improving accessibility Visual interfaces [1] Safonov et al . Web macros by example: users managing the www of applications . [2] Anupam et al. Automating web navigation with WebVCR . [3] Jung et al. One-shot procedure learning from instruction and observation . Future Work

Existing tools

Programming-by-Demonstration

Web Macros 1 , WebVCR 2 , PLOW 3 , etc.

Platypus

Not targeted for improving accessibility

Visual interfaces

Script Discovery Online Repository User-contributed scripts Discover As-You-Go Finds Applicable Scripts as a User Browses Find even if you can’t write Challenges Usability Maintaining Security Future Work

Online Repository

User-contributed scripts

Discover As-You-Go

Finds Applicable Scripts as a User Browses

Find even if you can’t write

Challenges

Usability

Maintaining Security

Conclusion Accessmonkey Extends influence to web users Allows web developers to benefit Leverages skill and motivation of users Embrace Web 2.0 Challenges need to be solved Potential to increase web accessibility

Accessmonkey

Extends influence to web users

Allows web developers to benefit

Leverages skill and motivation of users

Embrace Web 2.0

Challenges need to be solved

Potential to increase web accessibility

WebInSight http://webinsight.cs.washington.edu Thanks to: National Science Foundation , T.V. Raman, Sangyun Hahn, Oscar Danielsson, Gordon Hempton, Ryan Kaminsky, and GW Micro.