Web Browser Accessibility using Open-Source Software

3,149 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
3,149
On SlideShare
0
From Embeds
0
Number of Embeds
51
Actions
Shares
0
Downloads
65
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Web Browser Accessibility using Open-Source Software

    1. 1. Web Browser Accessibility using Open-Source Software http:// amico.sourceforge.net Željko Obrenović Jacco van Ossenbruggen Semantic Media Interfaces CWI, Amsterdam [email_address] http:// www.cwi.nl/~obrenovi /
    2. 2. Introduction <ul><li>Accessible Web Browser requires novel interaction modalities </li></ul><ul><ul><li>Speech input and output for blind users </li></ul></ul><ul><ul><li>Gestures, head movement for spinal cord injured </li></ul></ul><ul><ul><li>Multilingual translation… </li></ul></ul><ul><ul><li>Combination of modalities </li></ul></ul><ul><li>Web is more and more interactive </li></ul><ul><ul><li>Web 2.0 – promises much more interactivity… </li></ul></ul><ul><ul><li>But it is hard to go beyond modalities supported by the browser (screen, keyboard, mouse) </li></ul></ul>
    3. 3. Some Existing Solutions <ul><li>Browser Extensions </li></ul><ul><ul><li>Easy to build by most of developers </li></ul></ul><ul><ul><li>Problem of integration of complex code </li></ul></ul><ul><li>Specially Designed Browsers </li></ul><ul><ul><li>Less functional, not very popular </li></ul></ul><ul><ul><li>Label users as &quot;disabled“ </li></ul></ul><ul><li>Adapted Open Source Browsers </li></ul><ul><ul><li>Complexity of development and maintenance of code </li></ul></ul><ul><ul><ul><li>Firefox 1.5.0.2: 10,970 files, 2,172,520 lines of code </li></ul></ul></ul><ul><ul><li>Limited by technologies used by browser </li></ul></ul>
    4. 4. Potential of Open Source and Free Software <ul><li>Available OSS components, however, may support novel interaction modalities </li></ul><ul><ul><li>Computer vision: OpenCV, HandVu… </li></ul></ul><ul><ul><li>Speech: FreeTTS, MaryTTS, Sphinx-4… </li></ul></ul><ul><ul><li>Language tools: WordNet, ConceptNet… </li></ul></ul><ul><ul><li>Translation services… </li></ul></ul><ul><li>Can we better exploit OSS solutions, and reuse them with Web (2.0) technologies? </li></ul><ul><li>Example: Speech control of Google Maps: </li></ul>
    5. 5. All you do is put it together? <ul><ul><li>Many prog. languages </li></ul></ul><ul><ul><li>Many APIs </li></ul></ul><ul><ul><li>Semantic and temporal differences </li></ul></ul><ul><ul><ul><li>High-level Web XML-based APIs </li></ul></ul></ul><ul><ul><ul><li>Low-level APIs of the device world </li></ul></ul></ul><ul><ul><li>Fault tolerance </li></ul></ul><ul><ul><li>Flexible integration </li></ul></ul><ul><li>Why it is so hard to use OSS? </li></ul>
    6. 6. Our Solution: AMICO:WEB http://amico.sourceforge.net/ <ul><li>Service-based loosely-coupled integration </li></ul><ul><ul><li>Encapsulation OSS components as local or remote services </li></ul></ul><ul><ul><li>Solves the language issue, many OSS already provide service interfaces </li></ul></ul><ul><ul><ul><li>Run OSS service as a process, functionality through open API </li></ul></ul></ul><ul><li>Two parts: </li></ul><ul><ul><li>AMICO: A daptable M ulti- I nterface CO mmunicator </li></ul></ul><ul><ul><li>Web Integration Interfaces </li></ul></ul>Web Browser Web Integration Interfaces AMICO OSS Components
    7. 7. AMICO A daptable M ulti- I nterface CO mmunicator <ul><li>Publish-subscribe communication service: </li></ul><ul><ul><li>share data & exchange messages </li></ul></ul><ul><ul><li>run components as services </li></ul></ul><ul><li>More APIs (TCP, UDP, XML-RPC, OSC, SOAP, SQL…) </li></ul><ul><li>Fault tolerance by loosely coupled integration </li></ul><ul><li>Temporal and data bridging </li></ul><ul><ul><li>Low-level and high-level variables and transformations </li></ul></ul><ul><li>D ecl arative XML abstraction , rapid prototyping </li></ul><ul><ul><li>Flexible integration and reuse of components </li></ul></ul>Web Browser Web Integration Interfaces AMICO OSS Components
    8. 8. AMICO:WEB – Browser Integration <ul><li>Browser extensions (Firefox) </li></ul><ul><ul><li>Based on SIMILE Java Firefox extension </li></ul></ul><ul><ul><li>Use AMICO TCP and UDP interfaces </li></ul></ul><ul><li>AJAX </li></ul><ul><ul><li>Use AMICO HTTP Interaface (XMLHttpRequest) </li></ul></ul><ul><li>Applets and scripts </li></ul><ul><ul><li>TCP connection </li></ul></ul>Also in combination with extension such as Mozilla GreaseMonkey }
    9. 9. AMICO Example 1 / 2 <ul><li>Translation service </li></ul><ul><ul><li>BabelFish service  Text-to-speech </li></ul></ul><ul><ul><li>Problems of combining (legacy) Web services , local components and browser components : </li></ul></ul><ul><ul><ul><li>BabelFish Web Service </li></ul></ul></ul><ul><ul><ul><li>3 TTS engines: FreeTTS (English), Festival (Dutch), Mary (German, Tibetan) </li></ul></ul></ul><ul><ul><ul><li>Local database (MySQL, MS Access) </li></ul></ul></ul><ul><ul><ul><li>Browser toolbar as an interface </li></ul></ul></ul>
    10. 10. AMICO Example 2 / 2 <ul><li>Camera-based modalities – interaction with 3D (VRML) Web content </li></ul><ul><li>Problem of temporal mapping </li></ul><ul><ul><li>Fast low-level face detectors (simple numbers, 0.1s) </li></ul></ul><ul><ul><li>High-level and slower Javascript VRML browser API </li></ul></ul>
    11. 11. &quot; Under the hood &quot; WordNet database AMICO Core TCP UDP WordNet HTTP Application specific XML-RPC SQL Firefox toolbar extension User dictionary English speech recognizer English TTS engine Dutch TTS engine German TTS engine ConceptNet Yahoo BabelFish translation service Face/gesture/motion detection AJAX XMLHttpRequest Python Java Java C++ C Java MS Access MySQL MonetDB Web (HTML) Service Javascript Java Javascript
    12. 12. Conclusion <ul><li>AMICO:WEB – A Platform for Rapid prototyping of accessibility solutions in mainstream Web browsers </li></ul><ul><ul><li>Exploiting potential of OSS and free software </li></ul></ul><ul><ul><li>Platform for future work and Web accessibility research </li></ul></ul><ul><ul><li>Relation with W3C Rich Web Application Backplane </li></ul></ul><ul><li>Applications </li></ul><ul><ul><li>Improve accessibility of Web multimedia and e-learning systems </li></ul></ul><ul><ul><li>Education: building accessibility solutions by undergraduate students </li></ul></ul><ul><li>Future work: </li></ul><ul><ul><li>Solving open issues: security, installation… </li></ul></ul><ul><ul><li>Internet Explorer plugins , Google Web Toolkit… </li></ul></ul><ul><ul><li>Proxy and Server Integration Mechanisms </li></ul></ul>

    ×