SlideShare a Scribd company logo
Developer tool for creating accessible
GUIs in Android mobile OS

Paperback – October 2011
1. Android accessibility overview (I)

• Android OS Accessibility
   – Accessibility API quite powerful
       • Widgets containing states and meta information
       • Accessibility services and events
          – Multilingual TTS
          – Haptic (Vibration)
          – Sounds
   – Insufficent system-level accessibility
       • Mechanisms provided are not enough
       • Big problem!




                                                          2
2. Android accessibility overview (II)
2. Android accessibility overview (Ii)

• Some conclussions
   – Expensive developements
      • More requistes
      • More money and time

   – Leads into fragmentation
      • “Each developer , each Look&Feel”

   – Trouble to developers
      • Small targetting & Big effort  Low interest




                                                       3
3. Solving problemsSolving problems
                 3.

• Provide accessible resources
   – Avoiding trouble
      • Accessible applications by default
      • Hiding complexity to developers (total transparency)
      • Without regarding on resources or requirements
   – Maximizing compatibility
      • Working from 1.6 to current Android version
      • No kernel modifications or root required
   – Flexible + Scalable + Extendable + Customizable
   – Enhancing Android’s native accessibility


    Android accessibility framework
                                                               4
4. Accessibility framework – Accessibility service
4. Framework – Accessibility service

• Accessible service
   – Integrated with the Android OS
      • Operating on user’s demand (settings)
   – Accessible backend
      • Shared by all the applications using the framework
      • Working in background as follows:




                                                             5
4. Framework – Accessible widgets – Widgets
        4. Accessibility framework

• Widget accessible behaviour extension
   – Relying on accessible containers
   – TTS based feedback for blind users
• New accessible components
   – Calendar, charts, switch… and so on




                                              6
5. Accessibility framework – Containers
5. Accessible containers

• Set of accessible layouts
   – Extending Android’s default layouts
   – Different layouts for different solutions
• Enhancing Android accessibility
   – Screen reading
   – Main behaviour
        • The selected components are remarked
        • For each selected component, its information is secuentially spoken




                                                                           7
5. Accessibility framework – Containers (II)
5. Accessible containers (II)

  – User touch inputs
      • Selects the complete layout or just the tapped component
      • One tap selects, another confirms action
  – User trackball motions
      • Allows screen navigation
      • Each motion selects the next component in the target direction
      • Clicking the trackball perform action
  – Gesture navigation
      • Allows screen navigation with simple gestures




                                                                         8
5. Accessibility framework – Containers (III)
5. Accessible containers (III)

• Containers overview and gestures sample




                                                     9
6. Use case               6. Use case

• A developer has created a very nice application
• He wants to turn it accessible
   – In short time
   – In a cheap way
• He just
   – Adds the resources and libraries provided to his WS
   – Locates the GUI XMLs and their source code
      • Changes the default layouts for the accessible ones
          – May need to refactor the xml
      • Links the program and gestures functionallity (2 single LOCs)




                                                                   10
7.7. Accessibility framework – GUIs design assistant
  GUIs Assistant

• Tool for create GUIs
   – Branch of the original DroidDraw tool
   – Helps developers to create GUI
       • Integrating the accessible components and layouts
       • Generating the XML files




                                                             11
7. Accessibility framework – GUIs design assistant
End of presentation



     Thank you for your time

           Please suggest and ask

More Related Content

Viewers also liked

60 website evaluation and testing with wcag 2
60 website evaluation and testing with wcag 260 website evaluation and testing with wcag 2
60 website evaluation and testing with wcag 2
AEGIS-ACCESSIBLE Projects
 
8 ontology integration and interoperability (onto i op)
8 ontology integration and interoperability (onto i op)8 ontology integration and interoperability (onto i op)
8 ontology integration and interoperability (onto i op)
AEGIS-ACCESSIBLE Projects
 

Viewers also liked (7)

11 adibib presentation aegis nov30
11 adibib presentation aegis nov3011 adibib presentation aegis nov30
11 adibib presentation aegis nov30
 
60 website evaluation and testing with wcag 2
60 website evaluation and testing with wcag 260 website evaluation and testing with wcag 2
60 website evaluation and testing with wcag 2
 
8 ontology integration and interoperability (onto i op)
8 ontology integration and interoperability (onto i op)8 ontology integration and interoperability (onto i op)
8 ontology integration and interoperability (onto i op)
 
0 aegis
0 aegis0 aegis
0 aegis
 
17 creating a global public
17 creating a global public17 creating a global public
17 creating a global public
 
Day 2 jan albers presentation aegis (final)
Day 2   jan albers  presentation aegis (final)Day 2   jan albers  presentation aegis (final)
Day 2 jan albers presentation aegis (final)
 
Veritas introduction to task models - User Forum Nottingham, UK, 20.09.2011
Veritas introduction to task models - User Forum Nottingham, UK, 20.09.2011Veritas introduction to task models - User Forum Nottingham, UK, 20.09.2011
Veritas introduction to task models - User Forum Nottingham, UK, 20.09.2011
 

Similar to 26 developer tool for creating accessible guis in android mobile os upm

Android General information
Android General informationAndroid General information
Android General information
Prashant Gosai
 
Android application development
Android application developmentAndroid application development
Android application development
Linh Vi Tường
 
mobile application development mobile application development
mobile application development mobile application developmentmobile application development mobile application development
mobile application development mobile application development
Kamrankhan925215
 
Chapter 1 Introduction to android.ppt pl
Chapter 1 Introduction to android.ppt plChapter 1 Introduction to android.ppt pl
Chapter 1 Introduction to android.ppt pl
ENBAKOMZAWUGA
 
Introduction to android sessions new
Introduction to android   sessions newIntroduction to android   sessions new
Introduction to android sessions new
Joe Jacob
 

Similar to 26 developer tool for creating accessible guis in android mobile os upm (20)

My androidpresentation
My androidpresentationMy androidpresentation
My androidpresentation
 
Android General information
Android General informationAndroid General information
Android General information
 
Introduction to Android Development and Security
Introduction to Android Development and SecurityIntroduction to Android Development and Security
Introduction to Android Development and Security
 
Android application development
Android application developmentAndroid application development
Android application development
 
mobile application development mobile application development
mobile application development mobile application developmentmobile application development mobile application development
mobile application development mobile application development
 
Google android os
Google android osGoogle android os
Google android os
 
Building Effective and Rapid Applications with IBM MobileFirst Platform
Building Effective and Rapid Applications with IBM MobileFirst PlatformBuilding Effective and Rapid Applications with IBM MobileFirst Platform
Building Effective and Rapid Applications with IBM MobileFirst Platform
 
Chapter 1 Introduction to android.ppt pl
Chapter 1 Introduction to android.ppt plChapter 1 Introduction to android.ppt pl
Chapter 1 Introduction to android.ppt pl
 
android
androidandroid
android
 
android
androidandroid
android
 
Android Application Development Training by NITIN GUPTA
Android Application Development Training by NITIN GUPTA Android Application Development Training by NITIN GUPTA
Android Application Development Training by NITIN GUPTA
 
Introduction to android
Introduction to androidIntroduction to android
Introduction to android
 
Android Introduction
Android IntroductionAndroid Introduction
Android Introduction
 
Android report.
Android report.Android report.
Android report.
 
Anatomy of an HTML 5 mobile web app
Anatomy of an HTML 5 mobile web app Anatomy of an HTML 5 mobile web app
Anatomy of an HTML 5 mobile web app
 
Google android os
Google android osGoogle android os
Google android os
 
Introduction to android
Introduction to androidIntroduction to android
Introduction to android
 
Android Development
Android DevelopmentAndroid Development
Android Development
 
Android application development fundamentals
Android application development fundamentalsAndroid application development fundamentals
Android application development fundamentals
 
Introduction to android sessions new
Introduction to android   sessions newIntroduction to android   sessions new
Introduction to android sessions new
 

More from AEGIS-ACCESSIBLE Projects

More from AEGIS-ACCESSIBLE Projects (20)

Newsletter 7 AEGIS project
Newsletter 7 AEGIS projectNewsletter 7 AEGIS project
Newsletter 7 AEGIS project
 
Veritas newsletter no 5 final
Veritas newsletter no 5 finalVeritas newsletter no 5 final
Veritas newsletter no 5 final
 
Aegis concertation - 2nd International AEGIS conference
Aegis concertation - 2nd International AEGIS conferenceAegis concertation - 2nd International AEGIS conference
Aegis concertation - 2nd International AEGIS conference
 
Mobile applications (Panagiotis Tsoris, Steficon)
Mobile applications (Panagiotis Tsoris, Steficon)Mobile applications (Panagiotis Tsoris, Steficon)
Mobile applications (Panagiotis Tsoris, Steficon)
 
ViPi platform technologies and integration pathway (Karel Van Isacker, Phoeni...
ViPi platform technologies and integration pathway (Karel Van Isacker, Phoeni...ViPi platform technologies and integration pathway (Karel Van Isacker, Phoeni...
ViPi platform technologies and integration pathway (Karel Van Isacker, Phoeni...
 
Basic ICT Training curriculum (Andy Burton, NTU)
Basic ICT Training curriculum (Andy Burton, NTU)Basic ICT Training curriculum (Andy Burton, NTU)
Basic ICT Training curriculum (Andy Burton, NTU)
 
ViPi Survey (Andy Burton, NTU)
ViPi Survey (Andy Burton, NTU)ViPi Survey (Andy Burton, NTU)
ViPi Survey (Andy Burton, NTU)
 
General introduction of the ViPi project (Karel Van Isacker, PhoenixKM)
General introduction of the ViPi project (Karel Van Isacker, PhoenixKM)General introduction of the ViPi project (Karel Van Isacker, PhoenixKM)
General introduction of the ViPi project (Karel Van Isacker, PhoenixKM)
 
Semantic Content Management enhancements (George Milis, G.M EuroCy Innovation...
Semantic Content Management enhancements (George Milis, G.M EuroCy Innovation...Semantic Content Management enhancements (George Milis, G.M EuroCy Innovation...
Semantic Content Management enhancements (George Milis, G.M EuroCy Innovation...
 
Gelijke kansen op informatie, toegankelijke documenten en communicatiekanalen...
Gelijke kansen op informatie, toegankelijke documenten en communicatiekanalen...Gelijke kansen op informatie, toegankelijke documenten en communicatiekanalen...
Gelijke kansen op informatie, toegankelijke documenten en communicatiekanalen...
 
AEGIS SP4 story - building an accessible mobile application
AEGIS SP4 story - building an accessible mobile applicationAEGIS SP4 story - building an accessible mobile application
AEGIS SP4 story - building an accessible mobile application
 
AEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web applicationAEGIS SP3 story - building an accessible web application
AEGIS SP3 story - building an accessible web application
 
ACCESSIBLE newsletter n° 6
ACCESSIBLE newsletter n° 6ACCESSIBLE newsletter n° 6
ACCESSIBLE newsletter n° 6
 
AEGIS Newsletter n° 6
AEGIS Newsletter n° 6AEGIS Newsletter n° 6
AEGIS Newsletter n° 6
 
VERITAS newsletter n° 3
VERITAS newsletter n° 3VERITAS newsletter n° 3
VERITAS newsletter n° 3
 
VERITAS newsletter n° 2
VERITAS newsletter n° 2VERITAS newsletter n° 2
VERITAS newsletter n° 2
 
VERITAS newsletter n° 4
VERITAS newsletter n° 4VERITAS newsletter n° 4
VERITAS newsletter n° 4
 
Conference proceedings 2011 AEGIS International Workshop and Conference
Conference proceedings 2011 AEGIS International Workshop and ConferenceConference proceedings 2011 AEGIS International Workshop and Conference
Conference proceedings 2011 AEGIS International Workshop and Conference
 
Aegis concertation certh
Aegis concertation certhAegis concertation certh
Aegis concertation certh
 
Veritas iti aegis_conf
Veritas iti aegis_confVeritas iti aegis_conf
Veritas iti aegis_conf
 

Recently uploaded

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 

Recently uploaded (20)

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 

26 developer tool for creating accessible guis in android mobile os upm

  • 1. Developer tool for creating accessible GUIs in Android mobile OS Paperback – October 2011
  • 2. 1. Android accessibility overview (I) • Android OS Accessibility – Accessibility API quite powerful • Widgets containing states and meta information • Accessibility services and events – Multilingual TTS – Haptic (Vibration) – Sounds – Insufficent system-level accessibility • Mechanisms provided are not enough • Big problem! 2
  • 3. 2. Android accessibility overview (II) 2. Android accessibility overview (Ii) • Some conclussions – Expensive developements • More requistes • More money and time – Leads into fragmentation • “Each developer , each Look&Feel” – Trouble to developers • Small targetting & Big effort  Low interest 3
  • 4. 3. Solving problemsSolving problems 3. • Provide accessible resources – Avoiding trouble • Accessible applications by default • Hiding complexity to developers (total transparency) • Without regarding on resources or requirements – Maximizing compatibility • Working from 1.6 to current Android version • No kernel modifications or root required – Flexible + Scalable + Extendable + Customizable – Enhancing Android’s native accessibility  Android accessibility framework 4
  • 5. 4. Accessibility framework – Accessibility service 4. Framework – Accessibility service • Accessible service – Integrated with the Android OS • Operating on user’s demand (settings) – Accessible backend • Shared by all the applications using the framework • Working in background as follows: 5
  • 6. 4. Framework – Accessible widgets – Widgets 4. Accessibility framework • Widget accessible behaviour extension – Relying on accessible containers – TTS based feedback for blind users • New accessible components – Calendar, charts, switch… and so on 6
  • 7. 5. Accessibility framework – Containers 5. Accessible containers • Set of accessible layouts – Extending Android’s default layouts – Different layouts for different solutions • Enhancing Android accessibility – Screen reading – Main behaviour • The selected components are remarked • For each selected component, its information is secuentially spoken 7
  • 8. 5. Accessibility framework – Containers (II) 5. Accessible containers (II) – User touch inputs • Selects the complete layout or just the tapped component • One tap selects, another confirms action – User trackball motions • Allows screen navigation • Each motion selects the next component in the target direction • Clicking the trackball perform action – Gesture navigation • Allows screen navigation with simple gestures 8
  • 9. 5. Accessibility framework – Containers (III) 5. Accessible containers (III) • Containers overview and gestures sample 9
  • 10. 6. Use case 6. Use case • A developer has created a very nice application • He wants to turn it accessible – In short time – In a cheap way • He just – Adds the resources and libraries provided to his WS – Locates the GUI XMLs and their source code • Changes the default layouts for the accessible ones – May need to refactor the xml • Links the program and gestures functionallity (2 single LOCs) 10
  • 11. 7.7. Accessibility framework – GUIs design assistant GUIs Assistant • Tool for create GUIs – Branch of the original DroidDraw tool – Helps developers to create GUI • Integrating the accessible components and layouts • Generating the XML files 11
  • 12. 7. Accessibility framework – GUIs design assistant End of presentation Thank you for your time Please suggest and ask