The World Wide Web (Web) is a visually complex, dynamic, multimedia system that can be inaccessible to people with visual impairments. SADIe addresses this problem by using Semantic Web technologies to explicate implicit visual structures through a combination of an upper and lower ontology. This is then used to apply transcoding to a range of Websites. This paper describes a user evaluation that was performed using the SADIe system. Four users were presented with a series of Web pages, some having been adapted using SADIe's transcoding functionality and others retaining in their original state. The results of the evaluation showed that providing answers to a fact based question could be achieved more quickly when the information on the page was exposed via SADIe's transcoding. The data obtained during the experiment was analysed and shown to be statistically significant. This suggests that the transcoding techniques offered by SADIe can assist visually impaired users accessing content on the Web.

1. User Study of SADIe Transcoding Engine Darren Lunn, Sean Bechhofer and Simon Harper

2. Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study also provide insights into further transformations. 2

3. The Web Focus on presenting information visually. Images. Columns. Chunks. Some knowledge is only available implicitly from the page rendering. 3

4. Implicit Knowledge Advertisement Banner Menu Main Content 4

5. Assistive Technologies Visually impaired users can make use of assistive technologies e.g. screen readers. Render pages sequentially in audio. Achieved by accessing the underlying HTML. Focus on visual presentation rather than content hampers this. Particularly if attention is not paid to coherent design. Subtleties of visual presentation can be lost. 5

6. Assistive Technologies Traversal of content is serial. Top-to-bottom. Left-to-right. Important information may not be encountered until later on. Some information such as menus can be repeated for every page. 6

7. Transcoding Rules / Patterns. Can adapt a large number of pages. Can suffer from reduced accuracy. Annotation. Accurate. Time consuming as every page is annotated. 7

8. SADIe Approach The visual rendering of a Web element informs the user of its purpose. The CSS defines the visual rendering. Identifying the purpose of the CSS definition implicitly defines the purpose of the Web element. A single CSS definition is applied to every page within the Website. 8

9. SADIe Banner Heading Menu Banner Overview Heading Overview Main Story Tabs Advertisement Main Story Image 9

10. Is This Useful? Previously technically feasible of SADIe. Conducted user studies to support transcoding from user perspective. Identify future transcoding areas to investigate. 10

11. Remote Or Lab-Based Study? Remote Studies. Long term. Potentially more users. Can see what users did. Lab-based study. More controlled. Glean information from users. Can understand why users performed actions. 11

12. Stimuli Eight text-based Websites. News; Blogs; Search results. Taken from Alexa top 100. All pages transcoded in the same way. User presented with original or modified version. Tasks involved finding information on the page. 12

13. Users Four visually impaired users Frequent computer users. Used the Web daily. All used JAWS screen reader. 13

14. Tasks Users were presented with a page. They did not know which page. They did not know which version. Users were asked to complete a task. E.g. “What is the first search result”. Task completion time was calculated. 14

15. User Interaction Task index page Page 3 15

16. Time to Task Completion 16

17. T-Test Analysis Mean Times Original: 163.25 SADIe: 54.19 t(7.6) = -2.14 p = 0.033 As p < 0.05 statistically significant Supports the use of our transcoding 17

18. A Good Start Point Evaluation supports the use of SADIe transcoding. Defluff; Reorder; Menu. User discussions and observations highlight future areas of investigation. 18

19. Importance of Structure Participants frequently discussed the importance of page structure. “If you told me these were the results with a heading… that would help me.”- P1 “When you say heading level 4 or whatever, you need to describe what is under it.”- P3 19

20. Importance of Structure P3 found list structures much easier to navigate than paragraphs of text. Scope for not only reorganising page but restructuring elements. 20

21. Importance of Cues BBC News page required users to find story headline. SADIe version took longer. P2 reached headline within 3 seconds. Did not know it was the headline as page had changed. Required cue of “Africa” before realising they had gone too far. 21

22. Importance of Cues 22

23. Importance of Cues P1 identified search results from the word “cached.” P3 knew they had gone too far from the word “feedback.” Can we make use of these cues to guide people around the page? 23

24. User Strategies “Basic strategy is to use ‘find’ but this only really works when you know the page.” – P1 P2 quickly tabbed through the page to get an overview of the content. Can these strategies be utilised to help users? 24

25. Summary SADIe transcodes content based upon meaning of the visual rendering. User evaluation supports SADIe transcoding as a way to aid visually impaired users. Observations from the study provide insights into further transformations. 25

26. Questions? http://hcw.cs.manchester.ac.uk/ darren.lunn@cs.manchester.ac.uk