Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Avaliação da Usabilidade e da Acessibilidade do Ambiente Virtual de Aprendizagem TelEduc:  levando o “aprender ”  a todos ...
Agenda <ul><ul><li>Ideas </li></ul></ul><ul><ul><li>Materials </li></ul></ul><ul><ul><li>Methods </li></ul></ul><ul><ul><l...
Ideas Virtual Learning Environments (VLE) characteristics Funcionalities Security Performance Scalability Availability Usa...
Ideas <ul><ul><li>TelEduc Environment </li></ul></ul><ul><ul><ul><li>First Brazilian VLE open source </li></ul></ul></ul><...
Materials <ul><ul><li>Communication among all participants -> Mail/ Correio  and Discussion Forums/ Fórum de Discussão </l...
Methods Usability Log Interaction Analysis Inspection User Tests Nielsen Questionnaire Guidelines Heuristic WebHint
Methods - WebHint
Users <ul><li>Students with some VLE experience: 17 </li></ul><ul><li>One user with tool to change font size </li></ul>
Methods Accessibility WCAG (W3C) Inspection User Tests  IBM Tanaka (2009) Guidelines Heuristic Hera
Methods – Tanaka(2009) <ul><li>Similarly Nielsen usability evaluation </li></ul><ul><li>5  Heuristics: </li></ul><ul><li>S...
Examples
There is not showed a confirmation message
Examples of problems found <ul><li>Usability:   Add comment to a portfolio item </li></ul><ul><li>-  Nielsen Heuristics : ...
It is not possible to check a checkbox using only the keyboard
Accessibility:  It is not possible use the system only with  keyboard input. - Accessibility Heuristcs:   Support for diff...
Results <ul><li>  </li></ul><ul><li>  </li></ul><ul><ul><li>Usability Heuristic </li></ul></ul><ul><ul><li>Evaluation </li...
Results <ul><ul><li>Questionnaire </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul>
<ul><ul><li>WebHint Method: </li></ul></ul><ul><ul><ul><li>5 usability's problems found </li></ul></ul></ul><ul><ul><ul><l...
<ul><ul><li>Accessibility Heuristic </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul>Results Tool Errors x Severity To...
<ul><ul><li>Guidelines  </li></ul></ul><ul><ul><li>Evaluations </li></ul></ul>Results Priority Mail/ Correio Forum Portfol...
Conclusions <ul><ul><li>Methods are complementary: </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><li>  </li><...
Thanks <ul><ul><li>Instituto de Computação - Unicamp </li></ul></ul><ul><ul><li>Capes </li></ul></ul><ul><ul><li>CNPq </li...
Extra: Accessibility and Usability <ul><ul><li>In some situations were found problems that affect both usability and acces...
Extra: Accessibility and Usability <ul><ul><li>It happens because the success or not success message is showed for only a ...
Upcoming SlideShare
Loading in …5
×

Avaliação da Usabilidade e da Acessibilidade do Ambiente Virtual de Aprendizagem TelEduc: levando o “aprender” a todos

797 views

Published on

IHC+CLIHC 2011 - Evaluation Competition

Published in: Automotive, Technology, Design
  • Be the first to comment

  • Be the first to like this

Avaliação da Usabilidade e da Acessibilidade do Ambiente Virtual de Aprendizagem TelEduc: levando o “aprender” a todos

  1. 1. Avaliação da Usabilidade e da Acessibilidade do Ambiente Virtual de Aprendizagem TelEduc: levando o “aprender ” a todos André C. da Silva                                               Ariel Vargas     Caroline C. Letizio                                     Ricardo E. Caceffo Prof. Dr. Heloísa V. da Rocha Professor Institute of Computing - NIED UNICAMP Evaluation Competition                          October, 28 th 2011
  2. 2. Agenda <ul><ul><li>Ideas </li></ul></ul><ul><ul><li>Materials </li></ul></ul><ul><ul><li>Methods </li></ul></ul><ul><ul><li>Examples </li></ul></ul><ul><ul><li>Results </li></ul></ul><ul><ul><li>Conclusion </li></ul></ul>
  3. 3. Ideas Virtual Learning Environments (VLE) characteristics Funcionalities Security Performance Scalability Availability Usability Accessibility Reliability Maintainability ... Is the VLE for everyone?
  4. 4. Ideas <ul><ul><li>TelEduc Environment </li></ul></ul><ul><ul><ul><li>First Brazilian VLE open source </li></ul></ul></ul><ul><ul><ul><li>More than 4,000 installations </li></ul></ul></ul><ul><ul><ul><li>Analyzed version: 4.2 </li></ul></ul></ul><ul><ul><ul><li>It has been used in our university </li></ul></ul></ul>http://www.teleduc.org.br/
  5. 5. Materials <ul><ul><li>Communication among all participants -> Mail/ Correio and Discussion Forums/ Fórum de Discussão </li></ul></ul><ul><li>  </li></ul><ul><ul><li>Administration of several contents -> Support Materials/ Material de Apoio </li></ul></ul><ul><ul><li>Development, delivery and monitoring of activities -> Portfolio/ Portfólio </li></ul></ul>
  6. 6. Methods Usability Log Interaction Analysis Inspection User Tests Nielsen Questionnaire Guidelines Heuristic WebHint
  7. 7. Methods - WebHint
  8. 8. Users <ul><li>Students with some VLE experience: 17 </li></ul><ul><li>One user with tool to change font size </li></ul>
  9. 9. Methods Accessibility WCAG (W3C) Inspection User Tests IBM Tanaka (2009) Guidelines Heuristic Hera
  10. 10. Methods – Tanaka(2009) <ul><li>Similarly Nielsen usability evaluation </li></ul><ul><li>5 Heuristics: </li></ul><ul><li>Support for different types of input and output </li></ul><ul><li>Contents for all kind of users </li></ul><ul><li>Avoid independence of use </li></ul><ul><li>Respect the user preferences </li></ul><ul><li>Efficiency of alternative interaction </li></ul>
  11. 11. Examples
  12. 12. There is not showed a confirmation message
  13. 13. Examples of problems found <ul><li>Usability: Add comment to a portfolio item </li></ul><ul><li>- Nielsen Heuristics : Visibility and status of system </li></ul><ul><ul><li>- Log Interaction Analysis : Half of the users had executed the task distinct than expected </li></ul></ul><ul><li>Questionnaire : Half of the user agreed partially </li></ul><ul><li>&quot;The information showed by the system after I performed some action request are enough to make me understand the results of my action&quot; </li></ul>
  14. 14. It is not possible to check a checkbox using only the keyboard
  15. 15. Accessibility: It is not possible use the system only with keyboard input. - Accessibility Heuristcs: Support for different types of input and output - Guidelines: Checkpoint 6.4 - For scripts and applets, ensure that event handlers are input device-independent Examples of problems found
  16. 16. Results <ul><li>  </li></ul><ul><li>  </li></ul><ul><ul><li>Usability Heuristic </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul>Tool Errors x Severity Total 0 1 2 3 4 Mail/Correio 0 3 1 1 0 5 Portfolio/Portfólio 0 4 5 12 1 22 Discussion Forums/ Fórum de Discussão 0 2 3 2 0 7 Suport Material/ Material de Apoio 1 7 2 4 0 14 General/Geral 0 3 2 2 2 9 Total 1 19 13 21 3 58
  17. 17. Results <ul><ul><li>Questionnaire </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul>
  18. 18. <ul><ul><li>WebHint Method: </li></ul></ul><ul><ul><ul><li>5 usability's problems found </li></ul></ul></ul><ul><ul><ul><li>A few number of users </li></ul></ul></ul>Results
  19. 19. <ul><ul><li>Accessibility Heuristic </li></ul></ul><ul><ul><li>Evaluation </li></ul></ul>Results Tool Errors x Severity Total 0 1 2 3 4 Mail/Correio 0 0 0 0 13 13 Portfolio/Portfólio 0 0 0 0 9 9 Discussion Forums/ Fórum de Discussão 0 0 0 2 12 14 Suport Material/ Material de Apoio 0 0 0 0 16 16 General/Geral 0 0 2 5 11 18 Total 0 0 2 7 61 70
  20. 20. <ul><ul><li>Guidelines </li></ul></ul><ul><ul><li>Evaluations </li></ul></ul>Results Priority Mail/ Correio Forum Portfolio Support Material / Material de Apoio Total 1 2 1 1 2 6 2 8 8 8 8 32 3 1 3 3 3 10 Total 11 12 12 13 48
  21. 21. Conclusions <ul><ul><li>Methods are complementary: </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><li>   </li></ul><ul><ul><li>The usability results show that the TelEduc has good usability, also pointing specific problems that can be solved to improve VLE's usability. </li></ul></ul><ul><ul><li>The accessibility results show critical accessibility problems in TelEduc – Is NOT for everyone!! </li></ul></ul><ul><li>  </li></ul><ul><li>  </li></ul><ul><ul><ul><li>Accessibility </li></ul></ul></ul><ul><ul><ul><ul><li>2 inspection methods </li></ul></ul></ul></ul><ul><ul><ul><li>Usability </li></ul></ul></ul><ul><ul><ul><ul><li>1 inspection method </li></ul></ul></ul></ul><ul><ul><ul><ul><li>2 user tests methods </li></ul></ul></ul></ul>
  22. 22. Thanks <ul><ul><li>Instituto de Computação - Unicamp </li></ul></ul><ul><ul><li>Capes </li></ul></ul><ul><ul><li>CNPq </li></ul></ul><ul><ul><li>FAPESP </li></ul></ul><ul><li>More information about this work </li></ul><ul><li>http://www.students.ic.unicamp.br/~ra059664/ihc2011/ </li></ul>
  23. 23. Extra: Accessibility and Usability <ul><ul><li>In some situations were found problems that affect both usability and accessibility of TelEduc </li></ul></ul><ul><ul><li>For example: </li></ul></ul><ul><ul><ul><li>User starts the upload of some content in his/her portfolio </li></ul></ul></ul><ul><ul><ul><li>User opens another tab and continues browsing TelEduc, for example to read mail </li></ul></ul></ul><ul><ul><ul><li>When the user comes back to the portfolio tab, s/he is not able to know if the upload was successfully or not </li></ul></ul></ul>
  24. 24. Extra: Accessibility and Usability <ul><ul><li>It happens because the success or not success message is showed for only a few seconds ( usability issue ) and can't be “read” by the screen reader ( accessibility issue ) </li></ul></ul>

×