Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Alarming Usability Follow Up: Usability Testing in Public June 28, 2007
Thank you to Menlo Innovations!
What is the Michigan UPA? <ul><li>Promote and support user-centered design and usability in products, software, and web si...
What is the Michigan UPA? <ul><li>Events around the state </li></ul><ul><ul><li>Detroit </li></ul></ul><ul><ul><li>Oakland...
What is the Michigan UPA? <ul><li>World Usability Day for Michigan (November)‏ </li></ul><ul><ul><li>Led by/held at MSU UA...
Upcoming Events <ul><li>July 24 in East Lansing </li></ul><ul><ul><li>Understanding the human/package interface </li></ul>...
More Upcoming Events <ul><li>August  </li></ul><ul><ul><li>The Latest and Greatest: Recent Research for Usability and Inte...
MI UPA’s New Officers <ul><li>Mike Beasley </li></ul><ul><li>Carissa Demitris </li></ul><ul><li>Dunrie Greiling </li></ul>...
MI UPA’s New Award <ul><li>UPA Chapter Award for </li></ul><ul><ul><li>Promoting UPA </li></ul></ul><ul><ul><li>Increasing...
Dave MR’s New Award Our Immediate Past President has won a  Distinguished Service Award From the Usability Professionals’ ...
Another Other Announcements?
Thank You <ul><li>Menlo Innovations </li></ul><ul><li>Tec-Ed </li></ul><ul><li>Ann Arbor Hands-On Museum </li></ul><ul><li...
Volunteering is Cool <ul><li>Volunteering is a great experience and a great way to meet new people (some call it “networki...
The Ann Arbor Hands-On Museum <ul><li>Alarming Usability on Sunday afternoon: </li></ul><ul><ul><li>5 alarm clocks </li></...
Usability Testing in Public: Why? <ul><li>Walk-up-and-use products </li></ul><ul><li>Limited set of tasks </li></ul><ul><l...
Usability Testing in Public: Why not? <ul><li>Competing with: </li></ul><ul><ul><li>Other interesting things </li></ul></u...
Testing in Public: Things to Know
Testing in Public: Things to Know <ul><li>Get at least one person comfortable with being a barker </li></ul><ul><li>No tim...
Testing in Public at the AAHOM
Testing in Public at the AAHOM <ul><li>Staffed by volunteers (all of who are very cool)‏ </li></ul><ul><li>Had to adapt th...
The Alarm Clock Circuit A 20 minute break to amble about and examine the alarm clocks individually.
Alarm Clock #1 <ul><li>Average predicted difficulty: 3.13 </li></ul><ul><li>Average actual difficulty: 4.52 </li></ul><ul>...
Alarm Clock #2 <ul><li>Average predicted difficulty: 1.88 </li></ul><ul><li>Average actual difficulty: 2.10 </li></ul><ul>...
Alarm Clock #3 <ul><li>Average predicted difficulty: 3.15 </li></ul><ul><li>Average actual difficulty: 3.41 </li></ul><ul>...
Alarm Clock #4 <ul><li>Average predicted difficulty: 2.80 </li></ul><ul><li>Average actual difficulty: 3.20 </li></ul><ul>...
Alarm Clock #5 <ul><li>Average predicted difficulty: 2.29 </li></ul><ul><li>Average actual difficulty: 2.13 </li></ul><ul>...
Comparing all Five Clocks
Comparing all Five Clocks
Comparing all Five Clocks
Questions, Comments, Anecdotes?
Upcoming SlideShare
Loading in …5
×

Miupa June 28 2007

1,262 views

Published on

Michigan Usability Professionals Association (http://www.miupa.org) results from our Alarming Usability event at the Ann Arbor Hands On Museum

Published in: Technology, Education
  • Be the first to like this

Miupa June 28 2007

  1. 1. Alarming Usability Follow Up: Usability Testing in Public June 28, 2007
  2. 2. Thank you to Menlo Innovations!
  3. 3. What is the Michigan UPA? <ul><li>Promote and support user-centered design and usability in products, software, and web sites for Michigan companies. </li></ul><ul><li>Bring user experience designers, usability engineers, and human factors specialists together to network and learn. </li></ul><ul><li>Organize relevant events for training, awareness, and networking </li></ul>
  4. 4. What is the Michigan UPA? <ul><li>Events around the state </li></ul><ul><ul><li>Detroit </li></ul></ul><ul><ul><li>Oakland County </li></ul></ul><ul><ul><li>Ann Arbor </li></ul></ul><ul><ul><li>East Lansing </li></ul></ul><ul><ul><li>Grand Rapids </li></ul></ul>
  5. 5. What is the Michigan UPA? <ul><li>World Usability Day for Michigan (November)‏ </li></ul><ul><ul><li>Led by/held at MSU UAC </li></ul></ul><ul><ul><li>Participation and co-sponsored by MIUPA, STC-SM, MOCHI, and several schools and departments at MSU </li></ul></ul><ul><ul><li>Significant sponsorship by areas at MSU and outside companies. </li></ul></ul><ul><li>Internet User Experience 2007 (February)‏ </li></ul><ul><ul><li>A conference spotlighting methods for dramatically improving today’s web site user experience </li></ul></ul><ul><ul><li>Co-sponsored by STC-SM, MOCHI, and UXNet </li></ul></ul>
  6. 6. Upcoming Events <ul><li>July 24 in East Lansing </li></ul><ul><ul><li>Understanding the human/package interface </li></ul></ul><ul><ul><ul><li>Ongoing work at the school </li></ul></ul></ul><ul><ul><ul><ul><li>Child resistant AND elderly accessible </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Making warning labels noticeable </li></ul></ul></ul></ul><ul><ul><ul><li>Lab tour </li></ul></ul></ul><ul><ul><ul><ul><li>Eye tracker </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Label legibility measurement instrument </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Human/package touch interface measurement </li></ul></ul></ul></ul>
  7. 7. More Upcoming Events <ul><li>August </li></ul><ul><ul><li>The Latest and Greatest: Recent Research for Usability and Interface Design (location TBD)‏ </li></ul></ul><ul><ul><ul><li>Dr. Susan Weinschenk, Chief of Technical Staff, Human Factors International </li></ul></ul></ul><ul><li>September </li></ul><ul><ul><li>LIVE Web Site Evaluations: Usability, Branding, and Marketing Message (Location TBD)‏ </li></ul></ul><ul><ul><ul><li>Dave Mitropoulos-Rundus </li></ul></ul></ul><ul><li>November 8 </li></ul><ul><ul><li>World Usability Day for Michigan </li></ul></ul><ul><ul><ul><li>Michigan State University </li></ul></ul></ul>
  8. 8. MI UPA’s New Officers <ul><li>Mike Beasley </li></ul><ul><li>Carissa Demitris </li></ul><ul><li>Dunrie Greiling </li></ul><ul><li>Dave Mitropoulos-Rundus </li></ul>
  9. 9. MI UPA’s New Award <ul><li>UPA Chapter Award for </li></ul><ul><ul><li>Promoting UPA </li></ul></ul><ul><ul><li>Increasing its visibility </li></ul></ul><ul><ul><li>Collaborating with </li></ul></ul><ul><ul><ul><li>other related chapters </li></ul></ul></ul><ul><ul><ul><li>universities </li></ul></ul></ul>
  10. 10. Dave MR’s New Award Our Immediate Past President has won a Distinguished Service Award From the Usability Professionals’ Association
  11. 11. Another Other Announcements?
  12. 12. Thank You <ul><li>Menlo Innovations </li></ul><ul><li>Tec-Ed </li></ul><ul><li>Ann Arbor Hands-On Museum </li></ul><ul><li>Phil Holmes </li></ul><ul><li>Laurie Kantner </li></ul><ul><li>Tim Keirnan </li></ul><ul><li>Carol Treat Morgan </li></ul><ul><li>Sumanth Muthyala </li></ul><ul><li>Paul Ott </li></ul><ul><li>John Rivard </li></ul><ul><li>Dave Robinson </li></ul><ul><li>Barbra Wells </li></ul><ul><li>Lori Anschuetz </li></ul><ul><li>Yelena Babin </li></ul><ul><li>Tom Burton-West </li></ul><ul><li>Jennifer Carlson </li></ul><ul><li>Robert Gawecki </li></ul><ul><li>Wyatt Hazlett </li></ul><ul><li>Barb Hernandez </li></ul><ul><li>Lauren Holmes </li></ul>
  13. 13. Volunteering is Cool <ul><li>Volunteering is a great experience and a great way to meet new people (some call it “networking”). </li></ul><ul><li>Interested? </li></ul><ul><li>Talk to any of the officers </li></ul><ul><li>Visit http://www.miupa.org/ (specifically, the Contact Us page)‏ </li></ul>
  14. 14. The Ann Arbor Hands-On Museum <ul><li>Alarming Usability on Sunday afternoon: </li></ul><ul><ul><li>5 alarm clocks </li></ul></ul><ul><ul><li>5 stop watches </li></ul></ul><ul><ul><li>1 task </li></ul></ul><ul><ul><li>An army of volunteers </li></ul></ul><ul><ul><li>Lots of children </li></ul></ul><ul><li>http://www.aahom.org/ </li></ul><ul><li>http://www.upaboston.org/ </li></ul>
  15. 15. Usability Testing in Public: Why? <ul><li>Walk-up-and-use products </li></ul><ul><li>Limited set of tasks </li></ul><ul><li>No release forms </li></ul>
  16. 16. Usability Testing in Public: Why not? <ul><li>Competing with: </li></ul><ul><ul><li>Other interesting things </li></ul></ul><ul><ul><li>The participants’ agendas </li></ul></ul><ul><li>Harder to control the situation </li></ul>
  17. 17. Testing in Public: Things to Know
  18. 18. Testing in Public: Things to Know <ul><li>Get at least one person comfortable with being a barker </li></ul><ul><li>No time to train the user—they must know what the task entails right away </li></ul><ul><li>Keep engaging the participants </li></ul><ul><li>Know the demographics of the place you’ll be </li></ul><ul><li>Some people just aren’t going to care about your test </li></ul>
  19. 19. Testing in Public at the AAHOM
  20. 20. Testing in Public at the AAHOM <ul><li>Staffed by volunteers (all of who are very cool)‏ </li></ul><ul><li>Had to adapt the source material for event </li></ul><ul><li>The people going to the museum can be very young </li></ul>
  21. 21. The Alarm Clock Circuit A 20 minute break to amble about and examine the alarm clocks individually.
  22. 22. Alarm Clock #1 <ul><li>Average predicted difficulty: 3.13 </li></ul><ul><li>Average actual difficulty: 4.52 </li></ul><ul><li>Average difference in difficulty (actual – predicted): 1.39 </li></ul><ul><li>Success rate: 12 out of 21 </li></ul><ul><li>Average time: 118.59 seconds </li></ul><ul><li>20 people found it more difficult to use, 1 found it less </li></ul>
  23. 23. Alarm Clock #2 <ul><li>Average predicted difficulty: 1.88 </li></ul><ul><li>Average actual difficulty: 2.10 </li></ul><ul><li>Average difference in difficulty (actual – predicted): -.04 </li></ul><ul><li>Success rate: 17 out of 24 </li></ul><ul><li>Average time: 43.59 seconds </li></ul><ul><li>6 people found it more difficult to use, 8 found it less </li></ul>
  24. 24. Alarm Clock #3 <ul><li>Average predicted difficulty: 3.15 </li></ul><ul><li>Average actual difficulty: 3.41 </li></ul><ul><li>Average difference in difficulty (actual – predicted): .26 (.03 when one outlier is removed)‏ </li></ul><ul><li>Success rate: 10 out of 15 </li></ul><ul><li>Average time: 86.31 seconds </li></ul><ul><li>7 people found it more difficult to use, 6 found it less </li></ul>
  25. 25. Alarm Clock #4 <ul><li>Average predicted difficulty: 2.80 </li></ul><ul><li>Average actual difficulty: 3.20 </li></ul><ul><li>Average difference in difficulty (actual – predicted): .40 </li></ul><ul><li>Success rate: 10 out of 14 </li></ul><ul><li>Average time: 102.20 seconds </li></ul><ul><li>5 people found it more difficult to use, 2 found it less </li></ul>
  26. 26. Alarm Clock #5 <ul><li>Average predicted difficulty: 2.29 </li></ul><ul><li>Average actual difficulty: 2.13 </li></ul><ul><li>Average difference in difficulty (actual – predicted): -.38 (-.05 if the outlier is removed)‏ </li></ul><ul><li>Success rate: 11 out of 14 </li></ul><ul><li>Average time: 30.62 seconds </li></ul><ul><li>4 people found it more difficult to use, 6 found it less </li></ul>
  27. 27. Comparing all Five Clocks
  28. 28. Comparing all Five Clocks
  29. 29. Comparing all Five Clocks
  30. 30. Questions, Comments, Anecdotes?

×