15 Tips For Effective Usability Testing In India


Published on

An Introduction to Usability Testing and 15 tips for Effective Usability Testing in India. Presented at Management Development Institute, Gurgaon, India during the second day of Bar Camp Delhi 6 #bcd6

Published in: Technology, Design
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

15 Tips For Effective Usability Testing In India

  1. Usability Testing- An Introduction & Tips for Effective Usability Testing in India By Abhay Rautela ConeTrees.com , UXQuotes.com , TheUXBookmark.com , @conetrees
  2. Agenda <ul><li>Introduction </li></ul><ul><ul><li>Usability? </li></ul></ul><ul><ul><li>What is Usability Testing? </li></ul></ul><ul><ul><li>Why conduct Usability Testing? </li></ul></ul><ul><ul><li>When and What to perform Usability Testing on? </li></ul></ul><ul><ul><li>How many users to test? </li></ul></ul><ul><ul><li>The Usability Testing Process </li></ul></ul><ul><li>Applicability </li></ul><ul><li>Tips for Effective Usability Testing in India </li></ul><ul><li>Questions & Feedback </li></ul>
  3. What is Usability? <ul><li>Usability is what you may know as user friendliness- ease of use </li></ul><ul><li>Usability is used in context of any object or a product a human might interact with </li></ul><ul><li>A product with good usability is one that is: </li></ul><ul><ul><li>Effective- in helping the user accomplishing their goal for which they are using the product </li></ul></ul><ul><ul><li>Efficient (can help the user accomplish their goals goal quickly) </li></ul></ul><ul><ul><li>Satisfying to use </li></ul></ul><ul><ul><li>Easy to approach and low error rate and criticality </li></ul></ul>
  4. What is Usability Testing <ul><li>Usability Testing is a methodology </li></ul><ul><ul><li>To evaluate how easy a product is to use </li></ul></ul><ul><ul><li>By giving tasks that are commonly performed or intended to be performed on the product </li></ul></ul><ul><ul><li>To people who are representative of the product’s target audience </li></ul></ul><ul><li>Types </li></ul><ul><ul><li>Formative/ Exploratory </li></ul></ul><ul><ul><li>Summative/ Assessment/ Verification or Validation </li></ul></ul><ul><li>Towards the beginning of the PDLC, it’s good if you can conduct usability tests on your competitions’ products </li></ul>
  5. When and What to perform Usability Testing on <ul><li>You can and should test at most phases of the PDLC/ SDLC: </li></ul><ul><ul><li>Requirements Gathering </li></ul></ul><ul><ul><li>Design </li></ul></ul><ul><ul><li>Development </li></ul></ul><ul><ul><li>Testing </li></ul></ul><ul><ul><li>Release </li></ul></ul>
  6. When and What to perform Usability Testing on <ul><li>2. You can test from concept to ready product </li></ul><ul><ul><li>Prototype </li></ul></ul><ul><ul><ul><li>Level of detail </li></ul></ul></ul><ul><ul><ul><ul><li>Lo-fi to hi-fi (paper to interactive) </li></ul></ul></ul></ul><ul><ul><ul><li>Length and breadth of functionality </li></ul></ul></ul><ul><ul><ul><ul><li>Horizontal- all features, limited functionality </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Vertical- limited feature(s), full functionality within those feature(s) </li></ul></ul></ul></ul><ul><ul><li>Product </li></ul></ul><ul><ul><ul><li>Section </li></ul></ul></ul><ul><ul><ul><li>Complete </li></ul></ul></ul>
  7. How many users? <ul><li>Research (Virzi, 1992, Nielsen & Landauer,1993) indicates that 5 users uncover approximately 80% of a product’s usability problems </li></ul><ul><li>Other research suggest different numbers </li></ul><ul><li>The Truth: It depends </li></ul><ul><li>A simple answer: </li></ul><ul><ul><li>For those interested in DIY usability testing: 5 is good to uncover an appreciable number of usability issues in </li></ul></ul><ul><ul><ul><li>Increasing number of participants means significant increase in time and cost due to increased complexity of planning, participant management and data analysis amongst other factors </li></ul></ul></ul><ul><ul><li>Else consult with experienced professionals </li></ul></ul>
  8. Why conduct Usability Testing <ul><li>In order to make a product user friendly you need to uncover usability issues in it </li></ul><ul><li>You can’t do that on you own since: </li></ul><ul><ul><li>You might not be the end user </li></ul></ul><ul><ul><li>Even if you belong to the target audience, you are probably not of the same user expertise level as most of or a section of the users are. </li></ul></ul><ul><ul><li>You need to validate you assumptions </li></ul></ul><ul><ul><li>Make informed decisions. Have data by your side and make decisions on facts, not hunches or opinions </li></ul></ul>
  9. The benefits of Usability Testing <ul><li>Being penny wise, pound foolish does not pay. Don’t look at saving a few days because of which you end up overshooting your plan by months </li></ul><ul><li>Speed up development and cut costs by getting it right in the least time and money possible by making it easy to use for the user and designed in a way that best helps them accomplish their goals </li></ul><ul><li>PDLC integration: To continually identify and act upon usability issues throughout the process at a low cost rather than trying to at the end when it is more or less impossible </li></ul>
  10. The Usability Testing Process <ul><li>Plan </li></ul><ul><li>Participant Recruitment </li></ul><ul><li>Scenario/ Task creation </li></ul><ul><li>Pilot Test </li></ul><ul><li>Execution/ Test sessions </li></ul><ul><li>Data Analysis </li></ul><ul><li>Report </li></ul><ul><li>Checkpoint </li></ul>
  11. Applicability <ul><li>Specifically applies to: </li></ul><ul><ul><li>Usability testing in India in organizations following an Agile SDLC </li></ul></ul><ul><ul><li>More towards participants belonging to or residing in metros </li></ul></ul><ul><li>You should be interested if you are in India and: </li></ul><ul><ul><li>Are interested in learning about usability testing or are a usability engineer </li></ul></ul><ul><ul><li>A product manager interested in learning about usability testing </li></ul></ul><ul><ul><li>A start up interested in how usability testing can benefit your product </li></ul></ul><ul><li>Even if you are outside India: </li></ul><ul><ul><li>You should still be able to derive value from the tips if you are conducting usability tests in countries outside India </li></ul></ul>
  12. Applicability of Usability Testing Tips <ul><li>Why tips on India are different from the books? </li></ul><ul><ul><li>India has a different cultural system as compared to the west </li></ul></ul><ul><ul><ul><li>Culture </li></ul></ul></ul><ul><ul><ul><ul><li>Value system </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Language </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Ways of working and interfacing with people </li></ul></ul></ul></ul><ul><ul><ul><li>Hofstede’s cultural dimensions </li></ul></ul></ul><ul><ul><li>There is a distinction between the working of Indian internet companies and multinational corporations or foreign firms </li></ul></ul>
  13. Tip 1 (Planning) Create a Plan that Will be Read <ul><li>Suggest plan formats to the stakeholders </li></ul><ul><li>Finally, create a plan according to their preference </li></ul>
  14. Tip 2 (Planning) Participant Compensation that Works <ul><li>Kids- Toys, Chocolates, Confectionary </li></ul><ul><li>School- Movie tickets, Cash </li></ul><ul><li>College- Cash, Movie tickets, Shoppers Stop/ Life Style Coupons, Big Bazaar coupons </li></ul><ul><li>Working Professionals- Lunch/ Dinner coupons, Shoppers Stop/ Life Style Coupons, Big Bazaar coupons </li></ul><ul><li>Elders- Big Bazaar coupons </li></ul><ul><li>Recruitment during festival season is tough. Reverse the flow by offering festival related gifts as compensation instead of the usual </li></ul>
  15. Tip 3 (Recruitment) Talk like the User <ul><li>When calling prospective participants over the phone, speak in the language you feel the user is comfortable in, and can communicate and understand better to increase your chances of recruitment. </li></ul><ul><li>When the person at the other end is comfortable with you, and more importantly gets some feeling of trust, the better your chances or successful recruitment </li></ul><ul><li>Mix language and use slang when appropriate </li></ul><ul><li>Empathize with all users </li></ul><ul><li>Affection with children and respect to the elderly is required and just as beneficial </li></ul>
  16. Tip 4 (Execution) Record using Inbuilt Laptop Camera <ul><li>Inbuilt laptop cameras are hardly noticeable* </li></ul><ul><li>Reduce awkwardness and intimidation for the camera conscious, especially effective with participants from non-metros </li></ul><ul><li>Decrease introduction of bias, increase accuracy of test results </li></ul><ul><li>* The user must be briefed about recording them. Their permission is required before proceeding. Get a CDA/ NDA signed. </li></ul>
  17. Tip 5 (Execution) Simulate as much as possible <ul><li>Use a bandwidth shaper </li></ul><ul><ul><li>E.g.- You might want to limit speed to 56 kbps if this is the internet speed available to most of your users rather than using high speed internet connectivity available at your office </li></ul></ul><ul><li>Same goes for OS, browsers and resolution </li></ul>
  18. Tip 6 (Execution) Use ‘Think Aloud’ only if Appropriate <ul><li>Use ‘Think Aloud’ protocol only if participants are able to adapt to it easily, </li></ul><ul><ul><li>Feels unnatural for many thus increasing bias </li></ul></ul><ul><ul><li>Adds to the pressure and increases bias, may affect performance </li></ul></ul><ul><li>Retrospective evaluation is an alternative but is time consuming </li></ul>
  19. Tip 7 (Execution) Speak & Dress like the participant <ul><li>Try and dress like your participants, don’t be intimidating </li></ul><ul><li>Speak in the language you feel the participant is comfortable in, and can communicate and understand better to increase your chances of recruitment </li></ul><ul><li>This will help decrease bias introduced due to intimidation or awkwardness </li></ul><ul><li>The more comfortable the participant, the more your chances of accurate results </li></ul><ul><li>Caution! Don’t hand the reins over to the user </li></ul>
  20. Tip 8 (Execution) Stakeholders as observers <ul><li>Let the stakeholders get a first hand experience of how the user actually uses the product </li></ul><ul><li>Observation by stakeholders will help increases transparency and their belief validity of a methodology they are new to </li></ul><ul><li>If they can not be observers, provide access to all the video recordings of the sessions or even better, a highlights video </li></ul><ul><li>Stakeholders observing participants is more influential in them understanding usability issues rather than handing out a report </li></ul>
  21. Tip 9 (Execution) Usability testing at Elders homes <ul><li>In the field, try to restrict team to 2 members </li></ul><ul><li>One facilitator and one observer is good enough </li></ul><ul><li>Let them know how many will be coming in advance </li></ul><ul><li>Show your ID/ business card- Most elders are not comfortable with the idea of strangers entering their homes </li></ul>
  22. Tip 10 (Reporting) Prioritization also by LOE <ul><li>Prioritize by criticality and frequency of issues so stakeholders can decide on incorporation as required </li></ul><ul><li>When time and resources are scarce, stakeholders will pick recommendations requiring least effort to implement </li></ul>
  23. Tip 11 (Reporting) Provide quotes in original language <ul><li>Don’t translate quotes in English. When you translate a quote, you loose quality of the insight gained through it. (Think JPG- lossy) </li></ul><ul><li>You can provide a translation (in the rarer case) that you have stakeholders who don’t understand the language the quote is in </li></ul>
  24. Tip 12 (Reporting) Create a Report that will be read <ul><li>Discuss in advance the format of the report with stakeholders offering suggestions to them on it </li></ul><ul><li>Don’t deliver the report in a format that the stakeholder won’t read </li></ul><ul><li>Avoid an unpleasant surprise with a format that contains or misses out on information (and sorting) that the stakeholders wanted </li></ul>
  25. Tip 13 (Reporting) Present Report <ul><li>Submitting it does not guarantee it being read or stakeholders acting upon it </li></ul><ul><li>Always try and present the report </li></ul><ul><ul><li>To ensure comprehension of the entire report to stakeholders </li></ul></ul><ul><ul><li>To understand why certain recommendations can not be incorporated </li></ul></ul><ul><ul><li>To prevent information distortion </li></ul></ul>
  26. Tip 14- Checkpoint <ul><li>It is not uncommon in an Agile SDLC to see reports disappear over time without any incorporation of agreed recommendations </li></ul><ul><li>Checkpoint at appropriate intervals of time to keep track of and follow through on recommendations agreed to be incorporated </li></ul>
  27. Tip 15: Overall Process <ul><li>Involve stakeholders/ Product Department </li></ul><ul><ul><li>Absolutely important if usability is just beginning to get recognized in your organization or you are part of the few who are part of the group busy evangelizing </li></ul></ul><ul><ul><li>A must if you are at </li></ul></ul><ul><ul><ul><li>Stage 2 to 5 of Nielsen’s Corporate Usability Maturity </li></ul></ul></ul><ul><li>Why? </li></ul><ul><ul><li>They make or break usability within the organization </li></ul></ul><ul><ul><ul><li>Ultimately, they give the nod, allocate resources and budget for usability </li></ul></ul></ul><ul><ul><li>If you shut doors on them, they can shut you down since you are probably conducting usability tests because they are allowing you to </li></ul></ul>
  28. Questions?
  29. Feedback
  30. Thank you Website: http://www.conetrees.com Email: hello at conetrees dot com Twitter: http://www.twitter.com/conetrees Useful Quotes on User Experience: http://www.uxquotes.com The UX Practitioners’ resource: http://www.theuxbookmark.com
  31. Join the UX Book Club, New Delhi http://uxbookclub.org/doku.php?id=new_delhi As creator and lead coordinator of the UX Book Club, New Delhi, I’d like you to consider joining us if you are work in user experience in and around New Delhi Join the SlideShare Accessibility Group slideshare.com/group/web-accessibility View and share useful presentations on web accessibility- Join the group