Streamlined Product Evaluation

Slide 1: 1

Slide 2: Catherine Weeks SeaChange International 2

Slide 3: Product  & Evaluation 3

Slide 4: xpert Review reviews are a fast and economical route to improving the usability “Expert usability of a Web site... The report outlines the criteria used to evaluate to three) of “Heuristic evaluations usually are conducted by a small set (one the site with reliable recommendations, which are based on extensive Human-Computer its evaluators. The evaluators independently examine a user interface and judge euristic Review compliance with research and of principles. Mich. State focusing Accessibility Center “This is a more specific version experience.” – The result Usability &on cognitive Interaction (HCI) a set of usabilitya design walkthrough, of this analysis is a list of (http://usability.msu.edu/services_expertRev.asp) potential usability issues or problems. The usability principles, also referred to as principles. Based on a user's goals, a group of published steps through tasks, evaluating at usability heuristics, are taken from evaluators lists. Ideally, each potential usability each step assigned to it is for the heuristics to help facilitate the interface problem ishow difficultone or moreuser to identify and operatefixing the problem. ognitive Walkthrough As more evaluators are to their current true problems areclearly the Usability.gov element most relevant involved, more subgoal and how found.” – system provides (http://www.usability.gov/methods/heuristiceval.html) take into consideration the user's feedback to that action. Cognitive walkthroughs thought processes that contribute to decision making, such as memory load and ability to reason.” – Usability First (http://www.usabilityfirst.com/methods/cogwalk.txl) 4

Slide 5: xpert Review  Experience  Research  Many evaluators euristic Review  Principles  Non-expert  Comparable ognitive Walkthrough  Task centric 5

Slide 6: imited or no product team access imited UX resources imited time o access to users ccess to working applications 6

Slide 7: dentify User roduct Review  Gives 1,000 foot view  Looks at branding, product placement, end user satisfaction ognitive Walkthrough  Look through application based on user tasks  Find interaction problems, layout issues, and even bugs! reate Recommendations 7

Slide 8: ase Intro: o team Pet" project o requirements, no business case atural extension to current products 8

Slide 9: roduct Review Findings Customers will not be able to use [Product name] outside of [Parent product name], therefore creating a barrier to use…” …providers could alter the recommendations without any indication to the user that these are ‘sponsored’ rather than purely calculated recommendations.” ognitive Walkthrough Findings f the user selects the incorrect operation, in order to fix their 9

Slide 10: ase Intro: ffshore office (Asia) ustomer buy-in esponsive team dentify User: 10

Slide 11: roduct Review Findings t is unclear where the user should begin in order to make the system work, and would require a vast amount of training in order for the users to become proficient in the system. orrect SeaChange product branding was not used. ognitive Walkthrough Findings t is unclear how to access this application when receiving the 11 hardware.

Slide 12: equires few resources an be as minimal or extensive as needed roduces a report that is easy for the product team to work with 12

Slide 13: elies on experience and research, not user input! eliance on few people to catch many issues equires understanding of business needs imited team collaboration opportunities 13

Slide 14: ccess to a working interface or prototype roduct Review: 1 ~ 3 days ognitive Walkthrough: 3 ~ 5 days ecommendations: 2 ~ 5 days eport: 2 ~ 4 days 14

Slide 15: roduct is perceived as valuable to company strategy imited resources o access to users 15

Slide 16: orks well in limited resource situations an provide minimal to extensive reviews hould always opt to have users involved if possible esults in a clear report for the product team 16

Slide 17: roduct Review outline xample of Cognitive Walkthrough eport layout example 17

Slide 18: K/Cancel Comics: , http://www.ok-cancel.com/comic/82.html ognitive Walkthrough definition: http://www.usabilityfirst.com/methods/cogwalk.txl euristic Review definition: xpert Review definition: 18

Slide 19: 19