Userzoomwebinarmonsteraug09vf 100226135954-phpapp02
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share
  • 127 views

 

Statistics

Views

Total Views
127
Views on SlideShare
127
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-NoDerivs LicenseCC Attribution-NoDerivs License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • In this webinar, we will show you how you can remove face to face moderation, have hundred of users participate simultaneously from different locations in a cost effective and fast way. <br /> Userzoom is an on demand research service that will automatically capture and gather both customers attitudes and behaviors. <br /> After our demonstration, we will open up to Questions, but let’s start now by diving into UserZoom software as a service. <br />
  • In this webinar, we will show you how you can remove face to face moderation, have hundred of users participate simultaneously from different locations in a cost effective and fast way. <br /> Userzoom is an on demand research service that will automatically capture and gather both customers attitudes and behaviors. <br /> After our demonstration, we will open up to Questions, but let’s start now by diving into UserZoom software as a service. <br />
  • Thank you (Alfonso? Viginie?) <br /> I’m Denise Nangle, User Experience Research Manager at Monster. <br /> Today, I’d like to share with you how Userzoom helped Monster teams evaluate the success of our total redesign of the seeker experience. <br /> Before the launch of this complete redesign, Monster’s strategy was to make incremental changes to the user interface. <br /> Since REDUX was a complete web site redesign, with an entirely new user experience and new products, it offered us the opportunity to evaluate the entire experience, and not just one or two parts of the site. <br /> To do this, we needed the right tool that would allow us to evaluate both the strengths and weaknesses. <br /> So, we called upon Userzoom and started planning a remote, international online study. In late January 2009, we launched identical studies in the US, UK, France, Germany and the Netherlands. <br />
  • We knew we wanted to measure several areas, including user satisfaction, task success and efficiency, ease of use and likelihood of using Monster in the future. <br /> But we also wanted to gather qualitative feedback on what our users liked and didn’t like about the new experience. <br /> Since we were going to interpret the results of this study in context with with other remote studies done prior to the launch of REDUX, we had to structure the study to obtain comparative measures. <br /> We recruited panels of 250 people in each of the 5 markets we wanted to evaluate. <br /> Each participant was given 4 tasks to complete. <br /> All participants completed tasks in the same order, since some tasks had dependencies that required completion of an earlier task. <br /> We followed each task with self-reported success and satisfaction questions. We also gave participants an opportunity to tell us what they liked and didn’t like about the experience. <br /> Finally, we captured clickstream data to generate heat maps. This gave us another opportunity to objectively evaluate user behavior. <br /> We could see how they navigated the site, which areas of the site they visited, where they clicked, and more. <br />
  • We knew we wanted to measure several areas, including user satisfaction, task success and efficiency, ease of use and likelihood of using Monster in the future. <br /> But we also wanted to gather qualitative feedback on what our users liked and didn’t like about the new experience. <br /> Since we were going to interpret the results of this study in context with with other remote studies done prior to the launch of REDUX, we had to structure the study to obtain comparative measures. <br /> We recruited panels of 250 people in each of the 5 markets we wanted to evaluate. <br /> Each participant was given 4 tasks to complete. <br /> All participants completed tasks in the same order, since some tasks had dependencies that required completion of an earlier task. <br /> We followed each task with self-reported success and satisfaction questions. We also gave participants an opportunity to tell us what they liked and didn’t like about the experience. <br /> Finally, we captured clickstream data to generate heat maps. This gave us another opportunity to objectively evaluate user behavior. <br /> We could see how they navigated the site, which areas of the site they visited, where they clicked, and more. <br />
  • When we use large sample sizes across different markets, we are able to quickly identify where we are doing things the right way and where we need to make improvements. <br /> Because we have captured related metrics in past studies, are always planning future studies with similar measures, we are able to show improvement over time. <br /> We also recognize that our findings must be viewed as part of our entire knowledgebase, so we review other sources of data to validate and explain what users tell us in our remote studies. When we share the bigger picture with our teams, it allows us to make decisions that are based on user data. <br /> Another interesting learning came from the qualitiative sections of our studies. We found that when we asked users what they like, they often respond with vague comments such as “it’s easy” or “ it’s fast.” But when you ask people what they don’t like, they tend to be very specific about what they want to see on the site. We are taking advantage of learning when we design additional studies. If users are happy, that’s wonderful to hear. If they are not happy, the value of the response is learning why they are not happy. <br /> Lastly, this study allowed us to look at the complete site, not just this area or that page or this functionality. In sharing the results with the entire team, we succeed in pulling all our colleagues together and create a stronger team. It doesn’t matter if they are visual designers, or interaction designers or prototypers - everyone had a role in building our site and when we present the findings, everyone knows they played a part in our success. <br /> Thank you. <br /> [Back to Alfonso] <br />

Userzoomwebinarmonsteraug09vf 100226135954-phpapp02 Presentation Transcript

  • 1. www.userzoom.com Special guest Quality products & services for Online User Experience Research Webinar, August 19th
  • 2. www.userzoom.com Welcome! Here’s an overview of today’s webinar: 1. Brief UserZoom company presentation 2. About unmoderated remote UX research About 30 mins 3. About UZ Self-Serve Edition 4. Monster’s case study 5. Q&A + summary About 30 mins
  • 3. www.userzoom.com In just 2 mins… Our ‘elevator pitch’ 1. What is UserZoom and what do we do? • • International online market research firm, specializing in user experience and usability. Help brands to better understand their online users, boost website performance & improve business results. 2. How do we do it? • • Through a unique web-based software application (called UZ Self-Serve Edition) that empowers UX researchers & consultants to conduct highly sophisticated online research. Offer both a self-service solution and professional services. 3. Bottom line… Why should you work with us? • You’ll be able to capture & measure the critical and actionable data about your users’ online experience and behavior that you need to manage your business.
  • 4. www.userzoom.com Highlighted clients
  • 5. www.userzoom.com Our position in the market What does the market say about web research & analytics? •Usability testing in the lab is great, but it has its limitations •Web analytics tells you a lot about the WHAT, not the WHY •Conducting international testing is expensive •Benchmarking and measuring UX is more important than ever •Other… Highlight Highlight #1 #1 Overall conclusion: Today’s Web Business Managers seek more sophisticated and innovative research and analytics products to help them compete
  • 6. www.userzoom.com Strengths & weaknesses of some research methods Test REAL tasks Large Samples Reason WHY Behavioural Data Natural Setting Focus group      Usability labs          Online surveys       Web analytics UZ Self-Serve Edition     
  • 7. www.userzoom.com What is the value? How does it work?  Automated (or unmoderated) online user experience research*: 1. A researcher predefines a study script 2. No human moderation needed (moderation through software) 3. Hundreds of users participate simultaneously 4. You ask them to perform tasks and answer follow-up questions 5. Participation from geographically spread locations (local & int’l) and… 6. …in their natural context (using their own PCs) 7. Results: usability metrics, user behavior and web analytics Very cost-effective and fast research method Highlight Highlight #2 #2
  • 8. This is basically how it works 1. Define your study  Choose the type of study you want to conduct  Write your study script  Choose the recruitment method & audience  Pre-test before launch 2. Launch study, collect data & monitor progress  Invite users to participate (or ask your visitors to do it)  Collect data automatically  Monitor the progress realtime www.userzoom.com 3. Analyze results & generate a report  Perform advanced data analysis  Use filtering capabilities  Copy & paste results  Export automatically into Word or Excel
  • 9. www.userzoom.com What about user recruitment? Highlight Highlight #3 #3 Option 1: International panels* • + 10 million users, spread across 37 countries • Wide variety of profiles, great segmentation capabilities • Strict, professional control and panel mgmt. Option 2: Intercept method • Ask users who visit the website to participate in a study. • Insert a javascript in the page * Partners of Option 3: Private panels, mailing lists • Can also work with private databases
  • 10. www.userzoom.com Versatility of UserZoom (research you can do) • Our core: Online (remote) usability tests (task based) • But also the tool allows for:  Online Card-sorting exercises  True Intent studies / online surveys  Free / open search studies  Abandon analysis  Mobile interface tests  And more… • Test any web-based interface:  Website  Intranet  Prototype  Multimedia Highlight Highlight #4 #4
  • 11. www.userzoom.com Task based studies: Real users attempting real tasks Websites Task instructions are shown here to remind users what they need to do…
  • 12. www.userzoom.com Let’s see a video clip of a user participating in a study
  • 13. www.userzoom.com Results  Quantitative data: Effectiveness, efficiency & satisfaction ratios, ease of use and other Likert results are analyzed for statistical significance and correlations  Qualitative data: Lots of responses to open-ended questions, relative to each task  Behavioral data: Clickstream data and click-maps: Where did the participants actually go? Where did they click to get there.  User profile data: Who are my users? What do they come to our site for? How do they perceive us?
  • 14. www.userzoom.com Quick tour of our tool: UZ Self-Serve Edition • 100% hosted / on-demand solution • It includes access to 2 apps: 1. UZ Manager (for project design management) 2. UZ Analytics (for data analysis) Let’s take a quick tour…
  • 15. www.userzoom.com Easily create and manage your studies with UZ Manager Fake data shown
  • 16. www.userzoom.com Fake data shown
  • 17. www.userzoom.com About our scripting capabilities • Many advanced features and capabilities • Task validation criteria • Questionnaires tool • Logic/branching & conditions • Etc. • Easy to use! Highlight Highlight #5 #5
  • 18. www.userzoom.com Analyze results with UZ Analytics: UX ratios & responses Fake data shown
  • 19. www.userzoom.com Analyze results with UZ Analytics: Survey results Fake data shown
  • 20. www.userzoom.com Analyze results with UZ Analytics: Clickstreams per task Fake data shown
  • 21. www.userzoom.com Analyze results with UZ Analytics: Clickmaps/heatmaps per page Fake data shown
  • 22. www.userzoom.com UZ Analytics reporting & exporting capabilities  Lots of actionable data  combination of usability and behavior  Many advanced analysis features and capabilities  Generate automatic reports (.doc, .html future release)  Copy & paste capabilities  Export raw-data  Share results online Highlight Highlight #6 #6
  • 23. www.userzoom.com International user experience study Denise Nangle UX Researcher
  • 24. www.userzoom.com Background  Historically, Monster delivered incremental changes to UI  Project REDUX was a redesign of the entire site, offering new products and a new user experience  We needed an objective method to evaluate the strengths and weaknesses of this new user experience  Solution? Userzoom remote, international usability study  Kick off for US, UK, France, Germany and Netherlands studies in January 2009
  • 25. www.userzoom.com Objectives  Measure user satisfaction in 5 key markets  Measure task success and efficiency and identify usability issues as users complete common tasks  Evaluate ease of use and likelihood of using Monster in the future  Collect data on users’ likes as well as their pain points  Compare results with past remote studies and develop benchmarks
  • 26. www.userzoom.com Methodology  Recruited 250 participants per channel (total = 1250)  Each participant completed 4 tasks; each task was followed by a series of questions and a final questionnaire  Collected clickstream data to generate heat maps, which provided additional data on user behavior
  • 27. www.userzoom.com How Userzoom is helping Monster build a better user experience  Using large sample sizes across different markets, we identify opportunities for improvement in a very short period  We capture longitudinal metrics to demonstrate improvement over time  We triangulate results with other sources of data (marketing studies, web analytics, heuristic reviews, lab studies) to help product, development and UX teams make informed decisions based on actual data  It showed us that less satisfied users are more specific in describing what they’d like us to offer, and we take advantage of that information when designing other studies  When we bring a holistic approach to our research strategy and share the entire user experience, we are building a better UX team
  • 28. www.userzoom.com Thank you, Denise! Let’s do a quick summary and Q&A session now…
  • 29. www.userzoom.com Summary & highlights 1. Today’s Web Business Managers seek more sophisticated and innovative research and analytics products to help them compete 2. Very cost-effective and fast research method 3. Various options for user recruitment 4. Versatility of our tool, research you can do 5. Great scripting capabilities, lots of control for the researcher… 6. …as well as analytics, reporting & exporting capabilities Now on to the questions…
  • 30. Q&A session Would you like a demo? Contact us and we’ll offer you a chance to see and try out our technology Here’s our contact information Alfonso de la Nuez Sales Manager, USA Founder & CTO / R&D alfonso@userzoom.com www.userzoom.com Xavier Mestres Founder & Int’l Business Dev Members of Virginie Glaenzer vglaenzer@userzoom.com xmestres@userzoom.com USA Office  440 N. Wolfe Rd. - Sunnyvale, CA 94085 (USA) · [t] +1 (408) 524 7445 Spain offices  Av. Diagonal 419, 3º 2ª - 08008 Barcelona - T. +34 93 414 75 54 - F. +34 93 368 42 95  Gran Vía 62, 7º Izda. - 28013 Madrid - T. +34 91 542 62 52 - F. +34 91 298 08 92 Also in London in Sep 09!