Redesigning with Remote Research


Published on

This case study will demonstrate how remote user research shaped the redesign of

Published in: Economy & Finance, Business
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Redesigning with Remote Research

    1. 1. Redesigning with Remote Research Chris Farnum | Senior Information Architect | Enlighten Internet User Experience 2008 April 2, 2008
    2. 2. About the Client - TCS <ul><li>IT Services, Business Solutions and Outsourcing </li></ul><ul><li>HQ – Mumbai, India </li></ul><ul><li>Part of Tata Group, one of India’s largest industrial conglomerates and most respected brands </li></ul><ul><li>TCS has over 108,000 IT consultants in 47 countries </li></ul><ul><li>TCS Annual Sales: $4.3 billion (2006-2007 fiscal year) </li></ul><ul><li>Known for quality results – CMMI Maturity Level 5 </li></ul>
    3. 3. Project Goal – Redesign <ul><li>Global Message: Position TCS as a global company and highlight the message of the Global Network Delivery Model ™ </li></ul><ul><li>Brand building: Firmly establish TCS positioning and support the “Experience Certainty” campaign now and into the future </li></ul><ul><li>Demand generation: Create an environment to support Demand Generation using the new website </li></ul><ul><li>User-centric Design: Design and Develop site based on key user needs and tasks (i.e., ‘outside in’ vs. ‘inside out’) </li></ul><ul><li>Technical Infrastructure: Develop the new site on a scaleable Content Management System to facilitate content development & maintenance - Microsoft Sharepoint 2007 </li></ul>
    4. 4. Project Overview Engagement Plan Facilitated Work Sessions Analysis of Key Internal and External Factors Conduct User Research Project Requirements Strategic Assessment Project Requirements Information Architecture User Interface Functional Specifications Technical Specifications Art Comps Test Plan / User Acceptance Testing Launch Specifications Site Specification Art Production Programming Integration Quality Assurance User Acceptance Testing Staging Deployment Final Site Update Monitor Measure Report Improve On-Going Improvements DEFINE DESIGN BUILD Feature / Scope Definition Technical & Implementation Recommendations Preliminary UI Art Comps Strategy Requirements Design Build Maintenance
    5. 5. Research Step One – Stakeholder Interviews <ul><li>Enlighten and TCS staff conducted 28 group interview sessions on site in Chennai and Mumbai and by conference call with: </li></ul><ul><li>Practice Leads </li></ul><ul><li>Delivery Heads </li></ul><ul><li>Business Unit Managers </li></ul><ul><li>Sales Leaders </li></ul><ul><li>Human Resource Leaders </li></ul><ul><li>Global Representatives </li></ul><ul><li>Executive Leadership </li></ul><ul><li>Estimate: 60-70 participants </li></ul>Photo courtesy of Scott Mills
    6. 6. Site March 2007 – Home <ul><li>Long, crowded, and overwhelming </li></ul><ul><li>High abandonment rate </li></ul>
    7. 7. Original Site’s Organization & Navigation <ul><li>Left navigation </li></ul><ul><li>Overlapping choices </li></ul><ul><li>Options not grouped by type – apples and oranges </li></ul><ul><li>Prioritization of choices could be improved </li></ul>
    8. 8. Original Site – Services Channel Landing Page Calls to action need to be improved Channel navigation has no on-states Content could use more structure and editing
    9. 9. Interim Site – Launched Spring 2007
    10. 10. Interim Site Channel Content Channel navigation within a closed page element.
    11. 11. User Research Part One - Overview <ul><li>Research goals – to gain a better understanding of… </li></ul><ul><li>Buying cycle and research process </li></ul><ul><li>Site content and features </li></ul><ul><li>Brand attributes and positioning </li></ul><ul><li>How users see the relationships and grouping between different types of content </li></ul><ul><li>19 Participants </li></ul><ul><li>Customers representing North America, Ibero-America and UK (15) </li></ul><ul><li>Analysts (2) </li></ul><ul><li>Career Seekers (2) </li></ul><ul><li>User Segments </li></ul><ul><li>Customer: C-Level </li></ul><ul><li>Customer: Business Unit Manager </li></ul><ul><li>Industry Influencers </li></ul><ul><li>Career Seeker (Mid-career) </li></ul>
    12. 12. User Research Part One - Methods <ul><li>Remote user research allowed us to connect with users in their own offices while we remained in ours. </li></ul><ul><li>Sessions consisted of: </li></ul><ul><li>Interview questions </li></ul><ul><ul><li>Likert Scale questions (scale of 1-10) to measure the importance of site features and content </li></ul></ul><ul><ul><li>Discussion questions about buying cycle and brand perception </li></ul></ul><ul><li>Online card sorting observed in real time to inform organization of content </li></ul><ul><ul><li>Remote user testing tool: UserVue </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li>Online card sorting tool: WebSort </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li>Analysis with EZ-Calc </li></ul></ul>
    13. 13. Remote Research with UserVue Moderator (Enlighten, Ann Arbor) Participant (US, S. America, Europe…) TCS Observer (Chicago) TCS Observer (Mumbai) Desktop sharing via UserVue Voice via conference call line
    14. 14. UserVue Kung Fu <ul><li>Normally UserVue places a call directly to the participant – domestic calls ONLY. </li></ul><ul><li>For international calling , have UserVue dial an international conference call bridge line. </li></ul><ul><li>Send detailed instructions to particpants with invitations for accessing the prototype and the conference call. </li></ul><ul><li>Watch out for spam filters ! </li></ul><ul><li>Be flexible in case of poor connections. </li></ul><ul><li>Leave plenty of time between sessions if you want to capture video. </li></ul><ul><li>Practice! </li></ul>
    15. 15. Card Sorting Online with WebSort
    16. 16. User Research Part One - Findings <ul><li>Top 5 Features Ranked by Average “Importance” Score (1 – 10) </li></ul><ul><li>Case studies (7.8) </li></ul><ul><li>International locations/language (6.9) </li></ul><ul><li>White papers (6.4) </li></ul><ul><li>Articles about Innovation/R&D (6.4) </li></ul><ul><li>Press Releases (6.3) </li></ul><ul><li>Recommendation: Provide easy access to these basic types of content and make certain that they are well structured and well written. Also, take care to NOT overplay the marketing message. </li></ul>
    17. 17. User Research Part One – Findings cont. <ul><li>Key Observations: </li></ul><ul><li>Overall, users were comfortable sorting content into groupings by Industries and Services/Solutions. </li></ul><ul><li>Products, enterprise software, development environments formed reasonably cohesive groupings but were more difficult to place within the whole organization. </li></ul><ul><li>Case studies were easily recognizable and often grouped together on the basis of document type. </li></ul><ul><li>Certain individual topics like eLearning and enterprise software were more problematic. </li></ul><ul><li>Recommendations: </li></ul><ul><li>Create a site structure and navigation system that equally supports users who wish to browse either by horizontal services or vertical industries . </li></ul><ul><li>Provide alternate ways to find content by type (case study, white paper, etc.) </li></ul><ul><li>TCS Products are relevant both within their industry contexts and also aggregated as a type of offering. </li></ul><ul><li>Create special categories as needed to accommodate topics like Enterprise Software (e.g. SAP). </li></ul>
    18. 18. User Research Part One – Card Sort Diagram
    19. 19. User Research Part One - Outcomes <ul><li>Key Outcomes </li></ul><ul><li>Strategic recommendations and prioritized feature set </li></ul><ul><li>Report to client stakeholder governance board </li></ul><ul><li>Personas for high-priority user segments </li></ul><ul><ul><li>CIO </li></ul></ul><ul><ul><li>Business Unit Manager </li></ul></ul><ul><ul><li>Career Seeker </li></ul></ul><ul><ul><li>Industry Analyst </li></ul></ul><ul><li>High level information architecture recommendations </li></ul>
    20. 20. Proposed High Level Information Architecture
    21. 21. User Research Part Two - Overview <ul><li>Goal - get feedback on initial idea for key pages and features: </li></ul><ul><li>Home </li></ul><ul><li>Solutions/Offerings landing page </li></ul><ul><li>Services description detail page </li></ul><ul><li>About, Contact TCS </li></ul><ul><li>TCS Worldwide. </li></ul><ul><li>Participants - 9 participants (volunteers from part one) </li></ul><ul><li>6 customers </li></ul><ul><li>1 analyst </li></ul><ul><li>1 career seeker </li></ul><ul><li>1 TCS stakeholder </li></ul><ul><li>After five interviews, we updated the prototype to incorporate the feedback we had received so far. </li></ul>
    22. 22. User Research Part Two – Prototyping Methods <ul><li>Remote user testing with a clickable prototype </li></ul><ul><li>IA + Design collaboration = Medium Fidelity </li></ul><ul><li>Prototype created </li></ul><ul><li>with Visio + SWIPR </li></ul><ul><li> </li></ul><ul><li>Task based user testing sessions </li></ul><ul><li>Measure feedback via Likert Scale Questions </li></ul><ul><ul><li>Ease of Use: 1-10 </li></ul></ul><ul><ul><li>Usefulness: 1-10 </li></ul></ul><ul><li>Clients and internal team members observe live remotely and watch video captured from sessions </li></ul>
    23. 23. Prototype Version A - Home Industries not expected here Useful feature but not noticed Too much duplication
    24. 24. Prototype Version B - Home Industries and Offerings split, “Solutions” gone New layout with Flash promo area better shown, No main navigation bar on Home Content filter tool now more prominent Thought Leadership instead of Best Practices
    25. 25. More Prototype Pages – Channel Landing Global Navigation bar Interactive channel landing pages
    26. 26. More Prototype Pages – Topic Node Channel navigation Calls to action Channel content
    27. 27. More Prototype Pages – Interactive Map Details available via user user interaction
    28. 28. User Research Part Two - Outcomes <ul><li>Overall Acceptance of the prototype was good. </li></ul><ul><ul><li>Scores improved from version A to version B </li></ul></ul><ul><ul><li>Overall combined average score was approx 7 out of 10 </li></ul></ul><ul><ul><li>Some concerns about usefulness of article content </li></ul></ul><ul><li>Revised site architecture – Solutions  Offerings and Solutions </li></ul><ul><li>Adjusted labels – e.g. Best Practices  Thought Leadership </li></ul><ul><li>Repositioned tool for finding Case Studies and other resources </li></ul><ul><li>Adjusted site navigation and approach to main channels on Home </li></ul><ul><li>Worldwide map concept proved very popular </li></ul><ul><li>Contact Us scores improved dramatically in version B </li></ul>
    29. 29. Revised High Level Information Architecture
    30. 30. Next Step - Designing the Solution <ul><li>Next steps: </li></ul><ul><li>Revised wireframes and created a Functional Specification </li></ul><ul><li>Content types and descriptive metadata attributes </li></ul><ul><li>9 Core Page Types for the content management system </li></ul>
    31. 31. Designing the Solution – Functional Requirements Global Page Components Wireframes & Page Requirements
    32. 32. Designing the Solution – Moving from Design to Build <ul><li>Design Comps </li></ul><ul><li>Production Art </li></ul><ul><li>Site Inventory </li></ul><ul><li>Site Copy and Content </li></ul><ul><li>Creation of HTML page templates </li></ul><ul><li>Content Management System implementation </li></ul><ul><li>Flash development </li></ul><ul><li>QA Testing </li></ul><ul><li>UAT </li></ul><ul><li>Hosting… </li></ul>
    33. 33. The Big Moment Arrives! <ul><li>TCS.COM Relaunch – February 2008 </li></ul>
    34. 34. Relaunch - Home
    35. 35. Relaunch – Channel Landing
    36. 36. Relaunch – Topic Node <ul><li>Screenshot – with callouts? </li></ul>
    37. 37. Relaunch – Content Article
    38. 38. Relaunch – Worldwide Locations
    39. 39. Relaunch – Worldwide: Google Map
    40. 40. Relaunch – Contact Us
    41. 41. Web Analytics & Measurement <ul><li>Our scorecard so far … </li></ul><ul><li>Home page abandonment rate is down </li></ul><ul><li>Offerings is the most popular channel </li></ul><ul><li>Industries Channel funnels traffic to Offerings </li></ul><ul><li>About isn’t often the first section visited, but gets the second highest amount of traffic </li></ul><ul><li>Worldwide pages – 8% of site traffic </li></ul><ul><li>Thought Leadership gets the fewest visits of any of the main sections, but includes all main visitor groups: investors, careers, client content. </li></ul><ul><ul><li>Often followed by white papers and case studies in the same visit </li></ul></ul><ul><ul><li>Visits occurs late in sessions, not right away </li></ul></ul>3 mins 2:35 mins Visit Length 4.5 pages 3.43 pages Ave Pages Per Visit After Before
    42. 42. Web Analytics – Home Page “Heat Map”
    43. 43. Final Thoughts <ul><li>Prioritizing features within a large distributed organization is challenging - user research helps in making tough decisions </li></ul><ul><li>Try remote user testing: </li></ul><ul><ul><li>When local users are hard to recruit and schedule </li></ul></ul><ul><ul><li>When user segmentation requires geographic diversity , but you are on a tight schedule </li></ul></ul><ul><li>Prototyping is a great way to make your mistakes earlier and get your internal team and the client engaged </li></ul><ul><li>Go to India if you get the chance! </li></ul>Photo courtesy of Scott Mills
    44. 44. In Closing <ul><li>Questions and Comments? </li></ul><ul><li>Download: </li></ul><ul><li>This presentation is available online via Slideshare: </li></ul><ul><li> </li></ul><ul><li>Contact: </li></ul><ul><li>Chris Farnum, Senior Information Architect [email_address] </li></ul><ul><ul><ul><li>Enlighten Interactive Marketing | Web Development | Strategic Consulting </li></ul></ul></ul><ul><ul><ul><li>Ann Arbor, Michigan | </li></ul></ul></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.