Sentient Services (Ubiquity Marketing Un Summit 2009) V1


Published on

Is Market Research Dead in a 2.0 world?

Presentation given at the Ubiquity Marketing unSummit in Austin, TX. September 3, 2009.

Covers the current state of research in a customer driven web2.0 world. Contains tips and resources for entrepreneurs to leverage free and inexpensive market research techniques.

Published in: Business, News & Politics
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Sentient Services (Ubiquity Marketing Un Summit 2009) V1

  1. 1. Ubiquity Marketing unSummit<br />Is Market Research Dead in a 2.0 world?09.03.09<br />
  2. 2. What we will talk about<br />Sentient<br />Is research dead – in a 2.0 world?<br />Inc. article and response<br />Why research?<br />Ways for entrepreneurs to leverage <br />Best practices – stuff you can leave with<br />
  3. 3. Who We Are<br />Sentient Services is a Knowledge Studio® - the amalgamation of market research, user experience and information design practices. We leverage these core competencies for our clients in product development, interactive, sales, marketing, advertising and branding.<br />Sentient provides the knowledge to lead and the tools to connect with customers through research, customer innovation and technology.<br />We work with startups and F500 clients around the globe<br />We specialize in technology and companies that leverage technology and the internet in their products, marketing and sales<br />Accolades as a good company to work with and for:<br />2008 Inc. 5000 list<br />2007 and 2008 Fast 50 – Named one of the fastest growing privately held companies in Central Texas<br />2007 and 2008 Top 15 agency in Austin, Texas by the Austin Business Journal<br />2007 Best Places to Work in Central Texas<br />
  4. 4. What We Do<br />Information design providing the right information, in the right place, at the right time.<br />Usability services for web, software, product and creative with state-of-the-art lab.<br />Customer insights through advanced quantitative and qualitative methodologies.<br />Our Information Design practice provides an unparalleled scientific and customer research driven information platform<br />Content strategy | Information architecture | Heuristic design|<br />Interaction layers & dependencies | Wireframes <br />Full-service worldwide quantitative and qualitative research. We cover branding, customer engagement, market analysis (segmentation, sizing, pricing), product development and usability.<br />Focus groups | In-depth-interviews | Usability & Eye tracking | Online groups |<br />Web-based surveys | Phone-based surveys | Custom panel development<br />We conduct concise, measurable and actionable usability research, covering a range of different media including websites, software, email, packaging, interactive, print and television.<br />Business definition | Contextual assessment | Heuristic evaluation | Personas |<br />Task analysis | Usability analytics | Reporting (IA, content, wireframe)<br />
  5. 5. What we will talk about<br />Sentient<br />Is research dead – in a 2.0 world?<br />Inc. article and response<br />Why research?<br />Ways for entrepreneurs to leverage <br />Best practices – stuff you can leave with<br />
  6. 6. “The Customer Is the Company”<br />In June of 2008 Inc. published an article about Threadless entitled “The Customer Is the Company”. MIT’s Eric von Hippel implied that their business model spelled the end of traditional market research and large R&D departments. <br />You see, they get all their designs and input on what to sell from their customers via their website. Welcome to a web2.0 company. <br />So, is the market research industry out of business?<br />
  7. 7. Market Research – current state<br />On the surface, some major shifts.<br />Web2.0 “Threadless” effect<br />Response rates are declining, development cycles are shortening, costs are increasing…<br />Free survey software is out there and you can now use Facebook, LinkedIn… (all actually good resources given the right task)<br />Just because it worked 50 years ago does not mean it works today<br />Non-response bias, large internet samples lead to false stats…<br />There is still a place for market sizing and large scale quant segmentation studies<br />However, these are few and far between<br />Biggest value in market research for emergent sectors and companies lies in <br />developing the right product/service (usability, UI, lead user and observational design) <br />clearly communicating emerging and technical concepts with associated value propositions <br />… all targeted to the right person at the right time via engaging and salient media (what the other fine folks are here to talk about, so I will skip this)<br />
  8. 8. What is changing, what is not.<br />So, I wrote back to Inc. <br />“You can call it crowdsourcing or customer-driven design, but what Threadless does is essentially market research. I think of Threadless&apos;s user base as one large consumer panel. Threadless&apos;s business model immediately implements the findings from this market intelligence. What traditional market research does is similar. It provides the framework, methodology, and discipline to solicit feedback from customers. The rise of Threadless does not mean the end of market research but a transformation in the way companies implement it. That&apos;s what&apos;s changing.”<br />Knowledge by itself is not power, knowing what to do with it is. Call it what you want, but the basis of needing to understand customers and cut through questioning biases, sampling issues, analysis and then turning data into bite-sized business intelligence has not changed. Oh, and that is called market research.<br />
  9. 9. Why Market Research?<br />Two main reasons: Product Development + Branding. Why these two?<br />Product Development<br /><ul><li>If you want to keep your customers, if you want to know why you are losing business, if you want to know how to make your product/service better – just ask
  10. 10. Observational design and lead-user development are key and cost-effective tools to avoid extremely costly mistakes AND to develop additional breakthroughs that internal teams simply couldn’t have imagined – “forest and trees”</li></ul>Branding<br /><ul><li>Rapidly changing paradigms make today’s bleeding edge old tomorrow – you can get leapfrogged much too easily
  11. 11. Minimum ownership of means of production – the true knowledge economy
  12. 12. As quickly as tech is emerging many sectors are becoming “commodities” where good enough covers end-user needs</li></li></ul><li>What we will talk about<br />Sentient<br />Is research dead – in a 2.0 world?<br />Inc. article and response<br />Why research?<br />Ways for entrepreneurs to leverage <br />Best practices – stuff you can leave with<br />
  13. 13. Research is important, but it costs $<br />Yes and yes – but here are a few ways to get around that<br />There are many great FREE web survey tools out there ( is one of my favorite, and it has discounted non-profit pricing)<br />And, since the best research you can do is with current customers, typically the sample costs you nothing<br />Most research does not have to be complicated! Keep It Simple. If you don’t, you will spend more time convincing others that the analysis is correct than actually taking action on it<br />You can easily create basic online groups or forums to get feedback using LinkedIn. Facebook, Ning and other platforms<br />There is a ton of research already done – look at SEC filings, press releases, lobbying firms for your industry do a ton of research, local Chamber of Commerce…the list goes on<br />
  14. 14. What will still cost you<br />Time – if you want your research done on time, typically you will need to dedicate resources or hire an outside firm<br />Advanced analytics – segmentation, conjoint…<br />Nuanced survey writing – internal and external validity<br />Professional research management (replicates, non-responses analysis, normalizing data…)<br />In-person with facilities, one-way mirror, eye tracking<br />Prospect survey or focus group respondents<br />
  15. 15. What we will talk about<br />Sentient<br />Is research dead – in a 2.0 world?<br />Inc. article and response<br />Why research?<br />Ways for entrepreneurs to leverage <br />Best practices – stuff you can leave with<br />
  16. 16. Market Research<br /><ul><li>What is it?
  17. 17. Understanding why you are in business
  18. 18. When to use it?
  19. 19. When you don’t know, really
  20. 20. When not to use it?
  21. 21. When you can’t do anything with the answers
  22. 22. What can you do with it?
  23. 23. Make better products, say the right thing to the right person at the right time – spend your money wiser!
  24. 24. What it is not? Why are budgets hard to get sometimes?
  25. 25. Production, sales staff, advertising…not historically tangible or integrated
  26. 26. Why spend money on market research?
  27. 27. Because it makes the list above infinitely and measurably better</li></li></ul><li>Scoping a Project<br />What to do in-house?<br />Understand your business and where you have questions – don’t pay someone to do basic homework.<br />What to outsource?<br />Survey writing and analysis at a minimum – these are where the adage “Forest andthe trees” can bite you.<br />How to choose a methodology?<br />Quant. – when you need to size, project, track and otherwise measure<br />Qual. – when you need to understand, develop, “speak” and interact<br />How to choose a vendor?<br />Varies by your internal expertise and need for output and implementation<br />
  28. 28. Steps<br />
  29. 29. Survey Writing<br />Tone – don’t speak down, assume limited time and attention (respondents will skim), but don’t make too techy <br />Scales – huge debate here but some general guidelines:<br />Allow a Don’t Know/Refuse option<br />If the survey is short anchor all points<br />Avoid a mid-point (unless you can make a strong argument)<br />Create positively skewed response scales<br />Design and layout<br />Just because the web is “easy” does not mean that design can be ignored<br />Same basic principals that go into mail surveys apply here<br />Eye movement (columns, scrolling, etc.)<br />Column widths, number of pages vs. scrolling etc.<br />
  30. 30. Fielding and Project Management<br />Invitations and reminders<br />Subject line is important<br />“Need your feedback”<br />Check for common words that will get caught by SPAM filters<br />Have a call to action and how they benefit – “This is your chance to provide direct feedback on the products you use and to help make them better.”<br />Timing<br />Launch Tuesday-Thursday 10-2pm CST – for US<br />Majority of responses will come back within 48 hours<br />Send reminders out 3-5 business days later, no more than 2 reminders at most<br />SPAM and customer service<br />Stay in compliance (physical address, opt-out links, etc.)<br />Quality control<br />Check responses – do numbers make sense, it if looks wrong it probably is<br />Check for response outliers and remove if needed<br />Ensure that survey fielding period is long enough to get hard to reach respondents – replicates<br />Non-response bias<br />Sub-par response rate<br />Panels vs. RDD<br />
  31. 31. Turning Data into Insight and Action<br />Don’t walk…. Run – don’t let the results gather dust<br />Do share the results – don’t worry about knowledge ownership<br />But, ensure that implications and application of the data is clear in presentation/ briefing<br />But, don’t rush – one insignificant (there is not such thing) wrong number will call the entire study into doubt<br />Don’t overcomplicate the data or the results<br />Avoid weighting if at all possible<br />If you can’t summarize the key points on one page, try and try again<br />
  32. 32. Market Research – Core Competency<br />Our Market Research practice helps clients take the first step in interacting with customers, building better products and communicating – LISTENING<br />We combine our proven research principles with a depth of experience in sociology, psychology, economics, statistics and marketing. Key business areas we provide research intelligence for include:<br />Branding<br />Customer Engagement<br />Market Analysis (segments, sizing, pricing)<br />Product Development<br />Usability<br />Interactive<br />Social Media<br />
  33. 33. Market Research – Goals + Methodologies<br />RESEARCH GOAL<br /><ul><li>Understand the motivations </li></ul> underlying customer behavior<br /><ul><li>Develop, design, refine
  34. 34. Observe, brainstorm, ideate
  35. 35. Develop survey content
  36. 36. Marcom testing/development
  37. 37. Understand how users interact with product, software, or website
  38. 38. Pinpoint deficient or difficult-to use areas
  39. 39. Identify ways to improve the user experience
  40. 40. Increase interaction and sales
  41. 41. Brand awareness/Brand equity
  42. 42. Market size
  43. 43. Customer profile
  44. 44. Customer experience
  45. 45. Product/Service development
  46. 46. Marcom testing/development</li></ul>METHODOLOGY<br />QUALITATIVE<br />USER EXPERIENCE<br />QUANTITATIVE<br /> SENTIENT TOOL KIT<br /><ul><li>In-person/Web-based groups
  47. 47. In-person/Web/Phone interviews
  48. 48. Language analysis
  49. 49. Facial and behavioral coding
  50. 50. Observational fielding
  51. 51. Group ideation
  52. 52. Projective techniques
  53. 53. In-depth interviewing
  54. 54. Usability testing
  55. 55. Contextual inquiry
  56. 56. Eye-tracking analysis
  57. 57. Facial and behavioral coding
  58. 58. Language analysis
  59. 59. Experimental design
  60. 60. Web/Telephone surveys
  61. 61. Brand concept mapping
  62. 62. Market segmentation
  63. 63. Advanced modeling
  64. 64. Conjoint analysis
  65. 65. Text analysis
  66. 66. Data mining/Segmentation</li></li></ul><li>Market Research – Messaging Research Platform<br />IMAGERY & CREATIVE<br />POSITION:<br />WHO ARE YOU? What is the one idea or thought that will resonate with customers above all else, match their needs and set you apart from the crowd?<br />DIFFERENTIATION:<br />How are you better?<br />SIGNIFICANCE:<br />Why customers should care?<br />IDENTITY:<br />What do you do?<br />Very specifically & very simply – who are you?<br />True & meaningful differences. This is why you exist.<br />What is in it for the customer? Why do your differences matter to them?<br />MESSAGING SUPPORT:<br />Attributes, features and benefits<br />3<br />1<br />4<br />2<br />EMOTIONAL:<br />Emotional derivatives of brand interaction<br />
  67. 67. User Experience – Core Competency<br />We conduct concise, measurable and actionable usability research, covering a range of different media including websites, software, email, packaging, interactive, print and television. Our User Experience group works across the board from product development to creative optimization to increase business success through user-centered design.<br />Business Definition<br />Contextual Assessment<br />Heuristic Evaluation<br />Persona Development<br />Task Analysis<br />Usability Analytics<br />Reporting (IA, content, wireframe)<br />Consulting (see Information Design section)<br />
  68. 68. User Experience – Lab<br />Sentient owns and operates a singularly dedicated, state-of-the-art usability lab and focus group facility. The lab has the latest technology, including eye tracking, huge HD viewing screen, remote web viewing, and studio-quality video and sound.<br />We conduct:<br />Eye Tracking for web, software, packaging and advertising <br />Usability sessions<br />Focus groups<br />In-depth-interviews<br />Our usability setup (including eye tracking) can roll mobile to any location globally<br />
  69. 69. User Experience – Why Eye Tracking?<br />Eye tracking complements traditional behavioral and self-reported measures of user experience with physical measures of eye movements, showing us what users pay attention to and how they process the information they see<br />Eye tracking sheds light on the why underlying the what of user behavior:<br />Assess decision-making processes<br /> What elements of the medium do users consider before finally selecting one - all available options or only a few? <br />Search strategies and efficiency<br />How do users look for relevant information? Where do they expect it to be? Do they quickly recognize a relevant link/action signifier or do they need to read over it several times before taking action? How does messaging and copy interplay with the design and user experience?<br />Evaluate the match between visual design and business objectives<br />Which elements are users immediately drawn to during those critical first seconds of impression formation? Are the impressions formed from these images consistent with business objectives? <br />When eye tracking is added to the usability arsenal, we learn not only if design weaknesses exist, but also where they lie, why they fail and how to fix them<br />Eye tracking allows for meaningful benchmarking and measurable usability tracking <br />Heatmaps and gaze timelines allow for easy and accurate comparison between sites, ads and other visual stimuli (e.g., does it take 8 views to find vs. 5, is X viewed more than Y?).<br />
  70. 70. Heatmaps – What Do They Tell Us?<br />A heatmap is an aggregate image representing the eye gaze data of all users viewing a given page - the warmer colors at specific points on the page indicate where people’s viewing patterns converge, and thus show us which items or region draw the most attention from the group<br />A heatmap image provides a single-glance depiction of information viewing and patterns of usage<br />Even more importantly, it shows those areas that users never see at all – and if they didn’t see it, they can’t use it or choose it<br />Heatmaps provide a powerful visual tool that is driven by user behavior and allows clients to quickly spot design gaps, capitalize on usage patterns and communicate design direction easily to teams<br />
  71. 71. Heatmap – Example<br />Warmer colors indicate the areas that are viewed the most <br />Symbols indicate where each user clicked to navigate away from the page<br />
  72. 72. Gaze Timelines – What Do They Tell Us?<br />A gaze timeline is an individual image that indicates the path of one user’s eye gaze for the duration of each page, view or visual stimulus. Each circle indicates a fixation, and larger circles indicate longer fixations<br />Analyzing gaze timelines allows us to answer fine-grained questions such as:<br />What element(s) are viewed first, second and so on for a given task or impression?<br />Did users have trouble comprehending the information or design before taking action?<br />Did users see and then choose to skip over an area or simply not see it at all?<br />
  73. 73. Gaze Timeline – Example<br />This site is well-designed for Search Task A<br />This site is not well-designed for Search Task B<br />Relatively few fixation points and short scanpaths (lines between the fixation circles) indicate an efficient search <br />Numerous fixation points and long scanpaths indicate an inefficient search <br />
  74. 74. Gaze Timeline – Print Ad Example<br />In the first 5 seconds a viewer looks at faces first<br />Prices are not noticed in the first 5 seconds<br />Words in bubbles get read before standard text<br />Colored text and shapes draw attention to offers on the right, but not to pricing<br />Bottom left corner is a “dead” spot<br />5 Seconds<br />
  75. 75. Information Design– Core Competency<br />Our Information Design practice provides an unparalleled scientific and customer research driven information platform<br />Sentient Service’s Information Design group creates a user experience that delivers the right information in the right place at the right time<br />Content Strategy <br />Information Architecture<br />Heuristic Design<br />Interaction layers and dependencies<br />Wireframes<br />
  76. 76. Information Design – Approach <br /><ul><li>Our approach is user driven:</li></ul>WHO<br />WHY<br />WHAT<br />Understand who is using, their intent and motivations for interaction<br />Understand why they are using it this particular time<br />Understand what information and activity is important in the dialogue<br /><ul><li>From here we follow these rules that drive your success:</li></ul>REDUCE<br />SMART<br />INCREASE<br />Reduce the interaction layers and communications layers to their essence – smart is simple<br />The tools for smart design – market research, user experience/eye tracking, interactive expertise<br />Increase click rates, brand interaction, stickiness and sales through an improved user experience<br />
  77. 77. Contact Information<br />512.288.1706<br /> <br /><br />Paul Janowitz, CEO & Founder<br /><br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.