Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Best Practices In Market Research Portals


Published on

  • Be the first to comment

  • Be the first to like this

Best Practices In Market Research Portals

  1. 1. MI Metrics™: Web Search Example Q4 2008 – Q2 2009
  2. 2. Background
  3. 3. Northern Light overview <ul><li>Headquartered in Cambridge, Massachusetts </li></ul><ul><li>55 employees </li></ul><ul><li>Founded in 1996 and purchased by employees in 2003 </li></ul><ul><ul><li>Senior management 13 years with the company </li></ul></ul><ul><ul><li>Profitable and cash flow positive </li></ul></ul><ul><ul><li>Compound growth rate of 38% 2004 – 2008 </li></ul></ul><ul><ul><li>Up 30% for the first six months of 2009 over 2008 </li></ul></ul><ul><li>Northern Light has a single business: provide strategic research portals, content, and research services to the world’s leading organizations </li></ul>
  4. 4. Our current clients include many of the leading technology companies in the world <ul><li>Largest computer equipment manufacturer </li></ul><ul><li>Largest IT technology services provider </li></ul><ul><li>Largest IT security software company </li></ul><ul><li>Largest mobile phone manufacturer </li></ul><ul><li>Second largest global pharmaceutical company </li></ul><ul><li>Largest pharmaceutical company providing medications used to treat psychiatric and mental health-related conditions </li></ul><ul><li>Largest office supply superstore chain </li></ul><ul><li>Largest package delivery company </li></ul><ul><li>Largest disk drive manufacturer </li></ul><ul><li>Leading property and casualty insurer </li></ul><ul><li>Largest CAD/CAM solutions provider </li></ul><ul><li>Largest telephone system operator </li></ul><ul><li>Largest market research company </li></ul>
  5. 5. Background <ul><li>This is examination of Web search engine coverage and commentary from IT Analysts (e.g., Forrester, Gartner, IDC etc.) in the news for the time period covering the last quarter of 2008 and first two quarters of 2009 </li></ul><ul><li>Each of the main players in the market (Google, Microsoft, and Yahoo) are examined </li></ul><ul><li>Northern Light performed the examination using </li></ul><ul><ul><li>Northern Light Business News: 25,000 news stories per day from 8,000 sources, including 2,500 Industry Authority Blogs </li></ul></ul><ul><ul><li>MI Analyst™, Northern Light’s proprietary text analytics and sentiment scoring engine </li></ul></ul><ul><ul><li>Researchers on Northern Light’s staff </li></ul></ul>
  6. 6. Background (continued) <ul><li>In an actual client assignment, as opposed to this sample version, Northern Light could provide an analysis of commentary in IT analyst reports (from firms like Gartner, Forrester, IDC )in addition to commentary of IT analysts in the news </li></ul><ul><li>IT analyst reports are important influencers in technology markets </li></ul><ul><ul><li>Roughly half of analyst commentary on companies occurs in analyst reports and half in news </li></ul></ul><ul><ul><li>Need both sets analyzed for a comprehensive picture </li></ul></ul><ul><li>Also, this example limits the analysis to news commentary influenced by IT analysts, but in an actual client assignment this or any other limitation would be a client option </li></ul><ul><li>Lastly, in an actual client example any research source can be included at the clients option </li></ul><ul><ul><li>For example, market research reports, industry conference proceedings, Web social media, other licensed news feeds, etc. </li></ul></ul>
  7. 7. Deliverables <ul><li>MI Metrics’ deliverables consists of four major items </li></ul><ul><ul><li>Point of View: Northern Light’s summary of the business significance of the coverage and the commentary </li></ul></ul><ul><ul><li>Metrics: quantitative analysis of the press coverage or research given each competitor (commentary, share of voice, sentiment, and trends) </li></ul></ul><ul><ul><li>Identification of publishers, journalists, analysts, and authors who are providing positive and negative commentary </li></ul></ul><ul><ul><li>Quotes: comprehensive excerpts from the commentary supporting the major themes </li></ul></ul>
  8. 8. Point of View
  9. 9. Point of View - Metrics <ul><li>Microsoft's release of its new Web search engine, Bing, in Q2 ‘09 was the salient event that happened over this time period </li></ul><ul><li>The release of Bing increased press reports of IT analyst commentary about the category significantly </li></ul><ul><li>Amazingly, the release of Bing increased the positive IT analyst commentary of Google </li></ul><ul><ul><li>This could not have been the outcome that Microsoft was hoping for when it took the Bing story on the road with a press tour </li></ul></ul><ul><li>IT analyst press commentary of Microsoft’s Web search engine did increase as a result of Bing and the net sentiment expressed by IT analysts swung from negative to slightly positive </li></ul>
  10. 10. Point of View – Metrics (continued) <ul><li>Meanwhile Yahoo appeared caught in the crossfire as </li></ul><ul><ul><li>IT analyst press commentary for its Web search efforts did not increase in volume like its competitors </li></ul></ul><ul><ul><li>Yahoo IT analyst commentary reversed a trend toward a positive tone, with sentiment nose-diving into negative territory (once again) </li></ul></ul>
  11. 11. Point of View – Business Issues <ul><li>Bing may shake up the market </li></ul><ul><ul><li>Bing is trying to change the search paradigm by offering more value to users on the search result than Google does </li></ul></ul><ul><ul><li>Microsoft has a lot riding on Bing in its long struggle to catch Google </li></ul></ul><ul><li>Even so, Bing will not give Microsoft the top spot it covets in Web search by any means </li></ul><ul><ul><li>Success in overtaking Google in market share is viewed as a long-shot by IT analysts </li></ul></ul><ul><li>And Yahoo will take the hit from Bing, not Google </li></ul><ul><li>Google may have to refocus on Web search, leaving behind its attack in other areas where it competes with Microsoft </li></ul><ul><li>All of this fighting of market share is in a Web search market ad market that is suffering from the current recession </li></ul>
  12. 12. Point of View – Business Issues (continued) <ul><li>Mobile search is the market where Microsoft has the best chance against Google </li></ul><ul><li>In mobile search, the battle continues </li></ul><ul><ul><li>Success in the mobile search market is seen as imperative for both Microsoft and Google by IT analysts </li></ul></ul><ul><ul><li>Look for Microsoft to leverage its position with the Windows Mobile operating system – it has won some important deals </li></ul></ul><ul><ul><li>Look for Google to leverage its Android platform to gain default status with carriers – but it is behind Microsoft so far </li></ul></ul>
  13. 13. Coverage Metrics For Analyst Commentary In Press Media Articles On the Web Search Market
  14. 14. Press commentary by IT analysts Q4‘08 - Q2 ‘09 IT analyst commentary in the press mentioned Google and Yahoo about an equal number of times, but with very different expressed sentiment toward the different companies. Microsoft had less overall commentary and also a less favorable reception to its story than Google received. Positive Negative Neutral Total Microsoft 7 14 53 74 Yahoo! 12 30 66 108 Google 47 3 64 114 Total 71 47 178 296
  15. 15. Coverage and sentiment by IT analyst group Forrester and IDC provided the most sentiment-loaded press commentary about the Web search competitors, and it was largely positive. Frost & Sullivan and Gartner leaned toward the negative.
  16. 16. Share of Voice for press commentary by IT analysts Q4‘08 - Q2 ‘09 Google only narrowly grabbed the highest Share of Voice from Yahoo when the three quarters are examined together. This is surprising considering that Google holds 65% of Web search market share. Overall, IT analysts are very interested in the “Yahoo story.” As we will see later, Bing increases IT analyst interest in Bing significantly.
  17. 17. Net Positive commentary by IT analysts in press coverage Q4‘08 - Q2 ‘09 Net Positives are calculated by subtracting negative IT analyst mentions from positive mentions. Google was the only of the three to obtain a net positive sentiment score over all the IT analyst commentary in the press over three quarters. Microsoft was the most negative. Google Microsoft Yahoo!
  18. 18. Net Positive commentary by competitor Microsoft and Google rise together. The release of Bing actually increased the amount of positive IT analyst commentary in the press for Google! Google maintains its dominant position in positive share of mind as far as analysts commentary in the news. Meanwhile, Yahoo falls alone - back into negative territory. Q4 ‘08 Q2 ‘09 Q1 ‘09
  19. 19. Coverage and sentiment toward Microsoft The release of Bing generated much commentary for Microsoft in Q2 ‘09 – unfortunately for Microsoft, it was largely neutral. IT analysts just didn’t buy into Microsoft’s hoped-for spin.
  20. 20. Coverage and sentiment toward Yahoo Microsoft’s Bing introduction resulted in more commentary of Yahoo, but the spin on Bing knocked the wind out of the positive momentum Yahoo had begun to enjoy in the tone of press commentary.
  21. 21. Coverage and sentiment toward Google Google’s commentary and positive commentary soar as a result of the introduction of Microsoft’s Bing.
  22. 22. Individual analyst sentiment toward Microsoft (for client follow-up)
  23. 23. Individual analyst sentiment toward Yahoo (for client follow-up)
  24. 24. Individual analyst sentiment toward Google (for client follow-up)
  25. 25. Analyst Commentary In the News: Quotes
  26. 26. Analyst quotes and commentary <ul><li>Bing is seen as hoping to change the search paradigm </li></ul><ul><ul><li>“ Microsoft's Bing will change the face of search . . . Bing focuses on delivering answers, not Web pages.” </li></ul></ul><ul><ul><ul><li>Shar VanBoskirk, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>IOL Technology, May 29, 2009 </li></ul></ul></ul><ul><ul><li>“ They've highlighted some key areas where they're going above the concept of 10 blue links.” </li></ul></ul><ul><ul><ul><li>Allen Weiner, Gartner </li></ul></ul></ul><ul><ul><ul><li>, May 29, 2009 </li></ul></ul></ul><ul><ul><li>“ A distant third place in the search engine game, Microsoft hopes that this engine will help it gain more searcher share by delivering results and content more relevant to how users actually search.” </li></ul></ul><ul><ul><ul><li>Shar VanBoskirk, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>Forrester Blog, May 28, 2009 </li></ul></ul></ul>
  27. 27. MI Metrics™ for Analyst commentary in the News Analyst Quotes And commentary <ul><li>While Bing is not revolutionary, it represents serious improvements for Microsoft and puts it on par with rivals </li></ul><ul><ul><li>“ Gartner Group analyst Allen Weiner agreed that Bing isn't presenting a radical new way to search the Web. ‘I don't see anything that you can say, wow, I can't do this on Google or Yahoo,’ he said . . . However, what Bing does provide Microsoft is a way to catch up to what competitors have now in terms of features . . . ‘It's a marked improvement from Live Search . . . ‘They've done a lot to make the interface more usable, to make it cleaner-looking -- a lot with the algorithms to make the search results on par with their competitors for most searches.’” </li></ul></ul><ul><ul><ul><li>Allen Weiner, Gartner Group </li></ul></ul></ul><ul><ul><ul><li>PC World, May 28, 2009 </li></ul></ul></ul>
  28. 28. Analyst quotes and commentary <ul><li>Microsoft has a lot riding on this step and must pull it off </li></ul><ul><ul><li>“ Microsoft has really trailed miserably the Google success in the search space . . . They really need to come up with something extraordinary to change the momentum. And they're making a big attempt with this release to change the field. They're taking on changing people's expectations about what using search should be -- the experience of using search.” </li></ul></ul><ul><ul><ul><li>Hadley Reynolds, IDC </li></ul></ul></ul><ul><ul><ul><li>Tech World, May 29, 2009 </li></ul></ul></ul><ul><ul><li>“ Kumo [Bing’s pre-release codename] is Microsoft's ‘last chance’ to get search right as it cannot afford to launch another product that fails to engage with internet users. ‘If Kumo is going to be a success it needs to become a verb. For example 'I Kumoed you', I'm not sure that will happen.’” </li></ul></ul><ul><ul><ul><li>Mike Davis, Ovum </li></ul></ul></ul><ul><ul><ul><li>Telegraph, May 20, 2009 </li></ul></ul></ul>
  29. 29. Analyst quotes and commentary <ul><ul><li>“ Clearly Microsoft has to differentiate itself. Looking to overtake Google is brave, even Yahoo! will prove a challenge. People are so used to Google, shifting them will be hard . . . Bing will live or die on how clever it is, and how it learns what consumers want. It is creating a brand from scratch so marketing will be crucial.” </li></ul></ul><ul><ul><ul><li>Rebecca Jennings, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>The Independent, May 29, 2009 </li></ul></ul></ul><ul><ul><li>“ . . . the new tool is part of Microsoft's long-term plan to move beyond its stronghold in the PC operating system business and capture a more significant Web presence. ‘They need this for their future growth,’ . . . ‘With everyone moving toward a lightweight, mobile Internet, people don't need a PC or a big operating system. It's a big change. Microsoft doesn't need to unseat Google but they do need to get a Web presence.” </li></ul></ul><ul><ul><ul><li>Jim McGregor, In-Stat </li></ul></ul></ul><ul><ul><ul><li>PC World, May 28, 2009 </li></ul></ul></ul>
  30. 30. Analyst quotes and commentary <ul><li>Bing – no guarantees, present or future </li></ul><ul><ul><li>“ . . . can Bing get people to switch? That's more of a long-odds proposition.” </li></ul></ul><ul><ul><ul><li>Andrew Frank, Gartner </li></ul></ul></ul><ul><ul><ul><li>eWeek, June 10, 2009 </li></ul></ul></ul><ul><ul><li>“ They will be competitors against Google and Yahoo, but all that does is get them caught up . . . Let's say Bing puts Microsoft on an equal footing with Google and Yahoo considering the fact that players will continue to innovate; how quickly can Microsoft add more cool bells and whistles so it not only stays competitive but finds a way to inch ahead and come up with some element it can use to further (itself) in the market?” </li></ul></ul><ul><ul><ul><li>Allen Weiner, Gartner </li></ul></ul></ul><ul><ul><ul><li>CIO Today, May 28, 2009 </li></ul></ul></ul>
  31. 31. Analyst quotes and commentary <ul><li>Bing is seen as a threat to Yahoo, not Google </li></ul><ul><ul><li>“ However, because Bing is similar to Yahoo in its approach to search, it makes sense that it would take share away from Yahoo before it would Google's search engine . . .‘Bing is a greater threat to Yahoo than to Google because Yahoo has been sort of the content search engine and Google has been the utility search engine’ . . . ‘In other words, Yahoo has taken more of a ‘concierge approach’ to search, organizing its search results more based on what information other users have found useful in the past and based on services that can be offered around a search result’ . . . ‘This gives Yahoo's results more of the feel of a traditional Web portal than merely providing people with a list of relevant searches. Google, on the other hand, is more of a toolbar’ . . . ‘With Google's utilitarian approach and Bing and Yahoo being the more portal-based approach, it's easier to think why they would be more competitive.’” </li></ul></ul><ul><ul><ul><li>Shar VanBoskirk, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>The Industry Standard, June 5, 2009 </li></ul></ul></ul>
  32. 32. Analyst quotes and commentary <ul><ul><li>Google is top dog in search </li></ul></ul><ul><ul><li>&quot;It's really the branding that drives people to Google . . . They're the Kleenex of search.” </li></ul></ul><ul><ul><ul><li>Karsten Weide, IDC </li></ul></ul></ul><ul><ul><ul><li>CNN, May 6, 2009 </li></ul></ul></ul><ul><ul><li>“ IDC survey data shows that searching is the number one online activity for U.S. consumers and consumers convey the most trust and affinity for Google above all other online Internet brands.” </li></ul></ul><ul><ul><ul><li>Caroline Dangson, IDC </li></ul></ul></ul><ul><ul><ul><li>PC World, February 2, 2009 </li></ul></ul></ul><ul><ul><li>“ From a search perspective, Microsoft needs Yahoo and Yahoo needs Microsoft if they are to create a credible alternative to Google.” </li></ul></ul><ul><ul><ul><li>Neil MacDonald, Gartner </li></ul></ul></ul><ul><ul><ul><li>PC Advisor, January 16, 2009 </li></ul></ul></ul>
  33. 33. Analyst quotes and commentary <ul><li>Though the threat in search may be greater for Yahoo, Bing could prove to be a distraction for Google </li></ul><ul><ul><li>“ If Microsoft invests in improving Web search, then Google must respond with similar investment . . . That means Google doesn't have as much to invest in competing in things where Microsoft is ahead.” </li></ul></ul><ul><ul><ul><li>Whit Andrews, Gartner </li></ul></ul></ul><ul><ul><ul><li>Knight Ridder/Tribune Business News, June 8, 2009 </li></ul></ul></ul><ul><ul><li>“ . . . Bing has to convince people that there's something wrong with their current search experience; that’s the theme of their ‘Overload’ campaign . . . So far as it sows the seeds of discontent, that could create an opportunity, and makes it imperative for [Google CEO] Schmidt to continue on his promise that Google will continue to improve.” </li></ul></ul><ul><ul><ul><li>Andrew Frank, Gartner </li></ul></ul></ul><ul><ul><ul><li>eWeek, June 10, 2009 </li></ul></ul></ul>
  34. 34. Analyst quotes and commentary <ul><li>There is a battle looming for the mobile space </li></ul><ul><ul><li>“ When you look at where its growth opportunities are, the next billion Internet users are much more likely to use a mobile phone to access the Internet, not a PC.” </li></ul></ul><ul><ul><ul><li>Charles Golvin, Forrester </li></ul></ul></ul><ul><ul><ul><li>CRM Buyer, November 25, 2008 </li></ul></ul></ul><ul><ul><li>“ When I've worked with [Microsoft], they are a very, very competitive organization . . . They are very aggressive. When you get on the list of being a competitor, you never get off. Google is coming after Microsoft [in the mobile arena], and Microsoft is up for the challenge.” </li></ul></ul><ul><ul><ul><li>Bill Hughes, In-Stat </li></ul></ul></ul><ul><ul><ul><li>Search Mobile Computing </li></ul></ul></ul>
  35. 35. Analyst quotes and commentary <ul><li>In the battle to be the default search for carriers Google looks to leverage its Android platform while Microsoft throws its money (and weight) at the challenge – both are viable options </li></ul><ul><ul><li>“ The presence of new Android phones will give [Google] a better negotiating position with the carriers.” </li></ul></ul><ul><ul><ul><li>Charles Golvin, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>CRM Buyer, November 25, 2008 </li></ul></ul></ul><ul><ul><li>“ I’m sure Microsoft is giving these companies good deals to get carriage but that's not necessarily a bad thing . . . People will use what's on the screen to do the searches so that’s important for Microsoft even if they do wind up overpaying a little.” </li></ul></ul><ul><ul><ul><li>David Card, Forrester Research </li></ul></ul></ul><ul><ul><ul><li>Arizona Republic, January 7, 2009 </li></ul></ul></ul>
  36. 36. Analyst quotes and commentary <ul><ul><li>Declining ad revenues will be challenging Google (and all the players) for the near future </li></ul></ul><ul><ul><li>“ U.S. online ad revenue may shrink this year by six percent compared to 2008. Google’s growth in search ads cannot offset drops in display and classified ads.” </li></ul></ul><ul><ul><ul><li>Karsten Weide, IDC </li></ul></ul></ul><ul><ul><ul><li>BNET, April 22, 2009 </li></ul></ul></ul>
  37. 37. Contact information <ul><li>Priscilla Seuss, Vice President of Sales </li></ul><ul><li>[email_address] </li></ul><ul><li>617-794-8095 </li></ul><ul><li>Address: </li></ul><ul><ul><ul><ul><li>Northern Light </li></ul></ul></ul></ul><ul><ul><ul><ul><li>10 Canal Park </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Cambridge MA 02141 </li></ul></ul></ul></ul>