Measuring Communication Success


Published on

Measuring internal and external corporate communication program success

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • More than 40 projects in five tracks Store and Field Conversion Human Resources Strategy Marketing Supply Chain Base Activity Conversion involves first three tracks
  • Measuring Communication Success

    1. 1. Measuring Success: Both externally and internally March 2003 SEARS, ROEBUCK AND CO.
    2. 2. Agenda <ul><li>Measuring external communication </li></ul><ul><ul><li>Linking public relations to sales </li></ul></ul><ul><ul><li>Focusing on ROI </li></ul></ul><ul><li>Measuring internal change management communication </li></ul><ul><ul><li>Scope of the Conversion </li></ul></ul><ul><ul><li>Measuring associate understanding and attitudes </li></ul></ul><ul><ul><li>Customer and financial measures </li></ul></ul><ul><ul><li>Conclusions </li></ul></ul>
    3. 3. Keep it simple <ul><li>Revenue - Costs = Profit </li></ul>
    4. 4. Simplifying further... Marketing Communication Media Relations Events, Publicity, etc. Crisis Communication Investor Relations Etc. Revenue Increases Cost Control
    5. 5. Typically measurement... <ul><li>Stops at awareness </li></ul><ul><ul><li>Often stops short of awareness </li></ul></ul><ul><li>Measures output. Not impact. </li></ul><ul><li>Is often compared to advertising </li></ul><ul><ul><li>Ad equivalencies are the wrong measure </li></ul></ul><ul><ul><li>No measurement of impact, change in attitude or behavior </li></ul></ul>
    6. 6. Do they believe? <ul><li>Businesses want to measure behavior change -- Are they buying? </li></ul><ul><li>Are customers buying your products and services? </li></ul><ul><li>Are employees buying your messages? </li></ul>
    7. 7. Clipping and Message Analysis <ul><li>Can be a useful management tool </li></ul><ul><li>Measures activity and output of PR group </li></ul><ul><li>Measures whether key messages are being seen </li></ul><ul><li>Helpful in gauging whether coverage is negative or positive </li></ul><ul><li>Identifies positive and negative bias of media </li></ul><ul><li>Can calculate cost per impression </li></ul><ul><li>But, it is not a measure of ROI or behavior change </li></ul>
    8. 8. Taking clippings further... <ul><li>Link to changes in awareness, preference or behavior (purchase) </li></ul><ul><li>What is the impact on revenue? </li></ul><ul><li>What is impact on cost control, associate attitudes or other intermediate measures? </li></ul>
    9. 9. News Releases Events Media calls, etc ( Effort ) (Difficult to measure) Publicity (semi-controllable and measurable) Measure is circulation or viewers (MediaLink) Most people never see the article or hear the broadcast (0 impact) Effort that never gets printed, broadcast (0 impact) Percentage of effort results in publicity Percent of wasted effort Target Audience Consumers who see or hear the publicity and are part of the intended audience for message (difficult to measure, but assumed to be a fraction of the circulation number) No impact on consumers “ I still won’t shop.” Consumers who have an attitudinal shift -- “ I will shop as a result of that story” (measurable-- Oprah and BrandKeys) Those who read the article, intend to shop, but never follow through Consumers who take action as a result, and visit a store with intent to purchase (Traffic - no current measurement device) Those who don’t find what they need or want and make no purchase Customers make purchase Measure is revenue $ (SPRS report) Budget funds PR activity ($) Subract cost of all investments, leaving profit $ tied to PR program. ROI is how much of this is generated for every dollar invested at beginning Those not in target audience - not likely to purchase. (minimal impact) Businesses keep score with $ What is the relationship between a $ invested in PR and company revenue or profit? Measures existing Subtract customers who purchased without benefit of the publicity (test market vs. control or incremental above baseline) (AdEffect)
    10. 10. Does it work? <ul><li>Can you identify changes along the path? </li></ul><ul><li>Is there a link between public relations events and revenue? </li></ul><ul><li>Two examples of how changes have been measured at Sears and how you can design a model for your business. </li></ul>
    11. 11. Background <ul><li>One placement on the Oprah show involved providing Christmas gifts for foster children in a small Texas community. </li></ul><ul><li>Sears provided all the gifts for 100 children </li></ul><ul><li>Oprah exclaimed “We love Sears!” </li></ul><ul><li>Can this be measured? </li></ul>
    12. 12. Sears is high quality company <ul><li>Slight positive shift following the broadcast </li></ul><ul><li>65% agree vs. 58% </li></ul><ul><li>Shift came from all rating levels </li></ul>
    13. 13. Sears does good things for community <ul><li>Following broadcast saw a huge shift to positive on this question </li></ul><ul><li>Almost a five-fold increase in number of those agreeing completely </li></ul>
    14. 14. Plan to shop Sears for Holiday <ul><li>The show provided the incentive to move viewers from neutral to positive intent </li></ul><ul><li>Increased to 70% vs. 59% before show </li></ul>
    15. 15. “I plan to shop at Sears for the holidays.” <ul><li>The Oprah PR placement provided the additional incentive needed to move some viewers from a neutral position to a positive intent to shop at Sears. </li></ul><ul><ul><li>Neutrals dropped from 73 respondents to 52, and somewhat negatives dropped from 29 to 18. </li></ul></ul><ul><ul><ul><li>The strongest negatives remained the same. </li></ul></ul></ul><ul><ul><li>The positive side of the intent to shop increased from 178 to 210 respondents. </li></ul></ul>Percent
    16. 16. … estimate what you’ll spend at Sears during this holiday season. <ul><li>We saw earlier there was a positive shift in the number of people saying they planned on shopping at Sears. </li></ul><ul><ul><li>About 10% increase in positive intent. </li></ul></ul><ul><li>If we assume the mid-point for each range, and $600 for the over $500 data, then these 300 respondents represent an average of $195 per respondent after seeing Oprah, versus $140 before. </li></ul><ul><ul><li>An increase of +39% per shopper in the amount they estimate they’ll spend at Sears. </li></ul></ul>Percentage of Respondents
    17. 17. What was the impact? <ul><li>Shift in attitude led to planned spending increase of $40-million </li></ul><ul><li>Discounted by 2/3 to account for intentions that never come to fruition, the actual spending increase may be about $13-million </li></ul><ul><li>Subtract costs and calculate ROI </li></ul>
    18. 18. Fashion Footwear and NYT <ul><li>January feature placement in New York Times -- New York/New Jersey edition </li></ul><ul><li>What was the impact in that market vs. a control market and vs. national? </li></ul>
    19. 19. The New York Times
    20. 20. Fashion Footwear Results <ul><li>Week following placement NY and NJ markets were up vs. year ago. </li></ul><ul><li>Chicago down </li></ul><ul><li>National down </li></ul>
    21. 21. Footwear Conclusions <ul><li>A single placement in a credible publication made a dramatic difference in sales compared to both national and comparable market </li></ul><ul><li>The only variable that changed that week was the New York Times placement </li></ul><ul><li>Translated into measurable dollars </li></ul><ul><li>Cost of placement vs. incremental revenue increase gives ROI </li></ul>
    22. 22. Connecting the dots... <ul><li>Two examples measure the impact of single “communication events” -- not the cumulative impact of entire program </li></ul><ul><li>The right events can have a significant positive impact </li></ul><ul><ul><li>Activities and events which do not have positive impact are suspect </li></ul></ul><ul><li>Impact can be either a shift in attitudes or actions </li></ul>
    23. 23. Measuring internally <ul><li>Can the same principles be applied to an internal audience? </li></ul><ul><li>How do you define success in a large change management communication program? </li></ul>
    24. 24. Background <ul><li>In late 2001 in Full Line Stores… </li></ul><ul><ul><li>Announced 4,000 layoffs </li></ul></ul><ul><ul><li>Announced Productivity Improvements </li></ul></ul><ul><ul><li>Sears. Where Else? introduced </li></ul></ul><ul><ul><li>Morale is not at an all time high </li></ul></ul>
    25. 25. Measures going in wrong direction...
    26. 26. Conversion Objectives <ul><li>Improved customer satisfaction </li></ul><ul><li>Easier to shop </li></ul><ul><li>Easier to operate and easier to support store model </li></ul><ul><ul><li>Clear lines of accountability throughout the organization </li></ul></ul><ul><ul><li>Improved execution on in-stock, in-store marketing, customer service </li></ul></ul><ul><ul><li>Improved profitability </li></ul></ul>
    27. 27. Communication Principles <ul><li>Open and honest </li></ul><ul><li>Share information as soon as it’s available </li></ul><ul><li>Focus on key audiences, while making information available very broadly </li></ul><ul><li>Credibility is key </li></ul><ul><ul><li>No sugarcoating </li></ul></ul><ul><ul><li>No promises we can’t keep </li></ul></ul><ul><ul><li>Focus on the end result and how to get it </li></ul></ul><ul><li>Use existing communication channels where possible; emphasize personal communication </li></ul>
    28. 28. Communication Objectives <ul><li>Gain alignment among senior management for the changes that will be necessary </li></ul><ul><li>Create high awareness and understanding for: </li></ul><ul><ul><li>Why change is needed </li></ul></ul><ul><ul><li>What changes will be made and why </li></ul></ul><ul><li>Win support for the dramatic changes, despite announcements of layoffs and new job descriptions and accountabilities </li></ul><ul><li>Focus on new model: easier to shop, easier to operate </li></ul>
    29. 29. Communication Tactics <ul><li>Identify and leverage credible channels </li></ul><ul><li>Senior leadership meetings - FLST initiated </li></ul><ul><li>One-on-one meetings with leadership </li></ul><ul><li>Town Hall meetings (existing and new) </li></ul><ul><li>PMO Website </li></ul><ul><li>Regular features in S Journal, S Update </li></ul><ul><li>Training meetings and support materials </li></ul><ul><li>Detailed conversion manuals </li></ul><ul><li>Communication materials provided to DGMs for cascading through stores organization </li></ul>
    30. 30. Communication Tactics (cont’d) <ul><li>Issues and questions fielded in multiple ways, with response ASAP </li></ul><ul><li>Video Updates to field midway through conversion </li></ul><ul><li>In-store meeting materials for consistent messaging </li></ul><ul><li>Input into training materials to reinforce new store model of excellent customer service </li></ul><ul><li>Ongoing communication through newly defined MAP and Weekly Updates </li></ul>
    31. 31. Measurement <ul><li>Baseline MOC results reviewed </li></ul><ul><li>Key questions pulled for ongoing pulse surveys </li></ul><ul><li>Surveys following major communication events </li></ul><ul><li>Weekly review of Q&A and Issues raised to identify gaps in communication program </li></ul><ul><li>Informal discussions within stores organization </li></ul><ul><ul><li>Didn’t overreact to anecdotal information </li></ul></ul><ul><ul><li>Checked feedback against data </li></ul></ul>
    32. 32. Performance Improvement Program <ul><li>Projects that have a direct impact on the store were grouped together into a synchronized field “Conversion” calendar </li></ul>Strategy Marketing Supply Chain Store & Field <ul><li>Store & Field Organization </li></ul><ul><li>Store Activity </li></ul><ul><li>In Store Marketing </li></ul><ul><li>Labor Management </li></ul><ul><li>Sign Creation </li></ul><ul><li>Flow Optimization </li></ul><ul><li>Integrated Order Management </li></ul><ul><li>Liability Inventory </li></ul><ul><li>Ad Production </li></ul><ul><li>Promotional Profitability </li></ul><ul><li>Lands’ End Initiative </li></ul><ul><li>Covington Roll out </li></ul><ul><li>Center Core </li></ul><ul><li>Home Fashions </li></ul><ul><li>Footwear </li></ul><ul><li>Appliances </li></ul>HR <ul><li>e-Learning </li></ul><ul><li>e-Recruiting </li></ul><ul><li>Associate Services </li></ul>
    33. 33. Conversion Scope <ul><ul><li>Store Structure </li></ul></ul><ul><ul><li>District Structure </li></ul></ul><ul><ul><li>Region Structure </li></ul></ul><ul><li> </li></ul><ul><li>Number of Stores </li></ul><ul><ul><li>Center Aisle Cashwraps ALL </li></ul></ul><ul><ul><li>Signage and Fixturing ALL </li></ul></ul><ul><ul><li>Four Zone Merchandising ALL </li></ul></ul><ul><ul><li>Appliances 101 </li></ul></ul><ul><ul><li>Center Core 543 </li></ul></ul><ul><ul><li>Home Accents 557 </li></ul></ul><ul><ul><li>Mattresses 32 </li></ul></ul><ul><ul><li>Men’s Big and Tall 349 </li></ul></ul><ul><ul><li>Open Sell Shoes 216 </li></ul></ul><ul><ul><li>Tool Territory 149 </li></ul></ul><ul><ul><li>Merchandise and Customer Assist </li></ul></ul><ul><ul><li>Consultative Selling </li></ul></ul><ul><ul><li>Center Aisle Cashiering </li></ul></ul><ul><ul><li>POS Signing </li></ul></ul><ul><ul><li>Ad Setup/Take-down </li></ul></ul><ul><ul><li>Replenishment </li></ul></ul><ul><ul><li>POG/ZOG </li></ul></ul><ul><ul><li>Liability Merchandise </li></ul></ul><ul><ul><li>Labor Management </li></ul></ul><ul><ul><li>e-Learning </li></ul></ul><ul><ul><li>e-Recruiting </li></ul></ul>Note: initiatives will be implemented in all stores except where a specific number is given Field Organization Store Environment Service Levels Activities and Processes
    34. 34. Communication Output <ul><li>PMO website has had more than 2-million hits during conversion; Of the 24,000 visitors 23,000 are from the field. </li></ul><ul><li>PMO base conversion has been successfully implemented, and has been widely supported </li></ul><ul><li>Articles every month in corporate publications </li></ul><ul><li>Communication is becoming embedded as a core leadership responsibility in the stores organization </li></ul><ul><li>Web site is becoming an operational tool more than information only tool </li></ul>
    35. 35. Communication Results - Associates <ul><li>Associate attitudes (all store associates) are more positive than they have been since 1998. </li></ul><ul><li>Understanding of strategy is higher than it has ever been. </li></ul>
    36. 36. Store management is even more positive ... <ul><li>Assistant Store Managers and hourly leads feel good about the future, believe we are making the changes necessary to compete, and understand our strategy. </li></ul>
    37. 37. Customer feedback is also encouraging <ul><li>Customers reacted favorably to the new store environment </li></ul><ul><li>Store revenues were on target for Holiday </li></ul>
    38. 38. Financial Benefits are on track <ul><li>Conversion costs stayed on budget </li></ul><ul><li>Field operating costs met planned savings </li></ul><ul><li>Capital expenditures within budget </li></ul><ul><li>Communication had no incremental budget increase </li></ul><ul><li>Full Line Store profitability is up more than 30% </li></ul><ul><li>Sears posted record earnings in 2002 </li></ul>
    39. 39. Productivity <ul><li>Objective is to create a culture of continuous productivity improvement </li></ul><ul><li>Ongoing process of continuous improvement in efficiency and effectiveness </li></ul><ul><li>Ultimately, time will tell </li></ul><ul><ul><li>Can we continue to improve both customer satisfaction and productivity? </li></ul></ul>
    40. 40. Conclusions <ul><li>Looking at measurement from the perspective of the CEO will help clarify what’s important </li></ul><ul><li>Establishing a logic model for communications and measurement of results is good start </li></ul><ul><li>Building evidence over time will help improve ability to make fact-based decisions about public relations and communication investments </li></ul><ul><li>In some areas (such as marketing public relations) we can remove the mystery of the craft and earn respect of management team on their terms </li></ul><ul><li>There is still much to do </li></ul>
    41. 41. SEARS, ROEBUCK AND CO. Questions? Tom Nicholson Sears, Roebuck and Co. [email_address]