BEST Practices - Testing & Optimization | Bredan Rendan

635 views
588 views

Published on

Building a Successful Optimization Program - Presented on 12/6/12 by Brendan Regan : Marketing Optimization Specialist at Analytics Pros

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
635
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
9
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

BEST Practices - Testing & Optimization | Bredan Rendan

  1. 1. Building a SuccessfulOptimization Program December 6, 2012 Brendan Regan Marketing Optimization Specialist Analytics Pros
  2. 2. The Next 50 Minutes… Outputs
  3. 3. The Next 50 Minutes… Outputs• Preconceptions • Applicable Smarts• Agenda • Actionable Steps• Curiosity • Motivation!• Tour Guide
  4. 4. What We’ll Cover1. A Common Definition2. Philosophy of Optimization3. What It Takes to Be Successful4. Do These 4 Things Tomorrow5. Q & A
  5. 5. A Common Definitionof OptimizationBecause being on the same page is cool.
  6. 6. The Art and Science ofincreasing the marketing efficiency of a web property.
  7. 7. “Why is it an Art and a Science?!?”
  8. 8. Unpacking the Definition• Efficiency = more outputs w/ less inputs• Outputs = sales, leads, subscriptions, engagement, etc.• Higher efficiency = better Marketing ROI• Often accomplished via A/B/n or MVT testing – Less ideal, but “change and observe” counts, too
  9. 9. If Marketing is an Engine… Image credit: Popular Hot Rodding
  10. 10. Optimization Philosophy Our beliefs on Optimization
  11. 11. Optimization Philosophy1. Be data-driven – Data (quantitative & qualitative) drives testing, not opinion2. Be agile – A small lift next week is better than a larger lift next year3. Lift + Learn – It’s obviously about lift, but testing also provides valuable customer/business insights
  12. 12. Optimization Philosophy (cont’d)4. Gamble – Some tests will lose – Greater risk = greater potential lift5. Baby steps – Do what’s feasible ASAP, and build to more complex tests6. A process, not a project – The long-term goal is testing as part of marketing operations
  13. 13. What It TakesTo Be Successfulin Optimization A framework
  14. 14. What It Takes to Be Successful in Optimization People Tools Process
  15. 15. What It Takes to Be Successful in Optimization People
  16. 16. People (Skill Sets)• Business/Marketing Acumen• Data Analysis• Heuristic/Usability/UX• Visual Design• Optimization SME• Copywriting• Technical SME• Project Management/Coordination
  17. 17. People (Skill Sets)• Business/Marketing Acumen• Data Analysis• Heuristic/Usability/UX• Visual Design• Optimization SME• Copywriting• Technical SME• Project Management/Coordination
  18. 18. What It Takes to Be Successful in Optimization Process
  19. 19. Process (See? It’s Simple!)Business Challenges Hypotheses Analyze Report Results Findings Goals Target Heuristic Design Build Test Next Audience Data Variations Steps Usability Build Web Data Design Test Data Variations
  20. 20. Process (a simple one)1. Define the problem2. Research/observe the problem3. Form a hypothesis4. Conduct experiment5. Analyze experiment results Look familiar?6. Form a conclusion7. Socialize results
  21. 21. Process (7 Simple Steps)For more details:http://brendan-regan.com/the-steps-of-the-scientific-method-for-marketers/Disclaimer: My personal blog’s snark does not represent theviews of Analytics Pros ;-)
  22. 22. Process (Different Models)1. In House – Build a team2. Outsourced – Leverage partners/vendors/agencies3. Hybrid (most common) – Outsource specialized expertise • Data analysis • Testing SME • Creative
  23. 23. What It Takes to Be Successful in Optimization Tools
  24. 24. Tools• What technologies are needed to: – Coordinate resources – Design variations – Document requirements – Conduct experiment – Analyze results data – Socialize experiment results
  25. 25. Tools• What technologies are needed to: – Coordinate resources – Design variations – Document requirements – Conduct experiment – Analyze results data – Socialize experiment results
  26. 26. Tools Etc.
  27. 27. Do These 4 Things Tomorrow1. Conduct “gap analysis” on people skills and tools – Do we have enough resource allocation? – Do we need new tools? – Do we have all the necessary skills in- house?
  28. 28. Do These 4 Things Tomorrow2. Get a testing tool in place – Do we have IT support? – Build vs. buy? – Price range?
  29. 29. Do These 4 Things Tomorrow3. Build a business case (if necessary) – Case studies, calculators, presentations? – Opportunity cost? – Tying to corporate goals? – Who is scared of testing?
  30. 30. Do These 4 Things Tomorrow4. Get resources and/or outside help – Agency partners? – Consultants/specialists? – Testing vendors? – Training?
  31. 31. Questions?Comments? Stretch those vocal chords.
  32. 32. Follow Ups / Follow Me• brendan.regan@analyticspros.com• www.linkedin.com/in/brendanregan

×