SlideShare a Scribd company logo
1 of 26
Optimization
What’s the #(*#( is “optimization”?
David Oh / david@beachmint.com
@davidyoh
http://www.linkedin.com/in/davidoh
What is Optimization?

 Methodical improvement in any process using what is
commonly defined as the “scientific process”.
 What can be optimized?
– Everything! (it’s called “science” in the real world)
How is this different from “growthhacking”

 Pat Vlaskovits says growthhacking is "not a mastery of existing
and known marketing channels, SEO, SEM, PPC, viral
marketing etc etc"
 "Growth hacking is true innovation in sales and marketing
mediums”
 Optimization can be viewed as process in improvement in the
things that are known and are controllable.


http://www.slideshare.net/vlaskovits/growthhacker-live-preso-by-patrick-vlaskovits-pv
Optimization is…

 What we can do to improve our efforts given the product
we have currently


What we should do every day, every hour, with every
dollar we spend, every hour we devote to refining our
product... While we plan and try for "true" and disruptive
innovation
Optimization is…

 "I'm convinced that about half of
what separates the successful
entrepreneurs from the nonsuccessful ones is pure
perseverance. It is so hard. You put
so much of your life into this thing.
Why of Optimization

 ... No one has the luxury of knowing if true and disruptive
innovation is going to happen.
– Maybe the product is awesome, but the marketplace sucks, maybe it’s too ahead of its
time, or the company doesn't have the resources to put resources behind this.

 And if the marketing execution fails, it might actually ruin a
perfectly good product from succeeding. If marketing spends
too much money on the wrong channels, the company itself
might fail before the product can succeed.
The How of Optimization
Optimization process

 Systematic way of improving yield.
 Hypothesize something that would make people click on ads, fill out a form, or
pull out their credit cards.
 Randomly split people into groups who view a specific version of an ad or a
web page. Use statistics to determine significance of finding.
 Draw conclusions. Form a new hypothesis. Repeat.
Ready, Aim Fire.

 Also known as “science”
 Military has various versions too:
Ready, Aim, Fire.

 As does business textbooks
– PDCA (plan–do–check–act or plan–
do–check–adjust)

 As does nursing
Act Smart

 Also known as acting “smart”.
What do I need?
Tools and instruments needed

 Just like calculators, test tubes, telescopes, microscopes, radar,
you’ll need a variety of tools in order to optimize successfully.
– Tracking
– Attribution
– Analytics
– Testing platforms
Tracking

 When I say it, I mean external tracking– “Where did a user come
from?” and then what happens afterwards on my site?
– Google Analytics, Mixpanel, KISSMetrics, can also all do this

 Paid marketing specialized tracking
– CampaignEQ, also has cost measurement
– Doubleclick
– HasOffers
Attribution

 If a user did X, how do we credit their action (click, purchase), to:
–
–
–
–

Which paid marketing channel?
Which promotional message on the website?
Which social channel
Which email, etc, etc

Attribution = What was the event most responsible for a given
action.
Important for measuring ROI. Last click is standard– but lots of
companies have other attribution models.
Analytics

 How many clicks? how much time spent on site? How many sales
did I receive? Did the user scroll and click on a bunch of things or
did the user immediately click on the big button that says “Buy”
–
–
–
–

In what time period?
After how much time?
How many did what we wanted them to do?
How many did not?
Testing platforms

 Testing Platforms - Testing platforms at it's core is fundamentally
an attempt to remove one of the worst confounding variables:
TIME
– Medicine - randomized control trials

 Site Optimization
– Unbounce, Optimizely, VisualWebsite Optimizer, Test & Target

 Ad/Banner optimization
– Doubleclick, CampaignEQ, Facebook ads, Google Adwords, etc etc

 Email optimization
– Sailthru, Responsys, Mailchimp, Etc
Various Strategies
Stratagems

 Instrument (Tracking), Prepare, Gather Information (Analytics),
Develop a Plan

 Start at the area of greatest activity and potential opportunity
– Homepage
– Any registration walls, or payment walls (carts)

 Divide and Conquer. Segment.
Types of Tests

 Maximizing Local Maxima
– Singlevariate – Good for precise education on what variables improve
pefformance -

 Try to find a bigger Global Maxima: Don’t always test trivially
– Good for improving yield rapidly, at a greater risk of reduced performance,
and reduced knowledge of which single variable

http://www.smashingmagazine.com/2010/08/26/in-defense-of-a-b-testing/
Some things to test

 Different pictures and colors on ads and landing pages.
 Different style of buttons.
 Different “call to action”
– Click here now!, Join for FREE, Click and we will give you a backrub,
Lose weight NOW!

 A different catch-phrase.
 Amount of forms to fill out.
 Reducing number of pages.
Examples
Examples
Segmentation

 Split people up into ever and more specific
demographics such as gender, age, or where
they are located, or what they may have
purchased before.
 Airlines, Amazon, Dating Services, Harry
Potter
 Use automated systems and algorithms to
move towards the most optimal pricing for
different people.
–
–
–
–
–
–

Whether they come from Google, Facebook.
If they like listening to country music.
If they drive a certain car.
If they have a certain degree.
If they are looking for a Roomba.
If they live in a prestigious zip-code like 90210
Segmentation
David Oh / david@beachmint.com
@davidyoh
http://www.linkedin.com/in/davidoh

More Related Content

Similar to Optimization 12-03-2013

Growth hacking is a thing (1)
Growth hacking is a thing (1)Growth hacking is a thing (1)
Growth hacking is a thing (1)
Chris Dover
 
Stamats: Analytics Webinar
Stamats: Analytics WebinarStamats: Analytics Webinar
Stamats: Analytics Webinar
cjcunniff
 

Similar to Optimization 12-03-2013 (20)

PPC Growth Hacking - By Phil Pearce @ SuperWeek 2014
PPC Growth Hacking - By Phil Pearce @ SuperWeek 2014PPC Growth Hacking - By Phil Pearce @ SuperWeek 2014
PPC Growth Hacking - By Phil Pearce @ SuperWeek 2014
 
Digital marketing Nanodegree Portfolio
Digital marketing Nanodegree PortfolioDigital marketing Nanodegree Portfolio
Digital marketing Nanodegree Portfolio
 
Startup Jet Fuel
Startup Jet FuelStartup Jet Fuel
Startup Jet Fuel
 
Growth hacking is a thing (1)
Growth hacking is a thing (1)Growth hacking is a thing (1)
Growth hacking is a thing (1)
 
Successful Marketing Starts with a Strategy
Successful Marketing Starts with a StrategySuccessful Marketing Starts with a Strategy
Successful Marketing Starts with a Strategy
 
Webinar: Growth Optimization: Metrics & Frameworks by MasterClass Sr PM
Webinar: Growth Optimization: Metrics & Frameworks by MasterClass Sr PMWebinar: Growth Optimization: Metrics & Frameworks by MasterClass Sr PM
Webinar: Growth Optimization: Metrics & Frameworks by MasterClass Sr PM
 
From “Crawl" to “Walk” — Customizing Lift to Drive Value
From “Crawl" to “Walk” — Customizing Lift to Drive Value From “Crawl" to “Walk” — Customizing Lift to Drive Value
From “Crawl" to “Walk” — Customizing Lift to Drive Value
 
The Talent Institute - Grow Better Products, Faster
The Talent Institute - Grow Better Products, FasterThe Talent Institute - Grow Better Products, Faster
The Talent Institute - Grow Better Products, Faster
 
Successful Marketing Starts With A Strategy
Successful Marketing Starts With A StrategySuccessful Marketing Starts With A Strategy
Successful Marketing Starts With A Strategy
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo Testing
 
Startup analytics
Startup analyticsStartup analytics
Startup analytics
 
Mc4 e growth_hacking_2hr_gsew_MVPDraft1
Mc4 e growth_hacking_2hr_gsew_MVPDraft1Mc4 e growth_hacking_2hr_gsew_MVPDraft1
Mc4 e growth_hacking_2hr_gsew_MVPDraft1
 
Stamats: Analytics Webinar
Stamats: Analytics WebinarStamats: Analytics Webinar
Stamats: Analytics Webinar
 
Market Validation (Scale) (4).pdf
Market Validation (Scale) (4).pdfMarket Validation (Scale) (4).pdf
Market Validation (Scale) (4).pdf
 
Active Competitive Intelligence
Active Competitive IntelligenceActive Competitive Intelligence
Active Competitive Intelligence
 
Go-to-Market Strategy
Go-to-Market StrategyGo-to-Market Strategy
Go-to-Market Strategy
 
Hero Conf London 2018 - Frameworks for Insights and Impact
Hero Conf London 2018 - Frameworks for Insights and ImpactHero Conf London 2018 - Frameworks for Insights and Impact
Hero Conf London 2018 - Frameworks for Insights and Impact
 
Customer development and Agile development
Customer development and Agile developmentCustomer development and Agile development
Customer development and Agile development
 
Startup Marketing: A Systems Approach
Startup Marketing: A Systems ApproachStartup Marketing: A Systems Approach
Startup Marketing: A Systems Approach
 
How to Get Started with the Google Marketing Platform & All New Acquia Lift
How to Get Started with the Google Marketing Platform & All New Acquia LiftHow to Get Started with the Google Marketing Platform & All New Acquia Lift
How to Get Started with the Google Marketing Platform & All New Acquia Lift
 

Recently uploaded

Recently uploaded (20)

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 

Optimization 12-03-2013

  • 1. Optimization What’s the #(*#( is “optimization”? David Oh / david@beachmint.com @davidyoh http://www.linkedin.com/in/davidoh
  • 2. What is Optimization?  Methodical improvement in any process using what is commonly defined as the “scientific process”.  What can be optimized? – Everything! (it’s called “science” in the real world)
  • 3. How is this different from “growthhacking”  Pat Vlaskovits says growthhacking is "not a mastery of existing and known marketing channels, SEO, SEM, PPC, viral marketing etc etc"  "Growth hacking is true innovation in sales and marketing mediums”  Optimization can be viewed as process in improvement in the things that are known and are controllable.  http://www.slideshare.net/vlaskovits/growthhacker-live-preso-by-patrick-vlaskovits-pv
  • 4. Optimization is…  What we can do to improve our efforts given the product we have currently  What we should do every day, every hour, with every dollar we spend, every hour we devote to refining our product... While we plan and try for "true" and disruptive innovation
  • 5. Optimization is…  "I'm convinced that about half of what separates the successful entrepreneurs from the nonsuccessful ones is pure perseverance. It is so hard. You put so much of your life into this thing.
  • 6. Why of Optimization  ... No one has the luxury of knowing if true and disruptive innovation is going to happen. – Maybe the product is awesome, but the marketplace sucks, maybe it’s too ahead of its time, or the company doesn't have the resources to put resources behind this.  And if the marketing execution fails, it might actually ruin a perfectly good product from succeeding. If marketing spends too much money on the wrong channels, the company itself might fail before the product can succeed.
  • 7. The How of Optimization
  • 8. Optimization process  Systematic way of improving yield.  Hypothesize something that would make people click on ads, fill out a form, or pull out their credit cards.  Randomly split people into groups who view a specific version of an ad or a web page. Use statistics to determine significance of finding.  Draw conclusions. Form a new hypothesis. Repeat.
  • 9. Ready, Aim Fire.  Also known as “science”  Military has various versions too:
  • 10. Ready, Aim, Fire.  As does business textbooks – PDCA (plan–do–check–act or plan– do–check–adjust)  As does nursing
  • 11. Act Smart  Also known as acting “smart”.
  • 12. What do I need?
  • 13. Tools and instruments needed  Just like calculators, test tubes, telescopes, microscopes, radar, you’ll need a variety of tools in order to optimize successfully. – Tracking – Attribution – Analytics – Testing platforms
  • 14. Tracking  When I say it, I mean external tracking– “Where did a user come from?” and then what happens afterwards on my site? – Google Analytics, Mixpanel, KISSMetrics, can also all do this  Paid marketing specialized tracking – CampaignEQ, also has cost measurement – Doubleclick – HasOffers
  • 15. Attribution  If a user did X, how do we credit their action (click, purchase), to: – – – – Which paid marketing channel? Which promotional message on the website? Which social channel Which email, etc, etc Attribution = What was the event most responsible for a given action. Important for measuring ROI. Last click is standard– but lots of companies have other attribution models.
  • 16. Analytics  How many clicks? how much time spent on site? How many sales did I receive? Did the user scroll and click on a bunch of things or did the user immediately click on the big button that says “Buy” – – – – In what time period? After how much time? How many did what we wanted them to do? How many did not?
  • 17. Testing platforms  Testing Platforms - Testing platforms at it's core is fundamentally an attempt to remove one of the worst confounding variables: TIME – Medicine - randomized control trials  Site Optimization – Unbounce, Optimizely, VisualWebsite Optimizer, Test & Target  Ad/Banner optimization – Doubleclick, CampaignEQ, Facebook ads, Google Adwords, etc etc  Email optimization – Sailthru, Responsys, Mailchimp, Etc
  • 19. Stratagems  Instrument (Tracking), Prepare, Gather Information (Analytics), Develop a Plan  Start at the area of greatest activity and potential opportunity – Homepage – Any registration walls, or payment walls (carts)  Divide and Conquer. Segment.
  • 20. Types of Tests  Maximizing Local Maxima – Singlevariate – Good for precise education on what variables improve pefformance -  Try to find a bigger Global Maxima: Don’t always test trivially – Good for improving yield rapidly, at a greater risk of reduced performance, and reduced knowledge of which single variable http://www.smashingmagazine.com/2010/08/26/in-defense-of-a-b-testing/
  • 21. Some things to test  Different pictures and colors on ads and landing pages.  Different style of buttons.  Different “call to action” – Click here now!, Join for FREE, Click and we will give you a backrub, Lose weight NOW!  A different catch-phrase.  Amount of forms to fill out.  Reducing number of pages.
  • 24. Segmentation  Split people up into ever and more specific demographics such as gender, age, or where they are located, or what they may have purchased before.  Airlines, Amazon, Dating Services, Harry Potter  Use automated systems and algorithms to move towards the most optimal pricing for different people. – – – – – – Whether they come from Google, Facebook. If they like listening to country music. If they drive a certain car. If they have a certain degree. If they are looking for a Roomba. If they live in a prestigious zip-code like 90210
  • 26. David Oh / david@beachmint.com @davidyoh http://www.linkedin.com/in/davidoh

Editor's Notes

  1. Have you been part of a Facebook test?
  2. Have you been part of a Facebook test?
  3. Have you been part of a Facebook test?
  4. Have you been part of a Facebook test?
  5. Have you been part of a Facebook test?
  6. Have you been part of a Facebook test?
  7. Have you been part of a Facebook test?
  8. Have you been part of a Facebook test?
  9. Have you been part of a Facebook test?
  10. Have you been part of a Facebook test?
  11. Top was the originalMiddle one was the winner, with a 30% improvementLast one was the runner up, with a 27% improvement.
  12. Spent about 20 dollars to capture about 10 clicks.