Wrong confirmation ID

Email
Favorite
Favorited ×
Download
Embed
Private Content
Copy and paste this code into your blog or website Copy Customize… Close
We have emailed the verification/download link to "".
Login to your email and click the link to download the file directly.

To request the link at a different email address, update it here. Close
Validation messages. Success message. Fail message.

Check your bulk/spam folders if you can't find our mail.

Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

+ Follow

Make Better Decisions!

by Hiten Shah on Dec 08, 2010

3,949 views

More…

Less

10 Embeds 179

http://www.conseilsmarketing.fr	92
http://www.cazals.fr	56
http://www.conseilsmarketing.com	17
http://paper.li	6
http://twitter.com	2
http://bi-uniq.com	2
http://www.istikbal.gr	1
http://preacherspen.org	1
http://libguides.nus.edu.sg	1
http://www.twylah.com	1

More...

Statistics

Favorites: 7
Downloads: 135
Comments: 1
Embed Views: 179
Views on SlideShare: 3,770
Total Views: 3,949

1–1 of 1 previous next

Benjamin Alijagić , Designer at Farmeron VIDEO => http://www.livestream.com/plusconf/video?clipId=pla_561c5e89-d7c8-46da-84ec-33d1585a736b 1 year ago Reply
Are you sure you want to Yes No

Introduce myself.\n
How many of your know how to drive?\nHow many of you would like to drive this car?\n
How about blind-folded at 152 miles per hour?\nWell, that’s what most of us have been doing with our startups!\nSo...\n
We crash and burn.\nYou might even crash and burn if you aren’t blind-folded!\nSame with a startup, it’s EASY to fail. We all know that.\n
What’s easy?\n
It’s easy to add Google Analytics to your site and see reports.\nI am sure, most of our Google Analytics graphs don’t look like this.\nTraditional web analytics shows you page views, visits, page per visit, time on site, etc...\nThese are all easy metrics to get.\n
It’s also easy to track click through rates on ads.\n
Measuring what’s easy will increase you likelihood of failure.\nYou’ll crash and burn and end up with a startup just like this Ferrari.\n
Measuring what matters will increase your likelihood of success.\n
Vanity metrics are easy, they make you feel good.\nBest case = Up and to the right\nEveryone trying to take credit for it.\nEither way, what do you do next?\n
Actionable metrics point out problems and lead to solutions.\nThey make your learn faster and smarter about your business.\n
“Our hypothesis is that product manager type people have a problem doing fast/effective/frequent customer research.”\nQuestion: Is this hypothesis in fact true or not?!\nTake the least amount of effort to find out...\nWe did everything from customer interviews, fake landing pages, building a minimum viable product, pivoting and now have reach product / market fit and are optimizing the business.\n
How do you know what metrics matters? \nWhen I hear a metric from someone, I always try to ask them what decision that metric helps them make.\n
People sign up and pay online\nSign up for a 7 day free trial\nPay $97 per month\n
What would you measure?\nWhat would you optimize?\nSign up? Page views? Time on site? Bounce rate? CTR on ads?\nNext step is to write these down...\n\n
\n
Create a funnel out of the user actions and add numbers.\nThese user actions and numbers are your assumptions.\n
Get real data!\n
This is the funnel after implementing tracking for each step.\nBased on the original assumptions of 1% of people upgrading...\nWe’re not there yet. So...\n\n
Try to understand your riskiest point.\nUsually if people aren’t purchasing you want to focus on that.\nIn this example, people were purchasing, but the sign up is really low.\nSo we tried...\n
Adding a video to our homepage.\nIt increased the sign up rate, which was great.\nBut it decreased revenue :(\nFocusing on all the actionable metrics enabled us to see this.\nSo...we got inspired...\n
\n
The sign up rate increased, and the revenue increased dramatically.\n\n
You want to make sure you can compare the groups of people for these tests.\n
Sean Ellis and his 3 stages of a startup\n\nWe use the Startup Pyramid to remind us where we are and what our success metrics should be.\n\nProduct / Market Fit, Transition to Growth, Growth\n
AARRR!!! Dave McClure’s pirate metrics.\n\nHelps you frame key areas of your business based on a customer’s lifecycle.\n\nWe use this for idea generation.\n
And of course, Eric’s lean startup graphic.\n\nIt’s about validated learnings about customers and increasing cycle time.\n\nSo we can build something a LOT of people want to buy.\n
The principles of build, measure, learn help us think about how to get answers.\nThe methods and process of communication and information exchange are much different in a data-driven startup.\nThe tactical stuff to build, measure and learn faster is one side of things.\nNow I’m going to talk about the business processes and what we have learned trying to apply them.\nBefore continuing...clarify business process for a startup.\n\n
Company is divided into two teams. No sales, marketing, etc...\nProblem team identifies the most important problems to solve.\nSolution team finds the minimum solution for each problem.\nProblem team is more non-technical, solution team is more technical / “makers”. There are cross-functional folks too.\n
3 team meetings every week\nMonday - Team meeting to describe most important problems and goals for the week. Metrics + Few tasks, determine if solution team has input and let deadline for ideas on Tuesday.\nWednesday - Check in on how are we doing, solutions already getting implemented? What have we learned so far?\nFriday - Postmortem on learning and peek into next week from the Problem Team.\nProblem team is 1-week ahead.\n
To do this effectively we built a tool we are internally call KISSfocus.\nA tool we built to increase autonomy and communication, focused on our validated learnings driven process.\n5 tasks per person, only 1 is active (green-lighted), not in KF then not exist, backlog.\nWe set weekly goal and metrics based on most important problems.\nWhole team has visibility across all tasks, keeps solution team focused on most important problems.\n
\n

7 Favorites

Maxim Shatilov , Investment Analyst at ABRT Venture Fund 1 year ago
PaganGoatPants 1 year ago
Marco Lee , Consultant at Quan Pu Technology Corporation. 1 year ago
Anton Smythe Group at Anton Smythe Group 1 year ago
Daniel Patricio , Digital Marketer at Orange Rhino Media 1 year ago
Matt Gillooly 1 year ago
Octav Druta , Entrepreneur at - Tags metrics team 1 year ago

Make Better Decisions! — Presentation Transcript

Make Better Decisions!Using Metrics to WinHiten ShahPlusConf • December 7th, 2010
Ferrari F430 Spider
152 miles per hour
Most Startups Crash and Burn
Let’s talk about what else is easy.
Stop measuring what’s easy.
Start measuring what matters.
Vanity Metrics
Actionable Metrics
Original Hypothesis for KISSinsights“ Our hypothesis is that product manager type people have a problem doing fast/effective/frequent customer research.”
Are the metrics you aretracking helping you make decisions?
Example SaaS Web App• People sign up and pay online• They ﬁrst sign up for a 7 day free trial• Then they pay $97 per month
Example SaaS Web App • People sign up and pay online • They ﬁrst sign up for a 7 day free trial • Then they pay $97 per monthWhat are your assumptions?
Example SaaS Web App Macro StepsVisit Site Sign Up Activate Upgrade
Software as a Service Product (Assumptions)Key Actions % of people # of people Visit Site 100% 1000 Sign Up 10% 100 Activate 5% 50 Upgrade 1% 10 Revenue $970 per month
Baseline these key actions and assumptions.
Software as a Service Product (Actual Baseline)Key Actions % of people # of people Visit Site 100% 1000 Sign Up 3.6% 36 Activate 1.2% 12 Upgrade 0.4% 4 Revenue $388 per month
What would you try to improve?Key Actions % of people # of people Visit Site 100% 1000 Sign Up 3.6% 36 Activate 1.2% 12 Upgrade 0.4% 4 Revenue $388 per month
Software as a Service Product (Video Test)Key Actions % of people # of people Visit Site 100% 1000 Sign Up 6.5% 65 Activate 1.8% 18 Upgrade 0.3% 3 Revenue $291 per month vs. $388 baseline :(
Get inspired by what other’s have done
Software as a Service Product (Inspired Test)Key Actions % of people # of people Visit Site 100% 1000 Sign Up 7.7% 77 Activate 2.8% 28 Upgrade 1.2% 12 Revenue $1164 per month vs. $388 baseline :)
Software as a Service Product (Compare all 3)Key Actions Baseline Video Test Inspired Test Visit Site 100% 100% 100% Sign Up 3.6% 6.5% 7.7% Activate 1.2% 1.8% 2.8% Upgrade 0.4% 0.3% 1.2% Revenue $388 per $291 per $1164 per month month month
The Startup Pyramid The Race to the Top Growth Transition to Growth Product / Market Fit Sean Ellis: Startup-Marketing.com
AARRRCreated by Dave McClure - 500startups.com Designed by 1. ACQUISITION Customers come from various channels 2. ACTIVATION Customers use product for first time YOUR PRODUCT 3. RETENTION 4. REFERRAL Customers come back multiple times Customers refer others 5. REVENUE Customers make your business money
Minimize TOTAL time through the loop IDEASLearn Faster Build Faster LEARN BUILD Unit TestsSplit TestsCustomer Interviews Usability TestsCustomer Development Continuous IntegrationFive Whys Root Cause Incremental DeploymentAnalysis Free & Open-SourceCustomer Advisory Board ComponentsFalsifiable Hypotheses DATA CODE Cloud ComputingProduct Owner Cluster Immune System Just-in-time ScalabilityAccountability MEASURE RefactoringCustomer Archetypes Measure FasterCross-functional Teams Developer SandboxSemi-autonomous Teams Split Tests Funnel Analysis Minimum Viable ProductSmoke Tests Clear Product Owner Cohort Analysis Continuous Deployment Net Promoter Score Usability Tests Search Engine Marketing Real-time Monitoring Real-Time Alerting Customer Liaison Predictive Monitoring Eric Ries: StartupLessonsLearned.com
Lean Startup Data-Driven Process
No Departments, Just Two Teams ? Problem Team What are the ☼ Solution Team Find the most important minimum solution problems to solve? for a given problem.
15 - 45 minute team meetings (M,W,F)
“Your Focus Needs More Focus”
Questions?Got questions? Want advice? Email Me! hshah@kissmetrics.com

Make Better Decisions!

by Hiten Shah on Dec 08, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

10 Embeds 179

Statistics

Make Better Decisions! — Presentation Transcript