Most startups don’t know what they’ll bewhen they grow up. Freshbooks Mitel was invoicing Wikipedia was a Paypal for a web was to be lawnmowerﬁrst built for company design ﬁrm written by Palmpilots experts only Flickr Hotmail Twitter Autodesk was going to was a was a made desktop be an MMO database podcasting automation company company
Kevin Costner is a lousy entrepreneur. Don’t sell what you can make. Make what you can sell.
Analytics is the measurementof movement towards yourbusiness goals. http://www.ﬂickr.com/photos/itsgreg/446061432/
Small business example:Solare watches thenumbers• Stage: Revenue• Model: Retailer• Solare is an Italian ﬁne-dining restaurant under new management. The new team is trying to identify the key metrics and leading indicators
Solare watches the numbers• A line in the sand: Gross Revenue to Labor Cost • Under 30% is good • Below 24% is great • Lower than 20% and you may be under-stafﬁng, leading to dissatisﬁed customers• A leading indicator: Total covers is 5x reservations at 5PM • If you have 50 reservations at 5, you’ll have 250 covers that night. • This ratio varies by restaurant.
In a startup, the purpose ofanalytics is to iterate to aproduct/market ﬁt beforethe money runs out.
Qualitative or Quantitative5 things you Exploratory or Reportingneed to know Vanity or Actionableabout metrics Correlated or Causal Leading or Lagging
Qualitative Quantitative Unstructured, Numbers and stats; anecdotal, hard facts but less revealing, hard to insight. aggregate. Warm and fuzzy. Cold and hard.http://www.ﬂickr.com/photos/zooboing/8388257248/ http://www.ﬂickr.com/photos/x1brett/4665645157/
Simply: you can’t count smiles.Discover qualitatively, prove quantitatively.Qualitative is inspiration, quantitative is veriﬁcation.
Exploratory Reporting Speculative, trying Predictable, keeping to ﬁnd unexpected you abreast of or interesting normal, managerial insights. operations.http://www.ﬂickr.com/photos/50755773@N06/5415295449/ http://www.ﬂickr.com/photos/elwillo/4737933662/
Donald Rumsfeld on analytics Are facts which may be wrong and we know should be checked against data. know we don’t Are questions we can answer by reporting, which we should baseline know & automate.Things we Are intuition which we should we know quantify and teach to improve don’t effectiveness, efﬁciency. know we don’t Are exploration which is where unfair advantage and interesting know epiphanies live. (Or rather, Avinash Kaushik channeling Rumsfeld)
Vanity Actionable Picks a direction.Makes you feelgood, but doesn’tchange how you’llact.http://www.ﬂickr.com/photos/lostseouls/807253220/ http://www.ﬂickr.com/photos/aussiegall/6382775153/
A metric from the early, foolish days of the Web. Hits Count people instead. Marginally better than hits. Unless you’re displaying Page views ad inventory, count people. Is this one person visiting a hundred times, or are a Visits hundred people visiting once? Fail. This tells you nothing about what they did, why theyUnique visitors stuck around, or if they left. Followers/ Count actions instead. Find out how many followers friends/likes will do your bidding.Time on site, or Poor version of engagement. Lots of time spent on pages/visit support pages is actually a bad sign. How many recipients will act on what’s in them?Emails collected Number of Outside app stores, downloads alone don’t lead to downloads lifetime value. Measure activations/active accounts.
2-sided market model:AirBnB and photography• Stage: Revenue• Model: 2-sided marketplace• Rental-by-owner marketplace that allows property owners to list and market their houses. Offers a variety of related services as well.
AirBnB tests a hypothesis• The hypothesis: “Hosts with professional photography will get more business. And hosts will sign up for professional photography as a service.”• Built a concierge MVP• Found that professionally photographed listings got 2-3x more bookings than the market average.• In mid-to-late 2011, AirBnB had 20 photographers in the ﬁeld taking pictures for hosts.
NIGHTS BOOKED10 million 8 million 6 million 20 photographers 4 million 2 million 2008 2009 2010 2011 2012
http://www.ﬂickr.com/photos/circasassy/7858155676/ it’s a how you behave, If it won’t changebadmetric.
A few words on causality. http://www.ﬂickr.com/photos/roryﬁnneren/65729247
Correlated CausalTwo variables that An independentchange in similar factor that directlyways , perhaps impacts abecause they’re dependent one.linked to somethingelse. Summer al Ca us us Ca Correlated al Drowning Ice creamconsumption
Causality is a superpower, because it lets youchange the future. Correlation lets you Causality lets you predict the future change the future“I will have 420 “If I can make moreengaged users and ﬁrst-time visitors stay75 paying customers on for 17 minutes Inext month.” will increase sales in 90 days.” Optimize theFind correlation Test causality causal factor
Leading LaggingNumber today that Historical metric thatshows metric shows how you’retomorrow—makes doing—reports thethe news. news.
A leading indicator for e-commerce How many of your customers Then you are in Your customers You are just Focus on buy a second this mode will buy from you liketime in 90 days? Low CAC, 1-15% Acquisition Once 70% high of retailers checkout 15-30% Hybrid 2-2.5 20% Increasing per year of retailers returns Loyalty, >30% Loyalty >2.5 10% inventory per year of retailers expansion (Thanks to Kevin Hilstrom for this.)
Think about a car•60MPH is twice as fast as 30MPH•Speed limits and mileage are well understood •Kilometres are conveniently decimal; miles map to hours•Ratios everywhere •Miles travelled is good; •Miles per hour is better; •Accelerating or decelerating changes your gas pedal•Custom metrics: “MPH divided by speeding tickets” as a metric of “driving fast without losing my license”
Eric Ries’Three engines Stickiness Virality PriceApproach Keep people Make people Spend revenue coming back. invite friends. getting customers.Math that Get customers How many they Customers are matters faster than you tell, how fast worth more than lose them. they tell them. they cost to get.
Dave McClure’s Pirate metrics How do your users become aware of you? Acquisition AARRR SEO, SEM, widgets, email, PR, campaigns, blogs ... Do drive-by visitors subscribe, use, etc? Activation Features, design, tone, compensation, afﬁrmation ... Does a one-time user become engaged? Retention Notiﬁcations, alerts, reminders, emails, updates... Do you make money from user activity? Revenue Transactions, clicks, subscriptions, DLC, analytics... Do users promote your product? Referral Email, widgets, campaigns, likes, RTs, afﬁliates...
The ﬁve Stages of Lean Analytics EmpathyThe stage you’re at Stickiness Virality Revenue Scale
Example: a restaurant• Empathy: Before opening, the owner ﬁrst learns about the diners in its area, their desires, what foods aren’t available, and trends in eating.• Stickiness: Then he develops a menu and tests it out with consumers, making frequent adjustments until tables are full and patrons return regularly. He’s giving things away, testing things, asking diners what they think. Costs are high because of variance and uncertain inventory.• Virality: He starts loyalty programs to bring frequent diners back, or to encourage people to share with their friends. He engages on Yelp and Foursquare.• Revenue: With virality kicked off, he works on margins—fewer free meals, tighter controls on costs, more standardization.• Scale: Finally, knowing he can run a proﬁtable business, he pours some of the revenues into marketing and promotion. He reaches out to food reviewers, travel magazines, and radio stations. He launches a second restaurant, or a franchise based on the initial one.
Example: a software company• Empathy: The founder ﬁnds an unmet need, often because she has a background in a particular industry or has worked with existing solutions that are being disrupted.• Stickiness: She meets with an initial group of prospects, and signs contracts that look more like consulting agreements, which she uses to build an initial product. She’s careful not to commit to exclusivity, and tries to steer customers towards standardized solutions, charging heavily for custom features. She supports the customers directly from the engineering team until the product is stable and usable.• Virality: Product in hand, she asks for references from satisﬁed customers, and uses them as testimonials. She starts direct sales, and grows the customer base. She launches a user group, and starts to automate support. She releases an API, encouraging third-party development and scaling potential market size without direct development.• Revenue: She focuses on growing the pipeline, sales margins, and revenues while controlling costs. Tasks are automated, outsourced, or offshored. Feature enhancements are scored based on anticipated payoff and development cost. Recurring license and support revenue becomes an increasingly large component of overall revenues.• Scale: She signs deals with large distributors, and works with global consulting ﬁrms to have them deploy and integrate her tool. She attends trade shows to collect leads, carefully measuring cost of acquisition against close rate and lead value.
Mobile app model:Localmind hacks Twitter• Stage: Empathy• Model: UGC/mobile• Real-time question and answer platform tied to locations.• Needed to ﬁnd out if a core behavior—answering questions about a place— happened enough to make the business real
Localmind hacks Twitter• Before writing a line of code, Localmind was concerned that people would never answer questions. • This was their biggest risk: if questions went unanswered users would have a terrible experience and stop using Localmind.• Ran an experiment on Twitter • Tracked geolocated tweets in Times Square • Sent @ messages to people who had just tweeted, asking questions about the area: how busy is it; is the subway running on time; is something open; etc.• The response rate to their tweeted questions was very high. • Good enough proxy to de-risk the solution, and convince the team and investors that it was worth building Localmind.
When it’s time to move on• Have you conducted enough quality customer interviews to feel conﬁdent that I’ve found a problem worth solving?• Do you understand your customer well enough?• Do you believe your solution will meet the needs of customers?
1995 Hits1997 Visits1999 Visitors2002 Conversions Who did you add? Where from? Why?2010 Engagement What did they do? How did it beneﬁt? Who did you lose? Why did they leave?
Stickiness stage:WP Engine discovers the2% cancellation rate• Stage: Stickiness• Model: SaaS• Wordpress hosting company founded in July 2010, it raised $1.2M in November 2011
WP-Engine discovers the 2%cancellation rate• All companies have cancellations, but founder Jason Cohen was alarmed that he was losing a quarter of customers every year.• Jason called customers himself. “Not everyone wanted to speak with me, but enough people were willing to talk, even after they had left, that I learned a lot about why they were leaving.”• Asked around. Turns out 2% is best case for most hosting companies.• Without this, the company would have been getting diminishing returns over- optimizing churn; instead, they could focus on maximizing revenues or lowering acquisition costs.
When it’s time to move on• Are people using the product as expected?• Deﬁne an active user. What percentage of your users/customers is active?Write this down. Could this be higher? What can you do to improve engagement?• Evaluate your feature roadmap against the 7 questions to ask before buildingmore features. Does this change the priorities of feature development?• Evaluate the complaints you’re getting from users. How does this impactfeature development going forward?
Virality stage:Timehop’s content sharing• Stage: Virality• Model: Mobile app• Social network around the past• Focused on virality (but not necessarily the coefﬁcient!)
The one metric that matters: contentsharing• Focused on percent of daily active users that share their content• Aiming for 20-30% of DAU sharing“All that matters now is virality.Everything else—be it press,publicity stunts or something else—is like pushing a rock up amountain: it will never scale. Butbeing viral will.” - Jonathan Wegener, co-founder
3 kinds of virality• Inherent virality is built into the product, and happens as a function of use.• Artiﬁcial virality is forced, and often built into a reward system.• Word of mouth virality is simply conversations generated by satisﬁed users.
When it’s time to move on• Are you using one of the three types of virality (inherent, artiﬁcial, word of mouth) for your startup? Describe how. If virality is a weak aspect of your startup, write down 3-5 ideas for how you could build more virality into your product.• What’s your viral coefﬁcient? Even if it’s below 1 (which it likely is), do you feel like the virality that exists is good enough to help sustain growth and lower customer acquisition costs?• What’s your viral cycle time? How could you speed it up?
RevenuePour some of the money back into acquisition.
Revenue stage:Backupify’s customerlifecycle• Stage: Revenue• Model: SaaS• Leading backup provider for cloud based data.• The company was founded in 2008 by Robert May and Vik Chadha• Has gone on to raise $19.5M in several rounds of ﬁnancing.
Shifting to Customer AcquisitionPayback as a key metric• Initially focused on site visitors• Then focused on trials• Then switched to signups• Today, MRR• In early 2010, CAC was $243 and ARPU was only $39 • Pivoted to target business users • CLV-to-CAC today is 5-6x• Now they track Customer Acquisition Payback • Target is less than 12 months
Sergio Zyman’s many “mores”• If you’re dependent on physical, per-transaction costs (like direct sales, or shipping products to a buyer, or signing up merchants) then more eﬃciently will ﬁgure prominently on either the supply or demand side of your business model.• If you’ve found a high viral coefﬁcient, then more people makes sense, because you’ve got a strong force multiplier added to every dollar you pour into customer acquisition.• If you’ve got a loyal, returning set of customers who buy from you every time, then more often makes sense, and you’re going to emphasize getting them to come back more frequently.• If you’ve got a one-time, big-ticket transaction, then more money will help a lot, because you’ve only got one chance to extract revenue from the customer and need to leave as little money as possible on the table.• If you’re a subscription model, and you’re ﬁghting churn, then upselling customers to higher-capacity packages with broader features to additional subscribers within their organization is your best way of growing existing revenues, so you’ll spend a lot of time on more stuﬀ.
When it’s time to move onYou’re making moneyYou’re sustainableYou’re tracking growth metrics
The trust equation Your expertise & Do what you Are you one of reputation; say; say what us? Morality & certiﬁcations you do. personality. Credibility + Reliability + IntimacyTrustworthiness = Self-orientation What’s in it for you? Maister, Green and Galford
• A Facebook user reaching 7 friends within 10 days of signing up (Chamath Palihapitiya)• If someone comes back to Zynga a day after signing up for a game, they’ll probably become an engaged, paying user (Nabeel Hyatt)• A Dropbox user who puts at least one ﬁle in one folder on one device (ChenLi Wang)• Twitter user following a certain number of people, and a certain percentage of those people following the user back (Josh Elman)• A LinkedIn user getting to X connections in Y days (Elliot Schmukler) (These are also great segments to analyze.) (from the 2012 Growth Hacking conference)
The growth hack• Growth hacking is simply what marketing should have been doing, but it fell in love with Don Draper and opinions along the way• At its most basic: Optimize a factor you think is correlated with growth
The ﬁve Stages of Lean Analytics The business you’re in E- 2-sided Mobile User-gen SaaS Media commerce market app content
UGC model:Reddit goes from links tocommunity• Stage: Virality• Model: UGC• A graduate of the ﬁrst YCombinator class, reddit was acquired by Conde Nast but left largely to its own devices. Thanks to a vibrant community and some good guidance by its founders, it’s a trafﬁc powerhouse.
Reddit goes from links to community• Product evolution • Started as a simple link-sharing site with voting • Then added the ability to comment, with votes on comments • Then created the ability to make “self-posts” rather than only comment on off- site trafﬁc • Now self-posts are more than half of all posts
Reddit goes from links to community• Revenue from ads and “reddit gold” • Started as a joke, but turned into a revenue source • One person paid $1000 for a month; some paid $0.01. Avg. around $4. • Paying users get early access to features, since they’re an engaged beta
The ﬁve Stages of Lean Analytics The business you’re in E- 2-sided Mobile User-gen SaaS Media commerce market app content EmpathyThe stage you’re at One Metric Stickiness Virality Revenue That Matters. Scale
The B2B stereotype• Domain expert knows industry and the problem domain. Has a Rolodex; proxy for customers. http://www.techdigest.tv/2007/02/im_a_pc_im_a_ma.html• Disruption expert knows tech that will produce a change Sees beyond the current model. Domain Disruption expert expert Operations
Three typical approaches Create a popular consumer Dropbox Enterprise pivot product then pivot to tackle the enterprise Take an existing consumer or Yammer, Copy and rebuild open source idea and make it MapR enterprise-ready Convince the enterprise to Taleo,Disrupt a problem discard the old way because of Google overwhelming advantages. Apps
Enterprise example:Coradiant pivots fromservice to appliance• Stage: Revenue• Model: Enterprise sale• Coradiant started as a research ﬁrm, then moved into managed services. As the market’s needs changed and data center preferences ossiﬁed, the company switched from services to a physical appliance for web performance management.
Coradiant pivots from service toappliance• Started as an MSP in colocated spaces, offering service and virtual infrastructure.• Data center partners became competitors• Talked to customers, who liked the monitoring interface and performance management• Hibernated the company and turned the internal tool for monitoring web health (OutSight) into an appliance • MVP focused on the core value—what was actually happening on the wire • Reporting etc. was introduced as Excel exports initially • Made it easy to get data off the box to mitigate limited feature sets• Scaled through channels and partnerships (Splunk, Akamai, etc.)
Lean Analytics lifecyclefor an enterprise-focused startup Stage Do this Fear this Consulting to test ideas and Lock-in, IP Empathy bootstrap the business control, overﬁtting Standardization and integration; Ability to Stickiness shift from custom to generic integrate; support Word of mouth, references, case Bad vibes; Virality studies exclusivity Growing direct sales, professional Pipeline, revenue Revenue services, support recognition, comp Channels, analysts, ecosystems, Crossing the Scale APIs, vertically targeted products chasm; Gorillas
The Zero Overhead principleA central theme to this new wave ofinnovation is the application of core producttenets from the consumer space to theenterprise.In particular, a universal lesson that I keepsharing with all entrepreneurs building for theenterprise is the Zero Overhead Principle: nofeature may add training costs to theuser. DJ Patil
Skunk Works for intrapreneurs • The Lockheed Martin Skunk Works
Span of control and the railroads• Daniel C. McCallum
The BCG matrix• How businesses think about products or Question marks! increase Pivot to Stars! companies (low market share, market (high growth rate, share high growth rate) through high market share) May be the next big thing. virality, What everyone wants. As• Lean is about moving Consumes investment, but attention market invariably stops will require money to growing, should become up and to the right Growth rate increase market share. cash cows. Milk with Pivot to Pivot to revenue redeﬁne problem/ increase growth optimization as solution through rate through growth slows empathy disruption Dogs! Cash cows! (low market share, (high market share, low growth rate) low growth rate) Barely breaks even, may Boring sources of cash, to be a distraction from better be milked but not worth opportunities. Sell off or additional investment. shut down. Market share
Intrapreneur example:P&G changes the mopinstead of the soap• Stage: Empathy• Model: Retail/consumer packaged goods• P&G is constantly looking for better soaps. But innovation was slowing. Frustrated, they hired a design team to help them.
P&G changes the mopinstead of the soap• Heavy internal investment in R&D, but limited results• Brought in an outside agency (Continuum) to help• The team watched people as they mopped, recording and iterating their research approach• Watched someone pick up spilled coffee. Rather than mopping, the person swept up with a broom, then wiped with a cloth• Realized the mop, not the liquid, mattered• Studied the makeup of ﬂoor dirt; realized much of it is dust• Swiffer is a $500M innovation in a stalled industry
The Lean Analytics lifecyclefor an Intrapreneur Stage Do this Fear this Get buy-in Political fallout Beforehand Find problems; don’t test demand. Entitled, aggrieved Empathy Skip the business case, do analytics customers Know your real minimum based on Hidden “must haves”, Stickiness expectations, regulations feature creep Build inherent virality in from the Luddites who don’t Virality start; attention is the new currency understand sharing Consider the ecosystem, channels, Channel conﬂict, Revenue and established agreements resistance, contracts Hand the baton to others gracefully Hating what happens Scale to your baby
Metrics in practice:The Lean Analytics CycleSuccess! Pick OMTM Draw a line in the sand Pivot or give up Draw a new line Find a potential Try again improvementDid we movethe needle? Without With data: data: make a ﬁnd a good guess commonality Design a test Measure the results Hypothesis Make changes in production
Virality stage:Circle of Moms ﬁnds anengaged market• Stage: Stickiness• Model: UGC• Launched as Circle of Friends in 2007, it was a way for small groups to interact atop Facebook’s platform; but when engagement wasn’t good enough, the founders decided to dig deeper.
The problem: Not enough engagement• Too few people were actually using the product• Less than 20% of any circles had any activity after their initial creation• A few million monthly uniques from 10M registered users, but no sustained traction
What Circle of Moms found• They found moms were far more engaged • Their messages to one another were on average 50% longer • They were 115% more likely to attach a picture to a post they wrote • They were 110% more likely to engage in a threaded (i.e. deep) conversation • Circle owners’ friends were 50% more likely to engage with the circle • They were 75% more likely to click on Facebook notiﬁcations • They were 180% more likely to click on Facebook news feed items • They were 60% more likely to accept invitations to the app• Pivoted to the new market, including a name change• By late 2009, 4.5M users and strong engagement• Sold to Sugar, inc. in early 2012
Virality stage:qidiq streamlines invites• Stage: Virality• Model: SaaS• Tool to poll small groups, built in the Year One Labs accelerator
Initial design Redesigned workﬂow Survey owner adds recipient to group Survey owner adds recipient to group 70-90% RESPONSE RATE Survey owner asks question Survey owner asks question Recipient gets invite Recipient reads survey question10-25% RESPONSE RATE Recipient installs mobile app Recipient responds to question Recipient sees survey results Recipient creates account, proﬁle Recipient can edit proﬁle, view past (Later, if needed…) questions, etc. Recipient visits website Recipient reads survey question Recipient has no password! Recipient responds to question Recipient does password recovery Recipient sees survey results One-time link sent to email Recipient creates password Recipient can edit proﬁle, view past questions, etc.
“The most important ﬁgures thatone needs for management areunknown or unknowable, butsuccessful management mustnevertheless take account ofthem.” Lloyd S. Nelson
Pic by Twodolla on Flickr. http://www.ﬂickr.com/photos/twodolla/3168857844