2010 02 19 the lean startup - webstock 2010Eric Ries
This document summarizes the key principles of the Lean Startup methodology for building startups with a high chance of success. It discusses how traditional management practices fail for startups due to extreme uncertainty, and promotes an approach of continuous learning through building minimum viable products and customer feedback. Specific Lean Startup techniques mentioned include continuous deployment, the five whys problem-solving method, and running frequent A/B tests to rapidly validate hypotheses about what customers want.
2009_06_08 The Lean Startup Tokyo editionEric Ries
The document discusses the Lean Startup methodology for building startups. It describes how most startups fail due to making assumptions without validating them with customers. The Lean Startup approach advocates for continuous customer feedback through short development cycles, rapid experimentation, and measuring what customers actually do rather than what they say. This allows startups to continually learn and adjust their product to fit the market.
Patrick McKenzie Opticon 2014: Advanced A/B TestingPatrick McKenzie
A/B Testing Beyond Headlines and Button Colors -- ideas for tests (particularly for B2B SaaS), common pitfalls in organizations, and how to overcome them.
2010 10 19 the lean startup workshop for i_gap irelandEric Ries
The document discusses the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for an experimental, customer-focused approach where the minimum viable product is used to test hypotheses and gather customer feedback through rapid iteration. Key techniques include continuous deployment, rapid A/B testing, and using the five whys method to identify the root causes of problems. The goal is to minimize the time to validate learning about customers through frequent releases and measurement.
Democratizing Online Controlled Experiments at Booking.com - Lukas VermeerSavage Marketing
There is extensive literature about online controlled experiments, both on the statistical methods available to analyze experiment results as well as on the infrastructure built by several large scale Internet companies but also on the organizational challenges of embracing online experiments to inform product development.
At Booking.com we have been conducting evidenced based product development using online experiments for more than ten years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind.
In this presentation, Lukas will explain how building a central repository of successes and failures to allow for knowledge sharing, having a generic and extensible code library which enforces a loose coupling between experimentation and business logic, monitoring closely and transparently the quality and the reliability of the data gathering pipelines to build trust in the experimentation infrastructure, and putting in place safeguards to enable anyone to have end to end ownership of their experiments have allowed such a large organization as Booking.com to truly and successfully democratize experimentation.
The document discusses the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for building a minimum viable product and continuously validating hypotheses through customer experiments rather than fully planning products. Key techniques include rapid A/B testing, continuous deployment of code, and using metrics to guide product decisions rather than visions of predicted success. The goal is to maximize learning from customers with minimum resources to improve odds of achieving product-market fit.
Startup Glossary - Begriffe und Methoden aus der Startupwelt. Präsentation im Rahmen der Exec I/O 2013 in Düsseldorf.
Die Präsentation gibt eine kurze Einführung rund um die wichtigsten Innovationsmethoden von Startups. Was ist das Erfolgsgeheimnis von Dropbox, Airbnb & Co? Erfahren Sie was ein Startup von einem bestehen Unternehmen unterscheidet und mit Hilfe welcher Vorgehensmodelle innovative Produkte und Dienstleistungen systematisch entwickelt und getestet werden können. Themen sind dabei unter anderem: Lean Startup, Customer Development, Design Thinking und der Business Model Canvas.
The document discusses the Lean Startup methodology for developing startups with extreme uncertainty. It defines a startup as an experiment to deliver a new product or service under conditions of uncertainty. The Lean Startup approach advocates for frequent pivots or changes in direction based on learning from customers rather than assuming the initial problem or solution is correct. It emphasizes reducing the cycle time between learning from experiments through the OODA (observe, orient, decide, act) loop to increase the odds of success with limited resources. Faster startups allow more experiments per dollar invested.
2010 02 19 the lean startup - webstock 2010Eric Ries
This document summarizes the key principles of the Lean Startup methodology for building startups with a high chance of success. It discusses how traditional management practices fail for startups due to extreme uncertainty, and promotes an approach of continuous learning through building minimum viable products and customer feedback. Specific Lean Startup techniques mentioned include continuous deployment, the five whys problem-solving method, and running frequent A/B tests to rapidly validate hypotheses about what customers want.
2009_06_08 The Lean Startup Tokyo editionEric Ries
The document discusses the Lean Startup methodology for building startups. It describes how most startups fail due to making assumptions without validating them with customers. The Lean Startup approach advocates for continuous customer feedback through short development cycles, rapid experimentation, and measuring what customers actually do rather than what they say. This allows startups to continually learn and adjust their product to fit the market.
Patrick McKenzie Opticon 2014: Advanced A/B TestingPatrick McKenzie
A/B Testing Beyond Headlines and Button Colors -- ideas for tests (particularly for B2B SaaS), common pitfalls in organizations, and how to overcome them.
2010 10 19 the lean startup workshop for i_gap irelandEric Ries
The document discusses the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for an experimental, customer-focused approach where the minimum viable product is used to test hypotheses and gather customer feedback through rapid iteration. Key techniques include continuous deployment, rapid A/B testing, and using the five whys method to identify the root causes of problems. The goal is to minimize the time to validate learning about customers through frequent releases and measurement.
Democratizing Online Controlled Experiments at Booking.com - Lukas VermeerSavage Marketing
There is extensive literature about online controlled experiments, both on the statistical methods available to analyze experiment results as well as on the infrastructure built by several large scale Internet companies but also on the organizational challenges of embracing online experiments to inform product development.
At Booking.com we have been conducting evidenced based product development using online experiments for more than ten years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind.
In this presentation, Lukas will explain how building a central repository of successes and failures to allow for knowledge sharing, having a generic and extensible code library which enforces a loose coupling between experimentation and business logic, monitoring closely and transparently the quality and the reliability of the data gathering pipelines to build trust in the experimentation infrastructure, and putting in place safeguards to enable anyone to have end to end ownership of their experiments have allowed such a large organization as Booking.com to truly and successfully democratize experimentation.
The document discusses the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for building a minimum viable product and continuously validating hypotheses through customer experiments rather than fully planning products. Key techniques include rapid A/B testing, continuous deployment of code, and using metrics to guide product decisions rather than visions of predicted success. The goal is to maximize learning from customers with minimum resources to improve odds of achieving product-market fit.
Startup Glossary - Begriffe und Methoden aus der Startupwelt. Präsentation im Rahmen der Exec I/O 2013 in Düsseldorf.
Die Präsentation gibt eine kurze Einführung rund um die wichtigsten Innovationsmethoden von Startups. Was ist das Erfolgsgeheimnis von Dropbox, Airbnb & Co? Erfahren Sie was ein Startup von einem bestehen Unternehmen unterscheidet und mit Hilfe welcher Vorgehensmodelle innovative Produkte und Dienstleistungen systematisch entwickelt und getestet werden können. Themen sind dabei unter anderem: Lean Startup, Customer Development, Design Thinking und der Business Model Canvas.
The document discusses the Lean Startup methodology for developing startups with extreme uncertainty. It defines a startup as an experiment to deliver a new product or service under conditions of uncertainty. The Lean Startup approach advocates for frequent pivots or changes in direction based on learning from customers rather than assuming the initial problem or solution is correct. It emphasizes reducing the cycle time between learning from experiments through the OODA (observe, orient, decide, act) loop to increase the odds of success with limited resources. Faster startups allow more experiments per dollar invested.
The minimum viable product (MVP) is the minimum set of features needed to learn from early adopters and avoid building products that nobody wants. It maximizes learning per dollar spent and is probably much more minimum than you think. An MVP allows achieving a big vision in small increments through iteration without going in circles chasing what customers think they want. The unit of progress is validated learning about customers through techniques like smoke testing landing pages, in-product split testing, and customer discovery to minimize the total time in the build-measure-learn loop.
The document discusses the Lean Startup methodology for building startups with a focus on minimizing risk through continuous experimentation and customer feedback. It contrasts two approaches - one that failed after 5 years and $40M by making assumptions without validating them, and one that succeeded by rapidly iterating and testing hypotheses with customers. The Lean Startup process emphasizes small batches, continuous deployment, A/B testing, and the "Five Whys" technique to drive learning and improve faster than traditional approaches.
Master the essentials of conversion optimizationArnas Rackauskas
Conversion optimization is a process. Amateurs follow best practices and don’t know where to begin. Experts follow frameworks and processes.
This expert guide will teach you the process of optimization.
Usability testing involves having people complete tasks while thinking aloud to provide insight into their thought processes. It can be done using paper prototypes, websites, or existing sites. Benefits for designers include uncovering unexpected issues, testing assumptions, and getting stakeholder buy-in. Benefits for site owners are fixing problems early when cheaper, improving customer satisfaction, and increasing conversion rates. Guerilla or informal testing is quick, inexpensive, and provides qualitative insights that can immediately feed back into the design process. It involves recruiting your own test subjects and moderating the sessions yourself.
2010 04 28 The Lean Startup webinar for the Lean Enterprise InstituteEric Ries
The document discusses myths and truths about Lean Startups. It dispels four common myths: that Lean means cheap, that it only applies to web/internet companies, that Lean Startups are small, and that they replace vision with data. It then provides an overview of Lean Startup principles like building a Minimum Viable Product, conducting rapid split tests, and achieving continuous deployment through small, frequent code releases.
This document discusses the Lean Startup methodology for building startups. It emphasizes using validated learning through experiments and customer feedback to reduce the time and resources wasted on products no one wants. Key principles include building minimum viable products to test hypotheses quickly and continuously deploying code to gather feedback to pivot the product as needed. This approach aims to maximize learning while minimizing wasted effort through practices like rapid A/B testing and measuring business metrics.
This document discusses A/B testing and provides advice for conducting A/B tests. It notes that A/B testing was originally used in pharmaceutical testing but is now commonly used by websites to test different versions of pages or features. The document emphasizes defining key performance indicators, testing hypotheses with proper sample sizes and durations, and not assuming causation from correlations in results. It cautions that A/B testing requires data analysis and should not kill creativity.
Eric Ries Lean Startup Schematic View Of Agile Development And Customer Devel...Eric Ries
The document compares traditional, waterfall, agile, and lean startup product development methods. Traditional waterfall development has known problems and solutions and progresses through stages. Agile methods have working code as the unit of progress and an unknown problem but known solution, while agile XP adds a product owner. Lean startup tightly couples business, marketing, and engineering in customer feedback loops, with customer validation as progress and hypotheses, experiments, and insights driving unknown problems and solutions.
This document discusses the importance and benefits of user testing websites through diy methods. It begins by defining usability as how well users can achieve goals on a product and their satisfaction level. User testing helps remove obstacles between users and their goals, leading to more conversions and money. While we think we know our users, testing reveals how they actually use sites. Common mistakes are obvious, but some bad designs seem good initially. The document recommends testing at all stages of a project with inexpensive methods like remote and in-person testing. Only a few users and tasks are needed, and changes do not need to be big or expensive to make large impacts to metrics like conversions. The key is to test early and often.
Lean Launchpad - Week 3 - Experiment DayAaron Eden
This week we reviewed all of the past reading and exercises. After that we walked through how to create a first experiment based on the business model canvas as well as how to analyze the data to determine next steps.
Eric Ries - The Lean Startup - Google Tech TalkEric Ries
This document discusses Lean Startup principles including validated learning, building-measuring-learning quickly through iterations, and innovation accounting. It emphasizes that entrepreneurship is management, startups are experiments, and most successful startups pivot their vision based on customer feedback. The Lean Startup methodology advocates for developing minimum viable products and continuously deploying, measuring and improving through techniques like A/B testing to rapidly learn what customers want.
Startup Ingredients (Team, Solving a Problem, Customers)John Peebles
A talk I delivered at the Scotland Can Do SCALE event in Stirling. Other speakers included Noam Wasserman of Harvard Business School and Bill Aulet of MIT Sloan. This was a 1.5 hour talk covering three areas I'm really passionate about - great teams, building great products, and making customers successful.
How Prototyping Helps You Design a Better ProductUserZoom
Sarah Doody, a NYC based independent User Experience Designer, explains why we must prototype, the prototyping process, tips to prototype fast & furiously, how to use prototypes effectively in your product design process to improve clarity and collaboration with your team.
Lean Startup: How Development Looks Different at a StartupAbby Fichtner
How does development look different at a startup where learning (rather than working software) is our most important measure of progress?
Lean Startup is about creating companies with a BIG VISION, where we want to change the world and do something really significant. It's a methodology developed by Eric Ries to combine Agile Development with Customer Development so that we can be disciplined about how we create our startups. Come learn the concepts behind Lean Startup and discover how development looks different when you're creating things that nobody else done before.
[Slides from my ScrumClub Presentation (December 9, 2010)]
What does it mean to be a test engineer?Andrii Dzynia
Test engineering is hard, even harder than software development. Being test engineer puts you in a wider context, with no clear boundaries. You have to find those by yourself. This requires courage. Courage to take action, courage to make mistakes. As a test engineer, you do mistakes every day. You do them so often that sometimes you feel you can predict the future. Scientific explanation to this phenomena is patterns recognition. It is an ability of our brain to match the information from a stimulus with information retrieved from memory. Defect prevention is hard. Together with technical skills one have to develop high social awareness. Working on safety nets never was so important, different types of checks on different levels to make sure software is reliable and serves its purpose to the variety of everyday use-cases. We know that life is so complex and sometimes complicated which makes it impossible to predict all possible outcomes and scenarios. But striving for excellence never was so important as nowadays in such an open, transparent and competitive environment.
Goal of my talk will be to show you my everyday job as a test engineer. Not only how to look for defects, but how to prevent them from happening. Not only how to automate tests(noun), but how to build safety nets to minimize end-user impact. Not only how to inform testing status but how to influence quality on company level.
David Cancel discusses Performable's journey of pivoting its product twice based on customer feedback. The initial product focused on automatic optimization but customers wanted more customization. The first pivot aimed to support customization but proved difficult for SMB customers. The second pivot focused on metrics-driven marketers who were power users willing to pay for a solutions-focused platform. Cancel shares lessons around validating ideas with paying customers, identifying patterns from feedback, moving quickly, and solving real problems over indifference.
Finish Line Product Development Services offers product development services to help small companies reliably manufacture prototypes at a reasonable cost. They recommend: 1) conducting design verification testing with an independent engineering team to identify issues; 2) ensuring documentation is complete for manufacturing; and 3) doing field testing with customers to identify early issues that can be addressed before large-scale production. Finish Line has experience helping over 300 small companies through the prototype to production process.
2010 10 15 the lean startup at tech_hub londonEric Ries
The document discusses the key principles of the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for an approach of continuous experimentation through building minimum viable products, obtaining rapid customer feedback through metrics like split testing, and using this validated learning to iteratively pivot or evolve the product or business model. The goal is to minimize the time required to progress through the build-measure-learn feedback loop in order to increase the chances of success before running out of resources.
Customer development and Agile developmentdchurchv
The document discusses how applying customer development principles can help improve agile projects. It suggests focusing on validating hypotheses about customers, problems, and solutions through experiments like minimum viable products and customer interviews before fully developing features. This helps minimize costs and risks until learning what customers really want. Product owners and developers are encouraged to prioritize learning over building by finding the fastest way to test hypotheses through the build-measure-learn process.
Talks@Coursera - A/B Testing @ Internet Scalecourseratalks
This document discusses A/B testing at large internet companies. It describes how companies like Amazon, Microsoft, Google, and LinkedIn use A/B testing to evaluate new ideas, measure their impact, and gain customer feedback. It outlines best practices for A/B testing, such as running one experiment at a time, choosing appropriate metrics and statistical significance, properly powering experiments, and addressing issues like multiple testing. The document also describes the key components of a scalable A/B testing system, including experiment management, online infrastructure for traffic routing and data logging, and automated offline analysis.
This document provides ten techniques for project managers and designers to undermine developers' efforts to meet deadlines, including: adding unnecessary functionality, designing for multiple devices without considering reuse, providing incomplete or unrealistic designs, omitting important details, changing designs after completion, and demeaning developers. The overall tone is tongue-in-cheek, critiquing practices that can frustrate developers and waste time.
The document provides a summary of the top 10 mistakes that early stage startups can easily avoid. These include: not understanding the business model well enough; doing everything the first big client says; launching without customer input; building overly complex MVPs; designing for themselves without user research; pursuing too many opportunities; lacking a clear vision or monetization strategy; and not measuring product usage. Avoiding these common pitfalls can help startups focus their efforts and resources more effectively in the early stages.
The minimum viable product (MVP) is the minimum set of features needed to learn from early adopters and avoid building products that nobody wants. It maximizes learning per dollar spent and is probably much more minimum than you think. An MVP allows achieving a big vision in small increments through iteration without going in circles chasing what customers think they want. The unit of progress is validated learning about customers through techniques like smoke testing landing pages, in-product split testing, and customer discovery to minimize the total time in the build-measure-learn loop.
The document discusses the Lean Startup methodology for building startups with a focus on minimizing risk through continuous experimentation and customer feedback. It contrasts two approaches - one that failed after 5 years and $40M by making assumptions without validating them, and one that succeeded by rapidly iterating and testing hypotheses with customers. The Lean Startup process emphasizes small batches, continuous deployment, A/B testing, and the "Five Whys" technique to drive learning and improve faster than traditional approaches.
Master the essentials of conversion optimizationArnas Rackauskas
Conversion optimization is a process. Amateurs follow best practices and don’t know where to begin. Experts follow frameworks and processes.
This expert guide will teach you the process of optimization.
Usability testing involves having people complete tasks while thinking aloud to provide insight into their thought processes. It can be done using paper prototypes, websites, or existing sites. Benefits for designers include uncovering unexpected issues, testing assumptions, and getting stakeholder buy-in. Benefits for site owners are fixing problems early when cheaper, improving customer satisfaction, and increasing conversion rates. Guerilla or informal testing is quick, inexpensive, and provides qualitative insights that can immediately feed back into the design process. It involves recruiting your own test subjects and moderating the sessions yourself.
2010 04 28 The Lean Startup webinar for the Lean Enterprise InstituteEric Ries
The document discusses myths and truths about Lean Startups. It dispels four common myths: that Lean means cheap, that it only applies to web/internet companies, that Lean Startups are small, and that they replace vision with data. It then provides an overview of Lean Startup principles like building a Minimum Viable Product, conducting rapid split tests, and achieving continuous deployment through small, frequent code releases.
This document discusses the Lean Startup methodology for building startups. It emphasizes using validated learning through experiments and customer feedback to reduce the time and resources wasted on products no one wants. Key principles include building minimum viable products to test hypotheses quickly and continuously deploying code to gather feedback to pivot the product as needed. This approach aims to maximize learning while minimizing wasted effort through practices like rapid A/B testing and measuring business metrics.
This document discusses A/B testing and provides advice for conducting A/B tests. It notes that A/B testing was originally used in pharmaceutical testing but is now commonly used by websites to test different versions of pages or features. The document emphasizes defining key performance indicators, testing hypotheses with proper sample sizes and durations, and not assuming causation from correlations in results. It cautions that A/B testing requires data analysis and should not kill creativity.
Eric Ries Lean Startup Schematic View Of Agile Development And Customer Devel...Eric Ries
The document compares traditional, waterfall, agile, and lean startup product development methods. Traditional waterfall development has known problems and solutions and progresses through stages. Agile methods have working code as the unit of progress and an unknown problem but known solution, while agile XP adds a product owner. Lean startup tightly couples business, marketing, and engineering in customer feedback loops, with customer validation as progress and hypotheses, experiments, and insights driving unknown problems and solutions.
This document discusses the importance and benefits of user testing websites through diy methods. It begins by defining usability as how well users can achieve goals on a product and their satisfaction level. User testing helps remove obstacles between users and their goals, leading to more conversions and money. While we think we know our users, testing reveals how they actually use sites. Common mistakes are obvious, but some bad designs seem good initially. The document recommends testing at all stages of a project with inexpensive methods like remote and in-person testing. Only a few users and tasks are needed, and changes do not need to be big or expensive to make large impacts to metrics like conversions. The key is to test early and often.
Lean Launchpad - Week 3 - Experiment DayAaron Eden
This week we reviewed all of the past reading and exercises. After that we walked through how to create a first experiment based on the business model canvas as well as how to analyze the data to determine next steps.
Eric Ries - The Lean Startup - Google Tech TalkEric Ries
This document discusses Lean Startup principles including validated learning, building-measuring-learning quickly through iterations, and innovation accounting. It emphasizes that entrepreneurship is management, startups are experiments, and most successful startups pivot their vision based on customer feedback. The Lean Startup methodology advocates for developing minimum viable products and continuously deploying, measuring and improving through techniques like A/B testing to rapidly learn what customers want.
Startup Ingredients (Team, Solving a Problem, Customers)John Peebles
A talk I delivered at the Scotland Can Do SCALE event in Stirling. Other speakers included Noam Wasserman of Harvard Business School and Bill Aulet of MIT Sloan. This was a 1.5 hour talk covering three areas I'm really passionate about - great teams, building great products, and making customers successful.
How Prototyping Helps You Design a Better ProductUserZoom
Sarah Doody, a NYC based independent User Experience Designer, explains why we must prototype, the prototyping process, tips to prototype fast & furiously, how to use prototypes effectively in your product design process to improve clarity and collaboration with your team.
Lean Startup: How Development Looks Different at a StartupAbby Fichtner
How does development look different at a startup where learning (rather than working software) is our most important measure of progress?
Lean Startup is about creating companies with a BIG VISION, where we want to change the world and do something really significant. It's a methodology developed by Eric Ries to combine Agile Development with Customer Development so that we can be disciplined about how we create our startups. Come learn the concepts behind Lean Startup and discover how development looks different when you're creating things that nobody else done before.
[Slides from my ScrumClub Presentation (December 9, 2010)]
What does it mean to be a test engineer?Andrii Dzynia
Test engineering is hard, even harder than software development. Being test engineer puts you in a wider context, with no clear boundaries. You have to find those by yourself. This requires courage. Courage to take action, courage to make mistakes. As a test engineer, you do mistakes every day. You do them so often that sometimes you feel you can predict the future. Scientific explanation to this phenomena is patterns recognition. It is an ability of our brain to match the information from a stimulus with information retrieved from memory. Defect prevention is hard. Together with technical skills one have to develop high social awareness. Working on safety nets never was so important, different types of checks on different levels to make sure software is reliable and serves its purpose to the variety of everyday use-cases. We know that life is so complex and sometimes complicated which makes it impossible to predict all possible outcomes and scenarios. But striving for excellence never was so important as nowadays in such an open, transparent and competitive environment.
Goal of my talk will be to show you my everyday job as a test engineer. Not only how to look for defects, but how to prevent them from happening. Not only how to automate tests(noun), but how to build safety nets to minimize end-user impact. Not only how to inform testing status but how to influence quality on company level.
David Cancel discusses Performable's journey of pivoting its product twice based on customer feedback. The initial product focused on automatic optimization but customers wanted more customization. The first pivot aimed to support customization but proved difficult for SMB customers. The second pivot focused on metrics-driven marketers who were power users willing to pay for a solutions-focused platform. Cancel shares lessons around validating ideas with paying customers, identifying patterns from feedback, moving quickly, and solving real problems over indifference.
Finish Line Product Development Services offers product development services to help small companies reliably manufacture prototypes at a reasonable cost. They recommend: 1) conducting design verification testing with an independent engineering team to identify issues; 2) ensuring documentation is complete for manufacturing; and 3) doing field testing with customers to identify early issues that can be addressed before large-scale production. Finish Line has experience helping over 300 small companies through the prototype to production process.
2010 10 15 the lean startup at tech_hub londonEric Ries
The document discusses the key principles of the Lean Startup methodology for building startups under conditions of extreme uncertainty. It advocates for an approach of continuous experimentation through building minimum viable products, obtaining rapid customer feedback through metrics like split testing, and using this validated learning to iteratively pivot or evolve the product or business model. The goal is to minimize the time required to progress through the build-measure-learn feedback loop in order to increase the chances of success before running out of resources.
Customer development and Agile developmentdchurchv
The document discusses how applying customer development principles can help improve agile projects. It suggests focusing on validating hypotheses about customers, problems, and solutions through experiments like minimum viable products and customer interviews before fully developing features. This helps minimize costs and risks until learning what customers really want. Product owners and developers are encouraged to prioritize learning over building by finding the fastest way to test hypotheses through the build-measure-learn process.
Talks@Coursera - A/B Testing @ Internet Scalecourseratalks
This document discusses A/B testing at large internet companies. It describes how companies like Amazon, Microsoft, Google, and LinkedIn use A/B testing to evaluate new ideas, measure their impact, and gain customer feedback. It outlines best practices for A/B testing, such as running one experiment at a time, choosing appropriate metrics and statistical significance, properly powering experiments, and addressing issues like multiple testing. The document also describes the key components of a scalable A/B testing system, including experiment management, online infrastructure for traffic routing and data logging, and automated offline analysis.
This document provides ten techniques for project managers and designers to undermine developers' efforts to meet deadlines, including: adding unnecessary functionality, designing for multiple devices without considering reuse, providing incomplete or unrealistic designs, omitting important details, changing designs after completion, and demeaning developers. The overall tone is tongue-in-cheek, critiquing practices that can frustrate developers and waste time.
The document provides a summary of the top 10 mistakes that early stage startups can easily avoid. These include: not understanding the business model well enough; doing everything the first big client says; launching without customer input; building overly complex MVPs; designing for themselves without user research; pursuing too many opportunities; lacking a clear vision or monetization strategy; and not measuring product usage. Avoiding these common pitfalls can help startups focus their efforts and resources more effectively in the early stages.
Design Sprints: Learnings and Insights from the TrenchesBart Deferme
1. The document discusses learnings from conducting design sprints at Qwinix, a software development company. It summarizes insights from facilitating over 12 design sprints.
2. Key takeaways include the importance of producing a sprint report, ensuring collaboration through off-site lunches, careful recruitment of prototype testers, defining roles for facilitation, and keeping the goals of the sprint in focus to avoid going off track.
3. Other insights involve avoiding early discussions of monetization, helping clients identify their end users through questioning assumptions, understanding that the sprint is just the beginning of a user-centered design process, and managing expectations that the sprint is not a shortcut but a validation step.
The document discusses the Lean Startup methodology for building startups. It advocates for continuous customer feedback through minimum viable products, rapid experimentation via split testing, and addressing problems through root cause analysis using the Five Whys technique. The Lean Startup approach aims to shorten development cycles and learn quickly through frequent releases and measurement in order to improve the chances of success for startups.
The prototype is all done and it seems to work well. Now, how do you get the prototype manufactured reliably and at a reasonable cost? If you're like a lot of small companies, this is not something you do all the time. Finish Line has done more than one thousand projects for more than 250 small companies and we have learned a few things in the process.
Top 10 Things To Do If You Want To Get Fired Over A WordPress ProjectWilliam Bergmann
A rundown of 10 of the most common ways to wreck a WordPress project, along with tips to avoid them for Project Managers on both the Client and Agency side.
Mobile App Feature Configuration and A/B Experimentslacyrhoades
The document discusses feature configuration and A/B testing in mobile apps. It describes how Etsy uses feature flags and continuous experimentation to iteratively develop and test new features. Features can be enabled or disabled for certain users or groups. Experiments follow a process of setting up a feature flag, determining user eligibility, coding the feature, internal testing, then launching the feature to a percentage of users while collecting analytics. This allows gathering feedback to improve products and user experience.
The document discusses the principles of agile development as outlined in the Agile Manifesto. It describes how agile values individuals and interactions, working software, customer collaboration, and responding to change over processes, tools, documentation, contracts, and plans. It then provides details on 11 key principles of agile development including delivering frequently to gain early customer feedback, adapting to changing requirements, maintaining a constant development pace, and allowing self-organizing teams. The overall goal of agile is to satisfy customers through early and continuous delivery of working software.
10 Things CEOs Need to Know About Design Jason Putorti
Presentation first delivered at the 2010 Bessemer Cloud Conference introducing design concepts for non-designers, simple tactics to improve existing products, and strategies for success in product/experience design moving forward.
Thank you Dustin Curtis, Kim Goodwin, Jared Spool, Marc Gobé, Indi Young, Steve Krug, Robert Hoekman, Jr., Seth Godin, and Jesse James Garrett for content and inspiration.
Making simple, elegant solutions is HARD and often invisible. These are some of the most common things I hear come out of people’s mouths when heading for a bad UX decision.
Uniting product development, business strategy, and agile software practices.
Covers thinking about product development wholistically from a customer-first perspective. Suggests good principles for established companies and boostrappers.
This document provides guidance on product management techniques for discovering user needs and developing product ideas. It discusses how to understand users through interviews and observation to identify pain points. It also outlines a three-step process for proposing product changes: 1) deeply understand the problem, 2) identify an ideal solution, and 3) scope a practical solution. Additionally, it covers how to create clear product specifications that consider functionality, layout, text, and avoid issues that could complicate development. Examples of mockups, user flows, and other tools for visualizing and specifying products are also presented.
This document provides an overview of rapid product development using a continuous feature improvement approach. It begins by introducing Zach Beer and his experience in product development roles. It then discusses some quick disclaimers about terminology and assumptions. The document advocates for determining the narrowest feature slice that can add value, delivering it quickly for customer feedback, learning from each delivery, and repeating. It provides examples of how to choose the right feature slice and develop critical feedback loops from customers. The document acknowledges challenges but argues the approach ultimately makes development easier and teams happier. It analogizes the process to incremental car feature development.
7 Key Questions to Ask Your Prospective Tech AgencyKoombea
How’s your tech/web/mobile agency search going? You decided you need a dev shop, but what are the right questions to ask them?
At Koombea we want you to be prepared. And we are happy to help you figure out which agency is best for you—even if it’s not us.
When talking to prospective tech agencies, use these helpful 7 questions to filter your options.
Applying the Serverless Mindset to Any Tech StackBen Kehoe
The document discusses how serverless is a mindset focused on delivering customer value rather than a technology. It argues that the serverless mindset can be applied to any technology stack by maximizing the work not done and focusing on delivering value. At iRobot, they have fully adopted serverless and it has reduced their operational burden significantly. However, the document emphasizes that functions, managed services, cost reductions, and technology are not the ultimate points - the point is focusing on creating customer value. Serverless technologies emerge as a consequence of adopting this value-focused mindset.
There’s a lot of speculation about open source product development. How can a product with “no IP” be competitive? What are the viable business models, when the code is freely available? And how am I supposed to build and take a viable product to market if my open source company is focused on services, not products?
The truth is, you can build — and successfully take to market — an open source product. But the rules are different, and must not be ignored. Product development is guided by different goals. Business models are based on different value propositions. And open source communities must be considered partners in the effort, not detractors or nay-sayers.
This talk will focus on three areas of open source products: product development, go-to-market strategy, and balancing product and services work. We’ll look at examples of open source products who have threaded the needle and “made it,” as well as a few that have crashed and burned. Most importantly, we’ll offer clear tips and guidance for those considering building or marketing an open source product.
Decision making is fundamental to any professional activity. The study of “decision bias” is a fascinating subject. These studies show that the root cause of most faulty decision making is a wrong assumption.
One of the most common faulty assumptions in the product development world is that the development budget and time is an obvious thing. This assumption leads to a world of trouble
The document provides an overview of changes in the field of quality assurance (QA) and testing. It discusses how QA is becoming more collaborative and integrated earlier in the development process. It also addresses how automation, while not solving all problems, can help teams test smarter and faster by handling repetitive tasks. The document notes that the skills required of testers are evolving to include the ability to code, communicate effectively, and work within agile teams across distributed locations.
Maximize Your Content with Beautiful Assets : Content & Asset for Landing Page pmgdscunsri
Figma is a cloud-based design tool widely used by designers for prototyping, UI/UX design, and real-time collaboration. With features such as precision pen tools, grid system, and reusable components, Figma makes it easy for teams to work together on design projects. Its flexibility and accessibility make Figma a top choice in the digital age.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
Storytelling For The Web: Integrate Storytelling in your Design ProcessChiara Aliotta
In this slides I explain how I have used storytelling techniques to elevate websites and brands and create memorable user experiences. You can discover practical tips as I showcase the elements of good storytelling and its applied to some examples of diverse brands/projects..
EASY TUTORIAL OF HOW TO USE CAPCUT BY: FEBLESS HERNANEFebless Hernane
CapCut is an easy-to-use video editing app perfect for beginners. To start, download and open CapCut on your phone. Tap "New Project" and select the videos or photos you want to edit. You can trim clips by dragging the edges, add text by tapping "Text," and include music by selecting "Audio." Enhance your video with filters and effects from the "Effects" menu. When you're happy with your video, tap the export button to save and share it. CapCut makes video editing simple and fun for everyone!
Decormart Studio is widely recognized as one of the best interior designers in Bangalore, known for their exceptional design expertise and ability to create stunning, functional spaces. With a strong focus on client preferences and timely project delivery, Decormart Studio has built a solid reputation for their innovative and personalized approach to interior design.
Visual Style and Aesthetics: Basics of Visual Design
Visual Design for Enterprise Applications
Range of Visual Styles.
Mobile Interfaces:
Challenges and Opportunities of Mobile Design
Approach to Mobile Design
Patterns
Architectural and constructions management experience since 2003 including 18 years located in UAE.
Coordinate and oversee all technical activities relating to architectural and construction projects,
including directing the design team, reviewing drafts and computer models, and approving design
changes.
Organize and typically develop, and review building plans, ensuring that a project meets all safety and
environmental standards.
Prepare feasibility studies, construction contracts, and tender documents with specifications and
tender analyses.
Consulting with clients, work on formulating equipment and labor cost estimates, ensuring a project
meets environmental, safety, structural, zoning, and aesthetic standards.
Monitoring the progress of a project to assess whether or not it is in compliance with building plans
and project deadlines.
Attention to detail, exceptional time management, and strong problem-solving and communication
skills are required for this role.
Connect Conference 2022: Passive House - Economic and Environmental Solution...TE Studio
Passive House: The Economic and Environmental Solution for Sustainable Real Estate. Lecture by Tim Eian of TE Studio Passive House Design in November 2022 in Minneapolis.
- The Built Environment
- Let's imagine the perfect building
- The Passive House standard
- Why Passive House targets
- Clean Energy Plans?!
- How does Passive House compare and fit in?
- The business case for Passive House real estate
- Tools to quantify the value of Passive House
- What can I do?
- Resources
Technoblade The Legacy of a Minecraft Legend.Techno Merch
Technoblade, born Alex on June 1, 1999, was a legendary Minecraft YouTuber known for his sharp wit and exceptional PvP skills. Starting his channel in 2013, he gained nearly 11 million subscribers. His private battle with metastatic sarcoma ended in June 2022, but his enduring legacy continues to inspire millions.
Fonts play a crucial role in both User Interface (UI) and User Experience (UX) design. They affect readability, accessibility, aesthetics, and overall user perception.
Practical eLearning Makeovers for EveryoneBianca Woods
Welcome to Practical eLearning Makeovers for Everyone. In this presentation, we’ll take a look at a bunch of easy-to-use visual design tips and tricks. And we’ll do this by using them to spruce up some eLearning screens that are in dire need of a new look.
1. Building a great product is not about
creating tons of tactically useful
features which are tangentially related.
It’s about delivering a cohesive product
within well-defined parameters.
Product managers have to be great at
saying ‘No’. Not ‘Maybe’ or ‘Later’. The
only word is ‘No’.
Why you don’t
add new features
Source: https://blog.intercom.com/
2. 12 arguments
commonly
used to sneak
features into
a product
Click on a tile to find out more
But the data looks
good1 But it will only take a
few minutes2 But this customer is
about to quit3
But we can just
make it optional4 But my cousin’s
neighbour said…5
But we are supposed
to be allowed to work
on whatever we want
7 But 713,000 people
want it8 But our competitors
already have it9
But if we don’t build
it, someone else will10
6 But we’ve nothing
else planned
11
But the boss really
wants it 12 But this could be
‘The One’
3. 1.
But the data
looks good
“We’ve tried this feature with a small group and engagement is off the charts.” Often
this approach suffers from selective data analysis. Products are complex systems.
What appears to be an increase in engagement is really just pushing numbers
around from place to place.
You might consider your labels feature a success based on its usage, but did you
notice that your tags feature is suddenly no longer popular? Even when the data is
solid, and the increase in engagement is good, you still have to question whether it
fits within the purview of the product.
Add Tetris to your product and you’ll probably see a boost in engagement, but does
that mean your product is better?
4. 2.
But it will only
take a few
minutes
The main problem with this argument is that the scope of work should never be a
reason to include a feature in a product. Maybe it’s a reason to bump it up the
roadmap as a quick win, but that’s a roadmap decision, not a product one.
Lots of bad ideas can be built quickly. Don’t be seduced. There are no small
changes. Even the tiniest additions add hidden complexity that isn’t accounted for in
the “but it’s just 5 minutes” estimate.
5. 3.
But this
customer is
about to quit
This is feature blackmail. No customer can be more important than a good product.
The road to consulting-ware is signposted “just this once for just this customer”.
It leads to the perfect product, for just one customer, and even then their loyalty now
depends on you doing what they say. Delivering extra value to one customer comes
at the cost of taking value away from many others.
6. 4.
But we can
just make it
optional
This leads to death by preferences. Making features optional hides the complexity
from the default screens in the interface, but it still surfaces everywhere else.
The visible cost of this is a messy interface with lots of conditional design and
heaps of configuration. The hidden cost is that every optional feature weakens your
product definition.
You become “a time tracker that can also send invoices and, sorta, do payment
reconciliation. But not reporting. Yet...I think...I don’t know.”
7. 5.
But my cousin’s
neighbour said…
This is the “appeal to the anecdote”. It is rife in consumer products, and in SaaS
companies that can’t decide what precise jobs they do.
Extrapolating from a tiny sample is an easy way to bypass years of experience,
research, data, and behaviour to make a statement that sounds reasonable.
Saying “my brother’s company use Google Analytics, they all use advanced
segments” is an easy way to make a case for advanced segments, bypassing
key questions like:
• what your product actually does.
• whether your brother’s company are a good target customer.
• whether they actually use it or just say they do.
• and whether advanced segments are actually the right solution for what your
customers are trying to do.
8. 6.
But we’ve
nothing else
planned
The devil makes work for idle product teams, and boy does he come up with some
shitty features. The problem here is someone sees one or more engineers sitting
idle and immediately rushes through a new feature to “keep ‘em busy”.
Decisions are rushed and designs are cobbled together all in the name of avoiding
idle time. This is a bad way to “improve” a product. Instead of adding to technical
debt here, there’s an opportunity to pay some off.
As anyone who has worked in a professional kitchen knows: “if you’ve time to lean,
you’ve time to clean”. Idle time is best used fixing bugs, cleaning up test suites,
refactoring, etc. rather than derailing a product vision just to “keep the team
productive”.
9. 7.
But we are
supposed to be
allowed to work
on whatever
we want
This argument appeals to cultural pride. There are many big name companies that
promise engineers they can build whatever they want and ship it.
Usually this promise has one of two outcomes: It’s a lie told to attract engineers.
This gets noticed quickly and falls apart. You can’t fake culture. It’s true. The end
result is a one-size-fits-none product full of half-baked ideas.
There’s a difference between encouraging engineers to build things internally (a
good thing) and letting people add features to a product bypassing product
management (a bad thing).
10. 8.
But 713,000
people want it
Always beware when someone falls back to raw numbers to justify something. Any
product with any amount of traction can make an emotive claim using numbers. e.g.
“You could fill Dolores Park with people who have asked for Excel integration.”
Such a claim forces you to take off your product design hat, and be one of the
“people”. Are you really going to say no to all those faces? You have to. Because the
majority of your users will suffer otherwise.
The question isn’t “could we fill Dolores Park with people who want this feature?”, it’s
“is this a valuable feature, within our purview, that all our customers will use?”.
11. 9.
But our
competitors
already have it
That doesn’t mean it’s a good idea. It could be something they’re trying out. It could
be a shit idea. It could be something they’re planning on killing.
It’s a mistake to assume that your competitors are in any way smarter or more
tactical than you. Obsessing about your competitor’s features relegates you to
permanently delivering “yesterday’s technology tomorrow”.
12. 10.
But if we
don’t build it,
someone
else will
That doesn’t mean it should be in your product. If someone else builds it, do
customers no longer need your product? Will they all switch over? Simply saying
“someone else will” sounds good, but means nothing.
We’ve all caught ourselves saying it. Often it’s the logic used to expand a product
because you’re not willing to admit your product stops somewhere. You’re afraid to
draw the line.
Here’s an example: A typical date might involve a movie, dinner, and a lift home. If a
cinema owner is constantly worried about what other businesses will build, and
hungry to capture more value, they’ll put a restaurant into their cinema and start a
cab company. Then they’ll be weak at all three. Then restaurants start screening
movies…
13. 11.
But the boss
really wants it
If the boss is also the product manager, and has the necessary time and insight to
make smart holistic decisions, then this is fine.
However, if someone is trying to earn brownie points by focusing on pet projects that
their manager has a penchant for, this inevitably leads to trouble.
14. 12.
But this could
be ‘The One’
This is a classic “Appeal to the Unknown”. Editing a product requires some hard
decisions about what to build. You can speculate that any unbuilt feature could
transform your product. But speculation is all it is, nothing more.
When you’re afraid to make hard decisions, you fall back on appealing to the
unknown, and therefore building everything. You end up with a repository of
features, not a product.
15. The thing is, no one keeps crap ideas in
their roadmap. Identifying and eliminating
the bad ideas is the easy bit.
They require you to look at a proposal
and say “This is a really great idea,
I can see why our customers would
like it. Well done. But we’re not going
to build it. Instead, here’s what
we’re doing.”
Why is “no”
important?
Source: https://blog.intercom.com/