SlideShare a Scribd company logo
1 of 32
Build The Right
Stuff.
Workshop by Adam Scott & Arti Mathanda
ADAM SCOTT
@adamacs
ARTI MATHANDA
@artismarti
SIMPLY BUSINESS
❖ Britain’s biggest business insurance provider
❖ Selling insurance online for 10 years
❖ 300,000+ customers and counting
❖ Iterating on Agile & Lean methodologies for 4.5 years
I HAVE AN IDEA!
BUT…
WHERE DO YOU
WANT TO GO?
BUILD
BUILD
SHOULD YOU BUILD IT?
Why? ---> Why? ---> Why? ---> Why? ---> Why?
BUILD
CAN YOU BUILD IT?
What? & Who? & How?
BUILD
WILL YOU BUILD IT?
When?
LEAN START UP
- Build
- Measure
- Learn
BUILD
DEFINE EXPERIMENT
BUILD
HYPOTHESIS:
We believe that by doing x we will get benefit y.
ex. We believe that by making the Call To Action button
more prominent, we will get a better conversion rate
from Page 1 to Page 2
BUILD
BAD HYPOTHESIS (a fact or a given)
BUILD
GOOD HYPOTHESIS (it can be true or false)
BUILD
BASELINE:
Currently 25% conversion from Page 1 to Page 2..
BUILD
EXPECTED RESULTS:
Page 1 to Page 2 conversion increases by 10% points.
BUILD
MEASURE FOR:
2 weeks.
(Don’t forget Statistical Significance).
BUILD
GOOD MEASURES
BUILD
BAD MEASURES
BUILD
ALSO KEEP AN EYE ON:
Site Performance
Overall Conversions
Seasonal effects
Bounce Rates
etc etc etc
MEASURE
ACTUAL RESULTS:
Page 1 to Page 2 conversion increased by 3% points
MEASURE
IS IT STATISTICALLY SIGNIFICANT?
Yes!
LEARN
NOW WHAT?
LEARN
WHY DID IT FAIL?
LEARN
WHAT OTHER METRICS ARE AVAILABLE
TO ANALYSE THIS?
LEARN
TRY SOMETHING DIFFERENT?
LEARN
REVERT CHANGE?
LEARN
LEAVE IT RUNNING?
TLDR;
RECORD!
LET’S PRACTISE

More Related Content

What's hot

Finding Your Next Great Hire with Indeed CV
Finding Your Next Great Hire with Indeed CVFinding Your Next Great Hire with Indeed CV
Finding Your Next Great Hire with Indeed CVIndeed
 
Bob Sanders - Focus on Chemistry
Bob Sanders - Focus on ChemistryBob Sanders - Focus on Chemistry
Bob Sanders - Focus on ChemistryINBOUND
 
List Down Your Expectations
List Down Your ExpectationsList Down Your Expectations
List Down Your ExpectationsSV.CO
 
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCP
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCPPresentación Edgardo Ochoa - 21 Encuentro Empresarial CRCP
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCPcamaradecomerciovalparaiso
 
Building Credibility & Trust in a Connected World - Ben Aronsten, Seedrs
Building Credibility & Trust in a Connected World - Ben Aronsten, SeedrsBuilding Credibility & Trust in a Connected World - Ben Aronsten, Seedrs
Building Credibility & Trust in a Connected World - Ben Aronsten, SeedrsOnline Influence
 
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.Julian Bradder
 
The Art & Science of Value Creation: 3 Traits of Great Value-creators
The Art & Science of Value Creation: 3 Traits of Great Value-creatorsThe Art & Science of Value Creation: 3 Traits of Great Value-creators
The Art & Science of Value Creation: 3 Traits of Great Value-creatorsJay Selnick
 
Building a mobile web start-up in South Africa
Building a mobile web start-up in South AfricaBuilding a mobile web start-up in South Africa
Building a mobile web start-up in South AfricaMotribe
 

What's hot (8)

Finding Your Next Great Hire with Indeed CV
Finding Your Next Great Hire with Indeed CVFinding Your Next Great Hire with Indeed CV
Finding Your Next Great Hire with Indeed CV
 
Bob Sanders - Focus on Chemistry
Bob Sanders - Focus on ChemistryBob Sanders - Focus on Chemistry
Bob Sanders - Focus on Chemistry
 
List Down Your Expectations
List Down Your ExpectationsList Down Your Expectations
List Down Your Expectations
 
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCP
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCPPresentación Edgardo Ochoa - 21 Encuentro Empresarial CRCP
Presentación Edgardo Ochoa - 21 Encuentro Empresarial CRCP
 
Building Credibility & Trust in a Connected World - Ben Aronsten, Seedrs
Building Credibility & Trust in a Connected World - Ben Aronsten, SeedrsBuilding Credibility & Trust in a Connected World - Ben Aronsten, Seedrs
Building Credibility & Trust in a Connected World - Ben Aronsten, Seedrs
 
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.
Agile Inbound Marketing for B2B Technology, Software and SaaS Vendors.
 
The Art & Science of Value Creation: 3 Traits of Great Value-creators
The Art & Science of Value Creation: 3 Traits of Great Value-creatorsThe Art & Science of Value Creation: 3 Traits of Great Value-creators
The Art & Science of Value Creation: 3 Traits of Great Value-creators
 
Building a mobile web start-up in South Africa
Building a mobile web start-up in South AfricaBuilding a mobile web start-up in South Africa
Building a mobile web start-up in South Africa
 

Similar to Build Right Stuff Workshop

Ken courtright at make your mark success 2015
Ken courtright at make your mark success 2015Ken courtright at make your mark success 2015
Ken courtright at make your mark success 2015Ken Courtright
 
Ken courtright at ceo space 815
Ken courtright at ceo space 815Ken courtright at ceo space 815
Ken courtright at ceo space 815Ken Courtright
 
COMPANY PROFILE POWER POINT
COMPANY PROFILE POWER POINT COMPANY PROFILE POWER POINT
COMPANY PROFILE POWER POINT slamet Shaleh
 
Ken courtright at guerrilla business school
Ken courtright at guerrilla business schoolKen courtright at guerrilla business school
Ken courtright at guerrilla business schoolKen Courtright
 
Business presentation
Business presentationBusiness presentation
Business presentationqneteg
 
Top Tips and Tricks for creating a Kick Ass Pitch Deck
Top Tips and Tricks for creating a Kick Ass Pitch DeckTop Tips and Tricks for creating a Kick Ass Pitch Deck
Top Tips and Tricks for creating a Kick Ass Pitch DeckEllena Ophira
 
Life at Uniting Ambition >>> Join Us
Life at Uniting Ambition >>> Join UsLife at Uniting Ambition >>> Join Us
Life at Uniting Ambition >>> Join UsUniting Cloud
 
Join Uniting Ambition | Careers With Ambition
Join Uniting Ambition | Careers With AmbitionJoin Uniting Ambition | Careers With Ambition
Join Uniting Ambition | Careers With AmbitionUniting Cloud
 
Join Uniting Ambition | Careers With Ambition
Join Uniting Ambition  |  Careers With AmbitionJoin Uniting Ambition  |  Careers With Ambition
Join Uniting Ambition | Careers With AmbitionUniting Cloud
 
Ken Courtright DMS 2015
Ken Courtright DMS 2015Ken Courtright DMS 2015
Ken Courtright DMS 2015Ken Courtright
 
Ken courtright at ceo space 515
Ken courtright at ceo space 515Ken courtright at ceo space 515
Ken courtright at ceo space 515Ken Courtright
 
Eleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursEleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursStephen King
 
How to Become a Key Person of Influence in Your Industry
How to Become a Key Person of Influence in Your IndustryHow to Become a Key Person of Influence in Your Industry
How to Become a Key Person of Influence in Your IndustryMike Reid
 

Similar to Build Right Stuff Workshop (20)

Ken courtright at make your mark success 2015
Ken courtright at make your mark success 2015Ken courtright at make your mark success 2015
Ken courtright at make your mark success 2015
 
Ken courtright at ceo space 815
Ken courtright at ceo space 815Ken courtright at ceo space 815
Ken courtright at ceo space 815
 
COMPANY PROFILE POWER POINT
COMPANY PROFILE POWER POINT COMPANY PROFILE POWER POINT
COMPANY PROFILE POWER POINT
 
Ken courtright at guerrilla business school
Ken courtright at guerrilla business schoolKen courtright at guerrilla business school
Ken courtright at guerrilla business school
 
The XERO UK Sessions with Paul Dunn
The XERO UK Sessions with Paul DunnThe XERO UK Sessions with Paul Dunn
The XERO UK Sessions with Paul Dunn
 
Presentaion
PresentaionPresentaion
Presentaion
 
Business presentation
Business presentationBusiness presentation
Business presentation
 
Romania 5
Romania 5Romania 5
Romania 5
 
Top Tips and Tricks for creating a Kick Ass Pitch Deck
Top Tips and Tricks for creating a Kick Ass Pitch DeckTop Tips and Tricks for creating a Kick Ass Pitch Deck
Top Tips and Tricks for creating a Kick Ass Pitch Deck
 
Life at Uniting Ambition >>> Join Us
Life at Uniting Ambition >>> Join UsLife at Uniting Ambition >>> Join Us
Life at Uniting Ambition >>> Join Us
 
Join Uniting Ambition | Careers With Ambition
Join Uniting Ambition | Careers With AmbitionJoin Uniting Ambition | Careers With Ambition
Join Uniting Ambition | Careers With Ambition
 
Join Uniting Ambition | Careers With Ambition
Join Uniting Ambition  |  Careers With AmbitionJoin Uniting Ambition  |  Careers With Ambition
Join Uniting Ambition | Careers With Ambition
 
CeoSpace 1214
CeoSpace 1214CeoSpace 1214
CeoSpace 1214
 
Ken Courtright DMS 2015
Ken Courtright DMS 2015Ken Courtright DMS 2015
Ken Courtright DMS 2015
 
Ken courtright at ceo space 515
Ken courtright at ceo space 515Ken courtright at ceo space 515
Ken courtright at ceo space 515
 
Eleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursEleven Essentials For Entrepreneurs
Eleven Essentials For Entrepreneurs
 
The One Thing...
The One Thing...The One Thing...
The One Thing...
 
How to Become a Key Person of Influence in Your Industry
How to Become a Key Person of Influence in Your IndustryHow to Become a Key Person of Influence in Your Industry
How to Become a Key Person of Influence in Your Industry
 
Fstm ppt 2020
Fstm ppt 2020Fstm ppt 2020
Fstm ppt 2020
 
Sketch
SketchSketch
Sketch
 

Recently uploaded

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetEnjoy Anytime
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 

Recently uploaded (20)

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 

Build Right Stuff Workshop

Editor's Notes

  1. Product Architect 7 years experience in commercial insurance Started on phones -> Underwriter -> Change co-ordinator -> Product manager -> Architectural role Came from a waterfall background
  2. Started off as QA. Worked for various companies - including TW, HomeAway, BBC, Argos & now Lean Delivery Manager at SB
  3. technical implementation/design/resources etc & this is important and helps you build things right. But does not ensure you build the right things.
  4. Dig Deeper till you get to the heart of it. Find a REAL reason to build it. Should Can Will - still doesn’t address whether we built the right things eventually or did we just build it right. Agile etc
  5. Dig Deeper till you get to the heart of it. Find a REAL reason to build it.
  6. timeframes etc. Should Can Will - still doesn’t address whether we built the right things ultimately or did we just build it right. Agile etc
  7. quantitative & qualitative
  8. 5 Why’s → a good understanding of the problem that we are trying to solve and the benefit this will deliver. Create a hypothesis around this to succinctly define the benefit that you believe will be achieved by addressing the problem
  9. We believe that people will buy event insurance online
  10. ADAM: Pick the right measure (IMPORTANT)
  11. https://github.com/simplybusiness/bml/wiki/Dec-2014:-Activate-Pi-for-Accountants-for-our-MGA's-(BI) - good measures https://github.com/simplybusiness/bml/wiki/Nov-2014:-Replace-Trade-Selector-with-Trade-Search-Box - not so good measures
  12. Performance Issues? Poorly Implemented? Seasonal variance? Poor UX/UI? Were there other changes on your app that could have resulted in the less than expected uplift?
  13. PA STORY Learnings Many customers already had the cover, normally through their bank or as a benefit with products like health insurance Personal accident was associated with acts the people may perform at work to themselves. The cover is much bigger than this but this is the value that they see in it Learning assumptions to test People don't realise the full value of the cover Most people that want this cover will have bought it already or have it as a perk from another channel/activity (possibly not an insurance one)
  14. https://github.com/simplybusiness/bml/wiki/April-2013:-Accordion-Payment-Page-(Landlord) - abandon
  15. summary of process
  16. DON’T RELY ON YOUR MEMORY!
  17. Go through Quicksy