Speakers: Shaun Pearce, CTO, Gousto Dan Leitao, Product Consultant, Onfido Moderator: Liam McClary, UK Startups Segment Leader, AWS Focus: Product Innovative companies operate in a loop of experimentation and learning that leads to further data-driven iteration. Whether you're introducing a brand new service, or you’re trying to improve a particular feature, it’s crucial that you’re tracking and measuring user behavior. Come and learn from AWS customers on how they’re leveraging the low cost of experimentation on AWS, best practices for A/B testing, their approach to data collection and analysis, and how they prioritize new features.

1. Data-Driven Product Management
at Scale
Shaun Pearce - CTO
Nicolas Hemidy - Product Manager

2. We make cooking at home simple,
straightforward and fun.
We deliver a box of wholesome
ingredients in exact proportions with
step-by-step recipe cards.
What does Gousto do?

3. Personalised menu
30 recipes per
week
Reduced lead
times by 60%
7 delivery days per
weekIntroduced
evening delivery

4. Radishes
How do we organise ourselves?
Haricots
Carrots
Mushrooms
Artichokes
Potatoes The technical components the team builds and
maintains in order to expose those features
Comp.
The features the team needs to develop and
maintain in order to effect their metrics
Features
A way to easily measure the team
effectiveness in progressing their mission
Metrics
Why does the team exist and what are they
trying to achieve?
Mission
=
Test
LearnRefine
Radishes Product Owner Engineers
Agile Coach
Team
Data Analyst
Gousto Squads

5. How did we start?

6. Start simple
Customers
Product Owner
3rd party testing
platform
Configure test & analyse
results
Get
recipes
Display modified page
Recipe Service
R
Microservices
Send metrics
Get variant (JS)

7. Start simple, fail fast, learn quickly
+12%
CTR
VS

8. Top tips...
(when starting out)
Be prepared
Top of funnel first
Mind your tools

9. What if we wanted to do more
comprehensive testing?

10. Hypothesis:
More veg = happier customers..

11. Boxes not (only) bits
Change box content?
Consistent experience?
Forecast food?
Measure retention?

12. We need a more capable test
platform

13. Analytics Platform
Gousto’s test platform
Customers
Product OwnerMenu variation
Configure test
Event
stream
Display modified
page
RedshiftEMRS3Collector
Content Platform
Recipe Service
R
Experiment
Service
Analyseresults

14. Top tips...
(when doing more comprehensive
testing)
Focus on measuring
behaviour
Think about the cross
device experience
Mind performance

15. We’re hiring
twitter: @GoustoTech blog: techbrunch.gousto.co.uk apply: gousto.co.uk/jobs