Launching new products and features can be risky. No matter how much planning you do, there is always a chance that something goes wrong on launch day and your product begins throwing a bunch of errors and conversion rate starts plummeting. The damage from a bad launch can have long-lasting effects on your customers’ perception of your product and can result in lost revenue and customer churn. To prevent these issues, you could try to do more QA or beta testing but catching everything is practically impossible.

1. www.productschool.com
Shorter Iterations and Gradual Rollouts

2. Join 55,000+
Product Managers on
Free Resources
Discover great job
opportunities
Job Portal
prdct.school/PSJobPortalprdct.school/events-slack

3. CERTIFICATES
Your Product Management Certificate Path
Product Executive
Certificate™
Product Leader Certificate™Product Manager
Certificate™
20 HOURS40 HOURS40 HOURS

5. Corporate
Training
Level up your team’s Product
Management skills

6. With Gradual Rollouts
Kenneth Kutyn
Lead Solutions Engineer
@kennethmarshall

7. Agenda

8. 1.

21. Guesswork Gap

22. Guesswork Gap

23. Guesswork Gap

25. Culture of
experimentatio
n
Continuous
Code
Deploys

30. Feature
Flags
if feature_flag is ‘on’:
do_something()
else:
do_something_else()

32. https://flappy-interactive.onrender.com/

35. BUILD
LEARN
MEASURE
●
●
●
●
●
●
●
●
●
●
●
●

38. ●
●
○
○
●
●
➔
➔

39. A “Painted Door” test creates a minimal user
experience that mimics a full feature set and
measures the number of users who engage with it.

40. Would people use “save for
later” functionality on the
web?

42. “Save for later” isn’t available yet on our desktop
website but we’re thinking about adding it.
Is this a feature you would use?
Yes No

43. ●
●
○
○
➔
➔

44. ●
●
●
●
➔
➔

45. ●
●
●
➔

46. 41

47. 42
+75
%
Significant uplift
Significant reduction
Inconclusive

48. ●
●
●
➔
◆
◆
◆

49. 44

50. ●
○
○
○
●
○
○
○
○
○

51. 46

52. 47

53. 48

55. Feature
Flags
if feature_flag is ‘on’:
do_something()
else:
do_something_else()

59. “The design forces at play for different
categories of toggles are quite different and
managing them all in the same way can lead
to pain down the road”
- Pete Hodgson

62. Owner of Feature & Release
(PM, IC Eng, Eng Manager, Release Team)
Product Manager

65. Guesswork Gap

67. Feature
Flags
if feature_flag is ‘on’:
do_something()
else:
do_something_else()

71. Kenneth Kutyn
@kennethmarshall
kennethkutyn@optimizely.com

72. www.productschool.com
Part-time Product Management Training Courses
and
Corporate Training