Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Scheduled releases @ Commit Porto 2016

314 views

Published on

Talk at Commit Porto 2016 about why GetYourGuide keeps its apps on a rich release schedule

Published in: Software
  • Be the first to comment

Scheduled releases @ Commit Porto 2016

  1. 1. Scheduled releases Why GetYourGuide keeps its apps on a tight release schedule
  2. 2. Me iOS Engineer @ GetYourGuide GmbH FEUP alumnus @banaslee
  3. 3. GetYourGuide
  4. 4. • Find a tour • Check availability • Check reviews • Book • Redeem with your phone Getting to know Porto
  5. 5. • > 25k activities • > 130 countries • 2.5M customers • 14 languages • Engineering offices in Berlin & Zurich • Small product team for apps
  6. 6. Agenda • Context • Before • Now • Results
  7. 7. Native apps
  8. 8. Fragile environment • Running in a sandbox • Constrained memory • Limited processing power • Limited connectivity • Crashes
  9. 9. Local storage • Offline capabilities • Often relational databases • Data migration
  10. 10. Provisioning • Apps running on device must be signed • Registered developers • Complicated provisioning setup
  11. 11. Volatile environment • New technologies every year • Users are constantly updating their devices • Not the gold rush it used to be • Keeps you on your toes
  12. 12. App Stores
  13. 13. App Stores • Main (and mostly only) distribution channel • Apple says 65% of downloads come from search • Opaque ranking system • Hard to optimise due to limited amount of data • User acquisition is hard and expensive Source: https://developer.apple.com/app-store/search-ads/
  14. 14. App approval times (iOS) • Most apps are now reviewed in 24 hours Source: appreviewtimes.com 0 20 40 60 80 1 2 3 4 5 6 7 8
  15. 15. 0 days approval time on Android
  16. 16. Rolling out updates
  17. 17. 80% users using latest version 72 hours after update on iOS / 96 hours on Android
  18. 18. 97% number of sessions from the 5 most recent versions
  19. 19. 33 versions number of different versions live during the past two weeks
  20. 20. Experimentation
  21. 21. Missions • We have engineers, PMs and designers split in mission teams • Missions around metrics • Conversion • Repeat • Acquisition • ...
  22. 22. Hypotheses & Experiments • Build the right product • Maximise learnings • Smaller feedback cycles • Improve customer experience
  23. 23. Apps haven’t yet fully embraced experimentation
  24. 24. Before
  25. 25. Feature driven • Branches to isolate unfinished features • Builds for different quality stages • Automated builds • Automated testing • Manual release
  26. 26. Feature driven Attribution: https://www.atlassian.com/continuous-delivery/business-case-for-continuous-delivery
  27. 27. Spirits were down • Release estimates slipped • Scope creeping • Failing goals
  28. 28. Now
  29. 29. Release every two weeks • An experiment on process • Focus on focus • Keep a continuous stream of updates • Fixes are not hostage of moving release dates • Process not new but not common on small teams
  30. 30. Keep merging • Feature toggles • Unfinished features are merged to master
  31. 31. Simpler processes • Automated testing • Test builds • Localised assets
  32. 32. Release notes • Copy write • Translate
  33. 33. Continuous Delivery • Every change can be pushed to the store • Built over our CI • Test builds • UI tests • Deployment pipeline • HockeyApp • TestFlight • Release
  34. 34. Fastlane • Toolchain for Continuous Delivery • iOS • A bit on Android • Streamlined process • Moved separate scripts under Fastlane lanes • Adopted Match for simpler code signing
  35. 35. Results
  36. 36. Moving faster • 7 releases in Q2 vs 3 in Q1 • 5 experiments launched in Q2 vs 2 previously (Q1 & Q4’15) • Smaller yet bolder experiments • App Store features diluted some metrics
  37. 37. Quality & User satisfaction • “Move fast and break things” • Positive trend in reviews 0% 0% 1% 1% 2% 2% November December January February March April May June Crashes/Sessions
  38. 38. Quality & User satisfaction • “Move fast and break things” • Positive trend in reviews 1 stars 2 stars 3 stars 4 stars 5 stars 6 stars November December January February March April May June iOS Android
  39. 39. Quality & User satisfaction • Secret settings screen • Remote overrides
  40. 40. A solid process • A more stable set of scripts for CI • Scripts coverage extended • Pushing to store • Importing localised assets
  41. 41. A solid process • Requires • Continuous maintenance work • Expertise in CI and testing tools • Provides ownership of the process
  42. 42. Long path ahead Attribution: http://tgos.co.uk/skills/climb-every-mountain-how-to-start-scrambling
  43. 43. Links • https://appreviewtimes.com • https://developer.apple.com/app-store/search-ads/ • https://fastlane.tools • https://www.facebook.com/notes/facebook-engineering/timed-releases-for-mobile- apps/10151078442213920/ • https://www.youtube.com/watch?list=PLdr22uU_wISpW6XI1J0S7Lp-X8Km- HaQW&v=DWw1ankfqO0

×