Debunking serverless myths
•1 like•834 views
Report
Share
Download to read offline
In this talk we debunk common myths and misconceptions about serverless - how cold starts works, serverless is not just about saving operational cost, think about control with responsibility, and think about vendor lock-in with the reward.
More Related Content
What's hot
What's hot(20)
Similar to Debunking serverless myths
Similar to Debunking serverless myths(20)
More from Yan Cui
More from Yan Cui(20)
Recently uploaded
Recently uploaded(20)
Debunking serverless myths
- 1. Debunking Serverless Myths Yan Cui @theburningmonk
- 2. Yan Cui http://theburningmonk.com @theburningmonk AWS user for 10 years
- 7. What do you mean by ‘serverless’?
- 8. “Serverless”
- 10. Gojko Adzic It is serverless the same way WiFi is wireless. http://bit.ly/2yQgwwb
- 11. Serverless means… don’t pay for it if no-one uses it don’t need to worry about scaling don’t need to provision and manage servers
- 12. “Function-as-a-Service” AWS Lambda Azure Functions Google Cloud Functions Auth0 Webtask Spotinst Functions Kubeless IBM Cloud Functions
- 13. AWS Lambda
- 14. AWS Lambda API Gateway IOT SNS Kinesis CloudWatch
- 18. Simon Wardley Serverless will fundamentally change how we build business around technology and how you code.
- 19. Why serverless?
- 20. more Scalable (and scales faster!)
- 21. Cheaper (don’t pay for idle servers)
- 22. Resilience (built-in redundancy and multi-AZ)
- 23. Secure
- 24. idea production choose language + framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 25. idea production choose language + framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 26. idea production greater Velocity from idea to product
- 28. less ops responsibility on your shoulders
- 34. serverless is NOT the goal!
- 35. build products customers love to use
- 36. test ideas against the market quickly
- 37. iterate on s
- 39. own less technology, focus on creating Business Values
- 40. own less technology, focus on creating Business Values (serverless is just a good fit for this mindset)
- 41. serverless technologies are still maturing
- 43. DEBUNKING SERVERLESS MYTHS COLD STARTS COLD STARTS overplays or underplays the role of cold starts on serverless performance MYTH #1
- 44. DEBUNKING SERVERLESS MYTHS COLD STARTS COLD STARTS overplays or underplays the role of cold starts on serverless performance MYTH #1 COSTSCOSTS misunderstands thereal cost savings fromadopting serverless MYTH #2
- 45. DEBUNKING SERVERLESS MYTHS COLD STARTS COLD STARTS overplays or underplays the role of cold starts on serverless performance MYTH #1 COSTSCOSTS misunderstands thereal cost savings fromadopting serverless MYTH #2 CONTROL not realise that control of infra requires expensive skillsets to manage MYTH #3 CONTROL
- 46. DEBUNKING SERVERLESS MYTHS COLD STARTS COLD STARTS overplays or underplays the role of cold starts on serverless performance MYTH #1 COSTSCOSTS misunderstands thereal cost savings fromadopting serverless MYTH #2 CONTROL not realise that control of infra requires expensive skillsets to manage MYTH #3 CONTROL LOCK-INnot realise that lock-in risk rewards productivity, and true lock-in is dataMYTH #4 LOCK-IN
- 47. COLD STARTSCOLD STARTS overplays or underplays the role of cold starts on serverless performance MYTH #1 LOCK-IN not realise that lock-in risk rewards productivity, and true lock-in is data MYTH #4 LOCK-INCONTROL not realise that control of infra requires expensive skillsets to manage MYTH #3 CONTROLCOSTSCOSTS misunderstands the real cost savings from adopting serverless MYTH #2
- 50. “cold starts only happen to the first request”
- 51. function invocationconcurrent execution i.e. a container
- 52. function invocationconcurrent execution i.e. a container class instance method call
- 53. Lambda scales the number of concurrent executions based on traffic
- 54. existing “containers” are reused where possible
- 55. time invocation
- 70. FREQUENCY DURATION dictated by user traffic, out of your control
- 72. “Lambda is not a suitable solution for me because of cold starts”
- 73. “what is your latency requirement?”
- 74. cold starts that don’t add to user-facing latency is generally not worth worrying about
- 75. Node.js functions, no VPC, 1GB, averages ~500ms cold start with production workload
- 76. Node.js functions, no VPC, 1GB, averages ~500ms cold start with production workload (good enough for most web applications)
- 77. sporadic spikes latency existed before Lambda
- 78. GC pauses…
- 80. slow downstream, databases, etc.
- 82. cold starts is generally not an issue if you have a steady traffic pattern
- 83. time req/s
- 86. minimise the duration of cold starts so they fall within acceptable latency range
- 87. use higher memory setting if function performs CPU intensive work
- 88. use Node.js, Python or Golang
- 91. avoid VPCs (for now) unless you need to access VPC-protected resources
- 92. COSTSCOSTS misunderstands the real cost savings from adopting serverless MYTH #2 LOCK-IN not realise that lock-in risk rewards productivity, and true lock-in is data MYTH #4 LOCK-INCONTROL not realise that control of infra requires expensive skillsets to manage MYTH #3 CONTROL
- 93. “good luck when Amazon decides to raise the price of Lambda!”
- 94. mind the market force…
- 95. AWS announced 67 price reductions in the last 5 years, and 0 price hikes
- 97. Model Training Low-latency Prediction Serving via Batching
- 103. the platforms need to do better at educating users on how to choose between different services
- 105. https://www.doc.ic.ac.uk/~rbc/papers/fse-serverless-17.pdf “This paper presents two case industrial studies of early adopters, showing how migrating an application to the Lambda deployment architecture reduced hosting costs – by between 66% and 95%…”
- 106. what we can easily measure
- 108. what most of your budget is spent on
- 109. what businesses care about what we can easily measure what most of your budget is spent on
- 110. leverage: do more with less
- 111. idea production choose language + framework master language + framework figure out deployment configure AMI configure ELB configure autoscaling capacity planning over-provision for launch are we doing microservices? configure CI/CD
- 113. Serverless might cost you just as much, or even more, but you get so much more done
- 115. 6 developers, 6 months 95% saving against EC2 15x no. of production releases per month
- 117. CONTROL not realise that control of infra requires expensive skillsets to manage MYTH #3 CONTROL LOCK-IN not realise that lock-in risk rewards productivity, and true lock-in is data MYTH #4 LOCK-IN
- 122. Controlling your own infrastructure comes with Responsibilities
- 123. to take on these responsibilities you need to have the relevant skillsets in the organization Controlling your own infrastructure comes with Responsibilities
- 124. to take on these responsibilities you need to have the relevant skillsets in the organization Controlling your own infrastructure comes with Responsibilities ENGINEERS
- 126. to take on these responsibilities you need to have the relevant skillsets in the organization Controlling your own infrastructure comes with Responsibilities ENGINEERS ADMIN
- 127. to take on these responsibilities you need to have the relevant skillsets in the organization Controlling your own infrastructure comes with Responsibilities ENGINEERS ADMIN RECRUITMENT
- 128. to take on these responsibilities you need to have the relevant skillsets in the organization Controlling your own infrastructure comes with Responsibilities ENGINEERS ADMIN RECRUITMENT MARKET
- 130. what are you paying for?
- 131. guard against the temptation to look for control for control sake
- 132. AWS Lambda, Azure Functions, Google Cloud Functions Your custom, container-based, general purpose compute platform
- 134. LOCK-IN not realise that lock-in risk rewards productivity, and true lock-in is data MYTH #4 LOCK-IN
- 135. Lock-in risk Reward
- 136. it’s not a lock-in, it’s a form of coupling that has a switching cost
- 138. “vendor lock-in” switching cost “let’s avoid lock-in” prevention cost
- 140. The true danger with lock-in, especially with serverless, is the potential for data lock-in. Data has gravity. It accumulates. Data is economically disincentivized to leave, by way of platform pricing. This is the single biggest threat to vendor choice.
- 141. Newton’s 41st law: data has gravity
- 142. Newton’s 42nd law: data migration is gonna suck
- 146. “VENDOR LOCK-IN IS THE ROOT OF ALL EVIL”
- 147. to take on these responsibilities you need to have the relevant skills sets in the organization Controlling your own infrastructure comes with Responsibilities ENGINEERS ADMIN RECRUITMENT MARKET
- 148. if you already have the expertise, can their time be better used to generate more business value instead?
- 149. risk is just one side of the coin
- 151. extracting maximum value from your cloud provider minimising undifferentiated heavy-lifting faster time-to-market reward
- 153. own less technology, focus on creating Business Values
- 154. is vendor lock-in a risk? YES
- 155. is the return worth the risk? ABSOLUTELY!
- 156. there are no silver bullets
- 159. control comes with its own baggages
- 160. but sometimes the benefits outweigh the baggages
- 163. https://theburningmonk.com/hire-me AdviseTraining Delivery “Fundamentally, Yan has improved our team by increasing our ability to derive value from AWS and Lambda in particular.” Nick Blair Tech Lead