Cloud based infrastructure for massive scale, without massive costs
•Download as KEY, PDF•
3 likes•3,265 views
Cloud based services have enabled companies in 2012 to grow their customer base exponentially, in a matter of months. Even the smallest of startup teams can reach massive scale, while maintaining reasonable costs. Recent examples of this phenomena include Quora, Instagram and Pinterest. 10 years ago, without the benefits of cloud-based infrastructure services, how would these have companies fared? In this session, we will explore the new horizons achievable as a result of the tools available to today's developers and discuss how startups can leverage the latest and greatest technologies to operate lean and build successful, sustainable businesses.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Cloud based infrastructure for massive scale, without massive costs
Similar to Cloud based infrastructure for massive scale, without massive costs (20)
Recently uploaded
Recently uploaded (20)
Cloud based infrastructure for massive scale, without massive costs
- 1. Cloud based infrastructure for massive scale, without massive costs CLOUD: FROM BUZZ TO BENEFIT Presented by Elmer Thomas Developer Evangelist at SendGrid @thinkingserious
- 2. Elmer Thomas #ComputerEngineering #SoftwareEngineering #Productivity #Entrepreneurship #APIs #Education thinkingserious
- 3. Your app’s email infrastructure in the cloud {Subliminal Message: Head to our booth for goodies, *after* this talk} send and receive email to and from your application via APIs and/or SMTP transactional, relationship email or newsletters, bulk email
- 4. Gratitude
- 5. My Objective I want you to walk away with actionable solutions and the means to learn more independently *Don’t copy the slides
- 8. What’s Covered Definitions Tools of the Trade
- 9. What’s Covered Definitions Tools of the Trade Case Studies
- 10. What’s Covered Definitions Tools of the Trade Case Studies Cloud Service Providers
- 11. What’s Covered Definitions Tools of the Trade Case Studies Cloud Service Providers Issues and Concerns
- 12. What’s Covered Definitions Tools of the Trade Case Studies Cloud Service Providers Issues and Concerns Other Useful Cloud Services*
- 13. Cloud?
- 15. Characteristics
- 17. Characteristics On-demand & Self-service Network accessible
- 18. Characteristics On-demand & Self-service Network accessible Resource pooling
- 19. Characteristics On-demand & Self-service Network accessible Resource pooling Scalable
- 20. Characteristics On-demand & Self-service Network accessible Resource pooling Scalable Metered
- 21. Service Models
- 22. What Needs to Scale?
- 23. Web Server
- 25. Web Server Traffic bursts Increased traffic over time
- 26. Web Server Traffic bursts Increased traffic over time Reliability
- 28. Storage Server
- 30. Storage Server Backups Upload/Download of many/large files
- 31. Database Server
- 34. Email Server
- 37. Email Server Confirmations Notifications Receipts
- 38. People
- 40. People Systems & Processes Collaboration Tools
- 41. People Systems & Processes Collaboration Tools Resource Management
- 42. Tools of the Trade
- 43. Operating System Unix / Linux / Ubuntu Microsoft Windows Server
- 44. Computing Resources Amazon Elastic Compute Cloud (EC2) Windows Azure Compute Heroku Dynos
- 45. Web Server
- 47. CDN Amazon Cloudfront BitGravity CloudFlare
- 48. Load Balancer Amazon’s Elastic Load Balancer HAProxy
- 49. Web Framework Ruby on Rails Django Zend / Symfony 2
- 50. Database MySQL PostgreSQL Microsoft SQL MongoDB
- 52. Email Sendgrid Amazon Simple Email Service SES
- 53. DNS Amazon’s Route53 Dyn
- 54. MapReduce MrJob on Amazon's Elastic MapReduce (EMR) GearMan
- 55. Case Studies
- 58. OS: Ubuntu
- 59. OS: Ubuntu Compute: Amazon EC2
- 60. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx
- 61. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3
- 62. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront
- 63. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxy
- 64. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxy Web Framework: Pylons and Paste
- 65. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxy Web Framework: Pylons and Paste DB: MySQL
- 66. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxy Web Framework: Pylons and Paste DB: MySQL Caching: Memcached
- 67. OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxy Web Framework: Pylons and Paste DB: MySQL Caching: Memcached Emails: SendGrid
- 70. OS: Ubuntu
- 71. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25)
- 72. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx
- 73. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3
- 74. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront
- 75. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer
- 76. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django
- 77. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django DB: PostgreSQL
- 78. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached
- 79. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazon's Route53
- 80. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazon's Route53 MapReduce: Gearman
- 81. OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: Amazon's Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazon's Route53 MapReduce: Gearman
- 84. Web Server: Tornado and Node.js with Nginx for static pages
- 85. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish
- 86. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: Django
- 87. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: Django Caching: Memcached and membase / redis
- 88. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: Django Caching: Memcached and membase / redis DB: MySQL
- 89. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: Django Caching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR
- 90. Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: Django Caching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR Email: SendGrid
- 92. Amazon Web Services Microsoft Azure RackSpace Cloud Google App Engine HP Cloud Heroku Engine Yard
- 94. Support
- 95. Support What is the SLA / TOS?
- 96. Support What is the SLA / TOS? What happens when things go wrong?
- 97. Support What is the SLA / TOS? What happens when things go wrong? 24x7 Support?
- 98. Privacy
- 100. Privacy Data access breaches Have a strong privacy policy that ties into your provider’s
- 101. Control
- 102. Control You are at the mercy of your provider
- 103. Control You are at the mercy of your provider Mitigate with constant communication
- 104. Other Useful Cloud Services
- 105. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive
- 106. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote
- 107. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps
- 108. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub
- 109. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing
- 110. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest
- 111. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs
- 112. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker
- 113. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug
- 114. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio
- 115. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok
- 116. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok ZenDesk
- 117. Other Useful Cloud Services Dropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok ZenDesk
- 118. For deeper learning ...
- 121. Web Resources http://www.dzone.com/links/index.html http://cloud-computing.alltop.com/ http://cloudcomputing.sys-con.com/ http://www.infoworld.com/d/cloud-computing
- 122. Key Takeaways
- 123. Key Takeaways Cloud, use you must
- 124. Key Takeaways Cloud, use you must When architecting, don’t forget scalability
- 125. Key Takeaways Cloud, use you must When architecting, don’t forget scalability Learn from others, no need to re-invent the wheel
- 126. Questions? Elmer.Thomas@SendGrid.com @ThinkingSerious www.SlideShare.net/ThinkingSerious
Editor's Notes
- Thursday, April 3 3:05 to 4pm PST at the Grand Ballroom, MGM Grand Hotel\n\nTrack: CLOUD: FROM BUZZ TO BENEFIT\n\nCloud based services have enabled companies in 2012 to grow their customer base exponentially, in a matter of months. Even the smallest of startup teams can reach massive scale, while maintaining reasonable costs. Recent examples of this phenomena include Quora, Instagram and Pinterest. 10 years ago, without the benefits of cloud-based infrastructure services, how would these have companies fared?\n\nIn this session, we will explore the new horizons achievable as a result of the tools available to today's developers and discuss how startups can leverage the latest and greatest technologies to operate lean and build successful, sustainable businesses.\n
- Elmer Thomas is a Developer Evangelist at SendGrid. He works with developers at hackdays and conferences to further simplify the process of integrating with SendGrid’s APIs and to discover what new email challenges need to be conquered. When not on the road, he works on making life for developers using SendGrid frictionless.\n
- http://www.SendGrid.com\n
- http://www.futureinsightslive.com\nhttp://www.SendGrid.com \n
- You will be able to find the slides here: http://www.slideshare.net/thinkingserious \n
- \n
- \n
- \n
- \n
- \n
- \n
- Reference: http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf\n
- Image Credit: http://www.motifake.com/facebookview.php?id=121490\n
- \n
- \n
- \n
- \n
- \n
- Example of a SaaS: http://www.SendGrid.com\nExample of a PaaS: http://www.Heroku.com\nExample of a IaaS: http://aws.amazon.com/ec2 \nImage Credit: http://cloudblueprint.wordpress.com/cloud-taxonomy\n\n
- http://arnab.org/node/1075\n
- \n
- \n
- \n
- Image Credit: http://arnab.org/node/1075\n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- Ubuntu Server: http://www.ubuntu.com/business/server/overview\nFree access to Microsoft Windows Server through BizSpark: http://www.microsoft.com/bizspark/\nData Sourc: http://w3techs.com/technologies/overview/operating_system/all\n
- Amazon EC2: http://aws.amazon.com/ec2/\nWindows Azure Compute: http://www.windowsazure.com/en-us/home/features/compute/\nHeroku Dynos: https://devcenter.heroku.com/articles/dynos\n
- Apache Web Server: http://httpd.apache.org/\nMicrosoft IIS: http://www.microsoft.com/web/platform/server.aspx\nNginx: http://nginx.org/en/\nData source: http://w3techs.com/technologies/overview/web_server/all\n
- Amazon S3: http://aws.amazon.com/s3/\n
- Amazon Cloudfront: http://aws.amazon.com/cloudfront/\nBitGravity: http://www.bitgravity.com/\nCloudFlare: https://www.cloudflare.com/\nWhy a CDN? http://internetmarketingbyme.com/67/confuse-about-amazon-s3-vs-amazon-cloudfront-dont-be/\n
- Amazon’s Elastic Load Balancer: http://aws.amazon.com/elasticloadbalancing/\nHAProxy: http://haproxy.1wt.eu/\nImage Credit: http://www.ha-cc.org/high_availability/components/application_availability/cluster/load_balancing_cluster/\n
- Ruby on Rails: http://rubyonrails.org/\nDjango: https://www.djangoproject.com/\nZend: http://www.zend.com/en/\nSymfony 2: http://symfony.com/\n
- MySQL: http://www.mysql.com/\nPostgreSQL: http://www.postgresql.org/\nMicrosoft SQL: http://www.microsoft.com/sqlserver/en/us/default.aspx\nMongoDB: http://www.mongodb.org/\n
- Memcached: http://memcached.org/\nVarnish: https://www.varnish-cache.org/\n
- SendGrid: http://www.sendgrid.com\nAmazon SES: http://aws.amazon.com/ses/\n
- Amazon’s Route53: http://aws.amazon.com/route53/\nDyn: http://dyn.com/\n
- MrJob: https://github.com/Yelp/mrjob\nAmazon’s Elastic MapReduce (EMR): http://aws.amazon.com/elasticmapreduce/\nGearMan: http://gearman.org/\nImage Credit: http://www.cbsolution.net/ontarget/mapreduce_vs_data_warehouse\n
- \n
- \n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
- \n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
- \n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
- \n
- Amazon Web Services: http://aws.amazon.com/\nMicrosoft Azure: http://www.windowsazure.com/en-us/\nRackspace Cloud: http://www.rackspace.com/cloud/\nGoogle App Engine: https://developers.google.com/appengine/\nHP Cloud: http://hpcloud.com/\nHeroku: http://www.heroku.com/\nEngine Yard: http://www.engineyard.com/\n
- \n
- \n
- \n
- \n
- Reference: http://www.informationweek.com/news/security/attacks/232301079\n
- Reference: http://www.informationweek.com/news/security/attacks/232301079\n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- \n
- http://www.amazon.com/Cloud-Computing-Bible-Barrie-Sosinsky/dp/0470903562\n
- http://www.amazon.com/Scalability-Rules-Principles-Scaling-Sites/dp/0321753887\n
- \n
- Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
- Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
- Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
- elmer.thomas@sendgrid.com\nhttp://www.twitter.com/ThinkingSerious\nhttp://www.linkedin.com/in/ThinkingSerious \nhttp://www.slideshare.net/ThinkingSerious\n