• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Cloud based infrastructure for massive scale, without massive costs
 

Cloud based infrastructure for massive scale, without massive costs

on

  • 2,582 views

Cloud based services have enabled companies in 2012 to grow their customer base exponentially, in a matter of months. Even the smallest of startup teams can reach massive scale, while maintaining ...

Cloud based services have enabled companies in 2012 to grow their customer base exponentially, in a matter of months. Even the smallest of startup teams can reach massive scale, while maintaining reasonable costs. Recent examples of this phenomena include Quora, Instagram and Pinterest. 10 years ago, without the benefits of cloud-based infrastructure services, how would these have companies fared?

In this session, we will explore the new horizons achievable as a result of the tools available to today's developers and discuss how startups can leverage the latest and greatest technologies to operate lean and build successful, sustainable businesses.

Statistics

Views

Total Views
2,582
Views on SlideShare
2,553
Embed Views
29

Actions

Likes
3
Downloads
47
Comments
0

1 Embed 29

http://lanyrd.com 29

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Thursday, April 3 3:05 to 4pm PST at the Grand Ballroom, MGM Grand Hotel\n\nTrack: CLOUD: FROM BUZZ TO BENEFIT\n\nCloud based services have enabled companies in 2012 to grow their customer base exponentially, in a matter of months. Even the smallest of startup teams can reach massive scale, while maintaining reasonable costs. Recent examples of this phenomena include Quora, Instagram and Pinterest. 10 years ago, without the benefits of cloud-based infrastructure services, how would these have companies fared?\n\nIn this session, we will explore the new horizons achievable as a result of the tools available to today's developers and discuss how startups can leverage the latest and greatest technologies to operate lean and build successful, sustainable businesses.\n
  • Elmer Thomas is a Developer Evangelist at SendGrid. He works with developers at hackdays and conferences to further simplify the process of integrating with SendGrid’s APIs and to discover what new email challenges need to be conquered. When not on the road, he works on making life for developers using SendGrid frictionless.\n
  • http://www.SendGrid.com\n
  • http://www.futureinsightslive.com\nhttp://www.SendGrid.com \n
  • You will be able to find the slides here: http://www.slideshare.net/thinkingserious \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Reference: http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf\n
  • Image Credit: http://www.motifake.com/facebookview.php?id=121490\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Example of a SaaS: http://www.SendGrid.com\nExample of a PaaS: http://www.Heroku.com\nExample of a IaaS: http://aws.amazon.com/ec2 \nImage Credit: http://cloudblueprint.wordpress.com/cloud-taxonomy\n\n
  • http://arnab.org/node/1075\n
  • \n
  • \n
  • \n
  • Image Credit: http://arnab.org/node/1075\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Ubuntu Server: http://www.ubuntu.com/business/server/overview\nFree access to Microsoft Windows Server through BizSpark: http://www.microsoft.com/bizspark/\nData Sourc: http://w3techs.com/technologies/overview/operating_system/all\n
  • Amazon EC2: http://aws.amazon.com/ec2/\nWindows Azure Compute: http://www.windowsazure.com/en-us/home/features/compute/\nHeroku Dynos: https://devcenter.heroku.com/articles/dynos\n
  • Apache Web Server: http://httpd.apache.org/\nMicrosoft IIS: http://www.microsoft.com/web/platform/server.aspx\nNginx: http://nginx.org/en/\nData source: http://w3techs.com/technologies/overview/web_server/all\n
  • Amazon S3: http://aws.amazon.com/s3/\n
  • Amazon Cloudfront: http://aws.amazon.com/cloudfront/\nBitGravity: http://www.bitgravity.com/\nCloudFlare: https://www.cloudflare.com/\nWhy a CDN? http://internetmarketingbyme.com/67/confuse-about-amazon-s3-vs-amazon-cloudfront-dont-be/\n
  • Amazon’s Elastic Load Balancer: http://aws.amazon.com/elasticloadbalancing/\nHAProxy: http://haproxy.1wt.eu/\nImage Credit: http://www.ha-cc.org/high_availability/components/application_availability/cluster/load_balancing_cluster/\n
  • Ruby on Rails: http://rubyonrails.org/\nDjango: https://www.djangoproject.com/\nZend: http://www.zend.com/en/\nSymfony 2: http://symfony.com/\n
  • MySQL: http://www.mysql.com/\nPostgreSQL: http://www.postgresql.org/\nMicrosoft SQL: http://www.microsoft.com/sqlserver/en/us/default.aspx\nMongoDB: http://www.mongodb.org/\n
  • Memcached: http://memcached.org/\nVarnish: https://www.varnish-cache.org/\n
  • SendGrid: http://www.sendgrid.com\nAmazon SES: http://aws.amazon.com/ses/\n
  • Amazon’s Route53: http://aws.amazon.com/route53/\nDyn: http://dyn.com/\n
  • MrJob: https://github.com/Yelp/mrjob\nAmazon’s Elastic MapReduce (EMR): http://aws.amazon.com/elasticmapreduce/\nGearMan: http://gearman.org/\nImage Credit: http://www.cbsolution.net/ontarget/mapreduce_vs_data_warehouse\n
  • \n
  • \n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • Reference: http://www.bigfastblog.com/quoras-technology-examined\n\n
  • \n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • Reference: http://instagram-engineering.tumblr.com/post/13649370142/what-powers-instagram-hundreds-of-instances-dozens-of\n\n
  • \n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • Reference: http://www.quora.com/Pinterest/What-technologies-were-used-to-make-Pinterest\n\n
  • \n
  • Amazon Web Services: http://aws.amazon.com/\nMicrosoft Azure: http://www.windowsazure.com/en-us/\nRackspace Cloud: http://www.rackspace.com/cloud/\nGoogle App Engine: https://developers.google.com/appengine/\nHP Cloud: http://hpcloud.com/\nHeroku: http://www.heroku.com/\nEngine Yard: http://www.engineyard.com/\n
  • \n
  • \n
  • \n
  • \n
  • Reference: http://www.informationweek.com/news/security/attacks/232301079\n
  • Reference: http://www.informationweek.com/news/security/attacks/232301079\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • http://www.amazon.com/Cloud-Computing-Bible-Barrie-Sosinsky/dp/0470903562\n
  • http://www.amazon.com/Scalability-Rules-Principles-Scaling-Sites/dp/0321753887\n
  • \n
  • Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
  • Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
  • Image Source: https://devcentral.f5.com/weblogs/macvittie/archive/2009/10/28/to-take-advantage-of-cloud-computing-you-must-unlearn.aspx\n
  • elmer.thomas@sendgrid.com\nhttp://www.twitter.com/ThinkingSerious\nhttp://www.linkedin.com/in/ThinkingSerious \nhttp://www.slideshare.net/ThinkingSerious\n

Cloud based infrastructure for massive scale, without massive costs Cloud based infrastructure for massive scale, without massive costs Presentation Transcript

  • Cloud based infrastructurefor massive scale, withoutmassive costsCLOUD: FROM BUZZ TO BENEFITPresented by Elmer ThomasDeveloper Evangelist at SendGrid@thinkingserious
  • Elmer Thomas#ComputerEngineering#SoftwareEngineering #Productivity #Entrepreneurship #APIs #Educationthinkingserious
  • Your app’s email infrastructure in the cloud {Subliminal Message: Head to our booth for goodies, *after* this talk} send and receive email to and from your application via APIs and/or SMTP transactional, relationship email or newsletters, bulk email
  • Gratitude
  • My ObjectiveI want you to walk away with actionable solutions and the means to learn more independently *Don’t copy the slides
  • What’s Covered
  • What’s CoveredDefinitions
  • What’s Covered DefinitionsTools of the Trade
  • What’s Covered DefinitionsTools of the Trade Case Studies
  • What’s Covered Definitions Tools of the Trade Case StudiesCloud Service Providers
  • What’s Covered Definitions Tools of the Trade Case StudiesCloud Service Providers Issues and Concerns
  • What’s Covered Definitions Tools of the Trade Case Studies Cloud Service Providers Issues and ConcernsOther Useful Cloud Services*
  • Cloud?
  • Characteristics
  • CharacteristicsOn-demand & Self-service
  • CharacteristicsOn-demand & Self-service Network accessible
  • CharacteristicsOn-demand & Self-service Network accessible Resource pooling
  • CharacteristicsOn-demand & Self-service Network accessible Resource pooling Scalable
  • CharacteristicsOn-demand & Self-service Network accessible Resource pooling Scalable Metered
  • Service Models
  • What Needs to Scale?
  • Web Server
  • Web ServerTraffic bursts
  • Web Server Traffic burstsIncreased traffic over time
  • Web Server Traffic burstsIncreased traffic over time Reliability
  • Storage Server
  • Storage ServerBackups
  • Storage Server BackupsUpload/Download of many/large files
  • Database Server
  • Database ServerUser data
  • Database ServerUser dataContent
  • Email Server
  • Email ServerConfirmations
  • Email ServerConfirmationsNotifications
  • Email ServerConfirmationsNotifications Receipts
  • People
  • PeopleSystems & Processes
  • PeopleSystems & Processes Collaboration Tools
  • PeopleSystems & Processes Collaboration ToolsResource Management
  • Tools of the Trade
  • Operating System Unix / Linux / UbuntuMicrosoft Windows Server
  • Computing ResourcesAmazon Elastic Compute Cloud (EC2) Windows Azure Compute Heroku Dynos
  • Web Server
  • StorageAmazon S3
  • CDNAmazon Cloudfront BitGravity CloudFlare
  • Load BalancerAmazon’s Elastic Load Balancer HAProxy
  • Web Framework Ruby on Rails DjangoZend / Symfony 2
  • Database MySQLPostgreSQLMicrosoft SQL MongoDB
  • CachingMemcached Varnish
  • Email SendgridAmazon Simple Email Service SES
  • DNSAmazon’s Route53 Dyn
  • MapReduceMrJob on Amazons Elastic MapReduce (EMR) GearMan
  • Case Studies
  • OS: Ubuntu
  • OS: UbuntuCompute: Amazon EC2
  • OS: UbuntuCompute: Amazon EC2 Web Server: Nginx
  • OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3
  • OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront
  • OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: HAProxy
  • OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste
  • OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL
  • OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL Caching: Memcached
  • OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL Caching: Memcached Emails: SendGrid
  • OS: Ubuntu
  • OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25)
  • OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx
  • OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3
  • OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazons Route53
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazons Route53 MapReduce: Gearman
  • OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazons Route53 MapReduce: Gearman
  • Web Server: Tornado and Node.js with Nginx for static pages
  • Web Server: Tornado and Node.js with Nginx for static pagesLoad Balancing: HAProxy and Varnish
  • Web Server: Tornado and Node.js with Nginx for static pagesLoad Balancing: HAProxy and Varnish Web Framework: Django
  • Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis
  • Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL
  • Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR
  • Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR Email: SendGrid
  • Cloud Service Providers
  • Amazon Web Services Microsoft Azure RackSpace Cloud Google App Engine HP Cloud Heroku Engine Yard
  • Issues & Concerns
  • Support
  • SupportWhat is the SLA / TOS?
  • Support What is the SLA / TOS?What happens when things go wrong?
  • Support What is the SLA / TOS?What happens when things go wrong? 24x7 Support?
  • Privacy
  • PrivacyData access breaches
  • Privacy Data access breachesHave a strong privacy policythat ties into your provider’s
  • Control
  • ControlYou are at the mercy of your provider
  • ControlYou are at the mercy of your providerMitigate with constant communication
  • Other Useful Cloud Services
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok ZenDesk
  • Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok ZenDesk
  • For deeper learning ...
  • Web Resources http://www.dzone.com/links/index.html http://cloud-computing.alltop.com/ http://cloudcomputing.sys-con.com/http://www.infoworld.com/d/cloud-computing
  • Key Takeaways
  • Key TakeawaysCloud, use you must
  • Key Takeaways Cloud, use you mustWhen architecting, don’t forget scalability
  • Key Takeaways Cloud, use you mustWhen architecting, don’t forget scalability Learn from others, no need to re-invent the wheel
  • Questions? Elmer.Thomas@SendGrid.com @ThinkingSeriouswww.SlideShare.net/ThinkingSerious