Cloud based infrastructure for massive scale, without massive costs

Cloud based infrastructurefor massive scale, withoutmassive costsCLOUD: FROM BUZZ TO BENEFITPresented by Elmer ThomasDeveloper Evangelist at SendGrid@thinkingserious

Elmer Thomas#ComputerEngineering#SoftwareEngineering #Productivity #Entrepreneurship #APIs #Educationthinkingserious

Your app’s email infrastructure in the cloud {Subliminal Message: Head to our booth for goodies, *after* this talk} send and receive email to and from your application via APIs and/or SMTP transactional, relationship email or newsletters, bulk email

Gratitude

My ObjectiveI want you to walk away with actionable solutions and the means to learn more independently *Don’t copy the slides

What’s Covered

What’s CoveredDeﬁnitions

What’s Covered DeﬁnitionsTools of the Trade

What’s Covered DeﬁnitionsTools of the Trade Case Studies

What’s Covered Deﬁnitions Tools of the Trade Case StudiesCloud Service Providers

What’s Covered Deﬁnitions Tools of the Trade Case StudiesCloud Service Providers Issues and Concerns

What’s Covered Deﬁnitions Tools of the Trade Case Studies Cloud Service Providers Issues and ConcernsOther Useful Cloud Services*

Cloud?

Characteristics

CharacteristicsOn-demand & Self-service

CharacteristicsOn-demand & Self-service Network accessible

CharacteristicsOn-demand & Self-service Network accessible Resource pooling

CharacteristicsOn-demand & Self-service Network accessible Resource pooling Scalable

CharacteristicsOn-demand & Self-service Network accessible Resource pooling Scalable Metered

Service Models

What Needs to Scale?

Web Server

Web ServerTrafﬁc bursts

Web Server Trafﬁc burstsIncreased trafﬁc over time

Web Server Trafﬁc burstsIncreased trafﬁc over time Reliability

Storage Server

Storage ServerBackups

Storage Server BackupsUpload/Download of many/large ﬁles

Database Server

Database ServerUser data

Database ServerUser dataContent

Email Server

Email ServerConﬁrmations

Email ServerConﬁrmationsNotiﬁcations

Email ServerConﬁrmationsNotiﬁcations Receipts

People

PeopleSystems & Processes

PeopleSystems & Processes Collaboration Tools

PeopleSystems & Processes Collaboration ToolsResource Management

Tools of the Trade

Operating System Unix / Linux / UbuntuMicrosoft Windows Server

Computing ResourcesAmazon Elastic Compute Cloud (EC2) Windows Azure Compute Heroku Dynos

Web Server

StorageAmazon S3

CDNAmazon Cloudfront BitGravity CloudFlare

Load BalancerAmazon’s Elastic Load Balancer HAProxy

Web Framework Ruby on Rails DjangoZend / Symfony 2

Database MySQLPostgreSQLMicrosoft SQL MongoDB

CachingMemcached Varnish

Email SendgridAmazon Simple Email Service SES

DNSAmazon’s Route53 Dyn

MapReduceMrJob on Amazons Elastic MapReduce (EMR) GearMan

Case Studies

OS: Ubuntu

OS: UbuntuCompute: Amazon EC2

OS: UbuntuCompute: Amazon EC2 Web Server: Nginx

OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3

OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront

OS: UbuntuCompute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: HAProxy

OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste

OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL

OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL Caching: Memcached

OS: Ubuntu Compute: Amazon EC2 Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront LoadBalancing: HAProxyWeb Framework: Pylons and Paste DB: MySQL Caching: Memcached Emails: SendGrid

OS: Ubuntu

OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25)

OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx

OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3

OS: Ubuntu Compute: Amazon EC2with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: Cloudfront

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazons Route53

OS: Ubuntu Compute: Amazon EC2 with High-CPU Extra-Large machines (25) Web Server: Nginx Storage: Amazon S3 CDN: CloudfrontLoadBalancing: Amazons Elastic Load Balancer Web Framework: Django DB: PostgreSQL Caching: Memcached DNS: Amazons Route53 MapReduce: Gearman

Web Server: Tornado and Node.js with Nginx for static pages

Web Server: Tornado and Node.js with Nginx for static pagesLoad Balancing: HAProxy and Varnish

Web Server: Tornado and Node.js with Nginx for static pagesLoad Balancing: HAProxy and Varnish Web Framework: Django

Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis

Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL

Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR

Web Server: Tornado and Node.js with Nginx for static pages Load Balancing: HAProxy and Varnish Web Framework: DjangoCaching: Memcached and membase / redis DB: MySQL MapReduce: MrJob on EMR Email: SendGrid

Cloud Service Providers

Amazon Web Services Microsoft Azure RackSpace Cloud Google App Engine HP Cloud Heroku Engine Yard

Issues & Concerns

Support

SupportWhat is the SLA / TOS?

Support What is the SLA / TOS?What happens when things go wrong?

Support What is the SLA / TOS?What happens when things go wrong? 24x7 Support?

Privacy

PrivacyData access breaches

Privacy Data access breachesHave a strong privacy policythat ties into your provider’s

Control

ControlYou are at the mercy of your provider

ControlYou are at the mercy of your providerMitigate with constant communication

Other Useful Cloud Services

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok

Other Useful Cloud ServicesDropbox, Box, Google Drive, SkyDrive Evernote Google Apps GitHub Jing MogoTest SauceLabs Pivotal Tracker SnapABug Twilio OpenTok ZenDesk

For deeper learning ...

Web Resources http://www.dzone.com/links/index.html http://cloud-computing.alltop.com/ http://cloudcomputing.sys-con.com/http://www.infoworld.com/d/cloud-computing

Key Takeaways

Key TakeawaysCloud, use you must

Key Takeaways Cloud, use you mustWhen architecting, don’t forget scalability

Key Takeaways Cloud, use you mustWhen architecting, don’t forget scalability Learn from others, no need to re-invent the wheel

Questions? Elmer.Thomas@SendGrid.com @ThinkingSeriouswww.SlideShare.net/ThinkingSerious

Cloud based infrastructure for massive scale, without massive costs

by Elmer Thomas

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 27

Statistics