SlideShare a Scribd company logo
1 of 15
Download to read offline
Experience with AWS

    Sean O Sullivan
LocalSocial / Dial2Do
Motivation
•   Ease of use / Speed of use
•   Experimentation
•   AMIs
•   Flexibility
•   Pricing
LocalSocial
• S3
  – Stores our AMI
  – Fedora 8 from AWS
  – Plus all our own stuff (RoR, Scripts, …)
• EC2
  – One “small instance” Server
       • 1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core with 1 EC2
         Compute Unit), 160 GB of instance storage, 32-bit platform
  – Runs our AMI fulltime
  – Two domains right now
       • gigmonkey.com
       • mylocalsocial.com
  – And our VPN
• EBS
  – Connected to running EC2 Instance
  – Persistent Store for all mySQL DBs
LocalSocial
Localsocial: VPN
LocalSocial: Tools etc.
•   Wrote some wrappers around the command line tools
     – start_instance: start a new instance of our Base AMI
     – attach_database_volume: mount our EBS volume to our EC2 instance
•   Gets a new instance running with the required EBS volume (with our
    mySQL DB) mounted.
•   Also have commands to do with bundling up the AMI. Used if we make
    system changes that want to reflect across all newly started instances.
     – Excludes our application code - this is deployed after the instance is started.
•   Start to finish deploy
     –   1. Start new Instance of Base AMI
     –   2. Attach the DB EBS volume
     –   3. Setup our application environment (Capistrano deploy:setup)
     –   4. Deploy our application from our SVN repository.
     –   5. Restart services
•   Backup tasks
     – backup : wraps the ec2 snapshot command (creates a snapshot of our
       EBS volume)
     – Did this ourselves, but may use ec2onrails in future
Dial2Do: CloudFront
• Amazon's CDN service
• Delivery of static assets
   – e.g. images, javascript, stylesheets
   – Huge increase in speed (3x to 10x depending….)
• Drawback
   – Can't manually expire the local caches in CF
   – If you upload a new image it's fine
   – If you update a CSS file without changing it's name then the
     change will not be picked up for 24 hours.
• Workarounds
   – Version every filename (a pain!),
   – Use multiple "buckets" in Amazon
Dial2Do: CloudFront
Dial2Do: Backups
• Backup to S3
• Rotation policy
  – 7 dailies
  – 5 weeklies
  – Monthlies (never rotated)
• Keeps the size maintainable
  – And the bill modest
Costs
• EC2
  – Running Small Instance
       • $0.10 per instance-hour
       • 743 hours
       • $74.30 per month
• S3
  – 6-7Gb stored
  – Costs about $1 a month
  – $0.150 per GB
Costs
EC2 Dashboard
Wish List / to be done…
• Auto scaling
• Cost management
• Monitoring
Conclusions
• Nowadays: This stuff works!
• Excellent for startups
  – Contrast with “old days”
• Killer combo
  – Virtualisation
  – On-demand compute and storage
• Gets better month by month
  – The “grid” is becoming a reality

More Related Content

What's hot

What's hot (20)

HashiCorp at Just Eat
HashiCorp at Just EatHashiCorp at Just Eat
HashiCorp at Just Eat
 
AWS Quick Intro
AWS Quick IntroAWS Quick Intro
AWS Quick Intro
 
A brief introduction to CloudFormation
A brief introduction to CloudFormationA brief introduction to CloudFormation
A brief introduction to CloudFormation
 
goployer, 코드 기반의 배포 도구 - 송주영 (beNX) :: AWS Community Day 2020
goployer, 코드 기반의 배포 도구 - 송주영 (beNX) :: AWS Community Day 2020goployer, 코드 기반의 배포 도구 - 송주영 (beNX) :: AWS Community Day 2020
goployer, 코드 기반의 배포 도구 - 송주영 (beNX) :: AWS Community Day 2020
 
Amazon Web Services lection 2
Amazon Web Services lection 2Amazon Web Services lection 2
Amazon Web Services lection 2
 
Advanced EBS Snapshot Management (STG402) | AWS re:Invent 2013
Advanced EBS Snapshot Management (STG402) | AWS re:Invent 2013Advanced EBS Snapshot Management (STG402) | AWS re:Invent 2013
Advanced EBS Snapshot Management (STG402) | AWS re:Invent 2013
 
Introduction to Elastic Beanstalk
Introduction to Elastic BeanstalkIntroduction to Elastic Beanstalk
Introduction to Elastic Beanstalk
 
AWS re:Invent re:Cap - 새로운 관계형 데이터베이스 엔진: Amazon Aurora - 양승도
AWS re:Invent re:Cap - 새로운 관계형 데이터베이스 엔진: Amazon Aurora - 양승도AWS re:Invent re:Cap - 새로운 관계형 데이터베이스 엔진: Amazon Aurora - 양승도
AWS re:Invent re:Cap - 새로운 관계형 데이터베이스 엔진: Amazon Aurora - 양승도
 
Gaming on AWS - 2. Amazon Aurora 100% 활용하기 - 신규 기능 및 이전 방법 시연
Gaming on AWS - 2. Amazon Aurora 100% 활용하기 - 신규 기능 및 이전 방법 시연Gaming on AWS - 2. Amazon Aurora 100% 활용하기 - 신규 기능 및 이전 방법 시연
Gaming on AWS - 2. Amazon Aurora 100% 활용하기 - 신규 기능 및 이전 방법 시연
 
ECS위에 Log Server 구축하기
ECS위에 Log Server 구축하기ECS위에 Log Server 구축하기
ECS위에 Log Server 구축하기
 
Couchbase Usecase : Mobile Game Cookierun
Couchbase Usecase : Mobile Game CookierunCouchbase Usecase : Mobile Game Cookierun
Couchbase Usecase : Mobile Game Cookierun
 
Container Orchestration with Amazon ECS
Container Orchestration with Amazon ECSContainer Orchestration with Amazon ECS
Container Orchestration with Amazon ECS
 
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
 
Amazon Web Services lection 6
Amazon Web Services lection 6  Amazon Web Services lection 6
Amazon Web Services lection 6
 
Chugalug
ChugalugChugalug
Chugalug
 
Amazon Web Services lection 5
Amazon Web Services lection 5  Amazon Web Services lection 5
Amazon Web Services lection 5
 
Escalabilidade com Lambda e Elastic Beanstalk – Parte I
Escalabilidade com Lambda e Elastic Beanstalk – Parte IEscalabilidade com Lambda e Elastic Beanstalk – Parte I
Escalabilidade com Lambda e Elastic Beanstalk – Parte I
 
AWS Intro for Knight News Fellows
AWS Intro for Knight News FellowsAWS Intro for Knight News Fellows
AWS Intro for Knight News Fellows
 
Axemblr Provisionr 0.3.x Overview
Axemblr Provisionr 0.3.x OverviewAxemblr Provisionr 0.3.x Overview
Axemblr Provisionr 0.3.x Overview
 
Aws, an intro to startups
Aws, an intro to startupsAws, an intro to startups
Aws, an intro to startups
 

Similar to LocalSocial, Dial2Do and the Cloud

Similar to LocalSocial, Dial2Do and the Cloud (20)

Using ArcGIS Server in the Amazon Cloud
Using ArcGIS Server in the Amazon CloudUsing ArcGIS Server in the Amazon Cloud
Using ArcGIS Server in the Amazon Cloud
 
Debian Cloud - building the Debian AMIs
Debian Cloud - building the Debian AMIsDebian Cloud - building the Debian AMIs
Debian Cloud - building the Debian AMIs
 
Nuts and bolts of running a popular site in the aws cloud
Nuts and bolts of running a popular site in the aws cloudNuts and bolts of running a popular site in the aws cloud
Nuts and bolts of running a popular site in the aws cloud
 
Auto scaling websites in the cloud
Auto scaling websites in the cloudAuto scaling websites in the cloud
Auto scaling websites in the cloud
 
Understanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and PerformanceUnderstanding Elastic Block Store Availability and Performance
Understanding Elastic Block Store Availability and Performance
 
AWS (Hadoop) Meetup 30.04.09
AWS (Hadoop) Meetup 30.04.09AWS (Hadoop) Meetup 30.04.09
AWS (Hadoop) Meetup 30.04.09
 
Tech4Africa 2014
Tech4Africa 2014Tech4Africa 2014
Tech4Africa 2014
 
Basic ppt on cloud computing on amazon web
Basic ppt on cloud computing on amazon webBasic ppt on cloud computing on amazon web
Basic ppt on cloud computing on amazon web
 
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
AWS September Webinar Series - Visual Effects Rendering in the AWS Cloud with...
 
Big Data Day LA 2015 - Lessons learned from scaling Big Data in the Cloud by...
Big Data Day LA 2015 -  Lessons learned from scaling Big Data in the Cloud by...Big Data Day LA 2015 -  Lessons learned from scaling Big Data in the Cloud by...
Big Data Day LA 2015 - Lessons learned from scaling Big Data in the Cloud by...
 
There and Back Again: How We Drank the Chef Kool-Aid, Sobered Up, and Learned...
There and Back Again: How We Drank the Chef Kool-Aid, Sobered Up, and Learned...There and Back Again: How We Drank the Chef Kool-Aid, Sobered Up, and Learned...
There and Back Again: How We Drank the Chef Kool-Aid, Sobered Up, and Learned...
 
Developing in the Cloud
Developing in the CloudDeveloping in the Cloud
Developing in the Cloud
 
Journey towards serverless infrastructure
Journey towards serverless infrastructureJourney towards serverless infrastructure
Journey towards serverless infrastructure
 
CloudOverviewAWS.pptx
CloudOverviewAWS.pptxCloudOverviewAWS.pptx
CloudOverviewAWS.pptx
 
AWS Compute Services
AWS Compute ServicesAWS Compute Services
AWS Compute Services
 
cse40822-amazon.pptx
cse40822-amazon.pptxcse40822-amazon.pptx
cse40822-amazon.pptx
 
FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...
FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...
FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...
 
데이터 마이그레이션 AWS와 같이하기 - 김일호 솔루션즈 아키텍트:: AWS Cloud Track 3 Gaming
데이터 마이그레이션 AWS와 같이하기 - 김일호 솔루션즈 아키텍트:: AWS Cloud Track 3 Gaming데이터 마이그레이션 AWS와 같이하기 - 김일호 솔루션즈 아키텍트:: AWS Cloud Track 3 Gaming
데이터 마이그레이션 AWS와 같이하기 - 김일호 솔루션즈 아키텍트:: AWS Cloud Track 3 Gaming
 
Why Scale Matters and How the Cloud is Really Different (at scale)
Why Scale Matters and How the Cloud is Really Different (at scale)Why Scale Matters and How the Cloud is Really Different (at scale)
Why Scale Matters and How the Cloud is Really Different (at scale)
 
AWS Summit 2013 | Auckland - Your First Week with Amazon EC2
AWS Summit 2013 | Auckland - Your First Week with Amazon EC2AWS Summit 2013 | Auckland - Your First Week with Amazon EC2
AWS Summit 2013 | Auckland - Your First Week with Amazon EC2
 

More from Sean O'Sullivan

More from Sean O'Sullivan (20)

Effective Software : Distributed Engineering Team in Europe
Effective Software : Distributed Engineering Team in EuropeEffective Software : Distributed Engineering Team in Europe
Effective Software : Distributed Engineering Team in Europe
 
Beacosystem Talk @ MongoDB User Group Dublin @sos100
Beacosystem Talk @ MongoDB User Group Dublin @sos100Beacosystem Talk @ MongoDB User Group Dublin @sos100
Beacosystem Talk @ MongoDB User Group Dublin @sos100
 
Hardware is cool again
Hardware is cool againHardware is cool again
Hardware is cool again
 
Hardware is Cool (again)
Hardware is Cool (again)Hardware is Cool (again)
Hardware is Cool (again)
 
Beacosystem Tour for GDG Dublin - Sean O Sullivan
Beacosystem Tour for GDG Dublin - Sean O Sullivan Beacosystem Tour for GDG Dublin - Sean O Sullivan
Beacosystem Tour for GDG Dublin - Sean O Sullivan
 
LocalSocial XCake iBeacon Slides Q3 2015
LocalSocial XCake iBeacon Slides Q3 2015LocalSocial XCake iBeacon Slides Q3 2015
LocalSocial XCake iBeacon Slides Q3 2015
 
LocalSocial O Reilly Webcast Slides - A Tour of the Beacosystem
LocalSocial O Reilly Webcast Slides - A Tour of the BeacosystemLocalSocial O Reilly Webcast Slides - A Tour of the Beacosystem
LocalSocial O Reilly Webcast Slides - A Tour of the Beacosystem
 
LocalSocial Getting Started Guide
LocalSocial Getting Started GuideLocalSocial Getting Started Guide
LocalSocial Getting Started Guide
 
Proximity and In-Store Engagement for the Digital Marketing Institute
Proximity and In-Store Engagement for the Digital Marketing InstituteProximity and In-Store Engagement for the Digital Marketing Institute
Proximity and In-Store Engagement for the Digital Marketing Institute
 
Beacosystem V3
Beacosystem V3Beacosystem V3
Beacosystem V3
 
LocalSocial @ AppsWorld
LocalSocial @ AppsWorldLocalSocial @ AppsWorld
LocalSocial @ AppsWorld
 
LocalSocial : Beacosystem Overview
LocalSocial : Beacosystem OverviewLocalSocial : Beacosystem Overview
LocalSocial : Beacosystem Overview
 
Real Estate, Property and iBeacon
Real Estate, Property and iBeaconReal Estate, Property and iBeacon
Real Estate, Property and iBeacon
 
Indoor Location / iBeacon @ Digital Summit Ireland by LocalSocial
Indoor Location / iBeacon @ Digital Summit Ireland by LocalSocialIndoor Location / iBeacon @ Digital Summit Ireland by LocalSocial
Indoor Location / iBeacon @ Digital Summit Ireland by LocalSocial
 
LocalSocial Bluetooth Webinar
LocalSocial Bluetooth WebinarLocalSocial Bluetooth Webinar
LocalSocial Bluetooth Webinar
 
LocalSocial - Indoor Location Positioning Overview
LocalSocial - Indoor Location Positioning OverviewLocalSocial - Indoor Location Positioning Overview
LocalSocial - Indoor Location Positioning Overview
 
LocalSocial : In-store engagement platform
LocalSocial : In-store engagement platformLocalSocial : In-store engagement platform
LocalSocial : In-store engagement platform
 
Beyond The Check-In
Beyond The Check-InBeyond The Check-In
Beyond The Check-In
 
LocalSocial App Overview
LocalSocial App OverviewLocalSocial App Overview
LocalSocial App Overview
 
LocalSocial Smart Mobile Marketing
LocalSocial Smart Mobile MarketingLocalSocial Smart Mobile Marketing
LocalSocial Smart Mobile Marketing
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 

LocalSocial, Dial2Do and the Cloud

  • 1. Experience with AWS Sean O Sullivan
  • 3. Motivation • Ease of use / Speed of use • Experimentation • AMIs • Flexibility • Pricing
  • 4. LocalSocial • S3 – Stores our AMI – Fedora 8 from AWS – Plus all our own stuff (RoR, Scripts, …) • EC2 – One “small instance” Server • 1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit), 160 GB of instance storage, 32-bit platform – Runs our AMI fulltime – Two domains right now • gigmonkey.com • mylocalsocial.com – And our VPN • EBS – Connected to running EC2 Instance – Persistent Store for all mySQL DBs
  • 7. LocalSocial: Tools etc. • Wrote some wrappers around the command line tools – start_instance: start a new instance of our Base AMI – attach_database_volume: mount our EBS volume to our EC2 instance • Gets a new instance running with the required EBS volume (with our mySQL DB) mounted. • Also have commands to do with bundling up the AMI. Used if we make system changes that want to reflect across all newly started instances. – Excludes our application code - this is deployed after the instance is started. • Start to finish deploy – 1. Start new Instance of Base AMI – 2. Attach the DB EBS volume – 3. Setup our application environment (Capistrano deploy:setup) – 4. Deploy our application from our SVN repository. – 5. Restart services • Backup tasks – backup : wraps the ec2 snapshot command (creates a snapshot of our EBS volume) – Did this ourselves, but may use ec2onrails in future
  • 8. Dial2Do: CloudFront • Amazon's CDN service • Delivery of static assets – e.g. images, javascript, stylesheets – Huge increase in speed (3x to 10x depending….) • Drawback – Can't manually expire the local caches in CF – If you upload a new image it's fine – If you update a CSS file without changing it's name then the change will not be picked up for 24 hours. • Workarounds – Version every filename (a pain!), – Use multiple "buckets" in Amazon
  • 10. Dial2Do: Backups • Backup to S3 • Rotation policy – 7 dailies – 5 weeklies – Monthlies (never rotated) • Keeps the size maintainable – And the bill modest
  • 11. Costs • EC2 – Running Small Instance • $0.10 per instance-hour • 743 hours • $74.30 per month • S3 – 6-7Gb stored – Costs about $1 a month – $0.150 per GB
  • 12. Costs
  • 14. Wish List / to be done… • Auto scaling • Cost management • Monitoring
  • 15. Conclusions • Nowadays: This stuff works! • Excellent for startups – Contrast with “old days” • Killer combo – Virtualisation – On-demand compute and storage • Gets better month by month – The “grid” is becoming a reality