SlideShare a Scribd company logo
1 of 1
Download to read offline
SnapDish

Internet

1. Web / App Server
- instance m1.large
- python tornado
- python memcached
- python pymongo
- nginx

Amazon
Route 53
Amazon Simple
Storage Service
(S3)
Amazon
CloudFront

2. Image Server
- instance c3.large
- nginx gridfs
3. ElastiCache
- Job Queue
- python-rq + Redis
- Data Cache
- Memcached

Internet
Gateway

Elastic Load
Balancer
snapdish

Elastic Load
Balancer
api.snapdish

Elastic Load
Balancer
origin.snapdish

4. Job Queue Woker Server
- m1.small
Web/App Server

5. DB Server
- MongoDB
- Production h1.4xlarge
- Backup m1.large

Image Server

NAT

Web/App Server

Image Server

Availability Zone B

Availability Zone C

VPC Public Subnet

VPC Public Subnet

Write

Write

Read

Read

Read/Write Write Read

Read/Write
Read

6. Search Engine
- CloudSearch
- SQS to update index

Write

Read
Read
Read/Write

Read/Write

SQS
Elaticache
Elaticache
Elaticache
Memcached
Redis
CloudSearch
for Data Cache for job queue

MongoDB SEC

MongoDB PRI

MongoDB Arb
MongoDB
hidden backup

Availability Zone B

Availability Zone C

VPC Private Subnet

Write

Availability Zone C
VPC Private Subnet

VPC Private Subnet

Rreplica Sets

Batch Update Index
Job Queue worker
Virtual Private Cloud

More Related Content

What's hot

Detecting AWS control plane abuse in an actionable way using Det{R}ails
Detecting AWS control plane abuse in an actionable way using Det{R}ailsDetecting AWS control plane abuse in an actionable way using Det{R}ails
Detecting AWS control plane abuse in an actionable way using Det{R}ails
Tenchi Security
 
Amazon web services
Amazon web servicesAmazon web services
Amazon web services
tsaiscorpio
 

What's hot (18)

Detecting AWS control plane abuse in an actionable way using Det{R}ails
Detecting AWS control plane abuse in an actionable way using Det{R}ailsDetecting AWS control plane abuse in an actionable way using Det{R}ails
Detecting AWS control plane abuse in an actionable way using Det{R}ails
 
(BDT205) Your First Big Data Application on AWS | AWS re:Invent 2014
(BDT205) Your First Big Data Application on AWS | AWS re:Invent 2014(BDT205) Your First Big Data Application on AWS | AWS re:Invent 2014
(BDT205) Your First Big Data Application on AWS | AWS re:Invent 2014
 
AWS September Webinar Series - Running Microservices with Amazon EC2 Contain...
AWS September Webinar Series -  Running Microservices with Amazon EC2 Contain...AWS September Webinar Series -  Running Microservices with Amazon EC2 Contain...
AWS September Webinar Series - Running Microservices with Amazon EC2 Contain...
 
Apache Superset at Airbnb
Apache Superset at AirbnbApache Superset at Airbnb
Apache Superset at Airbnb
 
High Performance API Mashups with Node.js and ql.io
High Performance API Mashups with Node.js and ql.ioHigh Performance API Mashups with Node.js and ql.io
High Performance API Mashups with Node.js and ql.io
 
SCasia 2018 MSFT hands on session for Azure Batch AI
SCasia 2018 MSFT hands on session for Azure Batch AISCasia 2018 MSFT hands on session for Azure Batch AI
SCasia 2018 MSFT hands on session for Azure Batch AI
 
A Data Journey With AWS
A Data Journey With AWSA Data Journey With AWS
A Data Journey With AWS
 
Amazon web services
Amazon web servicesAmazon web services
Amazon web services
 
Running Fast, Interactive Queries on Petabyte Datasets using Presto - AWS Jul...
Running Fast, Interactive Queries on Petabyte Datasets using Presto - AWS Jul...Running Fast, Interactive Queries on Petabyte Datasets using Presto - AWS Jul...
Running Fast, Interactive Queries on Petabyte Datasets using Presto - AWS Jul...
 
CON420 Infrastructure as code for containers
CON420 Infrastructure as code for containersCON420 Infrastructure as code for containers
CON420 Infrastructure as code for containers
 
Presto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy endPresto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy end
 
Seravia in the Cloud
Seravia in the CloudSeravia in the Cloud
Seravia in the Cloud
 
AWS Customer Presentation - AideRss
AWS Customer Presentation - AideRss AWS Customer Presentation - AideRss
AWS Customer Presentation - AideRss
 
CloudStack / Saltstack lightning talk at DevOps Amsterdam
CloudStack / Saltstack lightning talk at DevOps AmsterdamCloudStack / Saltstack lightning talk at DevOps Amsterdam
CloudStack / Saltstack lightning talk at DevOps Amsterdam
 
Google Cloud DNS
Google Cloud DNSGoogle Cloud DNS
Google Cloud DNS
 
Building Your First Big Data Application on AWS
Building Your First Big Data Application on AWSBuilding Your First Big Data Application on AWS
Building Your First Big Data Application on AWS
 
Firebase - cloud based real time database
Firebase - cloud based real time databaseFirebase - cloud based real time database
Firebase - cloud based real time database
 
If you doing file uploads with rails you're gonna have a bad time
If you doing file uploads with rails you're gonna have a bad timeIf you doing file uploads with rails you're gonna have a bad time
If you doing file uploads with rails you're gonna have a bad time
 

Viewers also liked

13.04.14 digi women jean-o'sullivan
13.04.14 digi women  jean-o'sullivan13.04.14 digi women  jean-o'sullivan
13.04.14 digi women jean-o'sullivan
DigiWomen
 
Poster Design - Birthday
Poster Design - BirthdayPoster Design - Birthday
Poster Design - Birthday
BotoBata
 
Social welfare is maximum in case of imperfect competition
Social welfare is maximum in case of imperfect competitionSocial welfare is maximum in case of imperfect competition
Social welfare is maximum in case of imperfect competition
Akeeb Siddiqui
 
Characteristics and labour market performance of the new member state immigra...
Characteristics and labour market performance of the new member state immigra...Characteristics and labour market performance of the new member state immigra...
Characteristics and labour market performance of the new member state immigra...
Palkansaajien tutkimuslaitos
 
Collective bargaining india
Collective bargaining indiaCollective bargaining india
Collective bargaining india
sulejen
 
The Concept of Elasticity
The Concept of ElasticityThe Concept of Elasticity
The Concept of Elasticity
aizellbernal
 

Viewers also liked (15)

13.04.14 digi women jean-o'sullivan
13.04.14 digi women  jean-o'sullivan13.04.14 digi women  jean-o'sullivan
13.04.14 digi women jean-o'sullivan
 
Poster Design - Birthday
Poster Design - BirthdayPoster Design - Birthday
Poster Design - Birthday
 
Social welfare is maximum in case of imperfect competition
Social welfare is maximum in case of imperfect competitionSocial welfare is maximum in case of imperfect competition
Social welfare is maximum in case of imperfect competition
 
Revenue concept
Revenue conceptRevenue concept
Revenue concept
 
Characteristics and labour market performance of the new member state immigra...
Characteristics and labour market performance of the new member state immigra...Characteristics and labour market performance of the new member state immigra...
Characteristics and labour market performance of the new member state immigra...
 
NGO role in development of youth work
NGO role in development of youth workNGO role in development of youth work
NGO role in development of youth work
 
International Economics Guest Lecture
International Economics Guest LectureInternational Economics Guest Lecture
International Economics Guest Lecture
 
Entrepreneurship_Trade_Eco_Dev
Entrepreneurship_Trade_Eco_DevEntrepreneurship_Trade_Eco_Dev
Entrepreneurship_Trade_Eco_Dev
 
Pareto optimality
Pareto optimalityPareto optimality
Pareto optimality
 
Terms of trade-Nelson
Terms of trade-NelsonTerms of trade-Nelson
Terms of trade-Nelson
 
Collective bargaining india
Collective bargaining indiaCollective bargaining india
Collective bargaining india
 
The Concept of Elasticity
The Concept of ElasticityThe Concept of Elasticity
The Concept of Elasticity
 
Micro enterprise development and rural women enterpurinship by Parvani Sharma
Micro enterprise development and rural women enterpurinship by Parvani SharmaMicro enterprise development and rural women enterpurinship by Parvani Sharma
Micro enterprise development and rural women enterpurinship by Parvani Sharma
 
women empowerment
 women empowerment women empowerment
women empowerment
 
Child labour presentation
Child labour presentationChild labour presentation
Child labour presentation
 

Similar to SnapDish AWS

High-Availability Websites and Web Applications with AWS
High-Availability Websites and Web Applications with AWSHigh-Availability Websites and Web Applications with AWS
High-Availability Websites and Web Applications with AWS
Amazon Web Services
 
Building High-availability Websites on AWS
Building High-availability Websites on AWSBuilding High-availability Websites on AWS
Building High-availability Websites on AWS
Amazon Web Services
 
Amazon Webservice & Cloud Computing
Amazon Webservice & Cloud ComputingAmazon Webservice & Cloud Computing
Amazon Webservice & Cloud Computing
Jack Smith
 

Similar to SnapDish AWS (20)

High-Availability Websites and Web Applications with AWS
High-Availability Websites and Web Applications with AWSHigh-Availability Websites and Web Applications with AWS
High-Availability Websites and Web Applications with AWS
 
Building High-availability Websites on AWS
Building High-availability Websites on AWSBuilding High-availability Websites on AWS
Building High-availability Websites on AWS
 
Websites on AWS
Websites on AWSWebsites on AWS
Websites on AWS
 
(BDT308) Using Amazon Elastic MapReduce as Your Scalable Data Warehouse | AWS...
(BDT308) Using Amazon Elastic MapReduce as Your Scalable Data Warehouse | AWS...(BDT308) Using Amazon Elastic MapReduce as Your Scalable Data Warehouse | AWS...
(BDT308) Using Amazon Elastic MapReduce as Your Scalable Data Warehouse | AWS...
 
My First Big Data Application
My First Big Data ApplicationMy First Big Data Application
My First Big Data Application
 
Tracking and Monitoring APIs at Scale
Tracking and Monitoring APIs at ScaleTracking and Monitoring APIs at Scale
Tracking and Monitoring APIs at Scale
 
High Availability Websites: part two
High Availability Websites: part twoHigh Availability Websites: part two
High Availability Websites: part two
 
Workshop: Building Your First Big Data Application on AWS
Workshop: Building Your First Big Data Application on AWSWorkshop: Building Your First Big Data Application on AWS
Workshop: Building Your First Big Data Application on AWS
 
Mythical Mysfits: Monolith to Microservices with Docker and Fargate - MAD305 ...
Mythical Mysfits: Monolith to Microservices with Docker and Fargate - MAD305 ...Mythical Mysfits: Monolith to Microservices with Docker and Fargate - MAD305 ...
Mythical Mysfits: Monolith to Microservices with Docker and Fargate - MAD305 ...
 
StartPad Countdown 8 - Amazon Web Services and You
StartPad Countdown 8 - Amazon Web Services and YouStartPad Countdown 8 - Amazon Web Services and You
StartPad Countdown 8 - Amazon Web Services and You
 
Building Your First Big Data Application on AWS
Building Your First Big Data Application on AWSBuilding Your First Big Data Application on AWS
Building Your First Big Data Application on AWS
 
Building a Serverless Pipeline
Building a Serverless PipelineBuilding a Serverless Pipeline
Building a Serverless Pipeline
 
TIAD 2016 : Building a Serverless Pipeline
TIAD 2016 : Building a Serverless PipelineTIAD 2016 : Building a Serverless Pipeline
TIAD 2016 : Building a Serverless Pipeline
 
Amazed by AWS Series #4
Amazed by AWS Series #4Amazed by AWS Series #4
Amazed by AWS Series #4
 
4K Media Workflows on AWS
4K Media Workflows on AWS4K Media Workflows on AWS
4K Media Workflows on AWS
 
Serverless architecture with AWS Lambda (June 2016)
Serverless architecture with AWS Lambda (June 2016)Serverless architecture with AWS Lambda (June 2016)
Serverless architecture with AWS Lambda (June 2016)
 
AWS re:Invent 2016 Day 2 Keynote re:Cap
AWS re:Invent 2016 Day 2 Keynote re:CapAWS re:Invent 2016 Day 2 Keynote re:Cap
AWS re:Invent 2016 Day 2 Keynote re:Cap
 
AWS re:Invent 2016 Day 2 Keynote re:Cap
AWS re:Invent 2016 Day 2 Keynote re:CapAWS re:Invent 2016 Day 2 Keynote re:Cap
AWS re:Invent 2016 Day 2 Keynote re:Cap
 
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
AWS Pop-up Loft Berlin: Cache is King - Running Lean Architectures: Optimizin...
 
Amazon Webservice & Cloud Computing
Amazon Webservice & Cloud ComputingAmazon Webservice & Cloud Computing
Amazon Webservice & Cloud Computing
 

More from Fumikazu Kiyota (10)

PyCon Kyushu 2018 SnapDish LT
PyCon Kyushu 2018 SnapDish LTPyCon Kyushu 2018 SnapDish LT
PyCon Kyushu 2018 SnapDish LT
 
Food techtalk
Food techtalkFood techtalk
Food techtalk
 
TechCrunch CTO Night 2014
TechCrunch CTO Night 2014TechCrunch CTO Night 2014
TechCrunch CTO Night 2014
 
MongoDB祭り 2014年
MongoDB祭り 2014年MongoDB祭り 2014年
MongoDB祭り 2014年
 
2014/7/15 Vuzz SnapDish CTO Night Talk @AWS
2014/7/15 Vuzz SnapDish CTO Night Talk @AWS 2014/7/15 Vuzz SnapDish CTO Night Talk @AWS
2014/7/15 Vuzz SnapDish CTO Night Talk @AWS
 
SnapDish&CloudSearch@aws
SnapDish&CloudSearch@awsSnapDish&CloudSearch@aws
SnapDish&CloudSearch@aws
 
SnapDishって? (LT資料)
SnapDishって? (LT資料)SnapDishって? (LT資料)
SnapDishって? (LT資料)
 
Evernote Devcup 2013 Kickoff のLT資料
Evernote Devcup 2013 Kickoff のLT資料Evernote Devcup 2013 Kickoff のLT資料
Evernote Devcup 2013 Kickoff のLT資料
 
SnapDish 画像配信について
SnapDish 画像配信についてSnapDish 画像配信について
SnapDish 画像配信について
 
SnapDishの事例
SnapDishの事例SnapDishの事例
SnapDishの事例
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 

SnapDish AWS

  • 1. SnapDish Internet 1. Web / App Server - instance m1.large - python tornado - python memcached - python pymongo - nginx Amazon Route 53 Amazon Simple Storage Service (S3) Amazon CloudFront 2. Image Server - instance c3.large - nginx gridfs 3. ElastiCache - Job Queue - python-rq + Redis - Data Cache - Memcached Internet Gateway Elastic Load Balancer snapdish Elastic Load Balancer api.snapdish Elastic Load Balancer origin.snapdish 4. Job Queue Woker Server - m1.small Web/App Server 5. DB Server - MongoDB - Production h1.4xlarge - Backup m1.large Image Server NAT Web/App Server Image Server Availability Zone B Availability Zone C VPC Public Subnet VPC Public Subnet Write Write Read Read Read/Write Write Read Read/Write Read 6. Search Engine - CloudSearch - SQS to update index Write Read Read Read/Write Read/Write SQS Elaticache Elaticache Elaticache Memcached Redis CloudSearch for Data Cache for job queue MongoDB SEC MongoDB PRI MongoDB Arb MongoDB hidden backup Availability Zone B Availability Zone C VPC Private Subnet Write Availability Zone C VPC Private Subnet VPC Private Subnet Rreplica Sets Batch Update Index Job Queue worker Virtual Private Cloud