AWS Summit Tel Aviv - Startup Track - Backend Use Cases
Upcoming SlideShare
Loading in...5
×
 

AWS Summit Tel Aviv - Startup Track - Backend Use Cases

on

  • 602 views

 

Statistics

Views

Total Views
602
Views on SlideShare
602
Embed Views
0

Actions

Likes
2
Downloads
21
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

AWS Summit Tel Aviv - Startup Track - Backend Use Cases AWS Summit Tel Aviv - Startup Track - Backend Use Cases Presentation Transcript

  • AWS Summit 2013 Tel Aviv Oct 16 – Tel Aviv, Israel BACK-END USE CASES Carlos Conde – Sr. Mgr. Solutions Architecture Thomas Metschke – Technical Program Manager AWS OpsWorks
  • PRESENTATION TIER APPLICATION TIER INFORMATION TIER (FRONT-END) (BACK-END) (DATABASES)
  • PRESENTATION TIER APPLICATION TIER INFORMATION TIER (FRONT-END) (BACK-END) (DATABASES)
  • CONTENT DELIVERY NETWORK AMAZON CLOUDFRONT
  • AWS ELASTIC BEANSTALK WEB APPLICATION FRONT-END
  • AMAZON DYNAMODB DATA STORE
  • AMAZON S3 VIDEO FILES STORE
  • #1WORKFLOW
  • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
  • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
  • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
  • TASKS DECISIONS HISTORY
  • TASKS DECISIONS HISTORY STATELESS !
  • STATELESS SCALES HORIZONTALLY
  • AMAZON SWF ENABLES RESILIENT, SCALABLE, DISTRIBUTED WORKFLOWS
  • AMAZON SWF SERVICE SWF WORKER SWF DECIDER
  • DECIDERS COORDINATION LOGIC 1. Poll for work on a decision list Long polling 2. Evaluate workflow execution history SWF sends full history in JSON format 3. Return decision to Amazon SWF Usually scheduling another task
  • WORKERS EXECUTION LOGIC 1. Poll for work on a specific task list Long polling 2. Execute works, send heartbeats SWF sends input data from deciders 3. Return success / failure Detailed data can be provided to deciders
  • AMAZON SWF TRACKS:  Execution Time to start, time to finish, … Time to finish for overall workflow Timeouts controlled for each of these (and more)  Heartbeats for long-running activities (optional)  Decider is informed of timeouts Schedule retries, “mitigation” strategies or cleanup tasks
  • NO NEW LANGUAGE TO LEARN YOUR CODE IS YOUR WORKFLOW LANGUAGE AMAZON SWF MAINTAINS STATE
  • ALL HORIZONTAL SCALING PATTERNS APPLY
  • #2TRANSCODING
  • AMAZON ELASTIC TRANSCODER SCALABLE, EASY TO USE AND A COST EFFECTIVE
  • SD $0.015 / MINUTE Resolution of less than 720p HD $0.030 / MINUTE Resolution of more than 720p Transcode up to 20 minutes of content each month for free.
  • AMAZON ELASTIC TRANSCODER
  • #3SEARCH
  • AMAZON CLOUDSEARCH ENABLES RESILIENT, SCALABLE, DISTRIBUTED WORKFLOWS
  • select from where like * articles content ‘%cloud%’
  • Relevance & Ranking
  • Faceting
  • Field Search
  • Range Search
  • +
  • Endpoints doc-mydomain.us-east-1.cloudsearch.amazonaws.com search-mydomain.us-east-1.cloudsearch.amazonaws.com
  • HTTP POST author=carlos; date=2013-02-07; comment=text; +
  • SCALABLE SEARCH
  • Time: 1800h Requests <80% CPU Small Instance Partition 1 Copy 1 Time Elastic Search
  • Time: 2000h Requests >80% CPU Small Instance Partition 1 Copy 2 Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
  • Time: 2200h Requests >80% CPU Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
  • Time: 0000h Requests Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 <30% CPU Time Elastic Search
  • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
  • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Elastic Capacity Time Elastic Search
  • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Savings Savings Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Elastic Capacity Time Elastic Search
  • Cloud Search Search Instance Partition 1 Copy 1 Traffic Request volume & complexity Search Instance Partition 1 Copy 2 Search Instance Partition 1 Copy n
  • Data Document quantity & size Cloud Search Search Instance Search Instance Partition 1 Copy 1 Partition 2 Copy 1 Search Instance Partition n Copy 1
  • Data Document quantity & size Cloud Search Search Instance Request volume & complexity Search Instance Partition 1 Copy 1 Traffic Search Instance Partition 2 Copy 1 Partition n Copy 1 Search Instance Search Instance Search Instance Partition 1 Copy 2 Partition 2 Copy 2 Partition n Copy 2 Search Instance Search Instance Search Instance Partition 1 Copy n Partition 2 Copy n Partition n Copy n
  • SEARCH ENDPOINT AMAZON CLOUDSEARCH DOCUMENT ENDPOINT
  • #4NOTIFICATIONS
  • AMAZON SES BULK AND TRANSACTIONAL EMAIL-SENDING SERVICE
  • $0.10 PER 1000 EMAILS + $0.12 per GB of attachments
  • AMAZON SNS MOBILE PUSH NOTIFICATIONS
  • #5ENDPOINT
  • DIRECT API CALLS TO AWS
  • iOS Android // Create Amazon S3 Client // Create Amazon S3 Client AmazonS3Client *s3 = [[AmazonS3Client alloc] initWithAccessKey:ACCESS_KEY_ID withSecretKey:SECRET_KEY]; AmazonS3Client s3 = new AmazonS3Client( new BasicAWSCredentials( ACCESS_KEY_ID, SECRET_KEY ) ); // Put an Object into a Bucket // Put an Object into a Bucket S3PutObjectRequest *por = [[S3PutObjectRequest alloc] initWithKey:VIDEO_NAME inBucket:VIDEO_BUCKET]; por.contentType = @“mpeg4"; por.data = video; [s3 putObject:por]; PutObjectRequest por = new PutObjectRequest(VIDEO_BUCKET, VIDEO_NAME, new java.io.File( video ) ); s3.putObject( por ); // Get an Object from a Bucket // Get an Object from a Bucket S3GetObjectRequest *gor = [[S3GetObjectRequest alloc] initWithKey:VIDEO_NAME withBucket:VIDEO_BUCKET]; S3GetObjectResponse *response = [s3 getObject:gor]; S3Object data = s3.getObject(VIDEO_BUCKET, VIDEO_NAME);
  • IAM STS SECURITY TOKEN SERVICE
  • IAM STS
  • FOCUS ON YOUR CORE BUSINESS
  • AWS Summit 2013 Tel Aviv Oct 16 – Tel Aviv, Israel AWS OPSWORKS Thomas Metschke – Technical Program Manager AWS OpsWorks