AWS Summit Tel Aviv - Startup Track - Backend Use Cases
Upcoming SlideShare
Loading in...5
×
 

AWS Summit Tel Aviv - Startup Track - Backend Use Cases

on

  • 590 views

 

Statistics

Views

Total Views
590
Views on SlideShare
590
Embed Views
0

Actions

Likes
2
Downloads
20
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    AWS Summit Tel Aviv - Startup Track - Backend Use Cases AWS Summit Tel Aviv - Startup Track - Backend Use Cases Presentation Transcript

    • AWS Summit 2013 Tel Aviv Oct 16 – Tel Aviv, Israel BACK-END USE CASES Carlos Conde – Sr. Mgr. Solutions Architecture Thomas Metschke – Technical Program Manager AWS OpsWorks
    • PRESENTATION TIER APPLICATION TIER INFORMATION TIER (FRONT-END) (BACK-END) (DATABASES)
    • PRESENTATION TIER APPLICATION TIER INFORMATION TIER (FRONT-END) (BACK-END) (DATABASES)
    • CONTENT DELIVERY NETWORK AMAZON CLOUDFRONT
    • AWS ELASTIC BEANSTALK WEB APPLICATION FRONT-END
    • AMAZON DYNAMODB DATA STORE
    • AMAZON S3 VIDEO FILES STORE
    • #1WORKFLOW
    • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
    • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
    • START CHECK VIDEO REJECT STOP YES TOO LONG? YES CROP VIDEO NO SPAM CHECK SPAM? NO TRANSCODE INDEX & NOTIFY
    • TASKS DECISIONS HISTORY
    • TASKS DECISIONS HISTORY STATELESS !
    • STATELESS SCALES HORIZONTALLY
    • AMAZON SWF ENABLES RESILIENT, SCALABLE, DISTRIBUTED WORKFLOWS
    • AMAZON SWF SERVICE SWF WORKER SWF DECIDER
    • DECIDERS COORDINATION LOGIC 1. Poll for work on a decision list Long polling 2. Evaluate workflow execution history SWF sends full history in JSON format 3. Return decision to Amazon SWF Usually scheduling another task
    • WORKERS EXECUTION LOGIC 1. Poll for work on a specific task list Long polling 2. Execute works, send heartbeats SWF sends input data from deciders 3. Return success / failure Detailed data can be provided to deciders
    • AMAZON SWF TRACKS:  Execution Time to start, time to finish, … Time to finish for overall workflow Timeouts controlled for each of these (and more)  Heartbeats for long-running activities (optional)  Decider is informed of timeouts Schedule retries, “mitigation” strategies or cleanup tasks
    • NO NEW LANGUAGE TO LEARN YOUR CODE IS YOUR WORKFLOW LANGUAGE AMAZON SWF MAINTAINS STATE
    • ALL HORIZONTAL SCALING PATTERNS APPLY
    • #2TRANSCODING
    • AMAZON ELASTIC TRANSCODER SCALABLE, EASY TO USE AND A COST EFFECTIVE
    • SD $0.015 / MINUTE Resolution of less than 720p HD $0.030 / MINUTE Resolution of more than 720p Transcode up to 20 minutes of content each month for free.
    • AMAZON ELASTIC TRANSCODER
    • #3SEARCH
    • AMAZON CLOUDSEARCH ENABLES RESILIENT, SCALABLE, DISTRIBUTED WORKFLOWS
    • select from where like * articles content ‘%cloud%’
    • Relevance & Ranking
    • Faceting
    • Field Search
    • Range Search
    • +
    • Endpoints doc-mydomain.us-east-1.cloudsearch.amazonaws.com search-mydomain.us-east-1.cloudsearch.amazonaws.com
    • HTTP POST author=carlos; date=2013-02-07; comment=text; +
    • SCALABLE SEARCH
    • Time: 1800h Requests <80% CPU Small Instance Partition 1 Copy 1 Time Elastic Search
    • Time: 2000h Requests >80% CPU Small Instance Partition 1 Copy 2 Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
    • Time: 2200h Requests >80% CPU Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
    • Time: 0000h Requests Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 <30% CPU Time Elastic Search
    • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Time Elastic Search
    • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Elastic Capacity Time Elastic Search
    • Cost savings Requests Traditional required capacity Small Instance Partition 1 Copy 3 Savings Savings Small Instance Small Instance Partition 1 Copy 2 Partition 1 Copy 2 Small Instance Small Instance Small Instance Small Instance Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Partition 1 Copy 1 Elastic Capacity Time Elastic Search
    • Cloud Search Search Instance Partition 1 Copy 1 Traffic Request volume & complexity Search Instance Partition 1 Copy 2 Search Instance Partition 1 Copy n
    • Data Document quantity & size Cloud Search Search Instance Search Instance Partition 1 Copy 1 Partition 2 Copy 1 Search Instance Partition n Copy 1
    • Data Document quantity & size Cloud Search Search Instance Request volume & complexity Search Instance Partition 1 Copy 1 Traffic Search Instance Partition 2 Copy 1 Partition n Copy 1 Search Instance Search Instance Search Instance Partition 1 Copy 2 Partition 2 Copy 2 Partition n Copy 2 Search Instance Search Instance Search Instance Partition 1 Copy n Partition 2 Copy n Partition n Copy n
    • SEARCH ENDPOINT AMAZON CLOUDSEARCH DOCUMENT ENDPOINT
    • #4NOTIFICATIONS
    • AMAZON SES BULK AND TRANSACTIONAL EMAIL-SENDING SERVICE
    • $0.10 PER 1000 EMAILS + $0.12 per GB of attachments
    • AMAZON SNS MOBILE PUSH NOTIFICATIONS
    • #5ENDPOINT
    • DIRECT API CALLS TO AWS
    • iOS Android // Create Amazon S3 Client // Create Amazon S3 Client AmazonS3Client *s3 = [[AmazonS3Client alloc] initWithAccessKey:ACCESS_KEY_ID withSecretKey:SECRET_KEY]; AmazonS3Client s3 = new AmazonS3Client( new BasicAWSCredentials( ACCESS_KEY_ID, SECRET_KEY ) ); // Put an Object into a Bucket // Put an Object into a Bucket S3PutObjectRequest *por = [[S3PutObjectRequest alloc] initWithKey:VIDEO_NAME inBucket:VIDEO_BUCKET]; por.contentType = @“mpeg4"; por.data = video; [s3 putObject:por]; PutObjectRequest por = new PutObjectRequest(VIDEO_BUCKET, VIDEO_NAME, new java.io.File( video ) ); s3.putObject( por ); // Get an Object from a Bucket // Get an Object from a Bucket S3GetObjectRequest *gor = [[S3GetObjectRequest alloc] initWithKey:VIDEO_NAME withBucket:VIDEO_BUCKET]; S3GetObjectResponse *response = [s3 getObject:gor]; S3Object data = s3.getObject(VIDEO_BUCKET, VIDEO_NAME);
    • IAM STS SECURITY TOKEN SERVICE
    • IAM STS
    • FOCUS ON YOUR CORE BUSINESS
    • AWS Summit 2013 Tel Aviv Oct 16 – Tel Aviv, Israel AWS OPSWORKS Thomas Metschke – Technical Program Manager AWS OpsWorks