Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
ARCHITECTING    FOR AWSCarlos Conde │Solutions Architect
1.   ELASTICITY2.   DESIGN FOR FAILURE3.   LOOSE COUPLING4.   SECURITY5.   PERFORMANCE
#   1ELASTICITY   ●○○○○
AMAZON EC2ELASTIC COMPUTE CLOUD
AMAZON CLOUDWATCHMONITORING FOR AWS RESOURCES
AUTO SCALINGSCALE UP/DOWN EC2 CAPACITY
ELASTIC LOAD BALANCINGNETWORK TRAFFIC DISTRIBUTION
6 am
10 am
10 am
10 am
7 pm
7 pm
7 pm
without elasticity you cant accelerate
what you really need is…                           …adjustable capacity
#   2DESIGN FOR FAILURE       ●●○○○
« Everything fails all the time »                Werner Vogels               CTO of Amazon
YOUR GOALApplications should continue to function even if  the underlying physical hardware fails or is              remov...
Avoid single points of failure.Assume everything fails, and designbackwards.
Avoid single points of failure.Assume everything fails, and designbackwards.
AMAZON RDSRELATIONAL DATABASE SERVICE
AMAZONROUTE 53DOMAIN NAME SERVICE
AMAZON RDSMULTI-AZDEPLOYMENT
AMAZON CLOUDWATCH  ALARMS
AWS BUILDING BLOCKSInherently Fault-Tolerant Services     Fault-Tolerant with                                       the ri...
NETFLIXCHAOS MONKEY
#   3 LOOSECOUPLING  ●●●○○
BUILD LOOSELYCOUPLED SYSTEMS The looser the are coupled,    the bigger they scale
Create independent components
Create independent componentsDesign everything as a Black Box
Create independent componentsDesign everything as a Black BoxThink in terms of services
TRANSCODERECEIVE           & PUBLISH
TRANSCODERECEIVE                   & PUBLISH          QUEUE
AMAZON SQSSIMPLE QUEUE SERVICE
START  CHECK                                 REJECT           STOP  VIDEO                               YES               ...
MAINTENANCEAUDITABILITYFLEXIBILITYLOW-LEVEL
WHAT ARE WETRYING TO DO?
START  CHECK                                 REJECT           STOP  VIDEO                               YES               ...
START  CHECK                                 REJECT           STOP  VIDEO                               YES               ...
START  CHECK                                 REJECT           STOP  VIDEO                               YES               ...
TASKSDECISIONS   STATELESS ! HISTORY
STATELESS SCALES  HORIZONTALLY
AMAZON SWFWORKFLOW SERVICE FOR SCALABLE,    RESILIENT APPLICATIONS
AMAZON SWF  Keeps track of :   State   Executed tasks   Timeouts   Errors
WORKFLOWACTORS
DECIDERS     COORDINATION LOGIC1.   Poll for work on a decision list     Long polling: 60 seconds2.   Evaluate workflow ex...
WORKERS     COORDINATION LOGIC1.   Poll for work on a specific task list     Long polling: 60 seconds2.   Execute works, s...
ALLHORIZONTAL SCALING  PATTERNS APPLY
NO NEW LANGUAGE      TO LEARNYOUR CODE IS YOUR WORKFLOW LANGUAGE        SWF MAINTAINS STATE
AWS FLOW      FRAMEWORKJava Library • Entire workflow can be   expressed in sequential code •    Integrated with Java Util...
CHAINED TASKS          WITHOUT DECISIONS?RECEIVE         TRANSCODE      NOTIFY     use AMAZON SQS
TASK GRAPH            WITH DECISIONS?                         GOOD              OKRECEIVE        CHECK             SPAM   ...
#   4SECURITY  ●●●●○
AWS IAMIDENTITY AND ACCESS MANAGEMENT
MULTI-MULTI-FACTORAUTHENTICATION
SECURITY GROUPS    LAYERED SECURITY
CERTIFICATIONS& COMPLIANCE SAS 70 Type II audit ISO 27001 Certification Sarbanes-Oxley SOX HIPAA healthcare FISMA US ...
 PCI DSS Compliant  LEVEL 1 SERVICE PROVIDER
#   5PERFORMANCE    ●●●●●
VERTICALSCALING
CLUSTER COMPUTEEIGHT EXTRA LARGE   2x     Intel Xeon E5-2670, eight-core          Sandy Bridge architecture   60.5 GB of m...
CLUSTER GPUQUADRUPLE EXTRA LARGE          Intel Xeon X5570, quad-core    2x    Nehalem architecture       NVIDIA Tesla Fer...
AMAZONELASTICACHEMEMCACHED COMPATIBLE  IN-MEMORY CACHE
SEARCHENGINES
Relevance & Ranking
Faceting
RangeSearching
AMAZONCLOUDSEARCHFULLY-MANAGED SEARCH SERVICE
+
DEMOCRATIZE SEARCH Amazon CloudSearch delivers a fully-managed search service in the cloudthat can be set up and running i...
HTTP POST author=carlos;date=2012-06-07;   article=text;         …
MEDIA SHARINGREFERENCE ARCHITECTURE
HTTP POST author=carlos;date=2012-06-07;   article=text;         …  +
1.   ELASTICITY2.   DESIGN FOR FAILURE3.   LOOSE COUPLING4.   SECURITY5.   PERFORMANCE
« If youre not embarrassed when you ship  your first version you waited too long »                                   Matt ...
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Architecting for AWS
Upcoming SlideShare
Loading in …5
×

Architecting for AWS

13,612 views

Published on

Published in: Business, Technology
  • Dating for everyone is here: ♥♥♥ http://bit.ly/2Q98JRS ♥♥♥
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Sex in your area is here: ❶❶❶ http://bit.ly/2Q98JRS ❶❶❶
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD FULL BOOKS, INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y6a5rkg5 } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Excellent presentation
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Architecting for AWS

  1. 1. ARCHITECTING FOR AWSCarlos Conde │Solutions Architect
  2. 2. 1. ELASTICITY2. DESIGN FOR FAILURE3. LOOSE COUPLING4. SECURITY5. PERFORMANCE
  3. 3. # 1ELASTICITY ●○○○○
  4. 4. AMAZON EC2ELASTIC COMPUTE CLOUD
  5. 5. AMAZON CLOUDWATCHMONITORING FOR AWS RESOURCES
  6. 6. AUTO SCALINGSCALE UP/DOWN EC2 CAPACITY
  7. 7. ELASTIC LOAD BALANCINGNETWORK TRAFFIC DISTRIBUTION
  8. 8. 6 am
  9. 9. 10 am
  10. 10. 10 am
  11. 11. 10 am
  12. 12. 7 pm
  13. 13. 7 pm
  14. 14. 7 pm
  15. 15. without elasticity you cant accelerate
  16. 16. what you really need is… …adjustable capacity
  17. 17. # 2DESIGN FOR FAILURE ●●○○○
  18. 18. « Everything fails all the time » Werner Vogels CTO of Amazon
  19. 19. YOUR GOALApplications should continue to function even if the underlying physical hardware fails or is removed or replaced
  20. 20. Avoid single points of failure.Assume everything fails, and designbackwards.
  21. 21. Avoid single points of failure.Assume everything fails, and designbackwards.
  22. 22. AMAZON RDSRELATIONAL DATABASE SERVICE
  23. 23. AMAZONROUTE 53DOMAIN NAME SERVICE
  24. 24. AMAZON RDSMULTI-AZDEPLOYMENT
  25. 25. AMAZON CLOUDWATCH ALARMS
  26. 26. AWS BUILDING BLOCKSInherently Fault-Tolerant Services Fault-Tolerant with the right architecture Amazon S3  Elastic Load Balancing  Amazon EC2 Amazon SimpleDB  AWS IAM  Amazon EBS Amazon DynamoDB  AWS Elastic  Amazon RDS Amazon CloudFront Beanstalk Amazon SWF  Amazon VPC  Amazon Amazon SQS ElastiCache Amazon SNS  Amazon EMR Amazon SES  Amazon CloudSearch Amazon Route53
  27. 27. NETFLIXCHAOS MONKEY
  28. 28. # 3 LOOSECOUPLING ●●●○○
  29. 29. BUILD LOOSELYCOUPLED SYSTEMS The looser the are coupled, the bigger they scale
  30. 30. Create independent components
  31. 31. Create independent componentsDesign everything as a Black Box
  32. 32. Create independent componentsDesign everything as a Black BoxThink in terms of services
  33. 33. TRANSCODERECEIVE & PUBLISH
  34. 34. TRANSCODERECEIVE & PUBLISH QUEUE
  35. 35. AMAZON SQSSIMPLE QUEUE SERVICE
  36. 36. START CHECK REJECT STOP VIDEO YES NO TOO SPAM PUBLISH SPAM? LONG? CHECK & NOTIFYYES NO SHORTEN TRANSCODE VIDEO
  37. 37. MAINTENANCEAUDITABILITYFLEXIBILITYLOW-LEVEL
  38. 38. WHAT ARE WETRYING TO DO?
  39. 39. START CHECK REJECT STOP VIDEO YES NO TOO SPAM PUBLISH SPAM? LONG? CHECK & NOTIFYYES NO SHORTEN TRANSCODE VIDEO
  40. 40. START CHECK REJECT STOP VIDEO YES NO TOO SPAM PUBLISH SPAM? LONG? CHECK & NOTIFYYES NO SHORTEN TRANSCODE VIDEO
  41. 41. START CHECK REJECT STOP VIDEO YES NO TOO SPAM PUBLISH SPAM? LONG? CHECK & NOTIFYYES NO SHORTEN TRANSCODE VIDEO
  42. 42. TASKSDECISIONS STATELESS ! HISTORY
  43. 43. STATELESS SCALES HORIZONTALLY
  44. 44. AMAZON SWFWORKFLOW SERVICE FOR SCALABLE, RESILIENT APPLICATIONS
  45. 45. AMAZON SWF Keeps track of :  State  Executed tasks  Timeouts  Errors
  46. 46. WORKFLOWACTORS
  47. 47. DECIDERS COORDINATION LOGIC1. Poll for work on a decision list Long polling: 60 seconds2. Evaluate workflow execution history SWF sends full history in JSON format3. Return decision to Amazon SWF Usually scheduling another task
  48. 48. WORKERS COORDINATION LOGIC1. Poll for work on a specific task list Long polling: 60 seconds2. Execute works, send heartbeats SWF sends input data from deciders3. Return success / failure Detailed data can be provided to deciders
  49. 49. ALLHORIZONTAL SCALING PATTERNS APPLY
  50. 50. NO NEW LANGUAGE TO LEARNYOUR CODE IS YOUR WORKFLOW LANGUAGE SWF MAINTAINS STATE
  51. 51. AWS FLOW FRAMEWORKJava Library • Entire workflow can be expressed in sequential code • Integrated with Java Utils API
  52. 52. CHAINED TASKS WITHOUT DECISIONS?RECEIVE TRANSCODE NOTIFY use AMAZON SQS
  53. 53. TASK GRAPH WITH DECISIONS? GOOD OKRECEIVE CHECK SPAM TRANSCODE VIDEO LENGTH CHECK LONG SPAM SHORTEN PUBLISH REJECT VIDEO & NOTIFY use AMAZON SWF
  54. 54. # 4SECURITY ●●●●○
  55. 55. AWS IAMIDENTITY AND ACCESS MANAGEMENT
  56. 56. MULTI-MULTI-FACTORAUTHENTICATION
  57. 57. SECURITY GROUPS LAYERED SECURITY
  58. 58. CERTIFICATIONS& COMPLIANCE SAS 70 Type II audit ISO 27001 Certification Sarbanes-Oxley SOX HIPAA healthcare FISMA US Federal Government DIACAP MAC III Sensitive IATO
  59. 59.  PCI DSS Compliant LEVEL 1 SERVICE PROVIDER
  60. 60. # 5PERFORMANCE ●●●●●
  61. 61. VERTICALSCALING
  62. 62. CLUSTER COMPUTEEIGHT EXTRA LARGE 2x Intel Xeon E5-2670, eight-core Sandy Bridge architecture 60.5 GB of memory – 3.3 TB of storage
  63. 63. CLUSTER GPUQUADRUPLE EXTRA LARGE Intel Xeon X5570, quad-core 2x Nehalem architecture NVIDIA Tesla Fermi 2x M2050 GPUs 22 GB of memory – 1.7 TB of storage
  64. 64. AMAZONELASTICACHEMEMCACHED COMPATIBLE IN-MEMORY CACHE
  65. 65. SEARCHENGINES
  66. 66. Relevance & Ranking
  67. 67. Faceting
  68. 68. RangeSearching
  69. 69. AMAZONCLOUDSEARCHFULLY-MANAGED SEARCH SERVICE
  70. 70. +
  71. 71. DEMOCRATIZE SEARCH Amazon CloudSearch delivers a fully-managed search service in the cloudthat can be set up and running in less than 1 hour, with automatic scaling for data & traffic, at a price starting at less than $100 per month.
  72. 72. HTTP POST author=carlos;date=2012-06-07; article=text; …
  73. 73. MEDIA SHARINGREFERENCE ARCHITECTURE
  74. 74. HTTP POST author=carlos;date=2012-06-07; article=text; … +
  75. 75. 1. ELASTICITY2. DESIGN FOR FAILURE3. LOOSE COUPLING4. SECURITY5. PERFORMANCE
  76. 76. « If youre not embarrassed when you ship your first version you waited too long » Matt Mullenweg CEO & Founder of WordPress

×