Download to read offline
More Related Content
Similar to Modernizing DevOps
Modernizing DevOps
- 1. Modernizing DevOps onAWS Presented by Patrick Hannah VP of Engineering, CloudHesive
- 2. Introduction • Who amI? • What’s my background?
- 3. What are wegoing to talk about? • Overview • Newer AWS services to support your applications’ infrastructure architecture and your operations • Leveraging AWS services in lieu of home grown solutions • Conclusion
- 4. ALB, ELB, Route53 •ALB (Application Load Balancer) – Introduced Q3 2016 – Provisioned separately from ELB (but a migration tool is available) – Added support for WebSockets, HTTP/2, URI + Host Header based routing, ECS (multiple containers, different ports, etc.), per-port health checks and additional CloudWatch metrics. – Cheaper per ELB cost, but adds a per target cost (theory is that overall load balancing costs will decrease) – Integrates with AutoScaling, ECS, CloudFormation, CodeDeploy and ACM – Removes support for Non HTTP health checks and Application provided cookies – Eliminates some (but not all) use cases for NGINX (for example where a customer’s DNS server does not have CNAME support for Zone Apexes) • Route53 + Route53Health Checks – “Poor Mans ALB/ELB” – Ideal for use cases where ALB/ELB elasticity or active/passive failover is desired
- 5. ACM + Route53+ ALB • ACM, Route53 and ELB (or ELB or CloudFront) work well together to allow the creation of full stacks that can be securely accessed from the Internet (no more host files, SSL errors, etc.) • Create placeholder domains that your real domains point to, to ease migration efforts. • ACM = Free SSL Certificates (even though Let’s Encrypt does the same thing, it’s not as easy to implement), though ACM can only apply to ALB/ELB and CloudFront.
- 6. CloudFront • CloudFront costscan vary depending on the geographic local accessing the distributions. • For North American distributions, CloudFront costs are mitigated in the outbound bandwidth savings. • Consider third party CDNs (with fixed fees) if requests will originate primarily from South America, etc. where CloudFront outbound bandwidth costs are higher. • Even applications generating dynamic data benefit from CloudFront by minimizing the time to first byte (and providing HTTP/2.0 and IPv6 Support).
- 7. EFS, File Gateway,Block Storage, S3 • EFS – NFS based – Multi AZ – Pay as you go, more expensive than EBS, though – “Near Infinite” expansion – Now available on premise and through Direct Connect – Eliminates rolling your own NFS server • File Gateway – Instance based solution (geared towards on premise deployments. – NFS based – Backed by S3 – Eliminates S3FS • EBS vs. S3 – Newer EBS volumes compare in cost to S3 while providing block based storage, useful for applications which do not natively support S3
- 8. CloudWatch Events, CloudWatchMetrics • CloudWatch Events – Most services support either a combination of API Activity (CloudTrail) or State Change – Some also provide a mechanism to deliver events, though some services still leverage SNS instead (ElastiCache, RDS, etc.) – More interesting services include: • AutoScaling • EC2 • PHD • KMS • Trusted Advisor • SSM • CoudWatch Metrics – More interesting services include: • Billing • ALB (mentioned Earlier • Route53 – Poor Mans Endpoint Monitoring
- 9. SSM (f/k/a EC2Run Command) • Remotely (and securely) send commands to your Linux or Windows instances from the AWS Console or API • Integrate with CloudWatch Events and Lambda for a poor man’s self healing solution • Also supports Patch Management, State Management, Maintenance Windows and a Key/Value Store
- 10. Other Newer Services •Inspector – Agent based instance and application vulnerability scanning • X-Ray – Application Performance Monitoring • Cloud Directory – Multi-relational key/value store • Code/Commit/CodePipeline/CodeBuild/CodeDeploy – CI/CD/CM as-a-service
- 11. Conclusion and SomeAdvice • Most of these services amount to a few dollars a month – experiment and see what works for you!
- 12.
- 13. Further Learning • GettingStarted: https://aws.amazon.com/getting-started • General Reference: http://docs.aws.amazon.com/general/latest/gr • Global Infrastructure: https://aws.amazon.com/about-aws/global- infrastructure/ • FAQs: https://aws.amazon.com/faqs • Documentation: https://aws.amazon.com/documentation/ • Architecture: https://aws.amazon.com/architecture • Whitepapers: https://aws.amazon.com/whitepapers • Security: https://aws.amazon.com/security • Blog: https://aws.amazon.com/blogs • Service Specific Pages: https://aws.amazon.com/service • SlideShare: http://www.slideshare.net/AmazonWebServices • Github: https://github.com/aws and https://github.com/awslabs
- 14. Community (Meetups) • BocaRaton: https://www.meetup.com/awsflorida/ • Doral: https://www.meetup.com/AWSUserGroupDoral/ • Fort Lauderdale: https://www.meetup.com/South- Florida-Amazon-Web-Services-Meetup/ • Jacksonville: https://www.meetup.com/AWS-User- Groups-of-Florida-Jacksonville/ • Miami: https://www.meetup.com/aws-user-group- miami/ • Orlando: https://www.meetup.com/Orlando-AWS- Users-Group/ • Palm Beach Gardens: https://www.meetup.com/AWS- Users-Group-of-Florida-Palm-Beach-Gardens/ • Tampa: https://www.meetup.com/Tampa-AWS-Users- Group/
- 15.
- 16. Question 1 • Whatnew features does ALB offer?
- 17. Question 2 • Whatfeatures does ALB not offer?
- 18. Question 3 • Whywould you use CloudFront even though your site is comprised of mostly dynamic data?
- 19. Question 4 • Namea service that integrates with CloudWatch Events.
- 20. Question 5 • Namea service you would use to share storage across multiple instances.
Editor's Notes
- #3 Who are you? Patrick Hannah, CloudHesive (where I’m a co-founder and the VP of Engineering) What’s your background? Architecture, Security and Operations on AWS for 6 years, prior to that Contact Center Architecture and Operations for over 8 years. What do you hope to get out of the presentation? I want to help folks get as the same out of AWS as I have. I’d also like to see how others are using AWS – as with just about any thing in technology there are multiple ways to do something right (or wrong). How are you using cloud services? At CloudHesive, we provide consulting services to customers who wish to, or who are, leveraging AWS and we also use a number of AWS services to host our managed services customers (and the back-office systems supporting them). Why did you pick the cloud services that you are using? AWS is at the forefront of Cloud; their service catalog can support most traditional on-premise software use cases (infrastructure) but they also offer more abstracted services for software built on the cloud (such as SQS, which is one of my favorite) that negate the need to manage server infrastructure – on premise or on cloud. What about you?
- #9 Metric Description ChildHealthCheckHealthyCount For a calculated health check, the number of health checks that are healthy among the health checks that Amazon Route 53 is monitoring. Valid statistics: Average (recommended), Minimum, Maximum Units: Healthy health checks ConnectionTime The average time, in milliseconds, that it took Amazon Route 53 health checkers to establish a TCP connection with the endpoint. You can view ConnectionTimefor a health check either across all regions or for a selected geographic region. Valid statistics: Average (recommended), Minimum, Maximum Units: Milliseconds HealthCheckPercentageHealthy The percentage of Amazon Route 53 health checkers that consider the selected endpoint to be healthy. You can view HealthCheckPercentageHealthy only across all regions; data is not available for a selected region. Valid statistics: Average, Minimum, Maximum Units: Percent HealthCheckStatus The status of the health check endpoint that CloudWatch is checking. 1 indicates healthy, and 0 indicates unhealthy. You can view HealthCheckStatus only across all regions; data is not available for a selected region. Valid statistics: Minimum Units: none SSLHandshakeTime The average time, in milliseconds, that it took Amazon Route 53 health checkers to complete the SSL handshake. You can view SSLHandshakeTime for a health check either across all regions or for a selected geographic region. Valid statistics: Average (recommended), Minimum, Maximum Units: Milliseconds TimeToFirstByte The average time, in milliseconds, that it took Amazon Route 53 health checkers to receive the first byte of the response to an HTTP or HTTPS request. You can view TimeToFirstByte for a health check either across all regions or for a selected geographic region. Valid statistics: Average (recommended), Minimum, Maximum Units: Milliseconds Metric Description ActiveConnectionCount The total number of concurrent TCP connections active from clients to the load balancer and from the load balancer to targets. Statistics: The most useful statistic is Sum. ClientTLSNegotiationErrorCount The number of TLS connections initiated by the client that did not establish a session with the load balancer. Possible causes include a mismatch of ciphers or protocols. Statistics: The most useful statistic is Sum. HealthyHostCount The number of targets that are considered healthy. Statistics: The most useful statistics are Average, Minimum, and Maximum. HTTPCode_ELB_4XX_Count The number of HTTP 4XX client error codes that originate from the load balancer. Client errors are generated when requests are malformed or incomplete. These requests have not been received by the target. This count does not include any response codes generated by the targets. Statistics: The most useful statistic is Sum. Note that Minimum, Maximum, and Average all return 1. HTTPCode_ELB_5XX_Count The number of HTTP 5XX server error codes that originate from the load balancer. This count does not include any response codes generated by the targets. Statistics: The most useful statistic is Sum. Note that Minimum, Maximum, and Average all return 1. HTTPCode_Target_2XX_Count,HTTPCode_Target_3XX_Count,HTTPCode_Target_4XX_Count,HTTPCode_Target_5XX_Count The number of HTTP response codes generated by the targets. This does not include any response codes generated by the load balancer. Statistics: The most useful statistic is Sum. Note that Minimum, Maximum, and Average all return 1. IPv6ProcessedBytes The total number of bytes processed by the load balancer over IPv6. Statistics: The most useful statistic is Sum. IPv6RequestCount The number of IPv6 requests received by the load balancer. Statistics: The most useful statistic is Sum. Note that Minimum, Maximum, and Average all return 1. NewConnectionCount The total number of new TCP connections established from clients to the load balancer and from the load balancer to targets. Statistics: The most useful statistic is Sum. ProcessedBytes The total number of bytes processed by the load balancer over IPv4 and IPv6. Statistics: The most useful statistic is Sum. RejectedConnectionCount The number of connections that were rejected because the load balancer had reached its maximum number of connections. Statistics: The most useful statistic is Sum. RequestCount The number of requests received by the load balancer. This includes requests over IPv4 and IPv6. Statistics: The most useful statistic is Sum. Note that Minimum, Maximum, and Average all return 1. RulesEvaluated The number of rules processed by the load balancer given a request rate averaged over an hour. Statistics: The most useful statistic is Sum. TargetConnectionErrorCount The number of connections that were not successfully established between the load balancer and target. Statistics: The most useful statistic is Sum. TargetResponseTime The time elapsed, in seconds, after the request leaves the load balancer until a response from the target is received. This is equivalent to thetarget_processing_time field in the access logs. Statistics: The most useful statistics are Average and pNN.NN (percentiles). TargetTLSNegotiationErrorCount The number of TLS connections initiated by the load balancer that did not establish a session with the target. Possible causes include a mismatch of ciphers or protocols. Statistics: The most useful statistic is Sum. UnHealthyHostCount The number of targets that are considered unhealthy. Statistics: The most useful statistics are Average, Minimum, and Maximum. Metric Description EstimatedCharges The estimated charges for your AWS usage. This can either be estimated charges for one service or a roll-up of estimated charges for all services.
- #14 Each service has it’s own site and set of documentation The SlideShare presentations can be an invaluable resource when it comes to diving into the details The GitHub repositories have excellent examples of applications you can build on AWS