This document provides an overview of the key topics to be covered in a session about Amazon ElastiCache, including an overview of ElastiCache and Redis, best practices for scaling clusters, security and encryption, usage patterns, and questions. Specific topics that will be discussed are scaling clusters with online re-sharding, security and encryption options in ElastiCache, and various usage patterns and best practices.
by Mike Labib, In-Memory NoSQL Solutions Architect, AWS
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way. Level: 200 (requires understanding of database services)
URP? Excuse You! The Three Kafka Metrics You Need to KnowTodd Palino
What do you really know about how to monitor a Kafka cluster for problems? Is your most reliable monitoring your users telling you there’s something broken? Are you capturing more metrics than the actual data being produced? Sure, we all know how to monitor disk and network, but when it comes to the state of the brokers, many of us are still unsure of which metrics we should be watching, and what their patterns mean for the state of the cluster. Kafka has hundreds of measurements, from the high-level numbers that are often meaningless to the per-partition metrics that stack up by the thousands as our data grows.
We will thoroughly explore three key monitoring concepts in the broker, that will leave you an expert in identifying problems with the least amount of pain:
Under-replicated Partitions: The mother of all metrics
Request Latencies: Why your users complain
Thread pool utilization: How could 80% be a problem?
We will also discuss the necessity of availability monitoring and how to use it to get a true picture of what your users see, before they come beating down your door!
by Mikhail Prudnikov, Sr. Solutions Architect, AWS
Redis is an open source, in-memory data store that delivers sub-millisecond response times enabling millions of requests per second to power real-time applications. It can be used as a fast database, cache, message broker, and queue. Amazon ElastiCache delivers the ease-of-use and power of Redis along with the availability, reliability, scalability, security, and performance suitable for the most demanding applications. We’ll take a close look at Redis and how to use it to power different use cases.
Redis is an open source, in-memory data store that delivers sub-millisecond response times enabling millions of requests per second to power real-time applications. It can be used as a fast database, cache, message broker, and queue. Amazon ElastiCache delivers the ease-of-use and power of Redis along with the availability, reliability, scalability, security, and performance suitable for the most demanding applications. We’ll take a close look at Redis and how to use it to power different use cases.
Speaker: Samir Karande - Sr. Manager, Solutions Architecture, AWS
This document provides an overview of the technical architecture for an e-commerce website hosted on AWS. It includes DNS resolution with Route 53, content delivery with CloudFront, databases like DynamoDB and RDS, services for workflow, caching, storage, analytics processing, email delivery, and auto-scaling of application components. The website consists of three main services - a front-end catalog, checkout functionality, and marketing/recommendations. Analytics are performed via EMR and stored in S3.
How to Set Up a Cloud Cost Optimization Process for your EnterpriseRightScale
As cloud spend grows, enterprises need to set up internal processes to manage and optimize their cloud costs. This process will help organizations to accurately allocate and report on costs while minimizing wasted spend. In this webinar, experts from RightScale’s Cloud Cost Optimization team will share best practices in how to set up your own internal processes.
by Mike Labib, In-Memory NoSQL Solutions Architect, AWS
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way. Level: 200 (requires understanding of database services)
URP? Excuse You! The Three Kafka Metrics You Need to KnowTodd Palino
What do you really know about how to monitor a Kafka cluster for problems? Is your most reliable monitoring your users telling you there’s something broken? Are you capturing more metrics than the actual data being produced? Sure, we all know how to monitor disk and network, but when it comes to the state of the brokers, many of us are still unsure of which metrics we should be watching, and what their patterns mean for the state of the cluster. Kafka has hundreds of measurements, from the high-level numbers that are often meaningless to the per-partition metrics that stack up by the thousands as our data grows.
We will thoroughly explore three key monitoring concepts in the broker, that will leave you an expert in identifying problems with the least amount of pain:
Under-replicated Partitions: The mother of all metrics
Request Latencies: Why your users complain
Thread pool utilization: How could 80% be a problem?
We will also discuss the necessity of availability monitoring and how to use it to get a true picture of what your users see, before they come beating down your door!
by Mikhail Prudnikov, Sr. Solutions Architect, AWS
Redis is an open source, in-memory data store that delivers sub-millisecond response times enabling millions of requests per second to power real-time applications. It can be used as a fast database, cache, message broker, and queue. Amazon ElastiCache delivers the ease-of-use and power of Redis along with the availability, reliability, scalability, security, and performance suitable for the most demanding applications. We’ll take a close look at Redis and how to use it to power different use cases.
Redis is an open source, in-memory data store that delivers sub-millisecond response times enabling millions of requests per second to power real-time applications. It can be used as a fast database, cache, message broker, and queue. Amazon ElastiCache delivers the ease-of-use and power of Redis along with the availability, reliability, scalability, security, and performance suitable for the most demanding applications. We’ll take a close look at Redis and how to use it to power different use cases.
Speaker: Samir Karande - Sr. Manager, Solutions Architecture, AWS
This document provides an overview of the technical architecture for an e-commerce website hosted on AWS. It includes DNS resolution with Route 53, content delivery with CloudFront, databases like DynamoDB and RDS, services for workflow, caching, storage, analytics processing, email delivery, and auto-scaling of application components. The website consists of three main services - a front-end catalog, checkout functionality, and marketing/recommendations. Analytics are performed via EMR and stored in S3.
How to Set Up a Cloud Cost Optimization Process for your EnterpriseRightScale
As cloud spend grows, enterprises need to set up internal processes to manage and optimize their cloud costs. This process will help organizations to accurately allocate and report on costs while minimizing wasted spend. In this webinar, experts from RightScale’s Cloud Cost Optimization team will share best practices in how to set up your own internal processes.
Redis is an in-memory key-value store that is often used as a database, cache, and message broker. It supports various data structures like strings, hashes, lists, sets, and sorted sets. While data is stored in memory for fast access, Redis can also persist data to disk. It is widely used by companies like GitHub, Craigslist, and Engine Yard to power applications with high performance needs.
Learning Objectives:
- Learn how to make decisions about the service and share best practices and useful tips for success
- Learn about Content based routing, HTTP/2, WebSockets
- Secure your web applications using TLS termination, AWS WAF on Application Load Balancer
In this session we will explore the world’s first cloud-scale file system and its targeted use cases. Session attendees will learn about EFS’s benefits, how to identify applications that are appropriate for use with EFS, and details about its performance and security models. The target audience is file system administrators, application developers, and application owners that operate or build file-based applications.
Amazon Elastic Container Service for Kubernetes (Amazon EKS) is an upcoming managed service for running Kubernetes on AWS. This session will provide an overview of Amazon EKS, why we built it, and how it works.
AWS re:Invent 2016: Workshop: Choose Your Own SAML Adventure: A Self-Directed...Amazon Web Services
AWS supports identity federation using SAML (Security Assertion Markup Language) 2.0. Using SAML, you can configure your AWS accounts to integrate with your identity provider (IdP). Your federated users then are authenticated and authorized by your organization's IdP, and they can use single sign-on (SSO) to access AWS.
In this workshop, you choose your own path through the exercises to direct yourself to the technologies and use cases that matter to you. We start by guiding you through deploying an IdP and configuring SAML federation for AWS, including federated CLI access. We will then continue to walk you through a number of advanced SAML use cases, including how to:
Write S3 bucket policies for specific federated users.
Use SAML attributes to enforce additional authorization requirements.
Automate federation configurations across a large number of AWS accounts.
Implement other advanced SAML use cases for AWS.
This presentation provides an overview of Amazon Elastic Block Store (EBS) and key performance concepts. EBS provides persistent block level storage volumes for use with EC2 instances. It discusses the different volume types (standard and provisioned IOPS), factors that impact performance like block size and queue depth, and best practices for architecting storage for performance and availability. The presentation also provides examples of how enterprises and applications use EBS and guidelines for minimum, production and large-scale usage.
Migrating Your Databases to AWS - Deep Dive on Amazon RDS and AWS Database Mi...Amazon Web Services
The document discusses migrating databases to AWS using Amazon Relational Database Service (RDS) and AWS Database Migration Service (DMS). It outlines that RDS provides a managed relational database service and discusses engines, availability, scaling, backups and security. It then discusses DMS for migrating or replicating databases to AWS targets like RDS and Redshift. The Schema Conversion Tool is also covered for converting schemas during migrations. Real customer examples like Expedia migrating from SQL Server to AWS are provided to illustrate use cases.
Apache Kafka becoming the message bus to transfer huge volumes of data from various sources into Hadoop.
It's also enabling many real-time system frameworks and use cases.
Managing and building clients around Apache Kafka can be challenging. In this talk, we will go through the best practices in deploying Apache Kafka
in production. How to Secure a Kafka Cluster, How to pick topic-partitions and upgrading to newer versions. Migrating to new Kafka Producer and Consumer API.
Also talk about the best practices involved in running a producer/consumer.
In Kafka 0.9 release, we’ve added SSL wire encryption, SASL/Kerberos for user authentication, and pluggable authorization. Now Kafka allows authentication of users, access control on who can read and write to a Kafka topic. Apache Ranger also uses pluggable authorization mechanism to centralize security for Kafka and other Hadoop ecosystem projects.
We will showcase open sourced Kafka REST API and an Admin UI that will help users in creating topics, re-assign partitions, Issuing
Kafka ACLs and monitoring Consumer offsets.
Scaling production grade EKS Multi-Cluster environments using GitOpsCarlos Santana
Learn how to manage and scale productive ArgoCD deployments in a multi cluster environment easily and securely using GitOps patterns. We will present the deployment of applications across multiple Kubernetes clusters on various public, private, on-premises and explore the best practices for scaling and managing highly available, reliable and secure applications. We will also demonstrate how you can structure your Git repositories to share and scale within your teams and organization in order to deploy your cloud native deployments in an automatic and predictive way.
The document discusses Amazon Web Services (AWS) machine learning capabilities. It provides an overview of the AWS ML stack, which offers the broadest and most complete set of machine learning capabilities across vision, speech, text, search, chatbots, personalization, forecasting, fraud detection, and more. It also discusses several specific AWS machine learning services, including Amazon Rekognition (image and video analysis), Amazon Fraud Detector (online fraud detection), Amazon Kendra (enterprise search), Amazon CodeGuru (automated code reviews and profiling), and Contact Lens for Amazon Connect (contact center analytics).
This document provides an introduction to Amazon Aurora, AWS's managed relational database service. It discusses how Aurora was built to provide the speed and availability of commercial databases at the simplicity and cost-effectiveness of open source databases. The document outlines key Aurora features like automatic scaling, continuous backups, replication across Availability Zones, and integration with other AWS services. Customer case studies show how Aurora provides better performance at lower costs than alternative database options. The document also covers migration options and how Aurora offers a simpler, more cost-effective database solution than on-premises or self-managed options.
This presentation will show you overview of Google Cloud Service and show step-by-step example with Wordpress to introduce each service on GCP
Google Cloud Study Jam Bangkok 2019 #1 and #2 at ITKMITL and CPE KU on October 19-20, 2019
AWS Security Best Practices in a Zero Trust Security Model - DEM08 - Toronto ...Amazon Web Services
Zero trust security is quickly rising as a preferred alternative to traditional security approaches. The key enabling technology underlying the zero trust security approach is next-gen access which combines the critical capabilities of such technologies as identity as a service (IDaaS), enterprise mobility management (EMM), and privileged access management (PAM). In this session, we highlight AWS security best practices in a zero trust security model. Specifically, we explore securing the AWS root account, controlling access to the AWS Management Console, and the AWS Command Line Interface, and managing developer access to Amazon EC2 instances and containerized applications that run on them.
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Amazon Web Services
The AWS Global Network provides a secure, highly available, and high- performance infrastructure for customers. In this session, we walk through the architecture of various parts of the AWS network such as Availability Zones, AWS Regions, our Global Network connecting AWS Regions to each other and our Edge Network which provides Internet connectivity. We explain how AWS services such as AWS Direct Connect and Amazon CloudFront integrate with our Global Network to provide the best experience for our customers. We also dive into how the AWS Global Network connects to the rest of the Internet through peering at a global scale. If you are curious about how AWS network infrastructure can support large-scale cat photo distribution or how Internet routing works, this session answers those questions. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.
This document provides an overview of AWS multi-account architecture best practices and strategies for implementing a "landing zone" on AWS. It discusses setting up accounts for master, core services, shared services, development sandboxes, and team/group environments. The document then outlines steps for implementing a landing zone using the AWS Landing Zone solution, including setting up accounts for shared services, log archives, security and establishing baselines across team accounts.
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way.
Scaling Redis Workloads with Amazon ElastiCache - AWS Online Tech TalksAmazon Web Services
This document provides an overview and best practices for scaling Redis workloads with Amazon ElastiCache. It discusses:
- Amazon ElastiCache features like Redis and Memcached support, high performance, availability, and security.
- Redis cluster mode and how it provides automatic sharding and horizontal scaling.
- How to perform online resharding of Redis clusters with ElastiCache to scale without downtime.
- Common usage patterns for ElastiCache like caching, session management, and pub/sub.
Redis is an in-memory key-value store that is often used as a database, cache, and message broker. It supports various data structures like strings, hashes, lists, sets, and sorted sets. While data is stored in memory for fast access, Redis can also persist data to disk. It is widely used by companies like GitHub, Craigslist, and Engine Yard to power applications with high performance needs.
Learning Objectives:
- Learn how to make decisions about the service and share best practices and useful tips for success
- Learn about Content based routing, HTTP/2, WebSockets
- Secure your web applications using TLS termination, AWS WAF on Application Load Balancer
In this session we will explore the world’s first cloud-scale file system and its targeted use cases. Session attendees will learn about EFS’s benefits, how to identify applications that are appropriate for use with EFS, and details about its performance and security models. The target audience is file system administrators, application developers, and application owners that operate or build file-based applications.
Amazon Elastic Container Service for Kubernetes (Amazon EKS) is an upcoming managed service for running Kubernetes on AWS. This session will provide an overview of Amazon EKS, why we built it, and how it works.
AWS re:Invent 2016: Workshop: Choose Your Own SAML Adventure: A Self-Directed...Amazon Web Services
AWS supports identity federation using SAML (Security Assertion Markup Language) 2.0. Using SAML, you can configure your AWS accounts to integrate with your identity provider (IdP). Your federated users then are authenticated and authorized by your organization's IdP, and they can use single sign-on (SSO) to access AWS.
In this workshop, you choose your own path through the exercises to direct yourself to the technologies and use cases that matter to you. We start by guiding you through deploying an IdP and configuring SAML federation for AWS, including federated CLI access. We will then continue to walk you through a number of advanced SAML use cases, including how to:
Write S3 bucket policies for specific federated users.
Use SAML attributes to enforce additional authorization requirements.
Automate federation configurations across a large number of AWS accounts.
Implement other advanced SAML use cases for AWS.
This presentation provides an overview of Amazon Elastic Block Store (EBS) and key performance concepts. EBS provides persistent block level storage volumes for use with EC2 instances. It discusses the different volume types (standard and provisioned IOPS), factors that impact performance like block size and queue depth, and best practices for architecting storage for performance and availability. The presentation also provides examples of how enterprises and applications use EBS and guidelines for minimum, production and large-scale usage.
Migrating Your Databases to AWS - Deep Dive on Amazon RDS and AWS Database Mi...Amazon Web Services
The document discusses migrating databases to AWS using Amazon Relational Database Service (RDS) and AWS Database Migration Service (DMS). It outlines that RDS provides a managed relational database service and discusses engines, availability, scaling, backups and security. It then discusses DMS for migrating or replicating databases to AWS targets like RDS and Redshift. The Schema Conversion Tool is also covered for converting schemas during migrations. Real customer examples like Expedia migrating from SQL Server to AWS are provided to illustrate use cases.
Apache Kafka becoming the message bus to transfer huge volumes of data from various sources into Hadoop.
It's also enabling many real-time system frameworks and use cases.
Managing and building clients around Apache Kafka can be challenging. In this talk, we will go through the best practices in deploying Apache Kafka
in production. How to Secure a Kafka Cluster, How to pick topic-partitions and upgrading to newer versions. Migrating to new Kafka Producer and Consumer API.
Also talk about the best practices involved in running a producer/consumer.
In Kafka 0.9 release, we’ve added SSL wire encryption, SASL/Kerberos for user authentication, and pluggable authorization. Now Kafka allows authentication of users, access control on who can read and write to a Kafka topic. Apache Ranger also uses pluggable authorization mechanism to centralize security for Kafka and other Hadoop ecosystem projects.
We will showcase open sourced Kafka REST API and an Admin UI that will help users in creating topics, re-assign partitions, Issuing
Kafka ACLs and monitoring Consumer offsets.
Scaling production grade EKS Multi-Cluster environments using GitOpsCarlos Santana
Learn how to manage and scale productive ArgoCD deployments in a multi cluster environment easily and securely using GitOps patterns. We will present the deployment of applications across multiple Kubernetes clusters on various public, private, on-premises and explore the best practices for scaling and managing highly available, reliable and secure applications. We will also demonstrate how you can structure your Git repositories to share and scale within your teams and organization in order to deploy your cloud native deployments in an automatic and predictive way.
The document discusses Amazon Web Services (AWS) machine learning capabilities. It provides an overview of the AWS ML stack, which offers the broadest and most complete set of machine learning capabilities across vision, speech, text, search, chatbots, personalization, forecasting, fraud detection, and more. It also discusses several specific AWS machine learning services, including Amazon Rekognition (image and video analysis), Amazon Fraud Detector (online fraud detection), Amazon Kendra (enterprise search), Amazon CodeGuru (automated code reviews and profiling), and Contact Lens for Amazon Connect (contact center analytics).
This document provides an introduction to Amazon Aurora, AWS's managed relational database service. It discusses how Aurora was built to provide the speed and availability of commercial databases at the simplicity and cost-effectiveness of open source databases. The document outlines key Aurora features like automatic scaling, continuous backups, replication across Availability Zones, and integration with other AWS services. Customer case studies show how Aurora provides better performance at lower costs than alternative database options. The document also covers migration options and how Aurora offers a simpler, more cost-effective database solution than on-premises or self-managed options.
This presentation will show you overview of Google Cloud Service and show step-by-step example with Wordpress to introduce each service on GCP
Google Cloud Study Jam Bangkok 2019 #1 and #2 at ITKMITL and CPE KU on October 19-20, 2019
AWS Security Best Practices in a Zero Trust Security Model - DEM08 - Toronto ...Amazon Web Services
Zero trust security is quickly rising as a preferred alternative to traditional security approaches. The key enabling technology underlying the zero trust security approach is next-gen access which combines the critical capabilities of such technologies as identity as a service (IDaaS), enterprise mobility management (EMM), and privileged access management (PAM). In this session, we highlight AWS security best practices in a zero trust security model. Specifically, we explore securing the AWS root account, controlling access to the AWS Management Console, and the AWS Command Line Interface, and managing developer access to Amazon EC2 instances and containerized applications that run on them.
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Amazon Web Services
The AWS Global Network provides a secure, highly available, and high- performance infrastructure for customers. In this session, we walk through the architecture of various parts of the AWS network such as Availability Zones, AWS Regions, our Global Network connecting AWS Regions to each other and our Edge Network which provides Internet connectivity. We explain how AWS services such as AWS Direct Connect and Amazon CloudFront integrate with our Global Network to provide the best experience for our customers. We also dive into how the AWS Global Network connects to the rest of the Internet through peering at a global scale. If you are curious about how AWS network infrastructure can support large-scale cat photo distribution or how Internet routing works, this session answers those questions. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.
This document provides an overview of AWS multi-account architecture best practices and strategies for implementing a "landing zone" on AWS. It discusses setting up accounts for master, core services, shared services, development sandboxes, and team/group environments. The document then outlines steps for implementing a landing zone using the AWS Landing Zone solution, including setting up accounts for shared services, log archives, security and establishing baselines across team accounts.
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way.
Scaling Redis Workloads with Amazon ElastiCache - AWS Online Tech TalksAmazon Web Services
This document provides an overview and best practices for scaling Redis workloads with Amazon ElastiCache. It discusses:
- Amazon ElastiCache features like Redis and Memcached support, high performance, availability, and security.
- Redis cluster mode and how it provides automatic sharding and horizontal scaling.
- How to perform online resharding of Redis clusters with ElastiCache to scale without downtime.
- Common usage patterns for ElastiCache like caching, session management, and pub/sub.
This document provides an overview and summary of a session on working with Amazon ElastiCache for Redis. The session covers an introduction to Amazon ElastiCache and Redis, best practices and caching strategies when using ElastiCache, and hands-on workshops on performance testing and using ElastiCache for Redis. It also discusses Redis cluster mode, resizing and failure recovery strategies for ElastiCache clusters, and common usage patterns such as caching, processing streaming data, and powering mobile and IoT applications with ElastiCache.
The document discusses Amazon ElastiCache and Redis. It provides an overview of ElastiCache and Redis capabilities including:
1) ElastiCache is a fully managed in-memory data store that supports Redis and Memcached. It provides high performance with zero administration.
2) Redis is an open source in-memory data structure store that can be used for caching, messaging, and more. It supports data structures like strings, hashes, lists and more with atomic operations and optional persistence.
3) Examples of using Redis with ElastiCache include caching, real-time leaderboards, throttling API requests, and more. Redis capabilities like pub/sub and geospatial queries are also discussed
by Jeff Duffy, Database Specialist Solutions Architect, AWS
Database Week at the AWS Loft is an opportunity to learn about Amazon’s broad and deep family of managed database services. These services provide easy, scalable, reliable, and cost-effective ways to manage your data in the cloud. We explain the fundamentals and take a technical deep dive into Amazon RDS and Amazon Aurora relational databases, Amazon DynamoDB non-relational databases, Amazon Neptune graph databases, and Amazon ElastiCache managed Redis, along with options for database migration, caching, search and more. You'll will learn how to get started, how to support applications, and how to scale.
RedisConf17 - Turbo-charge your apps with Amazon Elasticache for RedisRedis Labs
This document provides an overview and summary of Amazon ElastiCache for Redis. It discusses the key features of ElastiCache including easy deployment and monitoring, enhanced Redis engine capabilities, high availability, cost effectiveness, and integration with other AWS services. It also covers usage patterns such as database caching, streaming data processing, and building real-time apps. Finally, it discusses best practices for building resilient architectures on ElastiCache including reference architectures, failure scenarios, and open source contributions from AWS.
Amazon Elasticache Deep Dive - March 2017 AWS Online Tech TalksAmazon Web Services
Amazon ElastiCache is a web service that makes it easy to deploy, operate, and scale an in-memory data store or cache in the cloud. The service improves the performance of web applications by allowing you to retrieve information from fast, managed, in-memory data stores, instead of relying entirely on slower disk-based databases. In this tech talk, we’ll provide a peek behind the scenes to learn about Amazon ElastiCache's design and architecture. You’ll see common design patterns with our Redis and Memcached offerings and how customers have used them for in-memory operations to reduce latency and improve application throughput. During this session, we review ElastiCache best practices, design patterns, and anti-patterns.
Learning Objectives:
- Learn how to integrate Amazon ElastiCache in your workloads
- Understand the benefits of an In-Memory data store
- Learn how to apply various caching strategies in your applications
- Hands on demonstration using Amazon ElastiCache
ElastiCache Deep Dive: Best Practices and Usage Patterns - March 2017 AWS Onl...Amazon Web Services
Amazon ElastiCache is a web service that makes it easy to deploy, operate, and scale an in-memory data store or cache in the cloud. The service improves the performance of web applications by allowing you to retrieve information from fast, managed, in-memory data stores, instead of relying entirely on slower disk-based databases. In this tech talk, we’ll provide a peek behind the scenes to learn about Amazon ElastiCache's design and architecture. You’ll see common design patterns with our Redis and Memcached offerings and how customers have used them for in-memory operations to reduce latency and improve application throughput. During this session, we review ElastiCache best practices, design patterns, and anti-patterns.
Learning Objectives:
- Learn how to integrate Amazon ElastiCache in your workloads
- Understand the benefits of an In-Memory data store
- Learn how to apply various caching strategies in your applications
- Hands on demonstration using Amazon ElastiCache
The document discusses Amazon ElastiCache and Redis. It provides information on Redis features like data structures, commands, scripting and clustering. It describes how ElastiCache can be used for caching with databases like DynamoDB and Elasticsearch to improve performance. It also discusses high availability, security features and online resharding with ElastiCache.
ElastiCache: Deep Dive Best Practices and Usage Patterns - AWS Online Tech TalksAmazon Web Services
This document provides an overview of Amazon ElastiCache and discusses best practices and usage patterns. It describes how ElastiCache provides fully managed, in-memory caching for internet-scale applications using Redis or Memcached. Examples of common usage patterns are discussed, such as caching, real-time analytics, gaming leaderboards, and geospatial applications. Customer examples from BBC and Expedia are also presented that discuss how they leverage ElastiCache.
Hands-On with Amazon ElastiCache for Redis - Workshop (DAT309-R1) - AWS re:In...Amazon Web Services
In-memory services, such as Amazon ElastiCache for Redis, provide a number of tools to accelerate application and database performance. In this workshop, we explore those tools and features and dive deep into Redis, the ElastiCache API, and the common architecture patterns for which we see customers using in-memory services. Gain hands-on experience launching a Redis cluster through AWS CloudFormation, updating the cluster through the CLI, and working with Redis data structures.
(BDT208) A Technical Introduction to Amazon Elastic MapReduceAmazon Web Services
"Amazon EMR provides a managed framework which makes it easy, cost effective, and secure to run data processing frameworks such as Apache Hadoop, Apache Spark, and Presto on AWS. In this session, you learn the key design principles behind running these frameworks on the cloud and the feature set that Amazon EMR offers. We discuss the benefits of decoupling compute and storage and strategies to take advantage of the scale and the parallelism that the cloud offers, while lowering costs. Additionally, you hear from AOL’s Senior Software Engineer on how they used these strategies to migrate their Hadoop workloads to the AWS cloud and lessons learned along the way.
In this session, you learn the benefits of decoupling storage and compute and allowing them to scale independently; how to run Hadoop, Spark, Presto and other supported Hadoop Applications on Amazon EMR; how to use Amazon S3 as a persistent data-store and process data directly from Amazon S3; dDeployment strategies and how to avoid common mistakes when deploying at scale; and how to use Spot instances to scale your transient infrastructure effectively."
ElastiCache Deep Dive: Design Patterns for In-Memory Data Stores (DAT302-R1) ...Amazon Web Services
In this session, we provide a behind the scenes peek to learn about the design and architecture of Amazon ElastiCache. See common design patterns with our Redis and Memcached offerings and how customers use them for in-memory data processing to reduce latency and improve application throughput. We review ElastiCache best practices, design patterns, and anti-patterns.
This session covers how the team at Ubisoft evolved For Honor's infrastructure using Amazon ECS and supporting systems (Amazon CloudFront, Amazon ElastiCache, Amazon Elasticsearch Service, Amazon SQS, and AWS Lambda, with monitoring through DataDog) from a proof of concept to an infrastructure as code solution. The team shares war stories about supporting both internal and live environments, and the challenges of bridging cloud and on-premises systems.
AWS provides a wide set of services to manage your data, which allow our customers to choose the right tool to the right workload. Learn how to make your databases up to 10x faster and less expensive with Amazon ElastiCache for Redis and utilize DynamoDB Accelerator (DAX) to access your data on DynamoDB faster with no additional development efforts. If you need fast access to your data, these services might be the right services for your workload.
Using Databases and Containers From Development to DeploymentAerospike, Inc.
This document discusses using containers and databases together from development to production. It addresses challenges like data redundancy, dynamic cluster formation and healing when containers start and stop. It proposes that existing architectures are broken and presents Aerospike as a solution, being self-organizing, self-healing and optimized for flash storage. It demonstrates building an app with Python, Aerospike and Docker, deploying to a Swarm cluster, and scaling the database and web tiers through containers.
This document discusses using containers and databases together from development to production. It addresses challenges like data redundancy, dynamic cluster formation and healing when containers start and stop. It proposes that Aerospike database combined with containers can provide data persistence, scalability, self-organization and efficient resource utilization to meet these challenges. Examples are given of building an app with Python, Aerospike and Docker Compose in development and deploying it to production behind HAProxy, including scaling the web tier and Aerospike cluster using Docker networking and the Interlock plugin.
The document provides an overview of Amazon Aurora, a managed relational database service from AWS. Some key points:
- Aurora is optimized for high performance and availability and is compatible with MySQL and PostgreSQL. It uses a distributed, fault-tolerant storage system and automatically handles administrative tasks.
- Aurora leverages other AWS services like Lambda, S3, IAM and CloudWatch. Its scale-out architecture provides high throughput and its asynchronous replication enables quick failover.
- Performance monitoring tools like Performance Insights help users analyze database load and identify bottlenecks. Recent innovations improve availability further with features like zero downtime patching and database cloning.
Architecting SAP on Amazon Web Services - SVC216 - Chicago AWS SummitAmazon Web Services
In this session, meet SAP-on-AWS experts to discuss what it takes to implement an SAP landscape on AWS. Starting with a typical customer requirement and sizing, we talk through the process involved in choosing the right organization and procedures to deploy SAP on AWS, from compute configurations and storage to security, management, and monitoring.
STG330_Case Study How Experian Leverages Amazon EC2, EBS, and S3 with Clouder...Amazon Web Services
Experian gathers, analyzes, and processes credit data at massive scale to help businesses make smarter decisions, individuals gain access to financial services, and lenders to minimize risk. The company built its petabyte-scale data-ingestion and analytics solution using CDH (Cloudera Distribution Including Apache Hadoop) running on Amazon EC2, with data stored in Amazon EBS and Amazon S3. This next generation big data platform aims to improve the data accuracy by moving away from traditional batch uploads to a real-time API-based ingestion process. In this talk, you will learn how Experian has leveraged different AWS compute and storage services for agility and quicker time to market. We will discuss lessons learned and best practices for success throughout.
Similar to DAT305_Amazon ElastiCache Deep Dive (20)
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
1) The document discusses building a minimum viable product (MVP) using Amazon Web Services (AWS).
2) It provides an example of an MVP for an omni-channel messenger platform that was built from 2017 to connect ecommerce stores to customers via web chat, Facebook Messenger, WhatsApp, and other channels.
3) The founder discusses how they started with an MVP in 2017 with 200 ecommerce stores in Hong Kong and Taiwan, and have since expanded to over 5000 clients across Southeast Asia using AWS for scaling.
This document discusses pitch decks and fundraising materials. It explains that venture capitalists will typically spend only 3 minutes and 44 seconds reviewing a pitch deck. Therefore, the deck needs to tell a compelling story to grab their attention. It also provides tips on tailoring different types of decks for different purposes, such as creating a concise 1-2 page teaser, a presentation deck for pitching in-person, and a more detailed read-only or fundraising deck. The document stresses the importance of including key information like the problem, solution, product, traction, market size, plans, team, and ask.
This document discusses building serverless web applications using AWS services like API Gateway, Lambda, DynamoDB, S3 and Amplify. It provides an overview of each service and how they can work together to create a scalable, secure and cost-effective serverless application stack without having to manage servers or infrastructure. Key services covered include API Gateway for hosting APIs, Lambda for backend logic, DynamoDB for database needs, S3 for static content, and Amplify for frontend hosting and continuous deployment.
This document provides tips for fundraising from startup founders Roland Yau and Sze Lok Chan. It discusses generating competition to create urgency for investors, fundraising in parallel rather than sequentially, having a clear fundraising narrative focused on what you do and why it's compelling, and prioritizing relationships with people over firms. It also notes how the pandemic has changed fundraising, with examples of deals done virtually during this time. The tips emphasize being fully prepared before fundraising and cultivating connections with investors in advance.
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
This document discusses Amazon's machine learning services for building conversational interfaces and extracting insights from unstructured text and audio. It describes Amazon Lex for creating chatbots, Amazon Comprehend for natural language processing tasks like entity extraction and sentiment analysis, and how they can be used together for applications like intelligent call centers and content analysis. Pre-trained APIs simplify adding machine learning to apps without requiring ML expertise.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
5. Request rate
High Low
Latency
Low High
Structure
Low
High
Data volume
Low High
Amazon
RDS
Amazon S3
Amazon
Glacier
Amazon
CloudSearch and
Amazon Elasticsearch
Service
Amazon
DynamoDB
Amazon
ElastiCache
and Amazon
DynamoDB
Accelerator
(DAX)
HDFS
33. ElastiCache Redis reference architecture
Availability Zone B Availability Zone CAvailability Zone A
REDIS:6379> hget feature:details “ref-arch”
34. ElastiCache Redis Reference Architecture
Availability Zone B Availability Zone CAvailability Zone A
Private SubnetPrivate Subnet Private Subnet
REDIS:6379> hget feature:details “ref-arch”
35. ElastiCache Redis Reference Architecture
Availability Zone B Availability Zone CAvailability Zone A
Private SubnetPrivate Subnet Private Subnet
REDIS:6379> hget feature:details “ref-arch”
security group security group security group
36. ElastiCache Redis Reference Architecture
Availability Zone B Availability Zone CAvailability Zone A
Private SubnetPrivate Subnet Private Subnet
REDIS:6379> hget feature:details “ref-arch”
security group security group security group
ElastiCache Redis Cluster
Amazon S3
bucket
REDIS RDB
snapshot
Encryption at
REST
37. ElastiCache Redis Reference Architecture
Availability Zone B Availability Zone CAvailability Zone A
Private SubnetPrivate Subnet Private Subnet
REDIS:6379> hget feature:details “ref-arch”
security group security group security group
ElastiCache Redis Cluster
security group
Public Subnet
security group
Public Subnet Public Subnet
Amazon S3
bucket
REDIS RDB
snapshot
security group
Encryption In-Transit 3.2.6 Redis AUTH
Encryption at
REST