Bridge to the Cloud: Using Apache Kafka to Migrate to AWS

•

2 likes•1,000 views

Most organizations don't move to the cloud all at once. You start with a new use case, or a new application. Sometimes these applications can run independently in the cloud, but oftentimes they need data from the on-premises datacenter. After the first migration is successful, more applications follow: brand new applications start in the cloud and need some data from existing applications that are still running on-premises. Existing applications slowly migrate, but need a strategy for migrating their data in phases, an initial bulk upload often followed by incremental updates. In a mature organization, this process can take years. In this session, Apache Kafka co-creator Jay Kreps shares how companies around the world are using Kafka to migrate to AWS. By implementing a central pipeline architecture using Apache Kafka to sync on-premises and cloud deployments, companies can accelerate migration times and reduce costs. The Kafka-centric migration process is ultimately more manageable for the organization.

Technology

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
BRIDGE TO THE CLOUD:
U SIN G A PA C H E K A F K A ® TO MIG R AT E TO AWS
JAY KREPS
C E O & C O - F O U N D E R , C O N F L U E N T
N O V E M B E R 2 0 1 7

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CLOUD MIGRATION: A ONE TIME THING?

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
In reality, we keep running
• Our apps are complex, intricately tied
together
• Some, built to run on legacy,
immovable systems

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
We don’t want to just move –
we want to build for the cloud

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MySQL
App
TeradataApp Oracle
Elasticsearch
App
DC-1
Amazon DynamoDB
Amazon S3
App
Amazon Redshift
AppApp
Amazon RDS

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon S3
Amazon DynamoDB
Oracle
App

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WHAT IS OUR BRIDGE?
Real-time
Secure
Reliable

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
1/3 of the Fortune 500

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ESTABLISH YOUR FOUNDATION
Amazon
S3
Amazon
DynamoDB
Oracle
1 Deploy Kafka on-premise and
Amazon Web Services (AWS)
App
Teradata

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ESTABLISH YOUR FOUNDATION
Amazon
S3
Amazon
DynamoDB
Oracle
App
Teradata
2 Create your pipeline and replicate
your topics to your AWS cluster

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
LET THE TRAFFIC FLOW
Amazon
S3
Amazon
DynamoDB
Oracle
Topic: dc1clicks
Topic: dc1users
3 Migrate app by app, database by
database
App
App

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MySQL
App
TeradataApp Oracle
Elasticsearch
App
Amazon DynamoDB
Amazon S3
App
Amazon Redshift
AppApp
Amazon RDS
eu-central
ap-northeast
DC-NY
DC-LON
DC-1

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
BUILT FOR THE FUTURE
ML

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WE CAN EVEN MANAGE IT FOR YOU
Now Generally Available on AWS
Fully-managed by the experts at Confluent
99.95% Uptime Guarantee

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
OR HELP RUN YOUR OWN

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Learn from Monsanto’s
Data Platform Architect
Transitioning to the cloud using a
streaming data platform
THANK YOU!
Watch here – http://bit.ly/2zUDAKN

Watch this talk here: https://www.confluent.io/online-talks/bridge-to-cloud-apache-kafka-migrate-aws Speakers: Priya Shivakumar, Director of Product, Confluent + Konstantine Karantasis, Software Engineer, Confluent + Rohit Pujari, Partner Solutions Architect, AWS Most companies start their cloud journey with a new use case, or a new application. Sometimes these applications can run independently in the cloud, but often times they need data from the on premises datacenter. Existing applications will slowly migrate, but will need a strategy and the technology to enable a multi-year migration. In this session, we will share how companies around the world are using Confluent Cloud, a fully managed Apache Kafka service, to migrate to AWS. By implementing a central-pipeline architecture using Apache Kafka to sync on-prem and cloud deployments, companies can accelerate migration times and reduce costs. In this online talk we will cover: •How to take the first step in migrating to AWS •How to reliably sync your on premises applications using a persistent bridge to cloud •Learn how Confluent Cloud can make this daunting task simple, reliable and performant •See a demo of the hybrid-cloud and multi-region deployment of Apache Kafka

App modernization on AWS with Apache Kafka and Confluent Cloud

Kai Wähner

Presentation from AWS ReInvent 2020. Learn how you can accelerate application modernization and benefit from the open-source Apache Kafka ecosystem by connecting your legacy, on-premises systems to the cloud. In this session, hear real customer stories about timely insights gained from event-driven applications built on an event streaming platform from Confluent Cloud running on AWS, which stores and processes historical data and real-time data streams. Confluent makes Apache Kafka enterprise-ready using infinite Kafka storage with Amazon S3 and multiple private networking options including AWS PrivateLink, along with self-managed encryption keys for storage volume encryption with AWS Key Management Service (AWS KMS).

re:Invent re:cap 2020

Kaushik Mohanraj

Reacting to an Event-Driven World (Kate Stanley & Grace Jansen, IBM) Kafka Su...

confluent

Developers are quickly moving to having Apache Kafka and events at the heart of their architecture. But how do you make sure your applications are resilient to the fluctuating load that comes with a never-ending stream of events? The Reactive Manifesto provides a good starting point for these kinds of problems. In this session explore how Kafka and reactive application architecture can be combined to better handle our modern event-streaming needs. We will explain why reactive applications are a great fit for Kafka and show an example of how to write a reactive producer and consumer.

Kafka Streams vs. KSQL for Stream Processing on top of Apache Kafka

Kai Wähner

Spoilt for Choice – Kafka Streams vs. KSQL for Stream Processing on top of Apache Kafka: Apache Kafka is a de facto standard streaming data processing platform. It is widely deployed as event streaming platform. Part of Kafka is its stream processing API “Kafka Streams”. In addition, the Kafka ecosystem now offers KSQL, a declarative, SQL-like stream processing language that lets you define powerful stream-processing applications easily. What once took some moderately sophisticated Java code can now be done at the command line with a familiar and eminently approachable syntax. This session discusses and demos the pros and cons of Kafka Streams and KSQL to understand when to use which stream processing alternative for continuous stream processing natively on Apache Kafka infrastructures. The end of the session compares the trade-offs of Kafka Streams and KSQL to separate stream processing frameworks such as Apache Flink or Spark Streaming.

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

confluent

Presenters: Rachel Pedreschi, Senior Director, Solutions Engineering, Imply.io + Josh Treichel, Partner Solutions Architect, Confluent Analytic pipelines running purely on batch processing systems can suffer from hours of data lag, resulting in accuracy issues with analysis and overall decision-making. Join us for a demo to learn how easy it is to integrate your Apache Kafka® streams in Apache Druid (incubating) to provide real-time insights into the data. In this online talk, you’ll hear about ingesting your Kafka streams into Imply’s scalable analytic engine and gaining real-time insights via a modern user interface. Register now to learn about: -The benefits of combining a real-time streaming platform with a comprehensive analytics stack -Building an analytics pipeline by integrating Confluent Platform and Imply -How KSQL, streaming SQL for Kafka, can easily transform and filter streams of data in real time -Querying and visualizing streaming data in Imply -Practical ways to implement Confluent Platform and Imply to address common use cases such as analyzing network flows, collecting and monitoring IoT data and visualizing clickstream data Confluent Platform, developed by the creators of Kafka, enables the ingest and processing of massive amounts of real-time event data. Imply, the complete analytics stack built on Druid, can ingest, store, query and visualize streaming data from Confluent Platform, enabling end-to-end real-time analytics. Together, Confluent and Imply can provide low latency data delivery, data transform, and data querying capabilities to power a range of use cases.

Kubernetes Apache Kafka

confluent

Speaker: Frank Pientka, Principal Software Architect, Materna Information & Communications SE Title of Talk: The need for speed – Data streaming in the Cloud with Kafka® Abstract: As Kubernetes is quickly becoming the de facto standard for the cloud operating system is Apache Kafka becoming the data streaming. Enterprise need more speed to get insights from fast growing data. Kafka and Kubernetes are a perfect team for these use cases. There are different options to run an Apache Kafka Cluster. Besides managed a Kafka cluster by the different cloud providers, running Kafka on Kubernetes is becoming more and more popular. We will introduce a setup, used components and recommendations from an own project with Kafka on Kubernetes. Finally we will share our lessons learned from this still evolving field

Services are the New Cloud Platform (Services-as-a-Platform)

Randy Bias

MQ, ETL and ESB middleware are often used as integration backbone between legacy applications, modern microservices and cloud services. This introduces several challenges and complexities like point-to-point integration or non-scalable architectures. This session discusses how to build a completely event-driven streaming platform leveraging Apache Kafka’s open source messaging, integration and streaming components to leverage distributed processing, fault-tolerance, rolling upgrades and the ability to reprocess events. Learn the differences between a event-driven streaming platform leveraging Apache Kafka and middleware like MQ, ETL and ESBs – including best practices and anti-patterns, but also how these concepts and tools complement each other in an enterprise architecture.

Express Scripts: Driving Digital Transformation from Mainframe to Microservices

confluent

Watch this talk here: https://www.confluent.io/online-talks/express-scripts-digital-transformation-from-mainframe-to-microservices Speakers: Ankur Kaneria, Principal Architect, Express Scripts + Kevin Petrie, Senior Director, Attunity + Alan Hsia, Group Manager, Product Marketing, Confluent Express Scripts is reimagining its data architecture to bring best-in-class user experience and provide the foundation of next-generation applications. The challenge lies in the ability to efficiently and cost-effectively access the ever-increasing amount of data. This online talk will showcase how Apache Kafka® plays a key role within Express Scripts’ transformation from mainframe to a microservices-based ecosystem, ensuring data integrity between two worlds. It will discuss how change data capture (CDC) technology is leveraged to stream data changes to Confluent Platform, allowing a low-latency data pipeline to be built. Watch now to learn: -Why Apache Kafka is an ideal data integration platform for microservices -How Express Scripts is building cloud-based microservices when the system of record is a relational database residing on an on-premise mainframe -How Confluent Platform allows for data integrity between disparate platforms and meets real time SLAs and low-latency requirements -How Attunity Replicate software is leveraged to stream data changes to Apache Kafka, allowing you to build a low-latency data pipeline

Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture

Kai Wähner

AWS Data Lake / Lake House + Confluent Cloud for Serverless Apache Kafka. Learn about use cases, architectures, and features. Data must be continuously collected, processed, and reactively used in applications across the entire enterprise - some in real time, some in batch mode. In other words: As an enterprise becomes increasingly software-defined, it needs a data platform designed primarily for "data in motion" rather than "data at rest." Apache Kafka is now mainstream when it comes to data in motion! The Kafka API has become the de facto standard for event-driven architectures and event streaming. Unfortunately, the cost of running it yourself is very often too expensive when you add factors like scaling, administration, support, security, creating connectors...and everything else that goes with it. Resources in enterprises are scarce: this applies to both the best team members and the budget. The cloud - as we all know - offers the perfect solution to such challenges. Most likely, fully-managed cloud services such as AWS S3, DynamoDB or Redshift are already in use. Now it is time to implement "fully-managed" for Kafka as well - with Confluent Cloud on AWS. Building a central integration layer that doesn't care where or how much data is coming from. Implementing scalable data stream processing to gain real-time insights Leveraging fully managed connectors (like S3, Redshift, Kinesis, MongoDB Atlas & more) to quickly access data Confluent Cloud in action? Let's show how ao.com made it happen! Translated with www.DeepL.com/Translator (free version)

Kafka for Real-Time Replication between Edge and Hybrid Cloud

Kai Wähner

Not all workloads allow cloud computing. Low latency, cybersecurity, and cost-efficiency require a suitable combination of edge computing and cloud integration. This session explores architectures and design patterns for software and hardware considerations to deploy hybrid data streaming with Apache Kafka anywhere. A live demo shows data synchronization from the edge to the public cloud across continents with Kafka on Hivecell and Confluent Cloud.

Kafka summit apac session

Christina Lin

Confluent REST Proxy and Schema Registry (Concepts, Architecture, Features)

Kai Wähner

One Kubernetes to rule them all (ZEUS 2019 Keynote)

Simon Harrer

In 2015, Google open sourced the core of their internal container clustering system under the name Kubernetes. Teams that previously relied upon IaaS and PaaS to run their applications quickly adopted Kubernetes instead. Today, only a few years later, Kubernetes is key to many companies and runs applications with literally billions of users. Kubernetes has become the de facto standard for deploying and running cloud native applications. We’ll give an overview of what Kubernetes is today and share our experiences from using Kubernetes in an ecormmerce and an IoT application. The future of Kubernetes could not look better. The Kubernetes ecosystem is growing, allowing to provision professionally managed databases directly within the cluster, running functions in a serverless-fashion, and even allowing us to host the code, the build pipeline and the application itself on Kubernetes. In the future, there might be only one Kubernetes to rule them all.

Elastically Scaling Kafka Using Confluent

confluent

Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services

confluent

Stream processing and managing real-time data

Amazon Web Services

Real-time analytics have traditionally been analyzed using batch processing in DWH/Hadoop environments. Common use cases use data lakes, data science, and machine learning (ML). Creating serverless data-driven architecture and serverless streaming solutions with services like Amazon Kinesis, AWS Lambda, and Amazon Athena can solve real-time ingestion, storage, and analytics challenges, and help you focus on application logic without managing infrastructure. Learn design patterns and best practices for serverless stream processing.

Kai Waehner - KSQL – The Open Source SQL Streaming Engine for Apache Kafka - ...

Codemotion

Top 5 Event Streaming Use Cases for 2021 with Apache Kafka

Kai Wähner

Apache Kafka and Event Streaming are two of the most relevant buzzwords in tech these days. Ever wonder what the predicted TOP 5 Event Streaming Architectures and Use Cases for 2021 are? Check out the following presentation. Learn about edge deployments, hybrid and multi-cloud architectures, service mesh-based microservices, streaming machine learning, and cybersecurity. On-demand video recording: https://videos.confluent.io/watch/XAjxV3j8hzwCcEKoZVErUJ

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

HostedbyConfluent

Confluent Cloud makes Devops engineers lives a lot more easier. Yet moving 1500 microservices, 10K topics and 100K partitions to a multi-cluster Confluent cloud can be a challenge. In this talk you will hear about 5 lessons that Wix has learned in order to successfully meet this challenge. These lessons include: 1. Automation, Automation, Automation - all the process has to be completely automated at such scale 2. Prefer a gradual approach - E.g. migrate topics in small chunks and not all at once. Reduces risks if things go bad 3. Cleanup first - avoid migrating unused topics or topics with too many unnecessary partitions

Apache Kafka as Event Streaming Platform for Microservice Architectures

Kai Wähner

This session introduces Apache Kafka, an event-driven open source streaming platform. Apache Kafka goes far beyond scalable, high volume messaging. In addition, you can leverage Kafka Connect for integration and the Kafka Streams API for building lightweight stream processing microservices in autonomous teams. The Confluent Platform adds further components such as a Schema Registry, REST Proxy, KSQL, Clients for different programming languages and Connectors for different technologies. The session discusses how tech giants like LinkedIn, Ebay or Airbnb leverage Apache Kafka as event streaming platform to solve various different business problems and how to create a scalable, flexible microservice architecture. A live demo shows how you can easily process and analyze streams of events using Apache Kafka and KSQL.

A guide through the Azure Messaging services - Update Conference

Eldert Grootenboer

An introduction to Serverless

Adrien Blind

This presentation explains what serverless is all about, explaining the context from Devs & Ops points of view, and presenting the various ways to achieve serverless (Functions a as Service, BaaS....). It also presents the various competitors on the market and demo one of them, openfaas. Finally, it enlarges the pictures, positionning serverless, combined with Edge computing & IoT, as a valuable triptic cloud vendors are leveraging on top of, to create end-to-end offers.

Supply Chain Optimization with Apache Kafka

Kai Wähner

Supply Chain optimization leveraging Event Streaming with Apache Kafka. See real-world use cases and architectures from Walmart, BMW, Porsche, and other enterprises to improve the Supply Chain Management (SCM) processes. Automation, robustness, flexibility, real-time, decoupling, data integration, and hybrid deployments... Video recording: https://youtu.be/dUkgungBmPs Blog post: https://www.kai-waehner.de/apache-kafka-supply-chain-management-scm-optimization-scor-six-sigma-real-time

Resilient microservices with Kubernetes - Mete Atamel

ITCamp

Creating a single microservice is a well understood problem. Creating a cluster of load-balanced microservices that are resilient and self-healing is not so easy. Managing that cluster with rollouts and rollbacks, scaling individual services on demand, securely sharing secrets and configuration among services is even harder. Kubernetes, an open-source container management system, can help with this. In this talk, we will start with a simple microservice, containerize it using Docker, and scale it to a cluster of resilient microservices managed by Kubernetes. Along the way, we will learn what makes Kubernetes a great system for automating deployment, operations, and scaling of containerized applications.

Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures

Kai Wähner

Talk at Strate Conference in London: Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures with Confluent: How do you leverage the flexibility and extreme scale of the public cloud and the Apache Kafka ecosystem to build scalable, mission-critical machine learning infrastructures that span multiple public clouds—or bridge your on-premises data centre to the cloud? Join Kai Wähner to learn how to use technologies such as TensorFlow with Kafka’s open source ecosystem for machine learning infrastructures. You’ll learn how to build a scalable, mission-critical machine learning infrastructure for data ingestion and processing, model training, deployment, and monitoring. The discussed architecture includes capabilities like scalable data preprocessing for training and predictions, a combination of different deep learning frameworks, data replication between data centers, intelligent real-time microservices running on Kubernetes, and local deployment of analytic models for offline predictions. Learn how the public cloud allows extreme scale for building analytic models and how the Apache Kafka open source ecosystem enables building a cloud-independent infrastructure for preprocessing and ingestion of data and inference and monitoring of analytic models in real time Understand why hybrid architectures and local model deployment are key for success in many scenarios and why you need a flexible machine learning architecture that supports different technologies and frameworks

Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...

HostedbyConfluent

Avoiding Groundhog Day - Enabling Transformation on Day 1, 100, or 1000 of yo...

Amazon Web Services

Migrating workloads to the cloud requires detailed planning and execution. When you’re an established business with users that rely on your cloud workloads, this can seem like an insurmountable task. A complete migration is a victory often celebrated as the end of the journey, when in reality it is just the first step in a process of continual optimization and evolution. To truly optimize the power of AWS and reap the financial and performance benefits of cloud computing, it is critical that you evaluate your workloads for opportunities to continue to evolve to drive business value and embrace the innovative nature of the AWS Cloud. In this session, join Rackspace to learn about key components to consider in order to execute a successful migration to AWS, the importance of optimizing your AWS environment over time, and how customers are leveraging Rackspace’s Fanatical Support for AWS to help them migrate and transform their workloads on AWS.

CON208_Building Microservices on AWS

Amazon Web Services

Increasingly, organizations are turning to microservices to help them empower autonomous teams, letting them innovate and ship software faster than ever before. But implementing a microservices architecture comes with a number of new challenges that need to be dealt with. Chief among these finding an appropriate platform to help manage a growing number of independently deployable services. In this session, Sam Newman, author of Building Microservices and a renowned expert in microservices strategy, will discuss strategies for building scalable and robust microservices architectures, how to choose the right platform for building microservices, and common challenges and mistakes organizations make when they move to microservices architectures."

What's hot

Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...

confluent

Express Scripts: Driving Digital Transformation from Mainframe to Microservices

confluent

Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture

Kai Wähner

Kafka for Real-Time Replication between Edge and Hybrid Cloud

Kai Wähner

Kafka summit apac session

Christina Lin

Confluent REST Proxy and Schema Registry (Concepts, Architecture, Features)

Kai Wähner

One Kubernetes to rule them all (ZEUS 2019 Keynote)

Simon Harrer

Elastically Scaling Kafka Using Confluent

confluent

Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services

confluent

Stream processing and managing real-time data

Amazon Web Services

Kai Waehner - KSQL – The Open Source SQL Streaming Engine for Apache Kafka - ...

Codemotion

Top 5 Event Streaming Use Cases for 2021 with Apache Kafka

Kai Wähner

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

HostedbyConfluent

Apache Kafka as Event Streaming Platform for Microservice Architectures

Kai Wähner

A guide through the Azure Messaging services - Update Conference

Eldert Grootenboer

An introduction to Serverless

Adrien Blind

Supply Chain Optimization with Apache Kafka

Kai Wähner

Resilient microservices with Kubernetes - Mete Atamel

ITCamp

Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures

Kai Wähner

Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...

HostedbyConfluent

What's hot (20)

Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...

Express Scripts: Driving Digital Transformation from Mainframe to Microservices

Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture

Kafka for Real-Time Replication between Edge and Hybrid Cloud

Kafka summit apac session

Confluent REST Proxy and Schema Registry (Concepts, Architecture, Features)

One Kubernetes to rule them all (ZEUS 2019 Keynote)

Elastically Scaling Kafka Using Confluent

Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services

Stream processing and managing real-time data

Kai Waehner - KSQL – The Open Source SQL Streaming Engine for Apache Kafka - ...

Top 5 Event Streaming Use Cases for 2021 with Apache Kafka

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

Apache Kafka as Event Streaming Platform for Microservice Architectures

A guide through the Azure Messaging services - Update Conference

An introduction to Serverless

Supply Chain Optimization with Apache Kafka

Resilient microservices with Kubernetes - Mete Atamel

Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures

Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...

Similar to Bridge to the Cloud: Using Apache Kafka to Migrate to AWS

Avoiding Groundhog Day - Enabling Transformation on Day 1, 100, or 1000 of yo...

Amazon Web Services

CON208_Building Microservices on AWS

Amazon Web Services

Journey Towards Scaling Your API to 10 Million Users

Adrian Hornsby

CON309_Containerized Machine Learning on AWS

Amazon Web Services

Image recognition is a field of deep learning that uses neural networks to recognize the subject and traits for a given image. In Japan, Cookpad uses Amazon ECS to run an image recognition platform on clusters of GPU-enabled EC2 instances. In this session, hear from Cookpad about the challenges they faced building and scaling this advanced, user-friendly service to ensure high-availability and low-latency for tens of millions of users.

NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017

Amazon Web Services

In this session, we will discuss how the AWS Serverless Application Repository makes it easy to discover and deploy serverless applications published by fellow developers and companies like Datadog, Here, Splunk, and many others. We will cover how you can use the repository to find applications for a variety of use cases and then deploy them to your AWS account. In addition, we will discuss how you can publish your own applications to the repository. You will also hear from two contributors, Datadog and Here, who will describe their approach to building the serverless applications that they have published to the Serverless Application Repository.

NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017

Amazon Web Services

MBL310_Building Hybrid and Web Apps with AWS Mobile CLI

Amazon Web Services

Mobile app development toolchains leveraging JavaScript, such as Ionic and React Native, are growing in popularity more each day. The pace of business makes it difficult to hire multiple engineers for different platforms and duplicate efforts. In this session you’ll see hands on how you can build beautiful user applications using Ionic and React Native without spending months learning how your backend architecture should be designed. Using the newly released AWS Mobile CLI and build tooling you’ll understand how your mobile developers can with a set of simple commands interface with Serverless AWS infrastructure and add in features such as User Sign-In and Sign-Up with Amazon Cognito, Serverless infrastructures using Amazon API Gateway, AWS Lambda and Amazon DynamoDB, and comprehensive analytics through Amazon Pinpoint.

Best Practices for Orchestrating AWS Lambda Workloads - SRV335 - re:Invent 2017

Amazon Web Services

Serverless and AWS Lambda specifically enable developers to build super-scalable application components with minimal effort. You can use Amazon Kinesis and Amazon SQS to create a universal event stream to orchestrate Lambdas into much more complex applications. Now, using AWS Step Functions, we can build large distributed applications with Lambdas using visual workflows. See how Step Functions are different from Amazon SWF, how to get started with Step Functions, and how to use them to take your Lambda-based applications to the next level. We start with a few granular functions and stitch them up using Step Functions. As we build out the application, we add monitoring to ensure that changes we make actually improve things, not make them worse. Leave the session with actionable learnings for using Step Functions in your environment right away. Session sponsored by Datadog

SRV331_Build a Multi-Region Serverless Application for Resilience and High Av...

Amazon Web Services

Have a mission-critical serverless app that requires maximum uptime? Come learn how to build and deploy a multi-region serverless application to maximize application availability and resilience. In this workshop, you'll enter a scenario in which you help a fictional unicorn ridesharing company (www.wildrydes.com) deploy a critical customer support application using a serverless architecture. When a passenger completes a ride, they can use the app to inform the company if they had any issues with their trip—perhaps a lost wallet or a misbehaving unicorn. Since Wild Rydes is global, this support application takes advantage of a multi-region, highly available architecture using services such as AWS Lambda, Amazon API Gateway, Amazon DynamoDB, Amazon Route 53, Amazon CloudFront and Amazon S3 to maximize availability. It also uses Amazon Cognito Federated Identities for user authentication. Attendees should bring a laptop and be familiar with the AWS Management Console and the AWS CLI.

Interstella 8888: Advanced Microservice Operations - CON407 - re:Invent 2017

Amazon Web Services

Interstella 8888 is an intergalactic trading company that deals in rare resources, but their antiquated monolithic logistics systems are causing the business to lose money. In this workshop, you’ll help Interstella 8888 build a modern microservices-based logistics system to save the company from financial ruin. We’ll give you the hands-on experience you need to run microservices in the real world. Ths includes implementing advanced container scheduling and scaling to deal with variable service requests, implementing a service mesh, issue tracing with Amazon X-Ray, container and instance-level logging with CloudWatch, and load testing. AWS credits are provided. Bring your laptop, and have an active AWS account.

What's New in Serverless - SRV305 - re:Invent 2017

Amazon Web Services

Join us to learn what's new in serverless computing and AWS Lambda. Dr. Tim Wagner, General Manager of AWS Lambda and Amazon API Gateway, will share the latest developments in serverless computing and how companies are benefiting from serverless applications. You'll learn about the latest feature releases from AWS Lambda, Amazon API Gateway, and more. You will also hear from FICO about how it is using serverless computing for its predictive analytics and data science platform.

DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...

New Relic

Presented by Kevin Downs, Senior AWS Technical Partner Manager of New Relic, at Amazon Web Services re:Invent 2017. Static applications living on long running servers are becoming history in the cloud along with the monitoring assumptions we used to make. Now, we routinely deploy a range of services from autoscaling compute to decoupled message queues to serverless. These dynamic services, along with microservice architectures both break and need to co-exist with traditional monitoring and instrumentation approaches. Whether you are building new apps, were told to migrate yesterday, are currently migrating, or are already scaling your apps on AWS, this session will dive into the how, where, and when to monitor your applications and infrastructure, no matter where your apps run. You’ll hear best practices we've learned from our customers and running our own service (1.5 Billion+ metrics per minute) too. Join us for a little bit of history and a whole lot of now as we show you how and what you need to scale and prove your success in the cloud.

Reactive Architectures with Microservices

AWS Germany

NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...

Amazon Web Services

Many customers are hesitant to adopt SaaS solutions due to the concerns on the safety of the network connectivity traversing internet. It is also difficult to manage the firewall rules, NAT Gateway or VPN connections. AWS PrivateLink provided solution that let our customers’ applications, whether in a VPC or in their own data center, to connect to SaaS solutions in a highly scalable and highly available manner, while keeping all the network traffic within the AWS network.

Devoxx: Building AI-powered applications on AWS

Adrian Hornsby

Enterprise Innovation? Yes, with AWS Cloud, AI, and IoT - WIN201 - re:Invent ...

Amazon Web Services

Join this State of the Union to learn about the latest developments from Amazon for enterprise workloads such as Windows, VMware, and SAP. Sandy Carter, AWS vice president for Enterprise Workloads, discusses the evolution of AWS services for enterprise workloads and the new features and services that we are launching for Windows and VMware. She shares the company’s vision for continuing to innovate in this space to make AWS the premier place for enterprise customers. Also, several major customers discuss their own experience running enterprise workloads on AWS as well as pursuing new solutions in areas like AI and IoT.

Case Study: Ola Cabs Uses Amazon EBS and Elastic Volumes to Maximize MySQL De...

Amazon Web Services

Ola Cabs is India’s leading taxi aggregator, providing point-to-point transportation for a million people daily in more than 110 cities. Ola Cabs chose AWS from the start because it offered the flexibility, scalability, and agility the company needed to establish its competitive edge. In this session, you hear about Ola Cabs’ journey to the cloud and learn how they take advantage of the flexibility and elasticity of Amazon EBS storage to optimize performance, maximize availability, and save money compared with instance storage. We describe best practices and share tips for success throughout.

ARC207_Monitoring Performance of Enterprise Applications on AWS

Amazon Web Services

"Applications running in a typical data center are static entities. But applications aren't static in the cloud. Dynamic scaling and resource allocation is the norm on AWS. Technologies such as Amazon EC2, AWS Lambda, and Auto Scaling provide flexibility in building dynamic applications and with this flexibility comes an opportunity to learn how an enterprise application functions optimally. New Relic helps manage these applications without sacrificing simplicity. In this session, we discuss changes in monitoring dynamic cloud resources. We'll share best practices we’ve learned working with New Relic customers on managing applications running in this environment to understand and optimize how they are performing. Session sponsored by New Relic"

CON203_Driving Innovation with Containers

Amazon Web Services

"Containers allow you to easily package an application's code, configurations, and dependencies into easy to use building blocks that deliver environmental consistency, operational efficiency, developer productivity, and version control. But how can developers leverage containers to drive innovation for their applications, their team, and organization? In this session, Asif Khan Technical Business Manager for AWS will discuss how containers are becoming a new cloud native compute primitive, and how your organization can use containers as a building block to accelerate innovation. WeWork's Christopher Tava, Joshua Davis, and OpsLine's Radek Wierzbicki will show how they adopted containers as discipline in code development, and how they refactored their production architecture into containers running on Amazon ECS in under 8 months."

Driving Innovation with Containers - CON203 - re:Invent 2017

Amazon Web Services

Containers allow you to easily package an application's code, configurations, and dependencies into easy to use building blocks that deliver environmental consistency, operational efficiency, developer productivity, and version control. But how can developers leverage containers to drive innovation for their applications, their team, and organization? In this session, Asif Khan Technical Business Manager for AWS will discuss how containers are becoming a new cloud native compute primitive, and how your organization can use containers as a building block to accelerate innovation. WeWork's Christopher Tava, Joshua Davis, and OpsLine's Radek Wierzbicki will show how they adopted containers as discipline in code development, and how they refactored their production architecture into containers running on Amazon ECS in under 8 months.

Similar to Bridge to the Cloud: Using Apache Kafka to Migrate to AWS (20)

Avoiding Groundhog Day - Enabling Transformation on Day 1, 100, or 1000 of yo...

CON208_Building Microservices on AWS

Journey Towards Scaling Your API to 10 Million Users

CON309_Containerized Machine Learning on AWS

NEW LAUNCH! AWS Serverless Application Repository - SRV215 - re:Invent 2017

MBL310_Building Hybrid and Web Apps with AWS Mobile CLI

Best Practices for Orchestrating AWS Lambda Workloads - SRV335 - re:Invent 2017

SRV331_Build a Multi-Region Serverless Application for Resilience and High Av...

Interstella 8888: Advanced Microservice Operations - CON407 - re:Invent 2017

What's New in Serverless - SRV305 - re:Invent 2017

DEV209 A Field Guide to Monitoring in the Cloud: From Lift and Shift to AWS L...

Reactive Architectures with Microservices

NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...

Devoxx: Building AI-powered applications on AWS

Enterprise Innovation? Yes, with AWS Cloud, AI, and IoT - WIN201 - re:Invent ...

Case Study: Ola Cabs Uses Amazon EBS and Elastic Volumes to Maximize MySQL De...

ARC207_Monitoring Performance of Enterprise Applications on AWS

CON203_Driving Innovation with Containers

Driving Innovation with Containers - CON203 - re:Invent 2017

More from confluent

Speed Wins: From Kafka to APIs in Minutes

confluent

Evolving Data Governance for the Real-time Streaming and AI Era

confluent

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...

confluent

Santander Stream Processing with Apache Flink

confluent

Unlocking the Power of IoT: A comprehensive approach to real-time insights

confluent

Workshop híbrido: Stream Processing con Flink

confluent

El Stream processing es un requisito previo de la pila de data streaming, que impulsa aplicaciones y pipelines en tiempo real. Permite una mayor portabilidad de datos, una utilización optimizada de recursos y una mejor experiencia del cliente al procesar flujos de datos en tiempo real. En nuestro taller práctico híbrido, aprenderás cómo filtrar, unir y enriquecer fácilmente datos en tiempo real dentro de Confluent Cloud utilizando nuestro servicio Flink sin servidor.

Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...

confluent

Our talk will explore the transformative impact of integrating Confluent, HiveMQ, and SparkPlug in Industry 4.0, emphasizing the creation of a Unified Namespace. In addition to the creation of a Unified Namespace, our webinar will also delve into Stream Governance and Scaling, highlighting how these aspects are crucial for managing complex data flows and ensuring robust, scalable IIoT-Platforms. You will learn how to ensure data accuracy and reliability, expand your data processing capabilities, and optimize your data management processes. Don't miss out on this opportunity to learn from industry experts and take your business to the next level.

AWS Immersion Day Mapfre - Confluent

confluent

La arquitectura impulsada por eventos (EDA) será el corazón del ecosistema de MAPFRE. Para seguir siendo competitivas, las empresas de hoy dependen cada vez más del análisis de datos en tiempo real, lo que les permite obtener información y tiempos de respuesta más rápidos. Los negocios con datos en tiempo real consisten en tomar conciencia de la situación, detectar y responder a lo que está sucediendo en el mundo ahora.

Eventos y Microservicios - Santander TechTalk

confluent

Q&A with Confluent Experts: Navigating Networking in Confluent Cloud

confluent

Citi TechTalk Session 2: Kafka Deep Dive

confluent

Build real-time streaming data pipelines to AWS with Confluent

confluent

Traditional data pipelines often face scalability issues and challenges related to cost, their monolithic design, and reliance on batch data processing. They also typically operate under the premise that all data needs to be stored in a single centralized data source before it's put to practical use. Confluent Cloud on Amazon Web Services (AWS) provides a fully managed cloud-native platform that helps you simplify the way you build real-time data flows using streaming data pipelines and Apache Kafka.

Q&A with Confluent Professional Services: Confluent Service Mesh

confluent

Citi Tech Talk: Event Driven Kafka Microservices

confluent

Confluent & GSI Webinars series - Session 3

confluent

An in depth look at how Confluent is being used in the financial services industry. Gain an understanding of how organisations are utilising data in motion to solve common problems and gain benefits from their real time data capabilities. It will look more deeply into some specific use cases and show how Confluent technology is used to manage costs and mitigate risks. This session is aimed at Solutions Architects, Sales Engineers and Pre Sales, and also the more technically minded business aligned people. Whilst this is not a deeply technical session, a level of knowledge around Kafka would be helpful.

Citi Tech Talk: Messaging Modernization

confluent

Transforming applications built with traditional messaging solutions such as TIBCO, MQ and Solace to be scalable, reliable and ready for the move to cloud How can applications built with traditional messaging technologies like TIBCO, Solace and IBM MQ be modernised and be made cloud ready? What are the advantages to Event Streaming approaches to pub/sub vs traditional message queues? What are the strengeths and weaknesses of both approaches, and what use cases and requirements are actually a better fit for messaging than Kafka?

Citi Tech Talk: Data Governance for streaming and real time data

confluent

Confluent & GSI Webinars series: Session 2

confluent

Data In Motion Paris 2023

confluent

Vous apprendrez également à : • Créer plus rapidement des produits et fonctionnalités à l’aide d’une suite complète de connecteurs et d’outils de gestion des flux, et à connecter vos environnements à des pipelines de données • Protéger vos données et charges de travail les plus critiques grâce à des garanties intégrées en matière de sécurité, de gouvernance et de résilience • Déployer Kafka à grande échelle en quelques minutes tout en réduisant les coûts et la charge opérationnelle associés

Confluent Partner Tech Talk with Synthesis

confluent

More from confluent (20)

Speed Wins: From Kafka to APIs in Minutes

Evolving Data Governance for the Real-time Streaming and AI Era

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...

Santander Stream Processing with Apache Flink

Unlocking the Power of IoT: A comprehensive approach to real-time insights

Workshop híbrido: Stream Processing con Flink

Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...

AWS Immersion Day Mapfre - Confluent

Eventos y Microservicios - Santander TechTalk

Q&A with Confluent Experts: Navigating Networking in Confluent Cloud

Citi TechTalk Session 2: Kafka Deep Dive

Build real-time streaming data pipelines to AWS with Confluent

Q&A with Confluent Professional Services: Confluent Service Mesh

Citi Tech Talk: Event Driven Kafka Microservices

Confluent & GSI Webinars series - Session 3

Citi Tech Talk: Messaging Modernization

Citi Tech Talk: Data Governance for streaming and real time data

Confluent & GSI Webinars series: Session 2

Data In Motion Paris 2023

Confluent Partner Tech Talk with Synthesis

Recently uploaded

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

Climate Impact of Software Testing at Nordic Testing Days

Kari Kakkonen

My slides at Nordic Testing Days 6.6.2024 Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.

Mind map of terminologies used in context of Generative AI

Kumud Singh

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

DevOps and Testing slides at DASA Connect

Kari Kakkonen

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

National Security Agency - NSA mobile device best practices

Quotidiano Piemontese

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Alex Pruden

This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second). Paper: https://eprint.iacr.org/2023/1886

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

Microsoft - Power Platform_G.Aspiotis.pdf

Uni Systems S.M.S.A.

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Recently uploaded (20)

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Essentials of Automations: The Art of Triggers and Actions in FME

Climate Impact of Software Testing at Nordic Testing Days

Mind map of terminologies used in context of Generative AI

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Removing Uninteresting Bytes in Software Fuzzing

DevOps and Testing slides at DASA Connect

20240607 QFM018 Elixir Reading List May 2024

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

20240605 QFM017 Machine Intelligence Reading List May 2024

Introduction to CHERI technology - Cybersecurity

By Design, not by Accident - Agile Venture Bolzano 2024

PCI PIN Basics Webinar from the Controlcase Team

National Security Agency - NSA mobile device best practices

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Securing your Kubernetes cluster_ a step-by-step guide to success !

Pushing the limits of ePRTC: 100ns holdover for 100 days

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Microsoft - Power Platform_G.Aspiotis.pdf

UiPath Test Automation using UiPath Test Suite series, part 6

Bridge to the Cloud: Using Apache Kafka to Migrate to AWS

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. BRIDGE TO THE CLOUD: U SIN G A PA C H E K A F K A ® TO MIG R AT E TO AWS JAY KREPS C E O & C O - F O U N D E R , C O N F L U E N T N O V E M B E R 2 0 1 7

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. In reality, we keep running • Our apps are complex, intricately tied together • Some, built to run on legacy, immovable systems

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ESTABLISH YOUR FOUNDATION Amazon S3 Amazon DynamoDB Oracle 1 Deploy Kafka on-premise and Amazon Web Services (AWS) App Teradata

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ESTABLISH YOUR FOUNDATION Amazon S3 Amazon DynamoDB Oracle App Teradata 2 Create your pipeline and replicate your topics to your AWS cluster

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. LET THE TRAFFIC FLOW Amazon S3 Amazon DynamoDB Oracle Topic: dc1clicks Topic: dc1users 3 Migrate app by app, database by database App App

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MySQL App TeradataApp Oracle Elasticsearch App DC-1 Amazon DynamoDB Amazon S3 App Amazon Redshift AppApp Amazon RDS eu-central ap-northeast DC-NY DC-LON

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MySQL App TeradataApp Oracle Elasticsearch App Amazon DynamoDB Amazon S3 App Amazon Redshift AppApp Amazon RDS eu-central ap-northeast DC-NY DC-LON DC-1

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. WE CAN EVEN MANAGE IT FOR YOU Now Generally Available on AWS Fully-managed by the experts at Confluent 99.95% Uptime Guarantee

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Learn from Monsanto’s Data Platform Architect Transitioning to the cloud using a streaming data platform THANK YOU! Watch here – http://bit.ly/2zUDAKN

Bridge to the Cloud: Using Apache Kafka to Migrate to AWS

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Bridge to the Cloud: Using Apache Kafka to Migrate to AWS

Similar to Bridge to the Cloud: Using Apache Kafka to Migrate to AWS (20)

More from confluent

More from confluent (20)

Recently uploaded

Recently uploaded (20)

Bridge to the Cloud: Using Apache Kafka to Migrate to AWS