2020-05-06 Apache Flink Meetup London: The Easiest Way to Get Operational with Apache Flink
•
1 like•365 views
This document discusses Ververica Platform, an open source tool for deploying and managing Apache Flink applications on Kubernetes. It offers a community edition that is free to use for both commercial and non-commercial purposes, as well as paid editions. It provides managed deployments of Flink on Kubernetes with capabilities like stateful upgrades and high availability without Zookeeper. The document also briefly outlines some future directions like integrated streaming SQL and an "Auto-Pilot" for Flink.
Report
Share
Report
Share
Recommended
Deploying Flink on Kubernetes - David Anderson
Kubernetes has rapidly established itself as the de facto standard for orchestrating containerized infrastructures. And with the recent completion of the refactoring of Flink's deployment and process model known as FLIP-6, Kubernetes has become a natural choice for Flink deployments. In this talk we will walk through how to get Flink running on Kubernetes
Webinar: 99 Ways to Enrich Streaming Data with Apache Flink - Konstantin Knauf
The need to enrich a fast, high volume data stream with slow-changing reference data is probably one of the most wide-spread requirements in stream processing applications. Apache Flink's built-in join functionalities and its flexible lower-level APIs support stream enrichment in various ways depending on the specific requirements of the use case at hand. In this webinar, I like to provide an overview of the basic methods to enrich a data stream with Apache Flink and highlight use cases, limitations, advantages and disadvantages of each.
Future of Apache Flink Deployments: Containers, Kubernetes and More - Flink F...
Container technology experiences an ever increasing adoption throughout many industries. Not only does this technology make your applications portable across different machines and operating systems, it also allows to scale applications in a matter of seconds. Moreover, it significantly simplifies and speeds up deployments which decreases development and operation costs. Consequently, more and more Flink deployments run in containerized environments which poses new challenges for Flink.
In this talk, we will take a look at Flink's current and future container support which will make it a first class citizen of the container world. First of all, we will explain how the new reactive execution mode will solve the problem of seamless application scaling and how it blends in with any environment. Complementary to the reactive mode, the active execution mode demonstrates its strengths when it comes to changing workloads such as batch jobs. Last but not least, we will take a look beyond Flink's own nose and investigate how Flink can be used together with Kubernetes operators or data Artisans' Application Manager. We will conclude the talk with a short demo of Flink's native Kubernetes support and giving an outlook on future developments in the container realm.
Multi-Clusters Made Easy with Liqo:
Getting Rid of Your Clusters Keeping Them...
Many companies are experiencing a dramatic increase in the number of their Kubernetes clusters, for
reasons such as geographical/legislative constraints, data/service replication, etc.
However, when the number of clusters increases, the complexity of deploying apps, managing the entire
multi-cluster infrastructure, and keeping its state under control, becomes rapidly an unmanageable
problem.
A possible solution is Liqo, an open-source project that simplifies the creation of multi-cluster topologies
by replicating the Kubernetes “cattle” model also to clusters.
Liqo creates a virtual cluster that spans multiple real clusters, either on-prem or managed (AKS, EKS,
GKE), and instantiates the desired applications seamlessly in the appropriate cluster.
This talk will discuss the potentials and roadblocks of this vision and highlight how Liqo brings multi-
cluster transparency to the users.
Gatekeeper: API gateway
In this WebHack talk I shared my experience about microservices, Docker, Kubernetes and Kong, an API gateway by Mashape. Since they are based on a real working system, this slides is majorly for how to build the whole thing up, not about detailed internal implementation. Although I included some details and reference in order to make it more comprehensive.
Lessons Learned Building a Connector Using Kafka Connect (Katherine Stanley &...
While many companies are embracing Apache Kafka as their core event streaming platform they may still have events they want to unlock in other systems. Kafka Connect provides a common API for developers to do just that and the number of open-source connectors available is growing rapidly. The IBM MQ sink and source connectors allow you to flow messages between your Apache Kafka cluster and your IBM MQ queues. In this session we will share our lessons learned and top tips for building a Kafka Connect connector. We'll explain how a connector is structured, how the framework calls it and some of the things to consider when providing configuration options. The more Kafka Connect connectors the community creates the better, as it will enable everyone to unlock the events in their existing systems.
NGINX: Basics and Best Practices EMEA
In this webinar we help you get started using NGINX, the de facto web server for building modern applications. We cover best practices for installing, configuring, and troubleshooting both NGINX Open Source and the enterprise-grade NGINX Plus.
https://www.nginx.com/resources/webinars/nginx-basics-best-practices-emea-2/
Beyond the Brokers | Emma Humber and Andrew Borley, IBM
While Kafka has guarantees around the number of server failures a cluster can tolerate, to avoid service interruptions, or even data loss, it is prudent to have infrastructure in place for when an environment becomes unavailable during a planned or unplanned outage.
This talk describes the architectures available to you when planning for an outage. We will examine configurations including active/passive and active/active as well as availability zones and debate the benefits and limitations of each. We will also cover how to set up each configuration using the tools in Kafka.
Whether downtime while you fail over clients to a backup is acceptable or you require your Kafka clusters to be highly available, this talk will give you an understanding of the options available to mitigate the impact of the loss of an environment.
Recommended
Deploying Flink on Kubernetes - David Anderson
Kubernetes has rapidly established itself as the de facto standard for orchestrating containerized infrastructures. And with the recent completion of the refactoring of Flink's deployment and process model known as FLIP-6, Kubernetes has become a natural choice for Flink deployments. In this talk we will walk through how to get Flink running on Kubernetes
Webinar: 99 Ways to Enrich Streaming Data with Apache Flink - Konstantin Knauf
The need to enrich a fast, high volume data stream with slow-changing reference data is probably one of the most wide-spread requirements in stream processing applications. Apache Flink's built-in join functionalities and its flexible lower-level APIs support stream enrichment in various ways depending on the specific requirements of the use case at hand. In this webinar, I like to provide an overview of the basic methods to enrich a data stream with Apache Flink and highlight use cases, limitations, advantages and disadvantages of each.
Future of Apache Flink Deployments: Containers, Kubernetes and More - Flink F...
Container technology experiences an ever increasing adoption throughout many industries. Not only does this technology make your applications portable across different machines and operating systems, it also allows to scale applications in a matter of seconds. Moreover, it significantly simplifies and speeds up deployments which decreases development and operation costs. Consequently, more and more Flink deployments run in containerized environments which poses new challenges for Flink.
In this talk, we will take a look at Flink's current and future container support which will make it a first class citizen of the container world. First of all, we will explain how the new reactive execution mode will solve the problem of seamless application scaling and how it blends in with any environment. Complementary to the reactive mode, the active execution mode demonstrates its strengths when it comes to changing workloads such as batch jobs. Last but not least, we will take a look beyond Flink's own nose and investigate how Flink can be used together with Kubernetes operators or data Artisans' Application Manager. We will conclude the talk with a short demo of Flink's native Kubernetes support and giving an outlook on future developments in the container realm.
Multi-Clusters Made Easy with Liqo:
Getting Rid of Your Clusters Keeping Them...
Many companies are experiencing a dramatic increase in the number of their Kubernetes clusters, for
reasons such as geographical/legislative constraints, data/service replication, etc.
However, when the number of clusters increases, the complexity of deploying apps, managing the entire
multi-cluster infrastructure, and keeping its state under control, becomes rapidly an unmanageable
problem.
A possible solution is Liqo, an open-source project that simplifies the creation of multi-cluster topologies
by replicating the Kubernetes “cattle” model also to clusters.
Liqo creates a virtual cluster that spans multiple real clusters, either on-prem or managed (AKS, EKS,
GKE), and instantiates the desired applications seamlessly in the appropriate cluster.
This talk will discuss the potentials and roadblocks of this vision and highlight how Liqo brings multi-
cluster transparency to the users.
Gatekeeper: API gateway
In this WebHack talk I shared my experience about microservices, Docker, Kubernetes and Kong, an API gateway by Mashape. Since they are based on a real working system, this slides is majorly for how to build the whole thing up, not about detailed internal implementation. Although I included some details and reference in order to make it more comprehensive.
Lessons Learned Building a Connector Using Kafka Connect (Katherine Stanley &...
While many companies are embracing Apache Kafka as their core event streaming platform they may still have events they want to unlock in other systems. Kafka Connect provides a common API for developers to do just that and the number of open-source connectors available is growing rapidly. The IBM MQ sink and source connectors allow you to flow messages between your Apache Kafka cluster and your IBM MQ queues. In this session we will share our lessons learned and top tips for building a Kafka Connect connector. We'll explain how a connector is structured, how the framework calls it and some of the things to consider when providing configuration options. The more Kafka Connect connectors the community creates the better, as it will enable everyone to unlock the events in their existing systems.
NGINX: Basics and Best Practices EMEA
In this webinar we help you get started using NGINX, the de facto web server for building modern applications. We cover best practices for installing, configuring, and troubleshooting both NGINX Open Source and the enterprise-grade NGINX Plus.
https://www.nginx.com/resources/webinars/nginx-basics-best-practices-emea-2/
Beyond the Brokers | Emma Humber and Andrew Borley, IBM
While Kafka has guarantees around the number of server failures a cluster can tolerate, to avoid service interruptions, or even data loss, it is prudent to have infrastructure in place for when an environment becomes unavailable during a planned or unplanned outage.
This talk describes the architectures available to you when planning for an outage. We will examine configurations including active/passive and active/active as well as availability zones and debate the benefits and limitations of each. We will also cover how to set up each configuration using the tools in Kafka.
Whether downtime while you fail over clients to a backup is acceptable or you require your Kafka clusters to be highly available, this talk will give you an understanding of the options available to mitigate the impact of the loss of an environment.
A Series of Fortunate Events: Building an Operator in Java
SpringOne 2021:
Session Title: A Series of Fortunate Events: Building an Operator in Java
Speakers: Alberto C. Ríos, Staff Engineer at VMware; Bella Bai, Software Engineer at VMware
Kafka Needs No Keeper
Kafka is evolving to remove its dependency on Zookeeper. The Kafka Improvement Proposal 500 (KIP-500) aims to manage Kafka's metadata log with a self-managed Raft consensus algorithm and controller quorum rather than relying on Zookeeper. This will improve scalability, robustness, and make deployment easier. It will take multiple releases to fully implement KIP-500, beginning with removing Zookeeper from clients and ending with a release where Zookeeper is no longer required.
A Modern C++ Kafka API | Kenneth Jia, Morgan Stanley
The document discusses a new C++ Kafka API called modern-cpp-kafka that was developed to address requirements for a pub/sub messaging system. It provides examples of how the API simplifies and improves upon an existing C++ Kafka client (librdkafka) for key tasks like producing and consuming messages. The modern-cpp-kafka API matches the Java API naming, uses RAII for lifetime management, and hides polling and queue details. It has led to improved throughput of over 26% for an application. The API is now open source and the team is working to expand it further.
Devoxx fr 2016 - Apache Kafka - Stream Data Platform
This document discusses Kafka, a distributed streaming platform. It provides an overview of Kafka's history and key features, including high throughput, horizontal scaling, persistence, and automatic recovery from failures. The document also covers topics, partitions, producers, consumers, consumer groups, and replication strategies. Examples of companies using Kafka are given, such as LinkedIn, Netflix, Twitter, and Microsoft.
Virtual Flink Forward 2020: Apache Flink Worst Wractices - Konstantin Knauf
Distributed stream processing is evolving from a technology in the sidelines of Big Data to a key enabler for businesses to provide more scalable, real-time services to their customers. We at Ververica, the company founded by the original creators of Apache Flink, and other prominent players in the Flink community have witnessed this development from the driver’s seat. Working with our customer and the wider community we have seen great success stories and we have seen things going wrong. In this talk, I would like to share anecdotes and hard-learned lessons of adopting distributed stream processing – Apache Flink specific as well as across frameworks. Afterwards, you will know, how not to model your use cases as a stream processing application, which data structures not to use, how not to deal with failure, how not to approach the topic of monitoring and much more.
Spring Cloud: API gateway upgrade & configuration in the cloud
In this presentation we walk through features of Spring Cloud Gateway and Spring Cloud Config projects, overview new features provided by Spring Cloud Gateway including advanced routing options for API services supporting parallel APIs in several versions, discuss code examples and configuration options. Once API gateway is deployed, we don’t want to redeploy it on configuration changes as well as redeploy other services upon configuration updates. And this is where Spring Cloud Config enters the game. It allows us to keep configurations in the cloud, for example in a Git repository, and once paired with tools necessary, enables almost zero-down-time configuration updates, audit of changes and parallel configurations for different environments.
Serverless and Servicefull Applications - Where Microservices complements Ser...
Serverless is a misnomer, your future cloud native applications will consist of both microservices and functions, wrapped as Linux containers, but in many cases where you the developer ignore the operational aspects of managing that infrastructure. In this session we get started using Function as a Service (FaaS) engine with Apache OpenWhisk deployed on Kubernetes and OpenShift. With Kubernetes/OpenShift being de-facto platform for Cloud Native Java Applications, we will explore on to see how to make Cloud Native Java Applications a.k.a Microservices can complement the serverless Functions. This technical intensive session will open up one of the possible serverless web application architecture where we deploy an API Gateway into the FaaS platform to draw the curtains up to see the microservices talking to the serverless functions. This session ends with us seeing how Event Sinks and Event Sources map in the Serverless World.
How to build 1000 microservices with Kafka and thrive
This talk is about the Wix ecosystem for event driven architecture on top of Kafka.
I share the best practices, SDKs and tools we have created in order to be able to scale our distributed system to more than 1000 microservices.
Ports, pods and proxies
This document discusses various methods for accessing Kubernetes pods including through API server proxies, port forwarding, and logs/attach. It begins with an overview of how pods expose access points via kubectl. Examples are provided for using kubectl proxy to access pod endpoints, port forwarding to proxy local ports to pods, and retrieving logs and attaching to pods' stdin/stdout/stderr. The raw kubectl option and debugging with increased log levels are also covered.
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
This document discusses securing Apache Kafka deployments with Vormetric and Confluent Platform. It begins with an introduction to Apache Kafka and Confluent Platform. It then provides an overview of Vormetric's policy-driven security solution and how it can be used to encrypt Kafka data at rest. The document outlines the typical Confluent Platform deployment architecture and various security considerations, such as authentication, authorization, and data encryption. Finally, it provides steps for implementing secure deployments using SSL, Kerberos, and Vormetric encryption policies.
10 Key Steps for Moving from Legacy Infrastructure to the Cloud
On-demand recording: https://nginx.webex.com/nginx/lsr.php?RCID=af9c355d1f42420b17e048e82ac6762b
Moving your applications from traditional IT stacks to the cloud is not an easy task. Migration to the cloud can cause security nightmares, performance degradation, and sudden cost spikes, to name just a few possible problems. For a successful cloud migration, you need to evolve both technology and business processes.
Nonetheless, moving from legacy infrastructure to public, private, or hybrid cloud can bring massive benefits, including increased flexibility, the ability to scale up or down as needed, and dramatic cost savings. When done well, transforming your business to adopt cloud services can be both painless and profitable.
Please join us for this webinar by James Bond, CTO at Hewlett Packard Enterprise and an expert in cloud computing. He will cover best practices for making your cloud migration successful, including:
* Why your organization should consider a cloud migration
* How to properly plan for cloud deployment
* What approach you should take to ensure security
* How orchestration tools can help achieve efficiency
* How to build cloud native applications to best take advantage of the cloud
Speaker: James Bond, facebook.com/enterprisecloud
James Bond is an expert in cloud computing with over 25 years of experience in the IT industry. He is a true cloud industry pioneer, having created several successful companies, founded business practices, and hosted infrastructure and software services long before the term "cloud computing" was first used. James is a Chief Technologist for Hewlett Packard Enterprise (HPE) providing cloud strategy, guidance, and implementation planning to Fortune 100 organizations that are planning a transition from legacy IT to cloud. He is a featured speaker at industry conferences and executive briefings throughout North America.
Relevez les défis Kubernetes avec NGINX
Découvrez les dernières tendances de Kubernetes et comment NGINX résout les défis courants dans Kubernetes. Ce webinar vous permettra de découvrir une solution apportant des réponses à vos défis liés à Kubernetes.
Rejoignez ce webinaire pour apprendre :
• Découvrir les avantages des différentes architectures
• Comment utiliser NGINX Ingress Controller pour sécuriser, renforcer et faire évoluer vos environnements Kubernetes
• Comment déployer NGINX nativement dans Kubernetes
• Effectuer un équilibrage de charges, de l’authentification et une sécurisation de manière transparente dans Kubernetes
• La duplication des services d'application, à la fois à l'intérieur et à l'extérieur de Kubernetes
• Optimiser la sécurisation des applications dans Kubernetes avec NGINX App Protect
Common issues with Apache Kafka® Producer
Badai Aqrandista, Confluent, Senior Technical Support Engineer
This session will be about a common issue in the Kafka Producer: producer batch expiry. We will be discussing the Kafka Producer internals, its common causes, such as a slow network or small batching, and how to overcome them. We will also be sharing some examples along the way!
https://www.meetup.com/apache-kafka-sydney/events/279651982/
Spring Boot—Production Boost
SpringOne 2021
Session Title: Spring Boot—Production Boost
Speaker: Thomas Vitale, Senior Software Engineer at Systematic
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
The document discusses the perils of secret sprawl and clear text secrets in Apache Kafka configurations. It proposes using a key management system (KMS) to securely store secrets and introducing a configuration provider that allows replacing secrets in configuration files with references to the KMS. The Kafka Improvement Proposals (KIPs) 297 and 421 aim to address this by externalizing secrets to providers and automatically resolving secrets during configuration parsing. Key recommendations include selecting a KMS, moving secrets to it, adding the configuration provider, and replacing secrets with indirection tuples pointing to the KMS.
ContainerDays NYC 2015: "Container Orchestration Compared: Kubernetes and Doc...
Slides from Darren Shepherd's talk "Container Orchestration Compared: Kubernetes and Docker Compose, Machine & Swarm" at ContainerDays NYC 2015: http://dynamicinfradays.org/events/2015-nyc/programme.html#orchestration
Sf bay area Kubernetes meetup dec8 2016 - deployment models
I talk about deploying complex, multi-layer applications in Kuberentes.
I describe how Kubernetes AppController project (https://github.com/Mirantis/k8s-AppController) can be leveraged to enhance such deployments
Five years of operating a large scale globally replicated Pulsar installation...
This document summarizes 5 years of operating a large-scale globally replicated Pulsar installation at Verizon Media. It discusses how the installation scaled up from 1 tenant and 2 data centers in 2015 to over 100 tenants and 6 data centers in 2020. It also covers the evolution of hardware used for brokers and bookkeepers, metrics and monitoring, deployment processes, broker isolation policies, storage utilization, and rack awareness in BookKeeper.
Securing Kafka
With Apache Kafka 0.9, the community has introduced a number of features to make data streams secure. In this talk, we’ll explain the motivation for making these changes, discuss the design of Kafka security, and explain how to secure a Kafka cluster. We will cover common pitfalls in securing Kafka, and talk about ongoing security work.
Building Microservices with the 12 Factor App Pattern on AWS
by Chris Hein, Partner Solutions Architect, AWS
Microservices architectures make applications easier to scale and faster to develop, enabling innovation and accelerating time-to-market for new features. But building containerized microservices across multiple teams means you need well-defined, guiding methodologies for software design and implementation. In this talk we’ll discuss architectural best practices for building containerized microservices on AWS, and how traditional software design patterns evolve in the context of containers. We will deep-dive into Martin Fowler’s principles of microservices and map them to the twelve-factor app pattern and real-life considerations. If you are building or in the process of building microservices on AWS, don’t miss this session.
Building and Deploying Cloud Native Applications
This deck provides an overview of Oracle's Cloud Native Application Development offerings. It covers developing and deploying cloud native applications like Microservices and Serverless functions using Continuous Integration and Delivery Pipelines. This will be followed by a workshop where you will get a hands-on experience of how to build and deploy simple Java and Node.js microservices using a CI/CD Pipelines and Kubernetes in Oracle Cloud.
Cloud Native Meetup Santa Clara 07-11-2019 by Manish Kapur
The document discusses trends in cloud native application development like microservices, serverless computing, and DevSecOps. It then describes Oracle's solution for building cloud native apps, including tools for continuous integration/delivery, a container registry, and a managed Kubernetes service. The solution aims to provide an end-to-end platform for developing, deploying, and operating container-based applications on Oracle Cloud Infrastructure.
More Related Content
What's hot
A Series of Fortunate Events: Building an Operator in Java
SpringOne 2021:
Session Title: A Series of Fortunate Events: Building an Operator in Java
Speakers: Alberto C. Ríos, Staff Engineer at VMware; Bella Bai, Software Engineer at VMware
Kafka Needs No Keeper
Kafka is evolving to remove its dependency on Zookeeper. The Kafka Improvement Proposal 500 (KIP-500) aims to manage Kafka's metadata log with a self-managed Raft consensus algorithm and controller quorum rather than relying on Zookeeper. This will improve scalability, robustness, and make deployment easier. It will take multiple releases to fully implement KIP-500, beginning with removing Zookeeper from clients and ending with a release where Zookeeper is no longer required.
A Modern C++ Kafka API | Kenneth Jia, Morgan Stanley
The document discusses a new C++ Kafka API called modern-cpp-kafka that was developed to address requirements for a pub/sub messaging system. It provides examples of how the API simplifies and improves upon an existing C++ Kafka client (librdkafka) for key tasks like producing and consuming messages. The modern-cpp-kafka API matches the Java API naming, uses RAII for lifetime management, and hides polling and queue details. It has led to improved throughput of over 26% for an application. The API is now open source and the team is working to expand it further.
Devoxx fr 2016 - Apache Kafka - Stream Data Platform
This document discusses Kafka, a distributed streaming platform. It provides an overview of Kafka's history and key features, including high throughput, horizontal scaling, persistence, and automatic recovery from failures. The document also covers topics, partitions, producers, consumers, consumer groups, and replication strategies. Examples of companies using Kafka are given, such as LinkedIn, Netflix, Twitter, and Microsoft.
Virtual Flink Forward 2020: Apache Flink Worst Wractices - Konstantin Knauf
Distributed stream processing is evolving from a technology in the sidelines of Big Data to a key enabler for businesses to provide more scalable, real-time services to their customers. We at Ververica, the company founded by the original creators of Apache Flink, and other prominent players in the Flink community have witnessed this development from the driver’s seat. Working with our customer and the wider community we have seen great success stories and we have seen things going wrong. In this talk, I would like to share anecdotes and hard-learned lessons of adopting distributed stream processing – Apache Flink specific as well as across frameworks. Afterwards, you will know, how not to model your use cases as a stream processing application, which data structures not to use, how not to deal with failure, how not to approach the topic of monitoring and much more.
Spring Cloud: API gateway upgrade & configuration in the cloud
In this presentation we walk through features of Spring Cloud Gateway and Spring Cloud Config projects, overview new features provided by Spring Cloud Gateway including advanced routing options for API services supporting parallel APIs in several versions, discuss code examples and configuration options. Once API gateway is deployed, we don’t want to redeploy it on configuration changes as well as redeploy other services upon configuration updates. And this is where Spring Cloud Config enters the game. It allows us to keep configurations in the cloud, for example in a Git repository, and once paired with tools necessary, enables almost zero-down-time configuration updates, audit of changes and parallel configurations for different environments.
Serverless and Servicefull Applications - Where Microservices complements Ser...
Serverless is a misnomer, your future cloud native applications will consist of both microservices and functions, wrapped as Linux containers, but in many cases where you the developer ignore the operational aspects of managing that infrastructure. In this session we get started using Function as a Service (FaaS) engine with Apache OpenWhisk deployed on Kubernetes and OpenShift. With Kubernetes/OpenShift being de-facto platform for Cloud Native Java Applications, we will explore on to see how to make Cloud Native Java Applications a.k.a Microservices can complement the serverless Functions. This technical intensive session will open up one of the possible serverless web application architecture where we deploy an API Gateway into the FaaS platform to draw the curtains up to see the microservices talking to the serverless functions. This session ends with us seeing how Event Sinks and Event Sources map in the Serverless World.
How to build 1000 microservices with Kafka and thrive
This talk is about the Wix ecosystem for event driven architecture on top of Kafka.
I share the best practices, SDKs and tools we have created in order to be able to scale our distributed system to more than 1000 microservices.
Ports, pods and proxies
This document discusses various methods for accessing Kubernetes pods including through API server proxies, port forwarding, and logs/attach. It begins with an overview of how pods expose access points via kubectl. Examples are provided for using kubectl proxy to access pod endpoints, port forwarding to proxy local ports to pods, and retrieving logs and attaching to pods' stdin/stdout/stderr. The raw kubectl option and debugging with increased log levels are also covered.
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
This document discusses securing Apache Kafka deployments with Vormetric and Confluent Platform. It begins with an introduction to Apache Kafka and Confluent Platform. It then provides an overview of Vormetric's policy-driven security solution and how it can be used to encrypt Kafka data at rest. The document outlines the typical Confluent Platform deployment architecture and various security considerations, such as authentication, authorization, and data encryption. Finally, it provides steps for implementing secure deployments using SSL, Kerberos, and Vormetric encryption policies.
10 Key Steps for Moving from Legacy Infrastructure to the Cloud
On-demand recording: https://nginx.webex.com/nginx/lsr.php?RCID=af9c355d1f42420b17e048e82ac6762b
Moving your applications from traditional IT stacks to the cloud is not an easy task. Migration to the cloud can cause security nightmares, performance degradation, and sudden cost spikes, to name just a few possible problems. For a successful cloud migration, you need to evolve both technology and business processes.
Nonetheless, moving from legacy infrastructure to public, private, or hybrid cloud can bring massive benefits, including increased flexibility, the ability to scale up or down as needed, and dramatic cost savings. When done well, transforming your business to adopt cloud services can be both painless and profitable.
Please join us for this webinar by James Bond, CTO at Hewlett Packard Enterprise and an expert in cloud computing. He will cover best practices for making your cloud migration successful, including:
* Why your organization should consider a cloud migration
* How to properly plan for cloud deployment
* What approach you should take to ensure security
* How orchestration tools can help achieve efficiency
* How to build cloud native applications to best take advantage of the cloud
Speaker: James Bond, facebook.com/enterprisecloud
James Bond is an expert in cloud computing with over 25 years of experience in the IT industry. He is a true cloud industry pioneer, having created several successful companies, founded business practices, and hosted infrastructure and software services long before the term "cloud computing" was first used. James is a Chief Technologist for Hewlett Packard Enterprise (HPE) providing cloud strategy, guidance, and implementation planning to Fortune 100 organizations that are planning a transition from legacy IT to cloud. He is a featured speaker at industry conferences and executive briefings throughout North America.
Relevez les défis Kubernetes avec NGINX
Découvrez les dernières tendances de Kubernetes et comment NGINX résout les défis courants dans Kubernetes. Ce webinar vous permettra de découvrir une solution apportant des réponses à vos défis liés à Kubernetes.
Rejoignez ce webinaire pour apprendre :
• Découvrir les avantages des différentes architectures
• Comment utiliser NGINX Ingress Controller pour sécuriser, renforcer et faire évoluer vos environnements Kubernetes
• Comment déployer NGINX nativement dans Kubernetes
• Effectuer un équilibrage de charges, de l’authentification et une sécurisation de manière transparente dans Kubernetes
• La duplication des services d'application, à la fois à l'intérieur et à l'extérieur de Kubernetes
• Optimiser la sécurisation des applications dans Kubernetes avec NGINX App Protect
Common issues with Apache Kafka® Producer
Badai Aqrandista, Confluent, Senior Technical Support Engineer
This session will be about a common issue in the Kafka Producer: producer batch expiry. We will be discussing the Kafka Producer internals, its common causes, such as a slow network or small batching, and how to overcome them. We will also be sharing some examples along the way!
https://www.meetup.com/apache-kafka-sydney/events/279651982/
Spring Boot—Production Boost
SpringOne 2021
Session Title: Spring Boot—Production Boost
Speaker: Thomas Vitale, Senior Software Engineer at Systematic
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
The document discusses the perils of secret sprawl and clear text secrets in Apache Kafka configurations. It proposes using a key management system (KMS) to securely store secrets and introducing a configuration provider that allows replacing secrets in configuration files with references to the KMS. The Kafka Improvement Proposals (KIPs) 297 and 421 aim to address this by externalizing secrets to providers and automatically resolving secrets during configuration parsing. Key recommendations include selecting a KMS, moving secrets to it, adding the configuration provider, and replacing secrets with indirection tuples pointing to the KMS.
ContainerDays NYC 2015: "Container Orchestration Compared: Kubernetes and Doc...
Slides from Darren Shepherd's talk "Container Orchestration Compared: Kubernetes and Docker Compose, Machine & Swarm" at ContainerDays NYC 2015: http://dynamicinfradays.org/events/2015-nyc/programme.html#orchestration
Sf bay area Kubernetes meetup dec8 2016 - deployment models
I talk about deploying complex, multi-layer applications in Kuberentes.
I describe how Kubernetes AppController project (https://github.com/Mirantis/k8s-AppController) can be leveraged to enhance such deployments
Five years of operating a large scale globally replicated Pulsar installation...
This document summarizes 5 years of operating a large-scale globally replicated Pulsar installation at Verizon Media. It discusses how the installation scaled up from 1 tenant and 2 data centers in 2015 to over 100 tenants and 6 data centers in 2020. It also covers the evolution of hardware used for brokers and bookkeepers, metrics and monitoring, deployment processes, broker isolation policies, storage utilization, and rack awareness in BookKeeper.
Securing Kafka
With Apache Kafka 0.9, the community has introduced a number of features to make data streams secure. In this talk, we’ll explain the motivation for making these changes, discuss the design of Kafka security, and explain how to secure a Kafka cluster. We will cover common pitfalls in securing Kafka, and talk about ongoing security work.
Building Microservices with the 12 Factor App Pattern on AWS
by Chris Hein, Partner Solutions Architect, AWS
Microservices architectures make applications easier to scale and faster to develop, enabling innovation and accelerating time-to-market for new features. But building containerized microservices across multiple teams means you need well-defined, guiding methodologies for software design and implementation. In this talk we’ll discuss architectural best practices for building containerized microservices on AWS, and how traditional software design patterns evolve in the context of containers. We will deep-dive into Martin Fowler’s principles of microservices and map them to the twelve-factor app pattern and real-life considerations. If you are building or in the process of building microservices on AWS, don’t miss this session.
What's hot (20)
A Series of Fortunate Events: Building an Operator in Java
A Series of Fortunate Events: Building an Operator in Java
A Modern C++ Kafka API | Kenneth Jia, Morgan Stanley
A Modern C++ Kafka API | Kenneth Jia, Morgan Stanley
Devoxx fr 2016 - Apache Kafka - Stream Data Platform
Devoxx fr 2016 - Apache Kafka - Stream Data Platform
Virtual Flink Forward 2020: Apache Flink Worst Wractices - Konstantin Knauf
Virtual Flink Forward 2020: Apache Flink Worst Wractices - Konstantin Knauf
Spring Cloud: API gateway upgrade & configuration in the cloud
Spring Cloud: API gateway upgrade & configuration in the cloud
Serverless and Servicefull Applications - Where Microservices complements Ser...
Serverless and Servicefull Applications - Where Microservices complements Ser...
How to build 1000 microservices with Kafka and thrive
How to build 1000 microservices with Kafka and thrive
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
Protecting your data at rest with Apache Kafka by Confluent and Vormetric
10 Key Steps for Moving from Legacy Infrastructure to the Cloud
10 Key Steps for Moving from Legacy Infrastructure to the Cloud
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
Overcoming the Perils of Kafka Secret Sprawl (Tejal Adsul, Confluent) Kafka S...
ContainerDays NYC 2015: "Container Orchestration Compared: Kubernetes and Doc...
ContainerDays NYC 2015: "Container Orchestration Compared: Kubernetes and Doc...
Sf bay area Kubernetes meetup dec8 2016 - deployment models
Sf bay area Kubernetes meetup dec8 2016 - deployment models
Five years of operating a large scale globally replicated Pulsar installation...
Five years of operating a large scale globally replicated Pulsar installation...
Building Microservices with the 12 Factor App Pattern on AWS
Building Microservices with the 12 Factor App Pattern on AWS
Similar to 2020-05-06 Apache Flink Meetup London: The Easiest Way to Get Operational with Apache Flink
Building and Deploying Cloud Native Applications
This deck provides an overview of Oracle's Cloud Native Application Development offerings. It covers developing and deploying cloud native applications like Microservices and Serverless functions using Continuous Integration and Delivery Pipelines. This will be followed by a workshop where you will get a hands-on experience of how to build and deploy simple Java and Node.js microservices using a CI/CD Pipelines and Kubernetes in Oracle Cloud.
Cloud Native Meetup Santa Clara 07-11-2019 by Manish Kapur
The document discusses trends in cloud native application development like microservices, serverless computing, and DevSecOps. It then describes Oracle's solution for building cloud native apps, including tools for continuous integration/delivery, a container registry, and a managed Kubernetes service. The solution aims to provide an end-to-end platform for developing, deploying, and operating container-based applications on Oracle Cloud Infrastructure.
JavaCro'14 - WebLogic-GlassFish-JaaS Strategy and Roadmap – Duško Vukmanović
JavaCro'14 - WebLogic-GlassFish-JaaS Strategy and Roadmap – Duško VukmanovićHUJAK - Hrvatska udruga Java korisnika / Croatian Java User Association
For those who are developing, managing, or planning enterprise Java and business application deployments on Oracle WebLogic Server with Oracle Coherence or Oracle GlassFish Server applications, this session gives a roadmap on how Oracle is evolving this infrastructure to be the next-generation application foundation for its customers to build on in a private cloud setting. Together with Java as a Service Update you will be able to see Oracle’s vision, product plans, and roadmap for this server infrastructure and how it will be used in the rapidly maturing cloud infrastructure space. The session will help you make key decisions about running enterprise applications on Oracle’s enterprise Java server foundation.Developing Oracle Fusion Middleware Applications in the Cloud
Slides from session at Oracle OpenWorld 2014 on Developing Oracle Fusion Middleware Applications in the Cloud.
Industry surveys show the use of cloud platforms can reduce overall development time by an order of 11 to 20 percent, with some respondents experience more than 30% time savings. This is largely due to the cloud platform's ability to streamline the development process, including the ability to quickly get the development assets online.
This session detailed the benefits and use cases for devloping and testing Oracle Fusion Middlewara Applications in the cloud. It also covers how to quickly and easily self-provision FMW development and testing environments into the cloud, as well as how to fully automate the build, deploy and configure your applications into the cloud as well as on-premise.
During the session we will provision an Oracle SOA environment to the Cloud; deploy and configure your Oracle SOA composites to the cloud, all in under 30 minutes..
VMware Tanzu Introduction- June 11, 2020
This document outlines an agenda for a presentation on vSphere 7 With Kubernetes and Tanzu. It includes introductions of the presenters Bernard Park and Prasanna Upperi. The presentation will cover an overview of Tanzu, vSphere with Kubernetes, and Tanzu Mission Control. It will also include demonstrations. The document provides background on the presenters and describes the Tanzu portfolio and key products like Tanzu Kubernetes Grid, vSphere with Kubernetes, and Tanzu Mission Control. It outlines how vSphere with Kubernetes allows using Kubernetes to manage VMs, containers, and other workloads across environments in a standardized way through custom resources.
WebGL and Real-Time Web Communication
The document appears to be a presentation about web technologies and real-time communication. It was created by Victor Sand and Peter Moskovits of Goo Technologies and Kaazing Corporation respectively. The presentation discusses HTML5 WebSockets and how they enable full-duplex communication between web browsers and backend servers, bridging continents in real-time. It also demonstrates using WebSockets to control devices like a Raspberry Pi light remotely.
.NET Application Modernization with PAS and Azure DevOps
This document provides an overview of a conference on .NET application modernization with Pivotal and Azure DevOps from October 7-10, 2019 in Austin. It includes presentations from Jason Stevens of Microsoft and Shawn Neal of Pivotal on approaching modernization, the state of .NET, modernization journeys, and using pipelines and environments. There are also sections on Pivotal and Spring logos and brands.
Apache Kafka 2.3 + Confluent Platform 5.3 => What's New?
Confluent Platform 5.3 includes the following key updates:
- Confluent Operator for Kubernetes and production-ready Ansible playbooks to automate deployment of Kafka and Confluent Platform on Kubernetes with cloud-native agility.
- A redesigned user interface for Confluent Control Center and a new command line interface to better understand and manage event streams.
- Role-based access control (in preview) and secret protection features to more securely access the platform.
- Continued integration of the latest Apache Kafka 2.3 release with new connectors and incremental cooperative rebalancing.
Cloud Foundry at VMware
This document provides an overview and history of Cloud Foundry at VMware. It discusses how Cloud Foundry was started as an open source project in 2009 and was later spun out to Pivotal in 2013. It describes the high-level architecture including how the Pivotal CF product is delivered, how Micro BOSH and Cloud Foundry are deployed, how user applications can be run, and how services and updates are managed. It also outlines VMware's continued integration with Cloud Foundry and areas of potential future focus.
C2B2 vFabric Hyperic Kickstart
VMWare's vFabric Hyperic is a powerful application and infrastructure monitoring solution. C2B2's vFabric Hyperic Kickstart is a 5-day engagement where a consultant will: install and configure the Hyperic server for production monitoring; install and configure agents to monitor applications and databases; configure alerts and user access; and provide training to get the most from the investment in Hyperic. The Kickstart provides rapid benefits, reduces implementation risk, and enables extending Hyperic monitoring over the long term.
Pivotal cf for_devops_mkim_20141209
Pivotal Cf, the most advanced Enterpise PaaS Platform in the world. this presentations explains how PCF helps developers and operators and boost their operational agility and enhance their IT capabilities.
Photon Controller: An Open Source Container Infrastructure Platform from VMware
This document summarizes a presentation about VMware's open source Photon Platform, which is optimized for running container workloads at scale. It discusses how Photon Platform uses the Photon Controller distributed management plane and Photon Machine compute hosts to provide a cloud-native platform that can support hundreds of thousands of containers. It also demonstrates deploying a Docker Swarm cluster on top of Photon Platform through the Photon API and controller.
What's new in Pivotal Cloud Foundry 1.6
The document discusses Pivotal Cloud Foundry (PCF), a platform that allows developers to build, deploy, and run cloud-native applications. It summarizes key features of PCF 1.6 including support for Spring Cloud services, the new Diego runtime, Docker containers, and .NET applications. The Diego runtime uses a distributed system of cells, schedulers, and shared state to run containerized applications at scale across private and public clouds. PCF aims to provide developers an integrated platform for building cloud-native applications throughout the full application lifecycle.
CI/CD 기반의 Microservice 개발
This document discusses using Docker and Kubernetes for microservice deployment through continuous integration and continuous delivery (CI/CD) pipelines. It describes building Docker images, pushing them to a registry, and deploying them to Kubernetes through tools like Wercker to automate the deployment process. Steps, pipelines, and workflows are defined in a Wercker YAML configuration file to orchestrate the automated build, test, and deployment of code changes.
Kovair DevOps - Overview Presentation
The pace of delivery in today’s software world has never been faster and more competitive. IT teams of organizations are always getting challenged with increasing demands both from the market as well as their own lines of Business. These demands have raised the need for implementation of Continuous Delivery (CD) and DevOps practices. Organizations need to implement solutions for achieving faster delivery in a more predictable, scalable and productive way by automating their delivery process with complete visibility to every stage of the release process in a collaborative manner.
Kovair Software with its Kovair DevOps offering helps organizations to drive this transformation and improve their IT efficiency by automating and orchestrating software releases, pipelines, and deployments across multiple environments.
Continuous Delivery with Grails and CloudBees
A presentation given at the 2011 Grails Exchange on Continuous Delivery in the Cloud with Grails using CloudBees PaaS.
How can Liferay Developers, Deployers move to the Cloud
The speaker discusses potential benefits for Liferay developers and administrators to use cloud platforms. Plugin developers can move development to the cloud for continuous integration and deployment, using services like CloudBees. Administrators can explore moving Liferay installations to platforms as a service (PaaS) for easier maintenance and scaling. This approach could improve productivity and reduce costs.
OSSFinance_UnlockingFinancialDatawithReal-TimePipelines.pdf
The document discusses building real-time data pipelines for financial data using Apache Kafka, Apache Flink, Apache NiFi, and SQL Stream Builder to ingest, process, analyze, and distribute streaming and batch data across hybrid cloud environments. It also covers using LLMs and Watson Assistant with Cloudera to build conversational interfaces and enhance data and analytics applications. The full platform capabilities of Cloudera DataFlow, Cloudera Data Platform, and Cloudera Machine Learning are presented as enabling real-time and AI-powered financial use cases.
Deliver your App Anywhere … Publicly or Privately
Developers are increasingly adopting a microservices approach for their apps in order to gain rapid iteration capabilities required for delivering new services faster. However, delivering the App still requires multiple steps such as allocation of virtual IPs, provisioning the front load balancer, configuring firewall rules, configuring a public domain, and DDOS. At present, each of these steps requires coordination across multiple teams with multiple iterations per team. The time efficiencies gained by adopting microservices and cloud-native technologies is negated due to the time taken to deliver the App.
In this session, Pranav Dharwadkar, VP of products at Volterra, and Jakub Pavlik, director of engineering, will help you understand these challenges and introduce a distributed proxy architecture that can alleviate the challenges across different cloud environments. This webinar will include a live demo using a distributed proxy architecture to advertise an App publicly and privately.
In this webinar, you will learn:
The steps required to deliver an App using the current approaches
How a distributed proxy architecture can be used to deliver the app publicly and privately
The operational benefits of a distributed proxy architecture for delivering new services
Cloud Foundry and Microservices: A Mutualistic Symbiotic Relationship
With businesses built around software now disrupting multiple industries that appeared to have stable leaders, the need has emerged for enterprises to create "software factories" built around the following principles:
Streaming customer feedback directly into rapid, iterative cycles of application development
Horizontally scaling applications to meet user demand
Compatibility with an enormous diversity of clients, with mobility (smartphones, tablets, etc.) taking the lead
Continuous delivery of value, shrinking the cycle time from concept to cash
Infrastructure has taken the lead in adapting to meet these needs with the move to the cloud, and Platform as a Service (PaaS) has raised the level of abstraction to a focus on an ecosystem of applications and services. However, most applications are still developed as if we're living in the previous generation of both business and infrastructure: the monolithic application. Microservices - small, loosely coupled applications that follow the Unix philosophy of "doing one thing well" - represent the application development side of enabling rapid, iterative development, horizontal scale, polyglot clients, and continuous delivery. They also enable us to scale application development and eliminate long term commitments to a single technology stack.
While microservices are simple, they are certainly not easy. It's recently been said that "microservices are not a free lunch". Interestingly enough, if you look at the concerns expressed here about microservices, you'll find that they are exactly the challenges that a PaaS is intended to address. So while microservices do not necessarily imply cloud (and vice versa), there is in fact a symbiotic relationship between the two, with each approach somehow compensating for the limitations of the other, much like the practices of eXtreme Programming.
Similar to 2020-05-06 Apache Flink Meetup London: The Easiest Way to Get Operational with Apache Flink (20)
Cloud Native Meetup Santa Clara 07-11-2019 by Manish Kapur
Cloud Native Meetup Santa Clara 07-11-2019 by Manish Kapur
JavaCro'14 - WebLogic-GlassFish-JaaS Strategy and Roadmap – Duško Vukmanović
JavaCro'14 - WebLogic-GlassFish-JaaS Strategy and Roadmap – Duško Vukmanović
Developing Oracle Fusion Middleware Applications in the Cloud
Developing Oracle Fusion Middleware Applications in the Cloud
.NET Application Modernization with PAS and Azure DevOps
.NET Application Modernization with PAS and Azure DevOps
Apache Kafka 2.3 + Confluent Platform 5.3 => What's New?
Apache Kafka 2.3 + Confluent Platform 5.3 => What's New?
Photon Controller: An Open Source Container Infrastructure Platform from VMware
Photon Controller: An Open Source Container Infrastructure Platform from VMware
How can Liferay Developers, Deployers move to the Cloud
How can Liferay Developers, Deployers move to the Cloud
OSSFinance_UnlockingFinancialDatawithReal-TimePipelines.pdf
OSSFinance_UnlockingFinancialDatawithReal-TimePipelines.pdf
Cloud Foundry and Microservices: A Mutualistic Symbiotic Relationship
Cloud Foundry and Microservices: A Mutualistic Symbiotic Relationship
More from Ververica
Webinar: How to contribute to Apache Flink - Robert Metzger
Robert Metzger will introduce you to the various ways of contributing to Apache Flink. We will start by an introduction into the Apache Software Foundation, its history and present-day status, and where Apache Flink fits within the Foundation. We’ll then give an overview of the different areas to contribute, and what to consider in those areas.
For example, how can I help users best on the user@flink mailing list, how are decisions being made in the community, how can I help with Flink releases or how can I contribute code to the project.
Webinar: Deep Dive on Apache Flink State - Seth Wiesman
Apache Flink is a world class stateful stream processor presents a huge variety of optional features and configuration choices to the user. Determining out the optimal choice for any production environment and use-case be challenging. In this talk, we will explore and discuss the universe of Flink configuration with respect to state and state backends.
We will start with a closer look under the hood, at core data structures and algorithms, to build the foundation for understanding the impact of tuning parameters and the costs-benefit-tradeoffs that come with certain features and options. In particular, we will focus on state backend choices (Heap vs RocksDB), tuning checkpointing (incremental checkpoints, ...) and recovery (local recovery), serializers and Apache Flink's new state migration capabilities.
Webinar: Detecting row patterns with Flink SQL - Dawid Wysakowicz
This document discusses using Apache Flink's SQL capabilities to analyze streaming data. It provides an example of detecting "rush hour" periods using taxi ride data streamed from New York City. SQL queries with MATCH_RECOGNIZE are shown to identify periods with increasing and decreasing ride counts over 30 minute windows, indicating morning and evening rush hours. The document also demonstrates finding taxi rides with mid-stops and detecting driver fatigue based on total ride durations per day.
Webinar: Flink SQL in Action - Fabian Hueske
Stream processing is rapidly adopted by the enterprise. While in the past, stream processing frameworks mostly provided Java or Scala-based APIs, stream processing with SQL is recently gaining a lot of attention because it makes stream processing accessible to non-programmers and significantly reduces the effort to solve common tasks.
About three years ago, the Apache Flink community started adding SQL support to process static and streaming data in a unified fashion. Today, Flink SQL powers production systems at Alibaba, Huawei, Lyft, and Uber. In this talk, I will discuss the current state of Flink’s SQL support and explain the importance of Flink’s unified approach to process static and streaming data. Once the basics are covered, I will present common real-world use cases ranging from low-latency ETL to pattern detection and demonstrate how easily they can be addressed by Flink SQL.
2018-04 Kafka Summit London: Stephan Ewen - "Apache Flink and Apache Kafka fo...
Learn how the combination of Apache Kafka and Apache Flink is making stateful stream processing even more expressive and flexible to support applications in streaming that were previously not considered streamable.
The new world of applications and fast data architectures has broken up the database: Raw data persistence comes in the form of event logs, and the state of the world is computed by a stream processor. Apache Kafka provides a strong solution for the event log, while Apache Flink forms a powerful foundation for the computation over the event streams.
In this talk we discuss how Flink’s abstraction and management of application state have evolved over time and how Flink’s snapshot persistence model and Kafka’s log work together to form a base to build ‘versioned applications’. We will also show how end-to-end exactly-once processing works through a smart integration of Kafka’s transactions and Flink’s checkpointing mechanism.
2018-01 Seattle Apache Flink Meetup at OfferUp, Opening Remarks and Talk 2
These slides contain the opening remarks and talk #2 from the first Seattle Apache Flink meetup which had the following talks.
Date: Jan 17th, 2018, Wednesday
Location: Bellevue, WA
OPENING REMARKS (~5min)
TALK #1 (~45min)
Haitao Wang, Senior Staff Engineer at Alibaba, will give a presentation on large-scale streaming processing with Flink and Flink SQL at Alibaba and several internal use cases.
See separate Slideshare: https://www.slideshare.net/dataArtisans/201801-seattle-apache-flink-meetup-talk-1-apache-flink-at-alibaba/edit
TALK #2 (~30min)
Bowen Li will talk about details of future meetup planning and logistics. He will also present how OfferUp, the largest mobile marketplace in the U.S., does large-scale stream processing with Flink to better serve local buyers and sellers, and what they have contributed to Flink's DataStream APIs, state backends, metrics system, and connectors.
We may also talk about what's new in Flink 1.4 and how users can leverage these new features, and what Flink 1.5 would look like and what's users vision on Flink.
SPONSOR: OfferUp
Attendees included: Alibaba Group, OfferUp, Uber, Amazon Web Services, Google, Microsoft, Zions Bank, Gridpoint, Dell/EMC, NeoPrime, Nordstrom, Snowflake, Tableau, Oracle, Expedia, Grab, Snapchat, and many others.
Stephan Ewen - Experiences running Flink at Very Large Scale
This talk shares experiences from deploying and tuning Flink steam processing applications for very large scale. We share lessons learned from users, contributors, and our own experiments about running demanding streaming jobs at scale. The talk will explain what aspects currently render a job as particularly demanding, show how to configure and tune a large scale Flink job, and outline what the Flink community is working on to make the out-of-the-box for experience as smooth as possible. We will, for example, dive into - analyzing and tuning checkpointing - selecting and configuring state backends - understanding common bottlenecks - understanding and configuring network parameters
Fabian Hueske - Stream Analytics with SQL on Apache Flink
Fabian Hueske presented on stream analytics using SQL on Apache Flink. Flink provides a scalable platform for stream processing that is fast, accurate, and reliable. Its relational APIs allow querying both batch and streaming data using standard SQL or a LINQ-style Table API. Queries on streaming data produce continuously updating results. Windows can be used to compute aggregates over tumbling time intervals. The dynamic tables representing streaming data can be converted to output streams encoding updates as insertions and deletions. While not all queries can be supported, techniques like limiting state size allow bounding computational resources. Use cases like continuous ETL, dashboards, and event-driven architectures were discussed.
Tzu-Li (Gordon) Tai - Stateful Stream Processing with Apache Flink
As Apache Flink continues to push the boundaries of stateful stream processing as an integral part of its past releases, increasing numbers of users are starting to realize the potential of stateful stream processing as a promising paradigm for robust and reactive data analytics as well as event-driven applications.
This talk aims at covering the general idea and motivations of stateful stream processing, and how Flink enables it with its powerful set of state management features and programming APIs. In addition to that, we will also take a look at the recent advancements related to Flink's state management and large state handling that were driven by our team at data Artisans team in the latest version 1.3 (expected release by end of May / early June).
Kostas Kloudas - Complex Event Processing with Flink: the state of FlinkCEP
Pattern matching over event streams is increasingly being employed in many areas including financial services and click stream analysis. Flink, as a true stream processing engine, emerges as a natural candidate for these usecases. In this talk, we will present FlinkCEP, a library for Complex Event Processing (CEP) based on Flink. At the conceptual level, we will see the different patterns the library can support, we will present the main building blocks we implemented to support them, and we will discuss possible future additions that will further enhance the coverage of the library. At the practical level, we will show how the integration of FlinkCEP with Flink allows the former to take advantage of Flink's rich ecosystem (e.g. connectors) and its stream processing capabilities, such as support for event-time processing, exactly-once state semantics, fault-tolerance, savepoints and high throughput.
Aljoscha Krettek - Portable stateful big data processing in Apache Beam
Apache Beam's new State API brings scalability and consistency to fine-grained stateful processing while remaining portable to any Beam runner. Aljoscha Krettek introduces the new state and timer features in Beam and shows how to use them to express common real-world use cases in a backend-agnostic manner.
Aljoscha Krettek - Apache Flink® and IoT: How Stateful Event-Time Processing ...
This document discusses Apache Flink and how it enables accurate analytics for Internet of Things (IoT) applications through stateful event-time stream processing. It begins by defining IoT and event-time stream processing, explaining that IoT data is continuously generated and has timestamps. It then discusses challenges like time mismatches between event time and processing time. The document also covers Flink's capabilities for stateful stream processing including failure handling through checkpoints, updating applications using savepoints, and high availability of the JobManager. It positions Flink as a stateful stream processor well-suited for IoT use cases.
Timo Walther - Table & SQL API - unified APIs for batch and stream processing
SQL is undoubtedly the most widely used language for data analytics. It is declarative and can be optimized and efficiently executed by most query processors. Therefore the community has made effort to add relational APIs to Apache Flink, a standard SQL API and a language-integrated Table API.
Both APIs are semantically compatible and share the same optimization and execution path based on Apache Calcite. Since Flink supports both stream and batch processing and many use cases require both kinds of processing, we aim for a unified relational layer.
In this talk we will look at the current API capabilities, find out what's under the hood of Flink’s relational APIs, and give an outlook for future features such as dynamic tables, Flink's way how streams are converted into tables and vice versa leveraging the stream-table duality.
Apache Flink Meetup: Sanjar Akhmedov - Joining Infinity – Windowless Stream ...
The extensive set of high-level Flink primitives makes it easy to join windowed streams. However, use cases that don’t have windows can prove to be more complicated, making it necessary to leverage operator state and low-level primitives to manually implement a continuous join. This talk will focus on the anomalies that present themselves when performing streaming joins with infinite windows, and the problems encountered operating topologies that back user-facing data. We will describe the approach taken at ResearchGate to implement and maintain a consistent join result of change data capture streams.
Kostas Kloudas - Extending Flink's Streaming APIs
As more and more organizations and individual users turn to Apache Flink for their streaming workloads, there is a bigger demand for additional functionality out-of-the-box. On one hand, there is demand for more low-level APIs that allow for more control, while on the other, users ask for more high-level additions that make the common cases easier to express. This talk will present the new concepts added to the Datastream API in Flink-1.2 and for the upcoming Flink-1.3 release that tried to consolidate the aforementioned goals. We will talk, among others, about the ProcessFunction, a new low level stream processing primitive that gives the user full control over how each event is processed and can register and react to timers, changes in the windowing logic that allow for more flexible windowing strategies, side outputs, and new features concerning the Flink connectors.
Fabian Hueske - Stream Analytics with SQL on Apache Flink
SQL is undoubtedly the most widely used language for data analytics for many good reasons. It is declarative,
many database systems and query processors feature advanced query optimizers and highly efficient execution engines, and last but not least it is the standard that everybody knows and uses. With stream processing technology becoming mainstream a question arises: “Why isn’t SQL widely supported by open source stream processors?”. One answer is that SQL’s semantics and syntax have not been designed with the characteristics of streaming data in mind. Consequently, systems that want to provide support for SQL on data streams have to overcome a conceptual gap. One approach is to support standard SQL which is known by users and tools but comes at the cost of cumbersome workarounds for many common streaming computations. Other approaches are to design custom SQL-inspired stream analytics languages or to extend SQL with streaming-specific keywords. While such solutions tend to result in more intuitive syntax, they suffer from not being established standards and thereby exclude many users and tools.
Apache Flink is a distributed stream processing system with very good support for streaming analytics. Flink features two relational APIs, the Table API and SQL. The Table API is a language-integrated relational API with stream-specific features. Flink’s SQL interface implements the plain SQL standard. Both APIs are semantically compatible and share the same optimization and execution path based on Apache Calcite.
In this talk we present the future of Apache Flink’s relational APIs for stream analytics, discuss their conceptual model, and showcase their usage. The central concept of these APIs are dynamic tables. We explain how streams are converted into dynamic tables and vice versa without losing information due to the stream-table duality. Relational queries on dynamic tables behave similar to materialized view definitions and produce new dynamic tables. We show how dynamic tables are converted back into changelog streams or are written as materialized views to external systems, such as Apache Kafka or Apache Cassandra, and are updated in place with low latency. We conclude our talk demonstrating the power and expressiveness of Flink’s relational APIs by presenting how common stream analytics use cases can be realized.
Stephan Ewen - Stream Processing as a Foundational Paradigm and Apache Flink'...
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays.
The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges.
We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
Stefan Richter - A look at Flink 1.2 and beyond @ Berlin Meetup
As we are quickly moving towards the end of the year, version 1.2 of Apache Flink is already just around the corner. In this talk we give a full overview of the new release, which brings us
dynamic job rescaling, integration with Apache Mesos, query able state, secure data access, and Kafka 0.10 support.
We also take a closer technical look at some of the most anticipated features. In particular, we will present details on dynamic job rescaling and query able state that were driven by our team at data Artisans.
With dynamic job rescaling, Flink 1.2 can now easily adjust operator parallelism to react to workload changes, while maintaining the fault tolerance guarantees and performance of previous versions.
Queryable state is our first step to blur the boundaries between stream processors and databases with the potential to revolutionize the current state-of-the-art in big data. We present how to blend database functionality with Flink by providing live read-access to operator states in a running streaming pipeline.
This talk concludes with a glimpse on the future roadmap beyond Flink 1.2 and how data Artisans plans to continue pushing the boundaries of stream processing.
Robert Metzger - Apache Flink Community Updates November 2016 @ Berlin Meetup
This document provides a summary of the Flink community update presented at the Berlin Flink Meetup on November 29, 2016. The agenda included a Flink community update by Kostas Tzoumas and Robert Metzger from data Artisans, a look at Apache Flink 1.2 by Stefan Richter from data Artisans, and a presentation on real-time analytics as a service at King by Gyula Fóra. The community update discussed the progress made since May 2016, including the upcoming 1.2 release and work on the 1.3 release through the FLIP process. Metrics were presented showing growth in the Flink community on GitHub and in local meetup groups around the world. Attendees were
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays.
The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges.
We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
More from Ververica (20)
Webinar: How to contribute to Apache Flink - Robert Metzger
Webinar: How to contribute to Apache Flink - Robert Metzger
Webinar: Deep Dive on Apache Flink State - Seth Wiesman
Webinar: Deep Dive on Apache Flink State - Seth Wiesman
Webinar: Detecting row patterns with Flink SQL - Dawid Wysakowicz
Webinar: Detecting row patterns with Flink SQL - Dawid Wysakowicz
2018-04 Kafka Summit London: Stephan Ewen - "Apache Flink and Apache Kafka fo...
2018-04 Kafka Summit London: Stephan Ewen - "Apache Flink and Apache Kafka fo...
2018-01 Seattle Apache Flink Meetup at OfferUp, Opening Remarks and Talk 2
2018-01 Seattle Apache Flink Meetup at OfferUp, Opening Remarks and Talk 2
Stephan Ewen - Experiences running Flink at Very Large Scale
Stephan Ewen - Experiences running Flink at Very Large Scale
Fabian Hueske - Stream Analytics with SQL on Apache Flink
Fabian Hueske - Stream Analytics with SQL on Apache Flink
Tzu-Li (Gordon) Tai - Stateful Stream Processing with Apache Flink
Tzu-Li (Gordon) Tai - Stateful Stream Processing with Apache Flink
Kostas Kloudas - Complex Event Processing with Flink: the state of FlinkCEP
Kostas Kloudas - Complex Event Processing with Flink: the state of FlinkCEP
Aljoscha Krettek - Portable stateful big data processing in Apache Beam
Aljoscha Krettek - Portable stateful big data processing in Apache Beam
Aljoscha Krettek - Apache Flink® and IoT: How Stateful Event-Time Processing ...
Aljoscha Krettek - Apache Flink® and IoT: How Stateful Event-Time Processing ...
Timo Walther - Table & SQL API - unified APIs for batch and stream processing
Timo Walther - Table & SQL API - unified APIs for batch and stream processing
Apache Flink Meetup: Sanjar Akhmedov - Joining Infinity – Windowless Stream ...
Apache Flink Meetup: Sanjar Akhmedov - Joining Infinity – Windowless Stream ...
Fabian Hueske - Stream Analytics with SQL on Apache Flink
Fabian Hueske - Stream Analytics with SQL on Apache Flink
Stephan Ewen - Stream Processing as a Foundational Paradigm and Apache Flink'...
Stephan Ewen - Stream Processing as a Foundational Paradigm and Apache Flink'...
Stefan Richter - A look at Flink 1.2 and beyond @ Berlin Meetup
Stefan Richter - A look at Flink 1.2 and beyond @ Berlin Meetup
Robert Metzger - Apache Flink Community Updates November 2016 @ Berlin Meetup
Robert Metzger - Apache Flink Community Updates November 2016 @ Berlin Meetup
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Recently uploaded
OpenMetadata Community Meeting - 5th June 2024
The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features.
* How to run your own data quality framework
* What is the performance impact of running data quality frameworks
* How to run the test cases in your own ETL pipelines
* How the Incident Manager is integrated
* Get notified with alerts when test cases fail
Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
Microservice Teams - How the cloud changes the way we work
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
Hand Rolled Applicative User Validation Code Kata
Could you use a simple piece of Scala validation code (granted, a very simplistic one too!) that you can rewrite, now and again, to refresh your basic understanding of Applicative operators <*>, <*, *>?
The goal is not to write perfect code showcasing validation, but rather, to provide a small, rough-and ready exercise to reinforce your muscle-memory.
Despite its grandiose-sounding title, this deck consists of just three slides showing the Scala 3 code to be rewritten whenever the details of the operators begin to fade away.
The code is my rough and ready translation of a Haskell user-validation program found in a book called Finding Success (and Failure) in Haskell - Fall in love with applicative functors.
Vitthal Shirke Java Microservices Resume.pdf
Software Engineering, Software Consulting, Tech Lead, Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Transaction, Spring MVC, OpenShift Cloud Platform, Kafka, REST, SOAP, LLD & HLD.
Measures in SQL (SIGMOD 2024, Santiago, Chile)
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
Graspan: A Big Data System for Big Code Analysis
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
Energy consumption of Database Management - Florina Jonuzi
Presentation from Florina Jonuzi at the GSD Community Stage Meetup on June 06, 2024
Empowering Growth with Best Software Development Company in Noida - Deuglo
Do you want Software for your Business? Visit Deuglo
Deuglo has top Software Developers in India. They are experts in software development and help design and create custom Software solutions.
Deuglo follows seven steps methods for delivering their services to their customers. They called it the Software development life cycle process (SDLC).
Requirement — Collecting the Requirements is the first Phase in the SSLC process.
Feasibility Study — after completing the requirement process they move to the design phase.
Design — in this phase, they start designing the software.
Coding — when designing is completed, the developers start coding for the software.
Testing — in this phase when the coding of the software is done the testing team will start testing.
Installation — after completion of testing, the application opens to the live server and launches!
Maintenance — after completing the software development, customers start using the software.
SMS API Integration in Saudi Arabia| Best SMS API Service
Discover the benefits and implementation of SMS API integration in the UAE and Middle East. This comprehensive guide covers the importance of SMS messaging APIs, the advantages of bulk SMS APIs, and real-world case studies. Learn how CEQUENS, a leader in communication solutions, can help your business enhance customer engagement and streamline operations with innovative CPaaS, reliable SMS APIs, and omnichannel solutions, including WhatsApp Business. Perfect for businesses seeking to optimize their communication strategies in the digital age.
WWDC 2024 Keynote Review: For CocoaCoders Austin
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
How Can Hiring A Mobile App Development Company Help Your Business Grow?
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Wondering how X-Sign gained popularity in a quick time span? This eSign functionality of XfilesPro DocuPrime has many advancements to offer for Salesforce users. Explore them now!
Unveiling the Advantages of Agile Software Development.pdf
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
Odoo ERP Vs. Traditional ERP Systems – A Comparative Analysis
When it is all about ERP solutions, companies typically meet their needs with common ERP solutions like SAP, Oracle, and Microsoft Dynamics. These big players have demonstrated that ERP systems can be either simple or highly comprehensive. This remains true today, but there are new factors to consider, including a promising new contender in the market that’s Odoo. This blog compares Odoo ERP with traditional ERP systems and explains why many companies now see Odoo ERP as the best choice.
What are ERP Systems?
An ERP, or Enterprise Resource Planning, system provides your company with valuable information to help you make better decisions and boost your ROI. You should choose an ERP system based on your company’s specific needs. For instance, if you run a manufacturing or retail business, you will need an ERP system that efficiently manages inventory. A consulting firm, on the other hand, would benefit from an ERP system that enhances daily operations. Similarly, eCommerce stores would select an ERP system tailored to their needs.
Because different businesses have different requirements, ERP system functionalities can vary. Among the various ERP systems available, Odoo ERP is considered one of the best in the ERp market with more than 12 million global users today.
Odoo is an open-source ERP system initially designed for small to medium-sized businesses but now suitable for a wide range of companies. Odoo offers a scalable and configurable point-of-sale management solution and allows you to create customised modules for specific industries. Odoo is gaining more popularity because it is built in a way that allows easy customisation, has a user-friendly interface, and is affordable. Here, you will cover the main differences and get to know why Odoo is gaining attention despite the many other ERP systems available in the market.
Recently uploaded (20)
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
Energy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina Jonuzi
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
SMS API Integration in Saudi Arabia| Best SMS API Service
SMS API Integration in Saudi Arabia| Best SMS API Service
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...
Unveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdf
Odoo ERP Vs. Traditional ERP Systems – A Comparative Analysis
Odoo ERP Vs. Traditional ERP Systems – A Comparative Analysis
2020-05-06 Apache Flink Meetup London: The Easiest Way to Get Operational with Apache Flink
- 1. © 2019 Ververica Konstantin Knauf Apache Flink Committer Head of Product @ Ververica The Easiest Way to Get Operational with Apache Flink
- 2. © 2019 Ververica2 Ververica Platform Community Edition Permanently Free Commercial Use Unlimited Applications
- 4. © 2019 Ververica4 Managed Deployment of Flink on Kubernetes Stateful Upgrades, Migrations, Rollbacks High-Availability w/o Zookeeper Community Edition Configuration and Metadata Management Artifact Management
- 5. © 2019 Ververica5 Managed Deployment of Flink on Kubernetes Stateful Upgrades, Migrations, Rollbacks High-Availability w/o Zookeeper Community Edition vs Stream Edition Configuration and Metadata Management Artifact Management Authentication with OpenID Connect & ApiTokens Role-Based Access Control Multiple Namespaces SLA Driven Support & Off-Cycle Bug Fixes Multi-Data Center Failover
- 6. © 2019 Ververica6 A Look Ahead Infrastructure Team
- 7. © 2019 Ververica7 Infrastructure Team SQL SQL SQL SQL SQL SQL SQL SQL SQL Integrated Streaming SQL Platform A Look Ahead
- 8. © 2019 Ververica8 A Look Ahead Infrastructure Team SQL SQL SQL SQL SQL SQL SQL SQL SQL Apache Flink Auto-Pilot
- 9. © 2019 Ververica Konstantin Knauf @snntrable www.ververica.com Thank You! # Getting Started # https://github.com/ververica/ververica-platform-playground $ helm repo add https://charts.ververica.com $ helm install vvp ververica/ververica-platform Apache Flink in Production with Ververica Platform Seth Wiesman https://www.youtube.com/watch?v=BaosqxYVcIw&lis=