1
An introduction to Confluent Cloud:
Apache Kafka as a Service
Hans Jespersen
VP, WW Systems Engineering
Confluent Inc
MÜNCHEN - 09. OKTOBER 2018
Confidential
Introducing Confluent CloudTM
A Way to Liberate Developers.
Confidential
01
Freedom to deploy
Kafka in any public
cloud
4
02
Access the rich
Kafka ecosystem
03
Develop faster using
the leading streaming
platform
04
Liberate yourself from
the operations burden
Introducing Confluent Cloud™
● Built on open source Apache Kafka
Confluent Cloud™ Gives You
Vendor Independence.
* support for AWS and GCP available today
● Port your existing pipelines regardless of
initial starting point
● No proprietary technology so not tied to
a single provider*
The most popular platform
Publish and subscribe, store and
process streams of data based on
Kafka’s latest release
Develop faster with the leading streaming platform
6
Fine tune for scale
Custom partitioning
Log compaction
Highest throughput
Best performance of any streaming
data service
Up to 1GB/s write, 2GB/s read
throughput
Retain and replay more data
Up to infinite retention
Leading open source
streaming platform
Access the Rich Kafka Ecosystem
Integrates with leading data
systems and apps
Multi-Language Support
7
Includes Kafka Core + Streams and
Connect API’s
Vibrant and growing open source
community
Support for leading languages
Bring more applications to the
platform
200+ pre-built connectors
4 ways Confluent
Cloud minimizes your
operations burden
No Infrastructure
Setup
No Cluster
Tuning
No Managing
Upgrades
Deploy Kafka
in Minutes
Liberate yourself from the operations burden
9
Feature Benefit Apache Kafka
Confluent Open
Source
Confluent
Enterprise
Confluent
Cloud™
Apache Kafka
High throughput, low latency, high availability, secure
distributed streaming platform
Kafka Connect API
Advanced API for connecting external sources/destinations
into Kafka
Kafka Streams API
Simple library that enables streaming application
development within the Kafka framework
Additional Clients
Supports non-Java clients; C, C++, Python, .NET and several
others
REST Proxy
Provides universal access to Kafka from any network
connected device via HTTP
Schema Registry
Central registry for the format of Kafka data – guarantees all
data is always consumable
Pre-Built Connectors
HDFS, JDBC, Elasticsearch, Amazon S3 and other connectors
fully certified and supported by Confluent
JMS Client
Support for legacy Java Message Service (JMS) applications
consuming and producing directly from Kafka
Confluent Control Center
Enables easy connector management, monitoring and
alerting for a Kafka cluster
Cloud Management
Console
Simply and effectively manage a Confluent Cloud cluster N/A
Auto Data Balancer Rebalancing data across cluster to remove bottlenecks Automatic
Replicator
Multi-datacenter replication simplifies and automates MDC
Kafka clusters
Support
Enterprise class support to keep your Kafka environment
running at top performance
Community Community 24x7x365 24x7x365
Confluent Cloud: Part of the Confluent Family
11
● New project
● Low budget
● Not business-critical
● Wants fast /
frictionless access
● Production apps
● Budget available
● Business-critical
● Wants reliable
service levels
Developer VP Engineering
Cloud Professional & Cloud Enterprise
Cloud Professional Cloud Enterprise
Unleash developer velocity Streaming service for all
your enterprise applications
12
Use Cases
Log Aggregation (Syslog)
Retail - Click Stream Analytics, Recommendations
AdTech (Mobile In App Advertising)
FinTech (Insurance)
IoT (Sensor data ingestion, Connected Factory)
Micro-Services
Rich User Experiences / Mobile Apps (i.e. Loyalty Apps, Gaming, etc)
Born Digital Companies
Legacy Middleware Modernization (Real-time ETL, MQ/JMS replacement)
Anything you can do with Kafka you can do with Confluent Cloud!
● Hosted service that reduces the burden on your
operations team
● No Vendor Lock In - take all your streaming
applications to another Kafka provider
● Get Visibility - Operations Dashboard gives you full
transparency into your Kafka pipelines - by topic, by
cluster, by app
● Supported by the team who created Kafka and has the
most experience working in large scale streaming
Confluent Cloud™ for the Enterprise: Scale without the Staff
13

An Introduction to Confluent Cloud: Apache Kafka as a Service

  • 1.
    1 An introduction toConfluent Cloud: Apache Kafka as a Service Hans Jespersen VP, WW Systems Engineering Confluent Inc MÜNCHEN - 09. OKTOBER 2018
  • 2.
  • 3.
    Introducing Confluent CloudTM AWay to Liberate Developers. Confidential
  • 4.
    01 Freedom to deploy Kafkain any public cloud 4 02 Access the rich Kafka ecosystem 03 Develop faster using the leading streaming platform 04 Liberate yourself from the operations burden Introducing Confluent Cloud™
  • 5.
    ● Built onopen source Apache Kafka Confluent Cloud™ Gives You Vendor Independence. * support for AWS and GCP available today ● Port your existing pipelines regardless of initial starting point ● No proprietary technology so not tied to a single provider*
  • 6.
    The most popularplatform Publish and subscribe, store and process streams of data based on Kafka’s latest release Develop faster with the leading streaming platform 6 Fine tune for scale Custom partitioning Log compaction Highest throughput Best performance of any streaming data service Up to 1GB/s write, 2GB/s read throughput Retain and replay more data Up to infinite retention
  • 7.
    Leading open source streamingplatform Access the Rich Kafka Ecosystem Integrates with leading data systems and apps Multi-Language Support 7 Includes Kafka Core + Streams and Connect API’s Vibrant and growing open source community Support for leading languages Bring more applications to the platform 200+ pre-built connectors
  • 9.
    4 ways Confluent Cloudminimizes your operations burden No Infrastructure Setup No Cluster Tuning No Managing Upgrades Deploy Kafka in Minutes Liberate yourself from the operations burden 9
  • 10.
    Feature Benefit ApacheKafka Confluent Open Source Confluent Enterprise Confluent Cloud™ Apache Kafka High throughput, low latency, high availability, secure distributed streaming platform Kafka Connect API Advanced API for connecting external sources/destinations into Kafka Kafka Streams API Simple library that enables streaming application development within the Kafka framework Additional Clients Supports non-Java clients; C, C++, Python, .NET and several others REST Proxy Provides universal access to Kafka from any network connected device via HTTP Schema Registry Central registry for the format of Kafka data – guarantees all data is always consumable Pre-Built Connectors HDFS, JDBC, Elasticsearch, Amazon S3 and other connectors fully certified and supported by Confluent JMS Client Support for legacy Java Message Service (JMS) applications consuming and producing directly from Kafka Confluent Control Center Enables easy connector management, monitoring and alerting for a Kafka cluster Cloud Management Console Simply and effectively manage a Confluent Cloud cluster N/A Auto Data Balancer Rebalancing data across cluster to remove bottlenecks Automatic Replicator Multi-datacenter replication simplifies and automates MDC Kafka clusters Support Enterprise class support to keep your Kafka environment running at top performance Community Community 24x7x365 24x7x365 Confluent Cloud: Part of the Confluent Family
  • 11.
    11 ● New project ●Low budget ● Not business-critical ● Wants fast / frictionless access ● Production apps ● Budget available ● Business-critical ● Wants reliable service levels Developer VP Engineering Cloud Professional & Cloud Enterprise Cloud Professional Cloud Enterprise Unleash developer velocity Streaming service for all your enterprise applications
  • 12.
    12 Use Cases Log Aggregation(Syslog) Retail - Click Stream Analytics, Recommendations AdTech (Mobile In App Advertising) FinTech (Insurance) IoT (Sensor data ingestion, Connected Factory) Micro-Services Rich User Experiences / Mobile Apps (i.e. Loyalty Apps, Gaming, etc) Born Digital Companies Legacy Middleware Modernization (Real-time ETL, MQ/JMS replacement) Anything you can do with Kafka you can do with Confluent Cloud!
  • 13.
    ● Hosted servicethat reduces the burden on your operations team ● No Vendor Lock In - take all your streaming applications to another Kafka provider ● Get Visibility - Operations Dashboard gives you full transparency into your Kafka pipelines - by topic, by cluster, by app ● Supported by the team who created Kafka and has the most experience working in large scale streaming Confluent Cloud™ for the Enterprise: Scale without the Staff 13