Push Technology, a verified gold technology partner, developed the Diffusion Kafka Adapter to meet the evolving requirements of the Kafka community. Diffusion is an Intelligent Event-Data Platform. Using Push’s Kafka Adapter, developers extend Kafka solutions efficiently and securely over the Internet, streaming real-time, event-driven data to millions of end-user apps and IoT devices. The adapter automatically maps Kafka message types to JSON, allowing web, mobile, and IoT clients to securely consume the data stored as rich data structures within Kafka. The adapter enables developers to configure how imported topics are structured, and to import topics that match a regular expression. The adapter can translate data from Kafka topics to Diffusion topics, and from Diffusion to Kafka. The adapter is designed it to make it quick and easy to integrate Kafka with Diffusion. The presentation will provide real-world examples of how the adapter is used to power Kafka in an event-driven world.

1. © 2021 Push Technology Ltd
Real-Time Streaming of Event-Driven Data
Maximizing Capabilities of Kafka

2. © 2021 Push Technology Ltd
Sanjai Marimadaiah
Chief Product Officer
Push Technology Inc.
PushTechnology.com
Extending Kafka
for
Distribution at Internet Scale
TOPIC

3. © 2021 Push Technology Ltd
Use Case - Streaming Market Data
Risk Modeling
Market Data
FLAT TOPIC STRUCTURE
Perfect for large volumes of Data
Kafka Streams API
Library to build streaming apps
Responsibility on Consumer
LOG-BASED EVENT-BROKER
Efficient for replaying/distributing
data to services & micro-services
Applications
over the Internet
Audit

4. © 2021 Push Technology Ltd
Requirements to Distribute Data at Internet Scale
v MASSIVE SCALABILITY
Millions of Topics & Connections
v EFFICIENT USE OF BANDWIDTH
Reduce cost of data consumption
Flow-Control, Delay, Conflation
v REAL-TIME RESPONSE
Latency in milli-seconds
v SIMPLIFIED CLIENT SOFTWARE
Time to Market and Maintenance
v OPEN PROTOCOLS & INTERFACES
MQTT, REST API, HTTP
Pub/Sub, Req-Response
REAL-TIME EVENT BROKER
An event-broker with critical
real-time streaming functionality
DEEP HIERARCHICAL TOPIC TREE
Organize and enrich data for efficient
distribution of specific data at scale
SECURITY : FINE GRAINED & ROLE-BASED
Access to specific parts of data in a JSON
Per-topic permissions in a hierarchical model
CAPABILITIES OF SOLUTION

5. © 2021 Push Technology Ltd
Extend Kafka with Diffusion® to Distribute Data at Scale
Derivative Pricing
Risk Modeling
Audit
Dashboards
Market Data
Diffusion®
Intelligent Event-Data Platform
Client Applications
over the internet

6. © 2021 Push Technology Ltd
Diffusion® Extends Kafka to Distribute Data at Scale
BUILT-IN ADAPTER TO KAFKA
Easy to ingest data from Kafka Topics
REAL-TIME EVENT BROKER
Queue-based event broker with Event History,
Pub/Sub, Request-Response, Flow-Control
DELTA STREAMING of EVENT DATA
Sends only bytes changed from previous message
OPEN PROTOCOL SUPPORT
MQTT, REST API, HTTP to server variety of clients
REAL-TIME DATA ENRICHMENT
Deep Hierarchical Topic Trees
DSLs to enrich data and set security policies

7. © 2021 Push Technology Ltd
Learn more about Kafka + Diffusion®
Go.PushTechnology.com/KafkaSummit
v Kafka Tutorials
v Sample Code on GitHub
v Implement on Diffusion Cloud for FREE

8. © 2021 Push Technology Ltd
© 2020 Push Technology Ltd Private and Confidential
Thank You