Recommended
Recommended
More Related Content
More from LibbySchulze
More from LibbySchulze (20)
Enhance your Kafka Infrastructure with Fluvio.pptx
- 1. Enhance your Kafka Infrastructure with Fluvio Webinar on Aug 16 @ 10 AM PDT
- 2. Webinar Agenda In this webinar, we will: ● Discuss what are the differences between Kafka and Fluvio ● Why companies are leveraging Fluvio to compliment Kafka ● How to quickly get started with Fluvio ● Live demo with Q&A
- 3. What are the differences between Kafka & Fluvio Programming language ● Kafka was built using the Java programming language ● Fluvio was built using the Rust programming language Fluvio provides Real-time data transformation ● SmartModules allow for programmable stream processing for clean data Performance Improvements ● Up to 3x latency ● Up to 5x throughput ● Up to 7x CPU utilization ● Up to 50 Memory utilization
- 4. Why companies are leveraging Fluvio to compliment Kafka
- 5. Stream Processing + Data Transformation
- 6. InfinyOn Approach to Intelligent Data Streaming ● Smart Pipelines vs. Simple Pipelines ○ Event stream processing with Web Assembly SmartModules ○ Process and transform data with single digit millisecond latency ○ Apply business logic to ensure data quality ● Smart Connectors vs ETL ○ Smart Modules can be deployed at source or sink connectors ○ No ETL tools required ● One solution vs. multiple tools and vendors Distributed Intelligence with centralized control
- 7. Live Demo with Q & A
- 8. Calls to Action ● Sign up for InfinyOn Cloud: ○ https://infinyon.cloud/signup ● Instructions on how to build a data streaming app: ○ https://www.infinyon.com/tutorials/rust/hello-world/ ● Schedule an event stream processing demo: ○ https://www.infinyon.com/use-cases/event-stream-processing/
Editor's Notes
- Hello and welcome to the: Enhance your Kafka Infrastructure with Fluvio webinar. I’m Grant Swanson, your host for today’s session. We will start with a few educational slides on Kafka vs. Fluvio, then go into a live demo and then finish up with with Q&A. Please enter questions anytime during the session in the questions window. In the handout section you will see some of our newest content that includes a speaking session on WASM technology from our CTO, Sehyo Chang at the most recent Kubecon Europe event. We also have content in PDF format that includes a Java vs Rust solution brief, a financial services solution brief, a real-time economy whitepaper, an eBook on how to enhance machine learning models with real-time data pipelines, and an InfinyOn Cloud datasheet. InfinyOn Cloud is a fully managed Fluvio service for enterprises.
- Now we will cover the agenda for this webinar, where we will: Discuss what are the differences between Kafka and Fluvio Why companies are leveraging Fluvio to compliment Kafka How to quickly get started with Fluvio Live demo with Q&A
- Let's talk about some of the differences between Kafka and Fluvio starting with Programming languages. Kafka was built over a decade ago using the Java programming language Fluvio was recently built using the Rust programming language Fluvio differentiates itself as a technology by providing Real-time stream processing and data transformation using web assembly, all in a single unified cluster. SmartModules allow for programmable stream processing for clean data. We will dive deeper into SmartModule functionality in the upcoming slides. We recently completed a POC with a company that serves over 3,000 global banks that enables over 1.2 billion people to carry out their daily banking needs. In the POC they did benchmark testing on Fluvio vs. Kafka. The results were outstanding. The Performance Improvements include Up to 3x latency Up to 5x throughput Up to 7x CPU utilization Up to 50 Memory utilization
- Why companies are leveraging Fluvio to compliment Kafka The number #1 use-case and reason why companies are leveraging Fluvio to enhance their Kafka infrastructure is to stream clean data to a Kafka topic. The Data Collection Pipeline shown in this diagram starts with an HTTP service and a Fluvio HTTP source connector. Streaming data flows into the Kafka sink connector where a SmartModules is applied. SmartModules are one of our premiere features, allowing users to have direct control over their streaming data by providing a programmable API for inline data transformation. Finally the transformed data event flows to the Kafka Consumer. Users can quickly and easily stream clean data to Kafka with no external ETL tools.
- With stream processing and real-time data transformation, companies can stream data from a sale, a shipment, or a trade and perform any transformations that are needed before it sinks to an application or database. The two most common use-cases are to build rich front-end customer experiences and real-time back-end operations. We believe that in the coming years there will be a fundamental paradigm shift in data engineering where companies will move away from traditional Extract, Transform and Load or ETL tools to an STL infrastructure or Stream Transform and Load.
- The InfinyOn approach to intelligent data streaming includes a new concept called smart pipelines. Smart pipelines are unique to InfinyOn and include Web Assembly Smart Modules that can process and transform data with single digit millisecond latency. Business logic can be applied to ensure data quality. SmartModules can be deployed at source connectors, sink connectors, or within the stream processing unit eliminating the need for ETL tools while providing a single solution with distributed intelligence and centralized control.
- Question 1: What other types of data transformation can be performed with Fluvio? filter, map, array map, etc. Question 2: Can you apply multiple SmartModules to a single data stream?
- If you are interested in building an event-driven application with InfinyOn Cloud, please sign up for a free InfinyOn Cloud account. Click on the Hello world link that has instructions on how to build a data streaming app. You can also schedule a demo with our technical team by clicking on the event stream processing link and then click on the request a demo button at the bottom of the page. All of these links are available in the chat window.