Downloaded 19 times
Uploaded byconfluent
Build a Real-Time Decision Support Application for Financial Market Traders with Confluent and Quix
The document discusses new features and updates from Confluent, including tech talks with partners, improved fully managed data stream integrations, and enhancements to AI model capabilities. It highlights the expansion of programs aimed at facilitating seamless transitions to Confluent’s platform and deploying data streaming solutions. Additionally, it introduces Quix's real-time data engineering framework and how it complements Flink for operational analytics and ML applications.
More Related Content
Similar to Build a Real-Time Decision Support Application for Financial Market Traders with Confluent and Quix
Build a Real-Time Decision Support Application for Financial Market Traders with Confluent and Quix
- 1. @yourtwitterhandle | developer.confluent.io Startingsoon… STARTING SOOOOON.. Starting sooooon ..
- 2. Copyright 2021, Confluent,Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. Real-time AI Model Config Params, Features Vector Store Object store AI-powered Apps Telemetry MLOps Pipelines Training Data Output
- 3. Copyright 2021, Confluent,Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. Real-time AI Params, Features Vector Store Telemetry MLOps Pipelines Model Inference Output
- 4. Copyright 2021, Confluent,Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. Real-time AI Params, Features Vector Store Telemetry MLOps Pipelines Model Inference Output
- 5. @yourtwitterhandle | developer.confluent.io Startingsoon… STARTING SOOOOON.. Starting sooooon ..
- 6. Goal Partners Tech Talksare webinars where subject matter experts from a Partner talk about a specific use case or project. The goal of Tech Talks is to provide best practices and applications insights, along with inspiration, and help you stay up to date about innovations in confluent ecosystem.
- 7. @yourtwitterhandle | developer.confluent.io Startingsoon… STARTING SOOOOON.. Starting sooooon ..
- 8. The Confluent Q3’24 Launch Making stream processing a developer’s best friend 💙🖤 STREAM CONNECT GOVERN Expanding our Connect with Confluent (CwC) Partner Program Access and configure fully managed data streams from directly within 50+ popular data systems. 5 new integrations added in Q3 2024 ! HTTP Source & Sink Connectors v2 Two of our most popular fully managed source and sink connectors just got even better! Client-Side Field Level Encryption Hey compliance teams - we don’t see your sensitive data. Encrypt your most sensitive data before it gets to Confluent Cloud. PROCESS Bringing Serverless Flink to the Tools and Formats Developers Love Flexible schema management- Use your own schema formats, don’t convert stuff. Table API (Open Preview)- Build Flink apps and functions your way with Java, Python. AI Model Inference (Open Preview)- Query your AI models with Flink SQL. More and More Private Networking Expanding to dedicated clusters on AWS. Confluent OEM Partner Program Enabling MSPs, CSPs, and ISVs worldwide to provide Confluent’s data streaming platform Easier sizing with new broker and client metrics Need more partitions or capacity? Our Metrics API now includes partition warnings, CKU count, and cluster load. We also updated the UI to show client metrics and versions. Confluent welcomes WarpStream! We’re taking data streaming in your own cloud to the next level Build with Confluent (BwC) 11 new partners added in Q3 2024
- 9. Q3’ 24 PartnerProgram Updates OEM Partner Program Confluent Migration Accelerator Introducing our OEM Partner Program! Enabling MSPs, CSPs, and ISVs worldwide to provide Confluent’s data streaming platform everywhere your business is run. Expanding our Confluent Migration Accelerator Program! Ensures seamless transitions from Apache Kafka or traditional systems to Confluent, offering exclusive resources, tailored support, and potential funding. Build with Confluent (BwC) Expanding our Build with Confluent Program! Customers can easily jumpstart new use cases with SIs’ data streaming solutions with specialized software bundles, expert support, and access to Confluent’s GTM teams. Connect with Confluent (CwC) Expanding our Connect with Confluent (CwC) Partner Program! Access and configure fully managed data streams from directly within 50+ popular data systems 5 new integrations added in Q3 2024!
- 10.
- 11. How Confluent Works:Data Augmentation Prepare data for a real-time knowledge base and contextualization in LLM queries Schema Registry Confluent Cloud Consumer Group Confluent-certified Sink Connector or Native Integration Confluent-certified Sink Connector or Native Integration Operational Data Store (Unstructured Data) Vector Store Versioned Data Products in git Embedding API Gateway Embedding Model Instances Vector Embedding Service Schema Specs Terraform
- 12. Implement Retrieval Augmented Generation(RAG) to enrich LLMs models with real-time updates by using AI models as first-class resources in Apache Flink: ● Utilize AI models directly within Flink queries ● Manage remotely hosted AI models with SQL DDL statements. ● Invoke remote AI model endpoints (e.g., OpenAI, AzureML, AWS SageMaker) Reference a remote model from customer endpoint Model prediction Integrate remote AI models seamlessly into your data pipeline Preview
- 13. Quix Perspective :AI 13
- 15. Organizational structure determinessystem structure Conway’s Law “Organizations which design systems are constrained to produce systems which are copies of the communication structures of these organizations.”
- 16. Traditional Multi-hop andMedallion architecture
- 17. Shifting left fromtraditional multi-hop ETL architecture
- 18. Shift left inpractice
- 19. Quix enables companiesto “shift left” and empower data teams to build with the tools they know
- 20. Build pipelines &storage to organise data and present it to the business Information Technology Quix brings all your teams and data together Data Engineering Software Engineering Data Science Provision & control infrastructure and resources Build and maintain business applications that create and consume data Study data to discover insights and build ML & AI models
- 21. Reference architecture inFormula 1
- 22. Quix Streams andQuix CLI Open source Python framework for real-time data engineering. Streaming DataFrames inspired by Pandas to easily move from batch to streaming. Sources and Sinks API for building custom integrations. Quix Pure Python real-time data engineering framework Quix Cloud and Quix Edge Unified platform for product engineering and data teams to collaborate on building and deploying applications and ML models without having to manage infrastructure.
- 23.
- 24.
- 25. Quix Streams Stateful windowoperations
- 26. What’s new inQuix Streams v2.11 Sources and Sinks API CSV, InfluxDB and more) Avro, JSON Schema, Protobuf and schema registry support
- 27. Preview of QuixStreams v3 Branching/splitting data pipelines Multiple topics consumed/produced in a single application
- 28. Quix Streams roadmap Checkout the roadmap: github.com/orgs/quixio/projects/1 Contribute/open issues: github.com/quixio/quix-streams/issues
- 29. Quix platform: QuixCloud and Quix Edge (BYOC)
- 30. Confluent Cloud nativeintegration
- 31. 🤝 Flink andQuix: better together 🐿 Why Flink? ● Best for data ingestion and processing of high volume raw data ● Best for flattening, branching and joining big data streams ● Best for software and platform engineering teams to prepare data for downstream data analytics and data science teams 🏎 Why Quix? ● Best for building real-time operational analytics applications ● Best for working with the data ecosystem in Python, e.g. feature stores, vector databases, ML model lifecycle ● Best for data analytics and data science teams to self-serve and build applications on real-time data streams
- 32. Solving real-time decisionsupport for financial traders
- 33.
- 34.
- 35.
- 36. AWS and BromptonBicycle Real-time analytics for e-bike telemetry
- 37.
- 38. Control Enabling race-winning IoTconnectivity with ML
- 39. Quix Templates Pre-built projectsand ready-to-run code snippets
- 40.