Build streaming LLM with Timeplus and Zilliz
•
0 likes•16 views
Processing streaming data in Kafka with Timeplus Proton and Zilliz as the vector database
Recommended
Recommended
More Related Content
Similar to Build streaming LLM with Timeplus and Zilliz
Similar to Build streaming LLM with Timeplus and Zilliz (20)
More from Zilliz
More from Zilliz (19)
Recently uploaded
Recently uploaded (20)
Build streaming LLM with Timeplus and Zilliz
- 1. April 2024 Streaming LLM Jove Zhong Co-Founder, Timeplus Data Streaming LLM Build Streaming LLM with Timeplus and Zilliz
- 2. April 2024 Streaming LLM Let’s start with a demo
- 3. April 2024 Streaming LLM February 2024 | Confidential February 2024 | Confidential Smaller ← -> Larger Edge Real-Time Future of AI AI&Vector&LLM 101
- 7. April 2024 Streaming LLM OLAP/DW not for streaming Why We Build Timeplus? Kafka is not for computing Flink is not a database
- 9. April 2024 Streaming LLM Timeplus 101 Unlocking business value from streaming data instantly Timeplus Cloud (SaaS) Timeplus Enterprise (OnPrem) Proton (Open Core)
- 10. April 2024 Streaming LLM https://github.com/timeplus-io/prot on SELECT * FROM car_live_data Stream tail SELECT count(*) FROM car_live_data Global aggregation SELECT window_start, count(*) FROM tumble(car_live_data, 1m) GROUP BY window_start Window aggregation SELECT cid, speed_kmh, lag(speed_kmh) OVER (PARTITION BY cid) AS last_spd FROM car_live_data Sub streams SELECT window_start, count(*) FROM tumble(car_live_data, 5s) GROUP BY window_start EMIT AFTER WATERMARK AND DELAY 2s Late event SELECT * FROM car_live_data WHERE _tp_time > now() - 1d Time travel SELECT device, cpu_usage, timestamp FROM device_utils INNER JOIN table(device_products_info) AS dim ON device_utils.product_id = dim.id Stream join SELECT * FROM table(car_live_data) Historical query Streaming SQL 101
- 11. April 2024 Streaming LLM Real-time data sources Trading Ops Applications After Before Case Study Timeplus + Real-Time Trade Monitoring Timeplus + Network Infrastructure Monitoring Global SOC PoP PoP
- 12. April 2024 Streaming LLM Model Serving fastapi stream view train predict Online payment data label payment realtime features 1m features 5m features daily features all features mv training data - query join asof join materialize view Label Interface query Predict UDF https://www.timeplus.com/post/real-time-machine-learning Case Study: AI/ML Timeplus + Real-Time Fraud Detection How to build a unified online + offline feature stores for AI/ML model
- 13. April 2024 Streaming LLM Thanks Questions? ⭐ https://github.com/timeplus-io/proton