Download as PDF, PPTX
Uploaded byconfluent
Change Data Streaming Patterns For Microservices With Debezium (Gunnar Morling, Red Hat) Kafka Summit London 2019
Gunnar Morling presents on change data streaming patterns for microservices using Debezium. Debezium is an open source platform for change data capture that retrieves change events from transaction logs of different databases. It streams these events to Apache Kafka in a unified format. This allows microservices to stay synchronized by consuming the change events and keeping their local data stores in sync without direct database access. Various patterns are demonstrated including microservice data synchronization, leveraging single message transformations, and ensuring data quality.
More Related Content
Similar to Change Data Streaming Patterns For Microservices With Debezium (Gunnar Morling, Red Hat) Kafka Summit London 2019
Change Data Streaming Patterns For Microservices With Debezium (Gunnar Morling, Red Hat) Kafka Summit London 2019
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8. A Better SolutionA Better Solution Streaming Change Events From the DatabaseStreaming Change Events From the Database @gunnarmorling Order Service C C UC U U D C C - Create U - Update D - Delete Change Data Capture #KafkaSummit #Debezium
- 9. A Better SolutionA Better Solution Streaming Change Events From the DatabaseStreaming Change Events From the Database @gunnarmorling Order Service C C UC U U D C C - Create U - Update D - Delete Change Data Capture #KafkaSummit #Debezium
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21. @gunnarmorling Order Item Stock App Local DBLocal DB Local DB App App Item ChangesStock Changes Pattern: Microservice DataPattern: Microservice Data SynchronizationSynchronization Microservice ArchitecturesMicroservice Architectures Propagate data between different services without coupling Each service keeps optimised views locally #KafkaSummit #Debezium
- 22. Source DB (with "Events" table) Kafka Connect Apache Kafka DBZ Order Events Credit Worthiness Check Events Pattern: OutboxPattern: Outbox Separate Events TableSeparate Events Table @gunnarmorling Order Service Shipment Service Customer Service IDCategory Type Payload 123 Order OrderCreated { "id" : 123, ... } 456 Order OrderDetail- Canceled { "id" : 456, ... } 789 ... ... ... Id AggregateType AggregateId Type Payload ec6e Order 123 OrderCreated { "id" : 123, ... } 8af8 Order 456 OrderDetailCanceled { "id" : 456, ... } 890b Customer 789 InvoiceCreated { "id" : 789, ... } "Outbox" table #KafkaSummit #Debezium
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29.
- 30.