Reliable Event Delivery with Apache Kafka®

•

Dec. 10, 2021

• •

Reliable event delivery
in Apache Kafka®
Jacek Grobelny, Tech Lead @ Consdata

Agenda
Consdata
Santander Poczta
Pierwsza implementacja
Problemy
Refactoring do Event Sourcingu
Obsługa błędów
Live Demo
P...

<CONSDATA >

Next SlideShares

Upcoming SlideShare

[Confluent] 실시간 하이브리드, 멀티 클라우드 데이터 아키텍처로 빠르게 혀...

[Confluent] 실시간 하이브리드, 멀티 클라우드 데이터 아키텍처로 빠르게 혀...

Loading in …3

×

Reliable Event Delivery with Apache Kafka®

Dec. 10, 2021

• •

Reliable Event Delivery with Apache Kafka®
Jacek Grobelny, Technology Lead at Consdata
Meetup link: https://www.meetup.com/Poznan-Kafka/events/282272378/
Presentation is in Polish

Reliable Event Delivery with Apache Kafka®
Jacek Grobelny, Technology Lead at Consdata
Meetup link: https://www.meetup.com/Poznan-Kafka/events/282272378/
Presentation is in Polish

More Related Content

Bezonomics: How Amazon Is Changing Our Lives and What the World's Best Companies Are Learning from It Brian Dumaine

No Filter: The Inside Story of Instagram Sarah Frier

Autonomy: The Quest to Build the Driverless Car—And How It Will Reshape Our World Lawrence D. Burns

Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think James Vlahos

From Gutenberg to Google: The History of Our Future Tom Wheeler

SAM: One Robot, a Dozen Engineers, and the Race to Revolutionize the Way We Build Jonathan Waldman

The Future Is Faster Than You Think: How Converging Technologies Are Transforming Business, Industries, and Our Lives Peter H. Diamandis

So You Want to Start a Podcast: Finding Your Voice, Telling Your Story, and Building a Community That Will Listen Kristen Meinzer

Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are Seth Stephens-Davidowitz

Life After Google: The Fall of Big Data and the Rise of the Blockchain Economy George Gilder

Future Presence: How Virtual Reality Is Changing Human Connection, Intimacy, and the Limits of Ordinary Life Peter Rubin

Live Work Work Work Die: A Journey into the Savage Heart of Silicon Valley Corey Pein

Ninety Percent of Everything: Inside Shipping, the Invisible Industry That Puts Clothes on Your Back, Gas in Your Car, and Food on Your Plate Rose George

Carrying the Fire: 50th Anniversary Edition Michael Collins

Island of the Lost: An Extraordinary Story of Survival at the Edge of the World Joan Druett

The Basics of Bitcoins and Blockchains: An Introduction to Cryptocurrencies and the Technology that Powers Them (Cryptography, Derivatives Investments, Futures Trading, Digital Assets, NFT) Antony Lewis

Einstein's Fridge: How the Difference Between Hot and Cold Explains the Universe Paul Sen

After Steve: How Apple Became a Trillion-Dollar Company and Lost its Soul Tripp Mickle

The Quiet Zone: Unraveling the Mystery of a Town Suspended in Silence Stephen Kurczy

The Wires of War: Technology and the Global Struggle for Power Jacob Helberg

System Error: Where Big Tech Went Wrong and How We Can Reboot Rob Reich

If Then: How the Simulmatics Corporation Invented the Future Jill Lepore

Liftoff: Elon Musk and the Desperate Early Days That Launched SpaceX Eric Berger

The Science of Time Travel: The Secrets Behind Time Machines, Time Loops, Alternate Realities, and More! Elizabeth Howell

A Brief History of Motion: From the Wheel, to the Car, to What Comes Next Tom Standage

An Ugly Truth: Inside Facebook’s Battle for Domination Sheera Frenkel

Bitcoin Billionaires: A True Story of Genius, Betrayal, and Redemption Ben Mezrich

The Players Ball: A Genius, a Con Man, and the Secret History of the Internet's Rise David Kushner

User Friendly: How the Hidden Rules of Design Are Changing the Way We Live, Work, and Play Cliff Kuang

Lean Out: The Truth About Women, Power, and the Workplace Marissa Orr

Blockchain: The Next Everything Stephen P. Williams

Uncanny Valley: A Memoir Anna Wiener

Reliable Event Delivery with Apache Kafka®

1. Reliable event delivery in Apache Kafka® Jacek Grobelny, Tech Lead @ Consdata
2. Agenda Consdata Santander Poczta Pierwsza implementacja Problemy Refactoring do Event Sourcingu Obsługa błędów Live Demo Podsumowanie
3. <CONSDATA >
4. Santander Poczta retail/corporate desktop/mobile ~7 mln kont ~700 mln wiadomości ~3TB storage
5. Problemy pierwszej implementacji
6. Problemy pierwszej implementacji synchroniczna komunikacja
7. Problemy pierwszej implementacji synchroniczna komunikacja masowa wysyłka
8. Problemy pierwszej implementacji synchroniczna komunikacja masowa wysyłka rosnący wolumen
9. Event Sourcing to the Rescue!
10. Zmiana architektury
11. Zmiana architektury Dziedzina i eventy
12. Zmiana architektury Dziedzina i eventy State store
13. Zmiana architektury Dziedzina i eventy State store Event store
14. Apache Kafka
15. Apache Kafka Referencje (LinkedIn, Netflix, Uber)
16. Apache Kafka Referencje (LinkedIn, Netflix, Uber) Wydajność
17. Apache Kafka Referencje (LinkedIn, Netflix, Uber) Wydajność Wolumen danych
18. Apache Kafka Referencje (LinkedIn, Netflix, Uber) Wydajność Wolumen danych Dumb Broker/Smart Consumer
19. Obsługa błędów
20. Obsługa błędów
21. Obsługa błędów
22. Obsługa błędów 2.0
23. Obsługa błędów 2.0
24. Obsługa błędów 2.0
25. Migracja
26. Migracja Wygenerowanie eventów na podstawie bazy
27. Migracja Wygenerowanie eventów na podstawie bazy Przepięcie się z trybu synchronicznego na asynchroniczny
28. Migracja Wygenerowanie eventów na podstawie bazy Przepięcie się z trybu synchronicznego na asynchroniczny Nowe state story!
29. LIVE DEMO https://github.com/Consdata/kouncil
30. Podsumowanie
31. Podsumowanie Dumb Broker/Smart Consumer vs Obsługa błędów
32. Podsumowanie Dumb Broker/Smart Consumer vs Obsługa błędów Alerting i monitoring
33. Podsumowanie Dumb Broker/Smart Consumer vs Obsługa błędów Alerting i monitoring Dobrać odpowiednie narzędzia developerskie
34. Dziękuję https://ynleborg.github.io https://blog.consdata.tech/ @ynleborg