The Open Policy Agent (OPA) is an open source, general-purpose policy engine that enables unified, context-aware policy enforcement across the entire stack.
In just a few years, Open Policy Agent (OPA) has emerged as one of the hotter technologies for policy management and fine grained access control in the cloud native ecosystem. Now it’s coming for your APIs!
In this session we will explore the underlying concepts and some of the components involved in OPA before we get hands on in live coding test driven authorization policies to protect API endpoints.
Modern businesses have data at their core, and this data is changing continuously. How can we harness this torrent of information in real-time? The answer is stream processing, and the technology that has since become the core platform for streaming data is Apache Kafka. Among the thousands of companies that use Kafka to transform and reshape their industries are the likes of Netflix, Uber, PayPal, and AirBnB, but also established players such as Goldman Sachs, Cisco, and Oracle.
Unfortunately, today’s common architectures for real-time data processing at scale suffer from complexity: there are many technologies that need to be stitched and operated together, and each individual technology is often complex by itself. This has led to a strong discrepancy between how we, as engineers, would like to work vs. how we actually end up working in practice.
In this session we talk about how Apache Kafka helps you to radically simplify your data processing architectures. We cover how you can now build normal applications to serve your real-time processing needs — rather than building clusters or similar special-purpose infrastructure — and still benefit from properties such as high scalability, distributed computing, and fault-tolerance, which are typically associated exclusively with cluster technologies. Notably, we introduce Kafka’s Streams API, its abstractions for streams and tables, and its recently introduced Interactive Queries functionality. As we will see, Kafka makes such architectures equally viable for small, medium, and large scale use cases.
Saturn 2018: Managing data consistency in a microservice architecture using S...Chris Richardson
A revised and extended version that I gave at Saturn 2018.
The services in a microservice architecture must be loosely coupled and so cannot share database tables. What’s more, two phase commit (a.k.a. a distributed transaction) is not a viable option for modern applications. Consequently, a microservices application must use the Saga pattern, which maintains data consistency using a series of local transactions.
In this presentation, you will learn how sagas work and how they differ from traditional transactions. We describe how to use sagas to develop business logic in a microservices application. You will learn effective techniques for orchestrating sagas and how to use messaging for reliability. We will describe the design of a saga framework for Java and show a sample application.
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...confluent
PayPal currently processes tens of billions of signals per day from different sources in batch and streaming mode. The data processing platform is the one powering these different analytical needs and use cases, not just at PayPal but our adjacencies like Venmo, Hyperwallet and iZettle. End users of this platform demand access to data insights with as much flexibility as possible to explore it with low processing latency.
One such use case is where our Switchboard(data de-multiplexer) platform where we process approximately 20 billion events daily and provide data to different teams and platforms with-in PayPal and also to platform outside PayPal for more insights. When we started building this platform Kafka was just another asynchronous message processing platform for us but we have seen it evolving to a place where its adds value not just in terms of event processing but also for platform resiliency and scalability.
Takeaway for the audience: Most people work with and have knowledge about data. With this talk I want to present information which is relevant and meaningful to the audience. Information and examples which will make it easier for attendees to understand our complex system and hopefully have some practical takeaways to use Kafka for similar problems on their hand.
Na každom pracovisku sa vyskytuje plytvanie, ktoré pomôže odhaliť a riešiť práve metóda 5S. Ak chceme budovať štíhly podnik, 5S je často implementované ako prvé. Metóda 5S je metóda, ktorá naozaj "uprace" výrobu a zvýši produktivitu. Ak je 5S dodržiavané a neustále zlepšované, tak možno očakávať 10 - 15% nárast produktivity.
The Open Policy Agent (OPA) is an open source, general-purpose policy engine that enables unified, context-aware policy enforcement across the entire stack.
In just a few years, Open Policy Agent (OPA) has emerged as one of the hotter technologies for policy management and fine grained access control in the cloud native ecosystem. Now it’s coming for your APIs!
In this session we will explore the underlying concepts and some of the components involved in OPA before we get hands on in live coding test driven authorization policies to protect API endpoints.
Modern businesses have data at their core, and this data is changing continuously. How can we harness this torrent of information in real-time? The answer is stream processing, and the technology that has since become the core platform for streaming data is Apache Kafka. Among the thousands of companies that use Kafka to transform and reshape their industries are the likes of Netflix, Uber, PayPal, and AirBnB, but also established players such as Goldman Sachs, Cisco, and Oracle.
Unfortunately, today’s common architectures for real-time data processing at scale suffer from complexity: there are many technologies that need to be stitched and operated together, and each individual technology is often complex by itself. This has led to a strong discrepancy between how we, as engineers, would like to work vs. how we actually end up working in practice.
In this session we talk about how Apache Kafka helps you to radically simplify your data processing architectures. We cover how you can now build normal applications to serve your real-time processing needs — rather than building clusters or similar special-purpose infrastructure — and still benefit from properties such as high scalability, distributed computing, and fault-tolerance, which are typically associated exclusively with cluster technologies. Notably, we introduce Kafka’s Streams API, its abstractions for streams and tables, and its recently introduced Interactive Queries functionality. As we will see, Kafka makes such architectures equally viable for small, medium, and large scale use cases.
Saturn 2018: Managing data consistency in a microservice architecture using S...Chris Richardson
A revised and extended version that I gave at Saturn 2018.
The services in a microservice architecture must be loosely coupled and so cannot share database tables. What’s more, two phase commit (a.k.a. a distributed transaction) is not a viable option for modern applications. Consequently, a microservices application must use the Saga pattern, which maintains data consistency using a series of local transactions.
In this presentation, you will learn how sagas work and how they differ from traditional transactions. We describe how to use sagas to develop business logic in a microservices application. You will learn effective techniques for orchestrating sagas and how to use messaging for reliability. We will describe the design of a saga framework for Java and show a sample application.
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...confluent
PayPal currently processes tens of billions of signals per day from different sources in batch and streaming mode. The data processing platform is the one powering these different analytical needs and use cases, not just at PayPal but our adjacencies like Venmo, Hyperwallet and iZettle. End users of this platform demand access to data insights with as much flexibility as possible to explore it with low processing latency.
One such use case is where our Switchboard(data de-multiplexer) platform where we process approximately 20 billion events daily and provide data to different teams and platforms with-in PayPal and also to platform outside PayPal for more insights. When we started building this platform Kafka was just another asynchronous message processing platform for us but we have seen it evolving to a place where its adds value not just in terms of event processing but also for platform resiliency and scalability.
Takeaway for the audience: Most people work with and have knowledge about data. With this talk I want to present information which is relevant and meaningful to the audience. Information and examples which will make it easier for attendees to understand our complex system and hopefully have some practical takeaways to use Kafka for similar problems on their hand.
Na každom pracovisku sa vyskytuje plytvanie, ktoré pomôže odhaliť a riešiť práve metóda 5S. Ak chceme budovať štíhly podnik, 5S je často implementované ako prvé. Metóda 5S je metóda, ktorá naozaj "uprace" výrobu a zvýši produktivitu. Ak je 5S dodržiavané a neustále zlepšované, tak možno očakávať 10 - 15% nárast produktivity.
Sme otrokmi zložitosti sveta okolo nás. Zložitosť nám bráni rozlišovať dôležité a nedôležité veci v našom živote. Budeme hovoriť o princípoch zjednodušovania, ktoré začína v našom myslení a môže prispieť k tomu, že aj naša práca bude jednoduchšia a výkonnejšia.
COMM-PASS katalóg - manažérske tréningy a workshopy - základné modulyCOMM-PASS
COMM-PASS KATALÓG TRÉNINGOV základné tréningové moduly
Ponukový katalóg obsahuje vybrané tréningové moduly.
Tréningové moduly je možné absolvovať samostatne ale aj v skupinách podľa tematickej nadväznosti.
Pri výbere pokročilého tréningu je vhodné absolvovať základnú úroveň tréningu, ale nie je to podmienkou. Výber úrovne závisí od aktuálnych schopností a zručností účastníkov.
Ďalšie články nájdete aj na Linkedin:
https://www.linkedin.com/today/author/38686991
SMART BRAIN PROJECT – diskusná skupina na Linkedin
https://www.linkedin.com/groups?groupDashboard=&gid=4002106&trk=anet_ug_anlytx&goback=.gna_4002106
VIDEO inšpirácie na youtube
https://www.youtube.com/channel/UCosv6ntXajFFsAVwkihmjBw
COMM-PASS na Linkedin
https://www.linkedin.com/company/comm-pass?trk=top_nav_home
http://www.slideshare.net/COMM-PASS
http://www.commpass.sk
COMM-PASS modulové workshopy - manažérske vzdelávanie, rozvoj a rastCOMM-PASS
COMM-PASS katalóg workshopov - základné tréningové moduly
Ponukový katalóg obsahuje vybrané tréningové moduly.
Tréningové moduly je možné absolvovať samostatne ale aj v skupinách podľa tematickej nadväznosti.
Pri výbere pokročilého tréningu je vhodné absolvovať základnú úroveň tréningu, ale nie je to podmienkou. Výber úrovne závisí od aktuálnych schopností a zručností účastníkov.
Ďalšie články nájdete aj na Linkedin:
https://www.linkedin.com/today/author/38686991
SMART BRAIN PROJECT – diskusná skupina na Linkedin
https://www.linkedin.com/groups?groupDashboard=&gid=4002106&trk=anet_ug_anlytx&goback=.gna_4002106
VIDEO inšpirácie na youtube
https://www.youtube.com/channel/UCosv6ntXajFFsAVwkihmjBw
COMM-PASS na Linkedin
https://www.linkedin.com/company/comm-pass?trk=top_nav_home
http://www.slideshare.net/COMM-PASS
http://www.commpass.sk
Prezentácia slúži na predstavenie možností vzdelávania v IT Academy.
Potrebuješ sa rýchlo naučiť dôležité veci pre reálnu prax? Si znechutený zo školy či práce? Máš dosť 1200 stranových kníh, v ktorej každý tretí príklad nefunguje? Nemáš polroka na samoštúdiúm?
Vyber si z ponuky 1023 prezenčných a 203 online certifikovaných kurzov. Staň sa odborníkom v oblasti IT, marketingu a manažmentu!
IT Academy má kurzy v kategóriach:
- Štartovacie kurzy
- Microsoft Office
- Operačné systémy
- Grafika a Dizajn
- Tvorba Web Stránok
- Databázy a Analytika
- Programovacie jazyky
- CISCO a sieť
- Administrácia IT
- SAP a ABAP
- Marketing, reklama a právo
- Manažérske kurzy
Naštartuj sa nami v IT!
Sleduj náš web:
IT Academy ➡ https://www.it-academy.sk/
VITA - Virtual IT Academy ➡ https://www.vita.sk/
Pridaj si nás na:
Facebook ➡ https://www.facebook.com/ITAcademySK/
LinkedIn ➡ https://www.linkedin.com/company/it-academy-sk/
Sme otrokmi zložitosti sveta okolo nás. Zložitosť nám bráni rozlišovať dôležité a nedôležité veci v našom živote. Budeme hovoriť o princípoch zjednodušovania, ktoré začína v našom myslení a môže prispieť k tomu, že aj naša práca bude jednoduchšia a výkonnejšia.
COMM-PASS katalóg - manažérske tréningy a workshopy - základné modulyCOMM-PASS
COMM-PASS KATALÓG TRÉNINGOV základné tréningové moduly
Ponukový katalóg obsahuje vybrané tréningové moduly.
Tréningové moduly je možné absolvovať samostatne ale aj v skupinách podľa tematickej nadväznosti.
Pri výbere pokročilého tréningu je vhodné absolvovať základnú úroveň tréningu, ale nie je to podmienkou. Výber úrovne závisí od aktuálnych schopností a zručností účastníkov.
Ďalšie články nájdete aj na Linkedin:
https://www.linkedin.com/today/author/38686991
SMART BRAIN PROJECT – diskusná skupina na Linkedin
https://www.linkedin.com/groups?groupDashboard=&gid=4002106&trk=anet_ug_anlytx&goback=.gna_4002106
VIDEO inšpirácie na youtube
https://www.youtube.com/channel/UCosv6ntXajFFsAVwkihmjBw
COMM-PASS na Linkedin
https://www.linkedin.com/company/comm-pass?trk=top_nav_home
http://www.slideshare.net/COMM-PASS
http://www.commpass.sk
COMM-PASS modulové workshopy - manažérske vzdelávanie, rozvoj a rastCOMM-PASS
COMM-PASS katalóg workshopov - základné tréningové moduly
Ponukový katalóg obsahuje vybrané tréningové moduly.
Tréningové moduly je možné absolvovať samostatne ale aj v skupinách podľa tematickej nadväznosti.
Pri výbere pokročilého tréningu je vhodné absolvovať základnú úroveň tréningu, ale nie je to podmienkou. Výber úrovne závisí od aktuálnych schopností a zručností účastníkov.
Ďalšie články nájdete aj na Linkedin:
https://www.linkedin.com/today/author/38686991
SMART BRAIN PROJECT – diskusná skupina na Linkedin
https://www.linkedin.com/groups?groupDashboard=&gid=4002106&trk=anet_ug_anlytx&goback=.gna_4002106
VIDEO inšpirácie na youtube
https://www.youtube.com/channel/UCosv6ntXajFFsAVwkihmjBw
COMM-PASS na Linkedin
https://www.linkedin.com/company/comm-pass?trk=top_nav_home
http://www.slideshare.net/COMM-PASS
http://www.commpass.sk
Prezentácia slúži na predstavenie možností vzdelávania v IT Academy.
Potrebuješ sa rýchlo naučiť dôležité veci pre reálnu prax? Si znechutený zo školy či práce? Máš dosť 1200 stranových kníh, v ktorej každý tretí príklad nefunguje? Nemáš polroka na samoštúdiúm?
Vyber si z ponuky 1023 prezenčných a 203 online certifikovaných kurzov. Staň sa odborníkom v oblasti IT, marketingu a manažmentu!
IT Academy má kurzy v kategóriach:
- Štartovacie kurzy
- Microsoft Office
- Operačné systémy
- Grafika a Dizajn
- Tvorba Web Stránok
- Databázy a Analytika
- Programovacie jazyky
- CISCO a sieť
- Administrácia IT
- SAP a ABAP
- Marketing, reklama a právo
- Manažérske kurzy
Naštartuj sa nami v IT!
Sleduj náš web:
IT Academy ➡ https://www.it-academy.sk/
VITA - Virtual IT Academy ➡ https://www.vita.sk/
Pridaj si nás na:
Facebook ➡ https://www.facebook.com/ITAcademySK/
LinkedIn ➡ https://www.linkedin.com/company/it-academy-sk/