SlideShare a Scribd company logo
1 | October 2022, Stockholm, Andreas R. Hyllested
Does Kafka deliver what is
needed?
2 | October 2022, Stockholm, Andreas R. Hyllested
The Architect
Andreas Rishede Hyllested
Senior Enterprise Architect
andreas.rishede.hyllested@dsv.com
17 years in
* Development
* Business Consulting
* Architecture
Today
* Architecting the Enterprise
3 | October 2022, Stockholm, Andreas R. Hyllested
What is DSV doing?
4 | October 2022, Stockholm, Andreas R. Hyllested
Running the supply chain
To consignee
From shipper
Freight forwarding services
Shipment booking — Pick-up — Warehouse — Documentation
& customs clearance — Cargo consolidation — Purchase order
management — Cross-dock terminal — Insurance Transport
Subcontracted
Logistics and distribution
Warehousing — Picking/packing — Cross-dock terminal —
Deconsolidation — Labelling, configuration, testing — Distribution
Documentation & customs clearance — E-commerce fulfilment — Carbon
emission reports — Supply Chain innovation — 4PL
5 | October 2022, Stockholm, Andreas R. Hyllested
Global footprint
More than 75,000
employees in over 90
countries
3rd largest
freight forwarder globally
+1,500 offices &
logistics facilities
DKK 182 billion
in annual revenue
Gross profit split on main activities
Air & Sea Road Solutions
63% 19% 18%
6 | October 2022, Stockholm, Andreas R. Hyllested
Customers across all industrues
Healthcare
Retail & Fashion
Technology
Industrial
Renewable Energy
Specialised Air & Sea
verticals
Chemicals
Oil and Gas
Fairs and Events
Project Logistics
Aerospace
Automotive
7 | October 2022, Stockholm, Andreas R. Hyllested
IT Strategy
8 | October 2022, Stockholm, Andreas R. Hyllested
DSV IT Strategy
01
Current operations
02
Acquisition ready
03
Digital innovation
Focus areas
9 | October 2022, Stockholm, Andreas R. Hyllested
01 Current
operations
10 | October 2022, Stockholm, Andreas R. Hyllested
Current operations: Integrations
* This is where we earn the money
* A few thousand apps
* ESB message-based integration
* Centralized teams with knowledge of how to integrate
* Strong governance and control
* Is this where we throw in Kafka?
* Not all at once
=> But maybe if we get data out?
SOR
SOR
SOR
11 | October 2022, Stockholm, Andreas R. Hyllested
02 Acquisition Ready
12 | October 2022, Stockholm, Andreas R. Hyllested
78%
11%
11%
1997
Breakdown of EBIT by division
Air & Sea
Road
Solutions
Breakdown of EBIT by geography
EMEA
Americas
APAC
DSV acquired Samson
Transport
2,694 DKKm
Revenue
98 DKKm
EBIT
1976
10 independent
hauliers established
DSV
2000
DSV acquired
DFDS Dan
Transport Group
19,478 DKKm
Revenue
854 DKKm
EBIT
67,747 DKKm
Revenue
2016
3,475 DKKm
EBIT
DSV acquired
UTi Worldwide
2008
37,435 DKKm
Revenue
1,936 DKKm
EBIT
DSV acquired
ABX LOGISTICS
DSV acquired
Frans Maas
2006
31,972 DKKm
Revenue
1,504 DKKm
EBIT
From local haulier to global player
A global network created through organic growth and M&A
115,932 DKKm
Revenue
In 2019, DSV
acquired
Panalpina
2020
9,520 DKKm
EBIT
2021
182,306 DKKm
Revenue
In August 2021,
DSV acquired
Agility GIL
16,223 DKKm
EBIT
38%
59%
3%
100%
13 | October 2022, Stockholm, Andreas R. Hyllested
Mergers must be swift
Large integrations limit our ability to take market share
* Overlapping customers
* Less internal focus on sale
* Integration seen as a risk from customer perspective
* Data quality
* Discontinued low margin business
02
Acquisition ready
14 | October 2022, Stockholm, Andreas R. Hyllested
Kafka in M&A
SOR
SOR
SOR
SOR
SOR
SOR
?
* In the past solved with ESB
technology - Biztalk
* We need to build a blueprint for
deploying Kafka clusters for M&A
activity
* Feed live data back and forth
* Sever the connection earlier and
focus on business integration
15 | October 2022, Stockholm, Andreas R. Hyllested
03 Digital Innovation
16 | October 2022, Stockholm, Andreas R. Hyllested
Technology Radar
Tracking
Testing
Adopting
Self-driving
vehicles
5G
network
Micro
mobility
Drones
Alternative
fuels
Exo
skeletons Conversational artificial
intelligence
Digital twins
Machine
learning
Visibility platform/
live tracking
Hybrid computing
platform
Automated
storage
system
17 | October 2022, Stockholm, Andreas R. Hyllested
Artificial Intelligence for Customs Declarations
* AI helps with live
consolidation of
paperwork – in this
case Customs
Declaration
* Powered by on real-
time data from back-
office sources and
3rd party
integrations with
customers and
authorities
18 | October 2022, Stockholm, Andreas R. Hyllested
Digital Twin
Automatic scanning for weight and size
* Live feed of data between IT
and OT systems – yields:
* Improved quality in handling
* Reduced average processing
time per pallet
19 | October 2022, Stockholm, Andreas R. Hyllested
Internet of Things (IoT)
Live cargo tracking
* IOT sources and backend system
sources are combined
* Improved visibility and
transparency for customers and
employees
20 | October 2022, Stockholm, Andreas R. Hyllested
Kafka for innovation
* Live data enables creative
solutions
* Improves process quality over all
* Allows for the transparency that
users have come to expect
Digital Product
Digital Product
Digital Product
SOR
SOR
SOR
03
Digital innovation
21 | October 2022, Stockholm, Andreas R. Hyllested
Time for
solutions
22 | October 2022, Stockholm, Andreas R. Hyllested
Ok, So Kafka is useful
But:
1. NFR?
2. How to organize data going in/out?
3. What to build?
SOR
SOR
SOR
23 | October 2022, Stockholm, Andreas R. Hyllested
Platform NFRs
NFR:
* 4-5 Nines uptime
* Geo-redundant
* Zero RPO failover
* Ability to add
clusters (meshing)
SOR
SOR
SOR
24 | October 2022, Stockholm, Andreas R. Hyllested
Design, ownership, change
SOR
SOR
SOR
Ownership
Domain Design
Governance Change mngt
25 | October 2022, Stockholm, Andreas R. Hyllested
Is this a mesh?
SOR
SOR
SOR
Piethein Strengholt
Data Mesh: Topologies and domain granularity
https://towardsdatascience.com/data-mesh-topologies-and-domain-granularity-65290a4ebb90
26 | October 2022, Stockholm, Andreas R. Hyllested
Platform capabilities
SOR
SOR
SOR
Protocol
Syntax
Mapping
Modelling
Windowing
Eventing
Routing
27 | October 2022, Stockholm, Andreas R. Hyllested
Building a platform
SOR
SOR
SOR
Pipelines
Config repo
... and hard work!
A catalogue
28 | October 2022, Stockholm, Andreas R. Hyllested
In conclusion
29 | October 2022, Stockholm, Andreas R. Hyllested
Does Kafka deliver?
Shorter answer:
1. Yes – but not alone
2. Super performant of
course
3. But you still need
in-house teams to
tie it all together
Longer answer:
1. We are beginning to see the
Geo aspects covered – but we
are not fully there
2. The Kafka eco-system feels a
little scattered – and there
are too many decisions to
make
3. Big organizations still tend
to want their own one-stop-
shop – Integrations is not
just Kafka
4. Task of modelling to
abstract away the underlying
complexity is often
underestimated
QUE
STI
ONS
?
LinkedIn
Andreas Rishede Hyllested
Senior Enterprise Architect
andreas.rishede.hyllested@dsv.com

More Related Content

Similar to Does Kafka deliver what is needed?

Tracxn - Geo Monthly - Denmark Tech - Jan 2022
Tracxn - Geo Monthly - Denmark Tech - Jan 2022Tracxn - Geo Monthly - Denmark Tech - Jan 2022
Tracxn - Geo Monthly - Denmark Tech - Jan 2022
Tracxn
 
The business case for SD WAN in the enterprise
The business case for SD WAN in the enterprise The business case for SD WAN in the enterprise
The business case for SD WAN in the enterprise
Colt Technology Services
 
Asiakastilaisuus 17.4.2018
Asiakastilaisuus 17.4.2018Asiakastilaisuus 17.4.2018
Asiakastilaisuus 17.4.2018
colliersinternationalfinland
 
Transport for London's Transition to Agile Delivery
Transport for London's Transition to Agile DeliveryTransport for London's Transition to Agile Delivery
Transport for London's Transition to Agile Delivery
WSO2
 
GraphTour - DXC - Digital Explorer
GraphTour - DXC - Digital ExplorerGraphTour - DXC - Digital Explorer
GraphTour - DXC - Digital Explorer
Neo4j
 
European Data Centre Market Update
European Data Centre Market UpdateEuropean Data Centre Market Update
European Data Centre Market Update
Nordic Digital Business Summit
 
RIEDEL Communications - Update brochure No. 18 (April 2016)
RIEDEL Communications - Update brochure No. 18 (April 2016)RIEDEL Communications - Update brochure No. 18 (April 2016)
RIEDEL Communications - Update brochure No. 18 (April 2016)
RIEDEL Communications
 
All Employee meeting 111022.pptx
All Employee meeting 111022.pptxAll Employee meeting 111022.pptx
All Employee meeting 111022.pptx
MattWolery1
 
Equity Forum Spring Conference 2023
Equity Forum Spring Conference 2023Equity Forum Spring Conference 2023
Equity Forum Spring Conference 2023
GESCO SE
 
B2B EDI Formats and MuleSoft X12 Connector
B2B EDI Formats and MuleSoft X12 ConnectorB2B EDI Formats and MuleSoft X12 Connector
B2B EDI Formats and MuleSoft X12 Connector
Vikalp Bhalia
 
Building Audi’s enterprise big data platform
Building Audi’s enterprise big data platformBuilding Audi’s enterprise big data platform
Building Audi’s enterprise big data platform
DataWorks Summit
 
Real World December 2014
Real World December 2014Real World December 2014
Real World December 2014
Posterscope
 
Logistics scm r&d mahmood sakhi albalushi - almadina logistics - muscat...
Logistics scm r&d   mahmood sakhi albalushi - almadina logistics - muscat...Logistics scm r&d   mahmood sakhi albalushi - almadina logistics - muscat...
Logistics scm r&d mahmood sakhi albalushi - almadina logistics - muscat...
Mahmood Albalushi
 
apidays London 2022 - Designing high-value data models with an API-first mind...
apidays London 2022 - Designing high-value data models with an API-first mind...apidays London 2022 - Designing high-value data models with an API-first mind...
apidays London 2022 - Designing high-value data models with an API-first mind...
apidays
 
Presentation for petrofac
Presentation for petrofacPresentation for petrofac
Presentation for petrofacdhlglobal
 
Canada-Ukraine Trade and Investment Support Project
Canada-Ukraine Trade and Investment Support ProjectCanada-Ukraine Trade and Investment Support Project
Canada-Ukraine Trade and Investment Support Project
Jason Prescott
 
2013 kepler cheuvreux autumn conference 20130920
2013 kepler cheuvreux autumn conference 201309202013 kepler cheuvreux autumn conference 20130920
2013 kepler cheuvreux autumn conference 20130920
kailashgavare
 
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
Funseam - Fundación para la Sostenibilidad Energética y Ambiental
 
Industrial Tech SW market dynamics
Industrial Tech SW market dynamicsIndustrial Tech SW market dynamics
Industrial Tech SW market dynamics
Christian Dahlen
 

Similar to Does Kafka deliver what is needed? (20)

Tracxn - Geo Monthly - Denmark Tech - Jan 2022
Tracxn - Geo Monthly - Denmark Tech - Jan 2022Tracxn - Geo Monthly - Denmark Tech - Jan 2022
Tracxn - Geo Monthly - Denmark Tech - Jan 2022
 
The business case for SD WAN in the enterprise
The business case for SD WAN in the enterprise The business case for SD WAN in the enterprise
The business case for SD WAN in the enterprise
 
Asiakastilaisuus 17.4.2018
Asiakastilaisuus 17.4.2018Asiakastilaisuus 17.4.2018
Asiakastilaisuus 17.4.2018
 
Transport for London's Transition to Agile Delivery
Transport for London's Transition to Agile DeliveryTransport for London's Transition to Agile Delivery
Transport for London's Transition to Agile Delivery
 
GraphTour - DXC - Digital Explorer
GraphTour - DXC - Digital ExplorerGraphTour - DXC - Digital Explorer
GraphTour - DXC - Digital Explorer
 
European Data Centre Market Update
European Data Centre Market UpdateEuropean Data Centre Market Update
European Data Centre Market Update
 
RIEDEL Communications - Update brochure No. 18 (April 2016)
RIEDEL Communications - Update brochure No. 18 (April 2016)RIEDEL Communications - Update brochure No. 18 (April 2016)
RIEDEL Communications - Update brochure No. 18 (April 2016)
 
All Employee meeting 111022.pptx
All Employee meeting 111022.pptxAll Employee meeting 111022.pptx
All Employee meeting 111022.pptx
 
Equity Forum Spring Conference 2023
Equity Forum Spring Conference 2023Equity Forum Spring Conference 2023
Equity Forum Spring Conference 2023
 
B2B EDI Formats and MuleSoft X12 Connector
B2B EDI Formats and MuleSoft X12 ConnectorB2B EDI Formats and MuleSoft X12 Connector
B2B EDI Formats and MuleSoft X12 Connector
 
Building Audi’s enterprise big data platform
Building Audi’s enterprise big data platformBuilding Audi’s enterprise big data platform
Building Audi’s enterprise big data platform
 
Real World December 2014
Real World December 2014Real World December 2014
Real World December 2014
 
Logistics scm r&d mahmood sakhi albalushi - almadina logistics - muscat...
Logistics scm r&d   mahmood sakhi albalushi - almadina logistics - muscat...Logistics scm r&d   mahmood sakhi albalushi - almadina logistics - muscat...
Logistics scm r&d mahmood sakhi albalushi - almadina logistics - muscat...
 
apidays London 2022 - Designing high-value data models with an API-first mind...
apidays London 2022 - Designing high-value data models with an API-first mind...apidays London 2022 - Designing high-value data models with an API-first mind...
apidays London 2022 - Designing high-value data models with an API-first mind...
 
Presentation for petrofac
Presentation for petrofacPresentation for petrofac
Presentation for petrofac
 
Canada-Ukraine Trade and Investment Support Project
Canada-Ukraine Trade and Investment Support ProjectCanada-Ukraine Trade and Investment Support Project
Canada-Ukraine Trade and Investment Support Project
 
Auckland Build Agenda
Auckland Build AgendaAuckland Build Agenda
Auckland Build Agenda
 
2013 kepler cheuvreux autumn conference 20130920
2013 kepler cheuvreux autumn conference 201309202013 kepler cheuvreux autumn conference 20130920
2013 kepler cheuvreux autumn conference 20130920
 
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
MESA REDONDA: FINANZAS SOSTENIBLES. Andres Suarez Exolum X SimposioFunseam202...
 
Industrial Tech SW market dynamics
Industrial Tech SW market dynamicsIndustrial Tech SW market dynamics
Industrial Tech SW market dynamics
 

More from confluent

Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
confluent
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
confluent
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
confluent
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
confluent
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
confluent
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
confluent
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
confluent
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
confluent
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
confluent
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
confluent
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
confluent
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
confluent
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
confluent
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
confluent
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
confluent
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
confluent
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
confluent
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
confluent
 

More from confluent (20)

Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 

Recently uploaded

Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
Ortus Solutions, Corp
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Jay Das
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
Srikant77
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Natan Silnitsky
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
Tier1 app
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 

Recently uploaded (20)

Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 

Does Kafka deliver what is needed?

  • 1. 1 | October 2022, Stockholm, Andreas R. Hyllested Does Kafka deliver what is needed?
  • 2. 2 | October 2022, Stockholm, Andreas R. Hyllested The Architect Andreas Rishede Hyllested Senior Enterprise Architect andreas.rishede.hyllested@dsv.com 17 years in * Development * Business Consulting * Architecture Today * Architecting the Enterprise
  • 3. 3 | October 2022, Stockholm, Andreas R. Hyllested What is DSV doing?
  • 4. 4 | October 2022, Stockholm, Andreas R. Hyllested Running the supply chain To consignee From shipper Freight forwarding services Shipment booking — Pick-up — Warehouse — Documentation & customs clearance — Cargo consolidation — Purchase order management — Cross-dock terminal — Insurance Transport Subcontracted Logistics and distribution Warehousing — Picking/packing — Cross-dock terminal — Deconsolidation — Labelling, configuration, testing — Distribution Documentation & customs clearance — E-commerce fulfilment — Carbon emission reports — Supply Chain innovation — 4PL
  • 5. 5 | October 2022, Stockholm, Andreas R. Hyllested Global footprint More than 75,000 employees in over 90 countries 3rd largest freight forwarder globally +1,500 offices & logistics facilities DKK 182 billion in annual revenue Gross profit split on main activities Air & Sea Road Solutions 63% 19% 18%
  • 6. 6 | October 2022, Stockholm, Andreas R. Hyllested Customers across all industrues Healthcare Retail & Fashion Technology Industrial Renewable Energy Specialised Air & Sea verticals Chemicals Oil and Gas Fairs and Events Project Logistics Aerospace Automotive
  • 7. 7 | October 2022, Stockholm, Andreas R. Hyllested IT Strategy
  • 8. 8 | October 2022, Stockholm, Andreas R. Hyllested DSV IT Strategy 01 Current operations 02 Acquisition ready 03 Digital innovation Focus areas
  • 9. 9 | October 2022, Stockholm, Andreas R. Hyllested 01 Current operations
  • 10. 10 | October 2022, Stockholm, Andreas R. Hyllested Current operations: Integrations * This is where we earn the money * A few thousand apps * ESB message-based integration * Centralized teams with knowledge of how to integrate * Strong governance and control * Is this where we throw in Kafka? * Not all at once => But maybe if we get data out? SOR SOR SOR
  • 11. 11 | October 2022, Stockholm, Andreas R. Hyllested 02 Acquisition Ready
  • 12. 12 | October 2022, Stockholm, Andreas R. Hyllested 78% 11% 11% 1997 Breakdown of EBIT by division Air & Sea Road Solutions Breakdown of EBIT by geography EMEA Americas APAC DSV acquired Samson Transport 2,694 DKKm Revenue 98 DKKm EBIT 1976 10 independent hauliers established DSV 2000 DSV acquired DFDS Dan Transport Group 19,478 DKKm Revenue 854 DKKm EBIT 67,747 DKKm Revenue 2016 3,475 DKKm EBIT DSV acquired UTi Worldwide 2008 37,435 DKKm Revenue 1,936 DKKm EBIT DSV acquired ABX LOGISTICS DSV acquired Frans Maas 2006 31,972 DKKm Revenue 1,504 DKKm EBIT From local haulier to global player A global network created through organic growth and M&A 115,932 DKKm Revenue In 2019, DSV acquired Panalpina 2020 9,520 DKKm EBIT 2021 182,306 DKKm Revenue In August 2021, DSV acquired Agility GIL 16,223 DKKm EBIT 38% 59% 3% 100%
  • 13. 13 | October 2022, Stockholm, Andreas R. Hyllested Mergers must be swift Large integrations limit our ability to take market share * Overlapping customers * Less internal focus on sale * Integration seen as a risk from customer perspective * Data quality * Discontinued low margin business 02 Acquisition ready
  • 14. 14 | October 2022, Stockholm, Andreas R. Hyllested Kafka in M&A SOR SOR SOR SOR SOR SOR ? * In the past solved with ESB technology - Biztalk * We need to build a blueprint for deploying Kafka clusters for M&A activity * Feed live data back and forth * Sever the connection earlier and focus on business integration
  • 15. 15 | October 2022, Stockholm, Andreas R. Hyllested 03 Digital Innovation
  • 16. 16 | October 2022, Stockholm, Andreas R. Hyllested Technology Radar Tracking Testing Adopting Self-driving vehicles 5G network Micro mobility Drones Alternative fuels Exo skeletons Conversational artificial intelligence Digital twins Machine learning Visibility platform/ live tracking Hybrid computing platform Automated storage system
  • 17. 17 | October 2022, Stockholm, Andreas R. Hyllested Artificial Intelligence for Customs Declarations * AI helps with live consolidation of paperwork – in this case Customs Declaration * Powered by on real- time data from back- office sources and 3rd party integrations with customers and authorities
  • 18. 18 | October 2022, Stockholm, Andreas R. Hyllested Digital Twin Automatic scanning for weight and size * Live feed of data between IT and OT systems – yields: * Improved quality in handling * Reduced average processing time per pallet
  • 19. 19 | October 2022, Stockholm, Andreas R. Hyllested Internet of Things (IoT) Live cargo tracking * IOT sources and backend system sources are combined * Improved visibility and transparency for customers and employees
  • 20. 20 | October 2022, Stockholm, Andreas R. Hyllested Kafka for innovation * Live data enables creative solutions * Improves process quality over all * Allows for the transparency that users have come to expect Digital Product Digital Product Digital Product SOR SOR SOR 03 Digital innovation
  • 21. 21 | October 2022, Stockholm, Andreas R. Hyllested Time for solutions
  • 22. 22 | October 2022, Stockholm, Andreas R. Hyllested Ok, So Kafka is useful But: 1. NFR? 2. How to organize data going in/out? 3. What to build? SOR SOR SOR
  • 23. 23 | October 2022, Stockholm, Andreas R. Hyllested Platform NFRs NFR: * 4-5 Nines uptime * Geo-redundant * Zero RPO failover * Ability to add clusters (meshing) SOR SOR SOR
  • 24. 24 | October 2022, Stockholm, Andreas R. Hyllested Design, ownership, change SOR SOR SOR Ownership Domain Design Governance Change mngt
  • 25. 25 | October 2022, Stockholm, Andreas R. Hyllested Is this a mesh? SOR SOR SOR Piethein Strengholt Data Mesh: Topologies and domain granularity https://towardsdatascience.com/data-mesh-topologies-and-domain-granularity-65290a4ebb90
  • 26. 26 | October 2022, Stockholm, Andreas R. Hyllested Platform capabilities SOR SOR SOR Protocol Syntax Mapping Modelling Windowing Eventing Routing
  • 27. 27 | October 2022, Stockholm, Andreas R. Hyllested Building a platform SOR SOR SOR Pipelines Config repo ... and hard work! A catalogue
  • 28. 28 | October 2022, Stockholm, Andreas R. Hyllested In conclusion
  • 29. 29 | October 2022, Stockholm, Andreas R. Hyllested Does Kafka deliver? Shorter answer: 1. Yes – but not alone 2. Super performant of course 3. But you still need in-house teams to tie it all together Longer answer: 1. We are beginning to see the Geo aspects covered – but we are not fully there 2. The Kafka eco-system feels a little scattered – and there are too many decisions to make 3. Big organizations still tend to want their own one-stop- shop – Integrations is not just Kafka 4. Task of modelling to abstract away the underlying complexity is often underestimated
  • 30. QUE STI ONS ? LinkedIn Andreas Rishede Hyllested Senior Enterprise Architect andreas.rishede.hyllested@dsv.com