SlideShare a Scribd company logo
Confluent Cloud – Data in Motion
06/10/2022
1
Confluent Cloud inside
the Digital
Transformation of
Autostrade per l’Italia
Confluent Cloud – Data in Motion
06/10/2022
Confluent Cloud – Data in Motion
06/10/2022
1. Company Presentation
2. ASPI Digital Transformation
3. The use of Kafka in ASPI
4. Confluent Cloud Migration
5. Next Steps
AGENDA
Confluent Cloud – Data in Motion
06/10/2022
3
2.855 km
of motorway in Italy
6,1 Billion €
+110% of investiments
in 2020/24 vs 2015/19
nearly 5.300
employees
204
Service Areas
1.907
Variable-message signs
along the network
4.991
cameras
3 Billion
€
of revenues Autostrade per l'Italia is one of Europe's leading
concessionaries for the construction and management
of toll motorways, with around 3,000 km of network
managed in Italy.
The Autostrade per l'Italia group includes five other
motorway concession companies and seven
companies that provide ancillary services to the core
motorway business and play a key role in
implementing the Company's transformation plan.
• Società Italiana
Traforo del Montebianco
• Raccordo Autostradale Valle d’Aosta
• Tangenziale di Napoli
• Autostrade Meridionali
• Società Autostradale Tirrenica
• Movyon
• Tecne
• Amplia Infrastructures
• Free-to-Experience
• Elgea
• Admoving
• Esse di Esse
• Giove clear
THE GROUP
THE COMPANY
2,5 Billion €
+60% of maint. costs
in 2020/24 vs 2015/19
Confluent Cloud – Data in Motion
06/10/2022
«Next To Digital» INITIATIVE
The Next To Digital initiative is included in the wide
Transformation Plan of Autostrade per l’Italia.
This initiative is the fundamental lever to guide and promote a
deep change in ASPI at multiple levels: new ways of working,
new technological capabilities, new skills to develop, new ways
of addressing all stakeholders (internal and external) and, finally, a
significant cultural change.
It concerns the digitalization of processes and services,
transformation of the road network into a "smart" infrastructure
through the most advanced technologies.
NtD initiative address these aims:
• Internal efficiency
• Civil infrastructure management and security
• Customer experience
200 Million €
of investment by 2024
+ 30 agile room
to develop End-to-End
innovative projects
Confluent Cloud – Data in Motion
06/10/2022
«Next To Digital» PROJECTS
Predictive models of traffic flows for planning construction sites
to minimize the impact on the road network (estimation of any
inconvenience caused and calculation of tariff discounts)
Real-time monitoring and alerting systems in relation to traffic
disruptions (e.g. road accidents) or road congestion on the network
due to:
- Proactive and dynamic management of lanes and speed limits
- Preventive deployment of traffic/rescue teams
New services for users: Recommended times for departure;
advance calculation of the toll; recommended restaurants,
attractions and places of interest along the route
Additional services in the service area (e.g. parking, "skip the line"
table reservation) and on the network (e.g. advance toll payment)
Digital communication channel between the customer and
Autostrade for distress alerts requests, complaints, assistance and
automatic processing of requests via Virtual Agent.
Confluent Cloud – Data in Motion
06/10/2022
Why Kafka?
• Become a Data Driven company
• Create a unique data layer to support Event Driven
architecture
• Eliminate Data Silos
• Provide Data Democratization through REST API
• Provide Standardization through JSON, AVRO
• Data Security with Zero Trust approach
Confluent Kafka has been chosen to accomplish Autostrade per l’Italia’s goals:
Confluent Cloud – Data in Motion
06/10/2022
Business Cases and Architecture
Confluent Cloud – Data in Motion
06/10/2022
Online Monitoring Traffic
GOAL
Monitor and analyze transit on tracks collected at toll booth in near real time.
HOW
RESULTS
Change-Data-Capture pattern of Confluent Cloud with 2 sync connectors.
• RAW data converted to JSON
formats for easier usability with
REST API
• Freshness of information for
end users
• Decoupling systems for less
overhead on DB2
Confluent Cloud – Data in Motion
06/10/2022
Electronic Toll enrichment
GOAL
Implementation of an on-cloud application that allows the management
of every aspect of the rectification traffic life cycle for users and special
users.
HOW
RESULTS
Raw Data is normalized and democratized through Kstream Java App
With Confluent Kafka, through the KStream we are able to deal with
data that was previously on silos to have a gain on data governance
on the outgoing DBMS.
Confluent Cloud – Data in Motion
06/10/2022
Integration Layer "CEM Impianti"
GOAL
Standardize the monitoring data and render them accessible via front end for reporting / monitoring activities.
HOW
RESULTS
Unique Integration Layer to collect data from OT Plants based on 3 steps:
• Mapping of monitoring data
• Data definition and Normalization
• Front-End for reporting and analytics
• Greater usability of data
• Reduced interventions time
• Best use of resources
• Reduction of low added value
activities
Confluent Cloud – Data in Motion
06/10/2022
PISTA 2.0
Most complex project based on Confluent Cloud (in evolution…)
GOAL
Refactoring of the message production and dispatching system from all the toll booths on the highway to a single Data Layer.
HOW
RESULTS
Provide a formal definition of the data using AVRO Schema, useful for:
• Manage information as a resource
• Create a process aimed at managing the data
• Data preparation and enrichment
• No use of DB for first ingestion of message acquisition
• Event Streaming – Ready
• Provide data detectability, monitoring and security
throughout its life cycle
Confluent Cloud – Data in Motion
06/10/2022
PISTA 2.0 Architecture
Confluent Cloud – Data in Motion
06/10/2022
13
13
Confluent Platform migration
to Confluent Cloud
Confluent Cloud – Data in Motion
06/10/2022
Migration to Confluent Cloud
SCENARIO
The migration from Confluent Platform to Confluent Cloud involved 15 Applications, mostly
based on collecting data from tracks and plants.
PROJECT
USE CASES
Autostrade per l’Italia started a multi-year modernization project that relies on the
transition from on-premise systems to Cloud platforms for increasing speed to
accomplish business requests and reduce low value-added activities.
• Pista 2.0 - First acquisition of transits and plate tracking on the toll booth
• Plants - Spooling of messages from suburbs to center
• TUTOR - collecting events
• Infoviability - collecting data from sensors on track
• Xmonit - Realtime monitoring and integration of plants
• FreeToX – Cashback system for customers
• Service Area – Smart services on the services area on the highway
Confluent Cloud – Data in Motion
06/10/2022
Confluent Platform
• 3 different environments on-premises
• Ansible playbooks for configurations
• Custom connectors
• Manage infrastructure for updates and develop new features
• Not scalable
• Storage tiering needed
• Managing Load Balancing for Kafka Brokers
ENVIRONMENTS
PROS
CONS
SVIL TEST PROD
Confluent Cloud – Data in Motion
06/10/2022
Confluent Cloud Architecture
ENVIRONMENTS
• Prod and noProd environments for data segregation
• Teampass as a Password Manager for Client API Keys & Secrets
• Zabbix as ASPI main Monitoring Platform
PROS
CONS
• 99.99% SLA
• Autoscaling
• No patching or planned maintenance
• Infinite Storage
• Easily connected via AWS Transit Gateway
• Users ACL: access to Control Center for Data Lineage view
• Kafka Connect onprem for custom use cases
Confluent Cloud – Data in Motion
06/10/2022
Next Steps
TRAFFIC PROJECT
IoT/MQTT
Refactoring of the functional perimeter, based on more than 70 applications, linked to the
collection and management of payments and transit data on the track. Main problems are:
• Highly interconnected area with strong dependencies between functional levels
• Highly standardized architectures based on legacy technologies and integration models (eg.: DB2,
db-to-db views).
• No API
• No Data Democratization
• No SecDevOps approach
• Solution: Confluent Cloud as single layer for Data acquisition & preparation.
Provide an enterprise platform for MQTT to manage messages from IoT devices and lay the
foundation for Event Driven Architecture.
• Main products identified: EMQX, HiveMQ, VerneMQ.
Confluent Cloud – Data in Motion
06/10/2022
18
THANK YOU
Confluent Cloud – Data in Motion
06/10/2022

More Related Content

Similar to Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia

Javier Lecanda - Colt SDN/NFV Experience inca 201706
Javier Lecanda - Colt SDN/NFV Experience   inca 201706Javier Lecanda - Colt SDN/NFV Experience   inca 201706
Javier Lecanda - Colt SDN/NFV Experience inca 201706
Independent Networks Co-operative Association
 
Forecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-SystemsForecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-Systems
Open Data Center Alliance
 
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOTConnectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
Solace
 
Strategic Technical Presenation
Strategic Technical PresenationStrategic Technical Presenation
Strategic Technical Presenation
StrategicProject
 
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
CA Technologies
 
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
Cisco Canada
 
ICC Data and Device management
ICC Data and Device managementICC Data and Device management
ICC Data and Device management
International Communications Corporation
 
SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services
Fabio Massimi
 
Delivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent NetworkDelivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent Network
Benjamin Eggerstedt
 
Why Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange ConnectWhy Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange Connect
Morgan Davidson
 
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche BahnOSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
mfrancis
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Ike Aniagoh
 
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Dr. Ranbijay Kumar
 
Confluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIKConfluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIK
confluent
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?
DevOps.com
 
Cotendo Cloudlet Datasheet
Cotendo Cloudlet DatasheetCotendo Cloudlet Datasheet
Cotendo Cloudlet Datasheet
gyanendra1
 
MF_OM_logistics_Final
MF_OM_logistics_FinalMF_OM_logistics_Final
MF_OM_logistics_FinalS K Goel
 

Similar to Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia (20)

Javier Lecanda - Colt SDN/NFV Experience inca 201706
Javier Lecanda - Colt SDN/NFV Experience   inca 201706Javier Lecanda - Colt SDN/NFV Experience   inca 201706
Javier Lecanda - Colt SDN/NFV Experience inca 201706
 
Forecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-SystemsForecast 2014: ODCA Board Best Practice: T-Systems
Forecast 2014: ODCA Board Best Practice: T-Systems
 
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOTConnectivité temps réel et bi-directionnelle ​ pour solutions IOT
Connectivité temps réel et bi-directionnelle ​ pour solutions IOT
 
Strategic Technical Presenation
Strategic Technical PresenationStrategic Technical Presenation
Strategic Technical Presenation
 
brocade-swisscom-ss
brocade-swisscom-ssbrocade-swisscom-ss
brocade-swisscom-ss
 
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
Case Study: KPN Incorporates Application and Infrastructured Monitoring Infor...
 
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...Cisco Connect Halifax 2018   Understanding Cisco's next generation sd-wan sol...
Cisco Connect Halifax 2018 Understanding Cisco's next generation sd-wan sol...
 
ICC Data and Device management
ICC Data and Device managementICC Data and Device management
ICC Data and Device management
 
SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services SCALES: Supply Chain Architecture Leading to Enhanced Services
SCALES: Supply Chain Architecture Leading to Enhanced Services
 
Delivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent NetworkDelivering Application Analytics for an Application Fluent Network
Delivering Application Analytics for an Application Fluent Network
 
Why Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange ConnectWhy Ontario Government chose Equinix Cloud Exchange Connect
Why Ontario Government chose Equinix Cloud Exchange Connect
 
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche BahnOSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
OSGi and Next Generation Trains - Jens Haeger, Deutsche Bahn
 
Forecast key1 0615_ak_evening
Forecast key1 0615_ak_eveningForecast key1 0615_ak_evening
Forecast key1 0615_ak_evening
 
Bina systems Cloud Applications
Bina systems Cloud ApplicationsBina systems Cloud Applications
Bina systems Cloud Applications
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator Suite
 
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)Identifying Bottlenecks in Mobile Cloud Computing (MCC)
Identifying Bottlenecks in Mobile Cloud Computing (MCC)
 
Confluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIKConfluent Partner Tech Talk with QLIK
Confluent Partner Tech Talk with QLIK
 
Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?Service Mesh: Two Big Words But Do You Need It?
Service Mesh: Two Big Words But Do You Need It?
 
Cotendo Cloudlet Datasheet
Cotendo Cloudlet DatasheetCotendo Cloudlet Datasheet
Cotendo Cloudlet Datasheet
 
MF_OM_logistics_Final
MF_OM_logistics_FinalMF_OM_logistics_Final
MF_OM_logistics_Final
 

More from confluent

Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
confluent
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
confluent
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
confluent
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
confluent
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
confluent
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
confluent
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
confluent
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
confluent
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
confluent
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
confluent
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
confluent
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
confluent
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
confluent
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
confluent
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
confluent
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
confluent
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
confluent
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
confluent
 

More from confluent (20)

Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 

Recently uploaded

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
Tendenci - The Open Source AMS (Association Management Software)
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Mind IT Systems
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Jay Das
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
kalichargn70th171
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
Srikant77
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
Ortus Solutions, Corp
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 

Recently uploaded (20)

Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 

Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia

  • 1. Confluent Cloud – Data in Motion 06/10/2022 1 Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia Confluent Cloud – Data in Motion 06/10/2022
  • 2. Confluent Cloud – Data in Motion 06/10/2022 1. Company Presentation 2. ASPI Digital Transformation 3. The use of Kafka in ASPI 4. Confluent Cloud Migration 5. Next Steps AGENDA
  • 3. Confluent Cloud – Data in Motion 06/10/2022 3 2.855 km of motorway in Italy 6,1 Billion € +110% of investiments in 2020/24 vs 2015/19 nearly 5.300 employees 204 Service Areas 1.907 Variable-message signs along the network 4.991 cameras 3 Billion € of revenues Autostrade per l'Italia is one of Europe's leading concessionaries for the construction and management of toll motorways, with around 3,000 km of network managed in Italy. The Autostrade per l'Italia group includes five other motorway concession companies and seven companies that provide ancillary services to the core motorway business and play a key role in implementing the Company's transformation plan. • Società Italiana Traforo del Montebianco • Raccordo Autostradale Valle d’Aosta • Tangenziale di Napoli • Autostrade Meridionali • Società Autostradale Tirrenica • Movyon • Tecne • Amplia Infrastructures • Free-to-Experience • Elgea • Admoving • Esse di Esse • Giove clear THE GROUP THE COMPANY 2,5 Billion € +60% of maint. costs in 2020/24 vs 2015/19
  • 4. Confluent Cloud – Data in Motion 06/10/2022 «Next To Digital» INITIATIVE The Next To Digital initiative is included in the wide Transformation Plan of Autostrade per l’Italia. This initiative is the fundamental lever to guide and promote a deep change in ASPI at multiple levels: new ways of working, new technological capabilities, new skills to develop, new ways of addressing all stakeholders (internal and external) and, finally, a significant cultural change. It concerns the digitalization of processes and services, transformation of the road network into a "smart" infrastructure through the most advanced technologies. NtD initiative address these aims: • Internal efficiency • Civil infrastructure management and security • Customer experience 200 Million € of investment by 2024 + 30 agile room to develop End-to-End innovative projects
  • 5. Confluent Cloud – Data in Motion 06/10/2022 «Next To Digital» PROJECTS Predictive models of traffic flows for planning construction sites to minimize the impact on the road network (estimation of any inconvenience caused and calculation of tariff discounts) Real-time monitoring and alerting systems in relation to traffic disruptions (e.g. road accidents) or road congestion on the network due to: - Proactive and dynamic management of lanes and speed limits - Preventive deployment of traffic/rescue teams New services for users: Recommended times for departure; advance calculation of the toll; recommended restaurants, attractions and places of interest along the route Additional services in the service area (e.g. parking, "skip the line" table reservation) and on the network (e.g. advance toll payment) Digital communication channel between the customer and Autostrade for distress alerts requests, complaints, assistance and automatic processing of requests via Virtual Agent.
  • 6. Confluent Cloud – Data in Motion 06/10/2022 Why Kafka? • Become a Data Driven company • Create a unique data layer to support Event Driven architecture • Eliminate Data Silos • Provide Data Democratization through REST API • Provide Standardization through JSON, AVRO • Data Security with Zero Trust approach Confluent Kafka has been chosen to accomplish Autostrade per l’Italia’s goals:
  • 7. Confluent Cloud – Data in Motion 06/10/2022 Business Cases and Architecture
  • 8. Confluent Cloud – Data in Motion 06/10/2022 Online Monitoring Traffic GOAL Monitor and analyze transit on tracks collected at toll booth in near real time. HOW RESULTS Change-Data-Capture pattern of Confluent Cloud with 2 sync connectors. • RAW data converted to JSON formats for easier usability with REST API • Freshness of information for end users • Decoupling systems for less overhead on DB2
  • 9. Confluent Cloud – Data in Motion 06/10/2022 Electronic Toll enrichment GOAL Implementation of an on-cloud application that allows the management of every aspect of the rectification traffic life cycle for users and special users. HOW RESULTS Raw Data is normalized and democratized through Kstream Java App With Confluent Kafka, through the KStream we are able to deal with data that was previously on silos to have a gain on data governance on the outgoing DBMS.
  • 10. Confluent Cloud – Data in Motion 06/10/2022 Integration Layer "CEM Impianti" GOAL Standardize the monitoring data and render them accessible via front end for reporting / monitoring activities. HOW RESULTS Unique Integration Layer to collect data from OT Plants based on 3 steps: • Mapping of monitoring data • Data definition and Normalization • Front-End for reporting and analytics • Greater usability of data • Reduced interventions time • Best use of resources • Reduction of low added value activities
  • 11. Confluent Cloud – Data in Motion 06/10/2022 PISTA 2.0 Most complex project based on Confluent Cloud (in evolution…) GOAL Refactoring of the message production and dispatching system from all the toll booths on the highway to a single Data Layer. HOW RESULTS Provide a formal definition of the data using AVRO Schema, useful for: • Manage information as a resource • Create a process aimed at managing the data • Data preparation and enrichment • No use of DB for first ingestion of message acquisition • Event Streaming – Ready • Provide data detectability, monitoring and security throughout its life cycle
  • 12. Confluent Cloud – Data in Motion 06/10/2022 PISTA 2.0 Architecture
  • 13. Confluent Cloud – Data in Motion 06/10/2022 13 13 Confluent Platform migration to Confluent Cloud
  • 14. Confluent Cloud – Data in Motion 06/10/2022 Migration to Confluent Cloud SCENARIO The migration from Confluent Platform to Confluent Cloud involved 15 Applications, mostly based on collecting data from tracks and plants. PROJECT USE CASES Autostrade per l’Italia started a multi-year modernization project that relies on the transition from on-premise systems to Cloud platforms for increasing speed to accomplish business requests and reduce low value-added activities. • Pista 2.0 - First acquisition of transits and plate tracking on the toll booth • Plants - Spooling of messages from suburbs to center • TUTOR - collecting events • Infoviability - collecting data from sensors on track • Xmonit - Realtime monitoring and integration of plants • FreeToX – Cashback system for customers • Service Area – Smart services on the services area on the highway
  • 15. Confluent Cloud – Data in Motion 06/10/2022 Confluent Platform • 3 different environments on-premises • Ansible playbooks for configurations • Custom connectors • Manage infrastructure for updates and develop new features • Not scalable • Storage tiering needed • Managing Load Balancing for Kafka Brokers ENVIRONMENTS PROS CONS SVIL TEST PROD
  • 16. Confluent Cloud – Data in Motion 06/10/2022 Confluent Cloud Architecture ENVIRONMENTS • Prod and noProd environments for data segregation • Teampass as a Password Manager for Client API Keys & Secrets • Zabbix as ASPI main Monitoring Platform PROS CONS • 99.99% SLA • Autoscaling • No patching or planned maintenance • Infinite Storage • Easily connected via AWS Transit Gateway • Users ACL: access to Control Center for Data Lineage view • Kafka Connect onprem for custom use cases
  • 17. Confluent Cloud – Data in Motion 06/10/2022 Next Steps TRAFFIC PROJECT IoT/MQTT Refactoring of the functional perimeter, based on more than 70 applications, linked to the collection and management of payments and transit data on the track. Main problems are: • Highly interconnected area with strong dependencies between functional levels • Highly standardized architectures based on legacy technologies and integration models (eg.: DB2, db-to-db views). • No API • No Data Democratization • No SecDevOps approach • Solution: Confluent Cloud as single layer for Data acquisition & preparation. Provide an enterprise platform for MQTT to manage messages from IoT devices and lay the foundation for Event Driven Architecture. • Main products identified: EMQX, HiveMQ, VerneMQ.
  • 18. Confluent Cloud – Data in Motion 06/10/2022 18 THANK YOU Confluent Cloud – Data in Motion 06/10/2022