Are you considering replacing your legacy data historian and moving your OT data to the cloud? Join this technical webinar to learn how to adopt InfluxDB and IO Base - a digital platform used to improve operational efficiencies!
Teréga Solutions are the creators of digital solutions used to improve energy efficiencies and to address decarbonization challenges. Their network includes 5,000+ km of gas pipelines within France; they aim to help France attain carbon neutrality by 2050. With these impressive goals in mind, Teréga has created IO-Base — the digital platform to improve industrial performance, and increase profitability. Creating digital twins for their clients allows them to collect data from all production sites and view it in real time, from anywhere and at any time.
Discover how Teréga uses InfluxDB, Docker, and AWS to monitor its gas and hydrogen pipeline infrastructure. They chose to replace their legacy data historian with InfluxDB — the purpose built time series database. They are collecting more than 100K different metrics at various frequencies — some are collected every 5 seconds to only every 1-2 minutes. THey have reduced overall IT spend by 50% and collect 2x the amount of data at 20x frequency! By using various industrial protocols (Modbus, OPC-UA, etc.), Teréga improved output, reduced the TCO, and is now able to create added-value services: forecast, monitoring, predictive maintenance.
Join this webinar as Thomas Delquié dives into:
Teréga's approach to modernizing fossil fuel pipelines IT systems while improving yields and safety
Their centralized methodology to collecting sensor, hardware, and network metrics
The importance of time series data and why they chose InfluxDB
2. Journée IO-BASE
Summary
● Teréga’s business: From gas storage/transportation to energy transition (biometh, H2, Digital Tools)
● Problem: to create digital, we need data. 2 failed approach: full copy, partial copy
● Solution: full cloud
● InfluxDB Choice
● General Architecture
● Challenges addressed while building solution
● Solution actuelle (vision client / usages)
● Impact for Teréga
● Next steps: InfluxDB 3.0 (explain what / why) - additional services in IO-Base
● Conclusion: Thx to InfluxDB → success
T
N
T
N
T
15’
15’
7’
6’
2’
3. Journée IO-BASE
NICOLAS LAFARGUE
THOMAS DELQUIÉ
About us
CTO - Terega Solutions Tech Lead / DevOps
● Working at Terega for 5 years
● API & Data Integration Architect
● DevOps Specialist
● AWS Cloud migration
● Tech Lead io-base project
● Working at Terega since 2010
● Developer, architect, datacenter
management
● AWS & GCP cloud migration
● Data Team creation and management
4. Journée IO-BASE
Teréga SA - Gas storage and transportation
Investment 2021
138 M€
650 employees - 2021
5 115 km
Pipelines
15,7 %of French Network
6,5 Gm3
Gas storage capacity
25,4 % French capacity
Revenus 2021
488 M€
New challenge: Energy transition
5. Journée IO-BASE
Origins of IO-Base
Leveraging Industrial Data - Problem statement
Industrial site(s)
Place to optimize / securize
(energy, carbon, raw material,
logistics…)
Great algorithms!
Easy creation of services
Place where the “best in class”
solutions are
Previous infrastructure to
manage and interconnect
6. Journée IO-BASE
Possible solutions
Full replication
- One more infrastructure
- Costly
- Hard to maintain: 2 active
database
Data cherry picking
- Security issue
- Bandwidth
- Data scattering/discrepancy
- Impossible to maintain
7. Journée IO-BASE
Paradigm shift: full cloud
Full Cloud
- No local IT (except for command/control)
- Data Historian in the Cloud
- Highest security possible for industrial site
Secure data collection & transfer
- Data diode for unidirectional flow of data
- Connect to sensors / PLC → send directly to the
Cloud
- Simple to install and no maintenance required
8. Journée IO-BASE
titre presentation
Teréga path to Industry 4.0
From legacy Data Historian to IO-Base
Seamless
migration
Final implementation: secure and distributed architecture
9. Journée IO-BASE
Cloud Data Historian: Build or buy?
Our needs:
● End-to-end solution to monitor our plants and leverage data
● Highly configurable system for end users with no code
● Both simple and secure to send and retrieve data
● Performance, scalability, 24/7 availability
Market survey:
● No industrial cloud native Data Historian
● Legacy Data Historian with an extension to the Cloud, but:
● Too complex to commission, not easy to customize
● Need to enhance security of data and infrastructure hosting it
● Expensive with complex licencing model
● Multitude of Data Platform, but:
● Focused on AI/Analytics, not industrial requirements and services
?
Decision: Build
10. Journée IO-BASE
InfluxDB Choice
How to build our own data historian:
● Need for a Time Series Database to meet our specific requirements.
● Evaluated solutions in 2019 such as BigTable with custom layers, WarpX,
and TimescaleDB.
Selection of InfluxDB:
● Performance
● Dynamic Measurement Creation
● Ecosystem
● Open source or free tier to evaluate
● Market Leadership
11. Journée IO-BASE
Challenges - feedback : Enhance Database Security
● Make InfluxDB Infrastructure Private : Use a private subnet and an
AWS Transit Gateway for enhanced security and isolation.
● From Basic Auth API to Oauth2 Auth API
● Custom layer on top of InfluxDB to manage permissions on each
measurements
15. Journée IO-BASE
Hierarchy & Metadata Challenges:
Solution : Maintain a straightforward data structure in InfluxDB and handle metadata and data hierarchy through
our layer on top, IOBASE. This allows the end user to dynamically reorganize their data whenever needed.
18. Journée IO-BASE
Performance Challenges
● Provide high-performance insertion, retrieval, and analysis of massive time-based
data
● Minor performance issue while retrieving the list of all measurements due to our
architecture => We used our custom data structuring layer on top of InfluxDB.
● Integration of Redis to maintain real-time data states, enabling efficient process
visualization (Indaview), formula calculations, and alerts.
23. Journée IO-BASE
IO-Base now
Secure, Performant, Agile, Industrial Data Twin platform
➔ Centralized master data
➔ Minimum onsite infrastructure:
only collection/transmission -
no maintenance
➔ Ease of data sharing
➔ Hardware / network agnostic
➔ Highest level of cyber-security
ENERGY
EFFICIENCY
INNOVATION.
PERFORMANCE.
SECURITY.
24. Journée IO-BASE
IO-Base
Results for Teréga SA
+50 %
-50 % 15 % 100 %
20x
Captured
Data -
100K points (and
counting)
Data frequency
(from 1 min to 5s)
Site travel
reduction
BYOD
ATAWAD
Zero Trust
TCO: IT licences
and
infrastructure costs
25. Journée IO-BASE
Next steps
Develop new services in IO-Base:
- Improvement of data versioning
- Integration with AWS AI services
- Contextualization - templates
Switch to InfluxDB 3.0:
- Longer data retention thanks to S3 storage
- Lower storage costs & TCO
- Leveraging Apache Arrow Flight SQL and
Compatible Ecosystem - integration for enhanced
data querying and analytics
31. Journée IO-BASE
Security
Code & Infrastructure
Convention 2023
Code quality - software and CI/CD
Code analyse in deployment pipeline
Infrastructure security audit
Penetration test of our solutions by ethical hackers.
Ongoing discussion with ANSSI (french top cybersecurity agency) for
certification
AWS Certified
Validated by AWS technical experts on resiliency, security, frugality
32. Journée IO-BASE
Security
IAM and monitoring
Convention 2023
Leading solution for authentication and identity
OpenID multifactor authentication: OTP, biometry, physical key
Connector : SAML V2, AD, Azure AD, Google Workspace
Technical monitoring
24/7 monitoring of all services in one centralized platform
33. IT architecture shift
➔ Security: neither firewall exceptions, nor software
to install on the OT side
➔ Agility: data access simplified
➔ Operations: monitoring, on-call…
‘Io-base’ architecture
Paradigm shift to improve: