"Climate change and the actions humanity is taking to counter it, is one of the most compelling events in human history. Renewable energy plays an important role in that effort but will most likely not be sufficient to reach our goals for a net zero greenhouse gas economy in 2050. To reach those goals we also must think about any greenhouse gas that we still produce and, for that matter have produced in the past. CCUS or Carbon Capturing, Utilization and Sequestration plays an important role. The technology is there and in may sound easy to start capturing and processing. But collecting these huge amounts of CO2 can pose quite a big risk as well. For example, our existing knowledge of subsurface behavior is much more geared to a semi-static process of oil and gas recovery over multiple decades. But we don’t have that time, so we must approach this in a much more dynamic fashion. For that purpose, we have collaborated with customers that actively capture and store CO2 on transforming their existing ‘static processing’ subsurface management landscape into an event driven green solution. We will show you how, with Confluent Kafka we can run live simulations based on real-time measurements on datasets that are decades old but solve a safe carbon capturing problem right now. With Kafka we create a ‘multi-disciplinary scientific mesh’ to solve a green problem. So, if you are interested in this very promising field of sustainable energy or want to know a bit more about what can and cannot be done with carbon capturing or if you’re interested in bringing multiple disciplines together: then we love to show you how you can use Kafka for that purpose!"

1. © 2024 CGI Inc. Public 1
The Most Compelling Event in Human
History is Event Driven
The Role of Kafka an Battling Climate Change

2. © 2024 CGI Inc. Public 2
2
About me
Michaël
van der Haven
Vice President Consulting Expert
(Renewable) Energy
CGI

3. © 2024 CGI Inc. Public 3
About me
Jessie
Hernandez
Software Architect
HPC job management
CGI

4. © 2024 CGI Inc. Public 4
CCUS
Carbon Capturing, Utilization and
Sequestration
Why and what is it?

5. © 2024 CGI Inc. Public 5
CCUS: Carbon Capture, Utlization and Sequestration
Not a license for Carbon Based Fuels!
Once captured:
• Use it in other industry processes
• Or store it somewhere safe, ideally in a form where
it can never be released anymore
– Limestone generation
– Soil Sequestration, etc
Challenge:
many industries, where ‘the product’ is producing CO2,
and not the fuel used
• Steel Industry
• Cement
• Composits
• Etc.

6. © 2024 CGI Inc. Public 6
Process Visualization

7. © 2024 CGI Inc. Public 7
CO2: Weird and Dangerous
• Heavier than air
• Mainz 2016 accident
• Behaves more like a fluid than a gas in
the subsurface
• Extremely corrosive when water is
added
That’s why Coca Cola works to remove rust!
• Getting CO2 to the storage location is a
challenge
• Corrosion
• Pressure
• Subsurface Conditions
You have to be extremely Sure
Certain and Safe!
When storing it underground

8. © 2024 CGI Inc. Public 8
Example
This image provides some insight on an offshore
CCUS project in Norway
Safety measures are:
• A double Sealing Layer so CO2 cannot leak
• A relatively low injection rate so we don’t
accidentally ‘crack’ the rock formations
• Geochemically stable: the reservoir doesn’t get
‘clogged’
Constant safety checking with, amongst others
seismic monitoring:
• You are putting something into the ground
• That has pressure
• Takes up volume
• So you want to make sure your safety
assumptions are not just assumptions but facts

9. © 2024 CGI Inc. Public 9
Seismic
Processing
The art of seeing the
subsurface

10. © 2024 CGI Inc. Public 10
Seismic Processing
How do we know the CO2 and the
subsurface is behaving like we expect it
to once it has been injected into the
subsurface?
Terabytes of
Seismic data
Thousands of CPU’s
Hundreds of GPU’s
Lots of Memory
purpose-built software

11. © 2024 CGI Inc. Public 11
Seismic processing jobs
Per Month Per Day Per Hour
Per Minute

12. © 2024 CGI Inc. Public 12
What does this software do?
All without dropping or losing a
scheduled job
– Provide easy access to complicated
algorithms.
– Segment the data into comprehensible
chunks of work
– Provide easy to understand overview of
intermediate results
– Chain and automatically generate and submit
follow-on tasks

13. © 2024 CGI Inc. Public 13
How did we try to fix this?
Instead of connecting directly to the database create a file
containing the update message
We ran into issues
Slow Disk I/O. Difficult to scale
No insight into
backlog
File permission
issues

14. © 2024 CGI Inc. Public 14
Solution: Lambda Architecture
Have each job publish all
data meant for the database
to a kafka topic and spin up
subscribers dynamically as
demand increases.
We can spin up different
types of subscribers to the
same topic to handle the
messages.
We still need and rely on
our relational database. We
still require consistent
relational data to perform the
automated generation and
submission of jobs.
• Batch Layer to schedule and run the jobs
• Speed Layer
• Kafka:
• Immediately act upon results instead of waiting until
the batch is finished
• A new job:
• A new batch item
• Processed in a new Kafka messages

15. © 2024 CGI Inc. Public 15
Future steps
É
É
É
Monitor
health of
jobs
Trigger
software
based on
health
information
Simplify
current
software

16. © 2024 CGI Inc. Public 16
Utilization Improvements
Cluster
Cluster
Jobs
Remaining
Jobs
Remaining

17. © 2024 CGI Inc. Public 17
Conclusions and Lessons Learned • What happens under ground: stays underground
– We reuse our subsurface knowledge to address the urgent CO2
problem
• Time is critical
– The same type of science
– Needs to be executed in a way shorter period of type
• Think event driven
– Sometimes simpler than first thought
– Relatively low impact on existing software
• Results
– For simple jobs and clusters a 15% improvement
– For massive clusters and jobs up to a 40% improvement
§ (or more if cloud scalability is utilized as well!)

18. © 2024 CGI Inc. Public 18
Insights you
can act on
Founded in 1976, CGI is among the largest IT and business
consulting services firms in the world.
We are insights-driven and outcomes-based to help accelerate
returns on your investments. Across hundreds of locations
worldwide, we provide comprehensive, scalable and sustainable
IT and business consulting services that are informed globally
and delivered locally.
cgi.com