CCV: migrating our payment processing system to MariaDB

MariaDB plc
MariaDB plcMariaDB plc
Key payment processing system
running on MariaDB Galera Cluster
Introduction
March 7, 2019 2
Harry Dijkstra
Senior Database Specialist
• 18 years experience in Oracle databases
• 2 years experience in DB2 and SQL Server
databases
• 3 years MariaDB experience
Ernst Wernicke
Senior Database and Storage Specialist
• Over 15 years experience in DB2, SQL Server and
Oracle databases
• Over 15 years experience in payment processing
systems
• 3 years MariaDB experience
CCV Processing
• Arnhem based
• Family owned
• 60 years old
• Payment processor
– Retail
– Parking
– Petrol
– Travel & Entertainment
• Loyalty provider
March 7, 2019 3
CCV @home in Europe
March 7, 2019 4
Fact & Figures
1.100
Employees
€ 190
Mio.
Revenue
220.000
Customers
+770 Mio.
Transactions
15.000
Webshops
600.000
Terminals
(touch points)
CCV Group
Presence CCV Easy solutions
6
Including local scheme (if applicable)
Only for international brands
No presence yet, but on target
list
March 7, 2019
Databases@CCV
March 7, 2019 7
• MariaDB
– private cloud
– future processing platform
– strategic future choice
• SQL server
– current processing platform
• DB2
– current back-office
• Oracle
– limited installed base
MariaDB@CCV
March 7, 2019 8
• CCV360
– Development of a new, omni-channel portfolio
– Terminal, cash-register app, webshop, loyalty,
merchant boarding and MyCCV
• jSwitch
– Operational 2021
– Future processing system
jSwitch@CCV
• Requirements
• Database architectures
• PoC
• Issues, considerations and discussions
• Next steps
• Realization
March 7, 2019 9
jSwitch Requirements summary
March 7, 2019 10
• Two geographical sites
• No SPOF at any level
• System must be scalable to be future proof
• Max 3 sec. data loss during disaster
• 4000 database transactions per second (min 2 hours)
– Upscaling to 12000
• Near zero downtime (planned and unplanned)
Considered architectures scenario A
March 7, 2019 11
• Asynchronous connection between datacenters.
Considered architectures scenario B
March 7, 2019 12
• Preferred configuration, but requires a third datacenter, third datacenter is
out-of-scope.
Considered architectures scenario B’
March 7, 2019 13
• Evolved from scenario B.
• No third datacenter.
• Nodes@DC2 needs human action to continue processing when DC1 is out.
Considered architectures C
March 7, 2019 14
• Asynchronous connection between datacenters.
• Semi-sync within datacenters
• Possible more than 3 sec. data loss
Considered architectures scenario D
March 7, 2019 15
• Cross datacenter latency
• Possible more than 3 sec. data loss
jSwitch Database Architecture 2
March 7, 2019 16
• 5 node Galera cluster doing all transaction
processing
• In DC1 and in DC2 an asynchronous
intermediate master to offload data for
– offside monitoring,
– reporting,
– ad-hoc queries and
– backup.
jSwitch Database Architecture 1
March 7, 2019 17
jSwitch High level design
March 7, 2019
18
jSwitch PoC
March 7, 2019 19
• 5 node Galera cluster, stretched over 2
datacenters
• Asynchronous slave in DC1 and DC2
• X-86 Hardware
– Bare metal, no virtualization
– Local storage
– 256GB RAM
– 1 cpu 6 cores HT 3.6 Ghz
• Maxscale at all application servers
Issues, considerations and discussions
March 7, 2019 20
• Issues & discussions:
– Periodical performance drops
– 5 node Galera performance problems
– Open source
– Support or no support
– Enterprise vs non-enterprise
– Small installed base (especially in The Netherlands)
– External support/consultancy hard to find
• Pros:
– Solid database solution
– Full support from MariaDB
– Short lines to MariaDB support and developers
– Fast and adequate support from account manager
• PoC Outcome: Go
Next steps
March 7, 2019 21
• Building test environment
• Building acceptance and production environment
• Automation
• Fault tolerant
• Monitoring using Monyog
• Sharding
– Logical
– Spyder
Realization Test
March 7, 2019 22
• 3 Teams
• 9 environments
• Automation – Ansible
• Discussion technical concepts
• Discussion responsibilities
• First real world transaction
Realization Acceptance and Production
March 7, 2019 23
• Migration path
• Building Accp environment
• Connection to other CCV systems
– Fraud detection
– Front - Back office
– MQ Services
– Ewacs alerting
– Other shared services
Questions?
March 7, 2019 24
h.dijkstra@nl.ccv.eu
e.wernicke@nl.ccv.eu
1 of 24

Recommended

How we switched to columnar at SpendHQ by
How we switched to columnar at SpendHQHow we switched to columnar at SpendHQ
How we switched to columnar at SpendHQMariaDB plc
834 views35 slides
How QBerg scaled to store data longer, query it faster by
How QBerg scaled to store data longer, query it fasterHow QBerg scaled to store data longer, query it faster
How QBerg scaled to store data longer, query it fasterMariaDB plc
643 views20 slides
How Pixid dropped Oracle and went hybrid with MariaDB by
How Pixid dropped Oracle and went hybrid with MariaDBHow Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDBMariaDB plc
766 views33 slides
Getting started in the cloud for developers by
Getting started in the cloud for developersGetting started in the cloud for developers
Getting started in the cloud for developersMariaDB plc
154 views23 slides
Introducing the ultimate MariaDB cloud, SkySQL by
Introducing the ultimate MariaDB cloud, SkySQLIntroducing the ultimate MariaDB cloud, SkySQL
Introducing the ultimate MariaDB cloud, SkySQLMariaDB plc
470 views37 slides
What to expect from MariaDB Platform X5, part 1 by
What to expect from MariaDB Platform X5, part 1What to expect from MariaDB Platform X5, part 1
What to expect from MariaDB Platform X5, part 1MariaDB plc
435 views33 slides

More Related Content

What's hot

Global Data Replication with Galera for Ansell Guardian® by
Global Data Replication with Galera for Ansell Guardian®Global Data Replication with Galera for Ansell Guardian®
Global Data Replication with Galera for Ansell Guardian®MariaDB plc
2.5K views21 slides
What to expect from MariaDB Platform X5, part 2 by
What to expect from MariaDB Platform X5, part 2What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2MariaDB plc
428 views33 slides
ClustrixDB: how distributed databases scale out by
ClustrixDB: how distributed databases scale outClustrixDB: how distributed databases scale out
ClustrixDB: how distributed databases scale outMariaDB plc
1.9K views28 slides
How Orwell built a geo-distributed Bank-as-a-Service with microservices by
How Orwell built a geo-distributed Bank-as-a-Service with microservicesHow Orwell built a geo-distributed Bank-as-a-Service with microservices
How Orwell built a geo-distributed Bank-as-a-Service with microservicesMariaDB plc
783 views24 slides
Configuring workload-based storage and topologies by
Configuring workload-based storage and topologiesConfiguring workload-based storage and topologies
Configuring workload-based storage and topologiesMariaDB plc
674 views33 slides
The architecture of SkySQL by
The architecture of SkySQLThe architecture of SkySQL
The architecture of SkySQLMariaDB plc
587 views13 slides

What's hot(20)

Global Data Replication with Galera for Ansell Guardian® by MariaDB plc
Global Data Replication with Galera for Ansell Guardian®Global Data Replication with Galera for Ansell Guardian®
Global Data Replication with Galera for Ansell Guardian®
MariaDB plc2.5K views
What to expect from MariaDB Platform X5, part 2 by MariaDB plc
What to expect from MariaDB Platform X5, part 2What to expect from MariaDB Platform X5, part 2
What to expect from MariaDB Platform X5, part 2
MariaDB plc428 views
ClustrixDB: how distributed databases scale out by MariaDB plc
ClustrixDB: how distributed databases scale outClustrixDB: how distributed databases scale out
ClustrixDB: how distributed databases scale out
MariaDB plc1.9K views
How Orwell built a geo-distributed Bank-as-a-Service with microservices by MariaDB plc
How Orwell built a geo-distributed Bank-as-a-Service with microservicesHow Orwell built a geo-distributed Bank-as-a-Service with microservices
How Orwell built a geo-distributed Bank-as-a-Service with microservices
MariaDB plc783 views
Configuring workload-based storage and topologies by MariaDB plc
Configuring workload-based storage and topologiesConfiguring workload-based storage and topologies
Configuring workload-based storage and topologies
MariaDB plc674 views
The architecture of SkySQL by MariaDB plc
The architecture of SkySQLThe architecture of SkySQL
The architecture of SkySQL
MariaDB plc587 views
How to power microservices with MariaDB by MariaDB plc
How to power microservices with MariaDBHow to power microservices with MariaDB
How to power microservices with MariaDB
MariaDB plc611 views
Deploying MariaDB databases with containers at Nokia Networks by MariaDB plc
Deploying MariaDB databases with containers at Nokia NetworksDeploying MariaDB databases with containers at Nokia Networks
Deploying MariaDB databases with containers at Nokia Networks
MariaDB plc2.4K views
How MariaDB is approaching DBaaS by MariaDB plc
How MariaDB is approaching DBaaSHow MariaDB is approaching DBaaS
How MariaDB is approaching DBaaS
MariaDB plc1K views
The role of databases in modern application development by MariaDB plc
The role of databases in modern application developmentThe role of databases in modern application development
The role of databases in modern application development
MariaDB plc185 views
ClustrixDB at Samsung Cloud by MariaDB plc
ClustrixDB at Samsung CloudClustrixDB at Samsung Cloud
ClustrixDB at Samsung Cloud
MariaDB plc1.4K views
Introducing the R2DBC async Java connector by MariaDB plc
Introducing the R2DBC async Java connectorIntroducing the R2DBC async Java connector
Introducing the R2DBC async Java connector
MariaDB plc766 views
Webinar slides: How to Migrate from Oracle DB to MariaDB by Severalnines
Webinar slides: How to Migrate from Oracle DB to MariaDBWebinar slides: How to Migrate from Oracle DB to MariaDB
Webinar slides: How to Migrate from Oracle DB to MariaDB
Severalnines2K views
M|18 Welcome Keynote by MariaDB plc
M|18 Welcome KeynoteM|18 Welcome Keynote
M|18 Welcome Keynote
MariaDB plc457 views
Faster, better, stronger: The new InnoDB by MariaDB plc
Faster, better, stronger: The new InnoDBFaster, better, stronger: The new InnoDB
Faster, better, stronger: The new InnoDB
MariaDB plc651 views
Writing powerful stored procedures in PL/SQL by MariaDB plc
Writing powerful stored procedures in PL/SQLWriting powerful stored procedures in PL/SQL
Writing powerful stored procedures in PL/SQL
MariaDB plc1.6K views
Under the hood: SkySQL monitoring by MariaDB plc
Under the hood: SkySQL monitoringUnder the hood: SkySQL monitoring
Under the hood: SkySQL monitoring
MariaDB plc558 views
MariaDB ColumnStore by MariaDB plc
MariaDB ColumnStoreMariaDB ColumnStore
MariaDB ColumnStore
MariaDB plc489 views
SkySQL MariaDB 云数据组件 by YUCHENG HU
SkySQL MariaDB 云数据组件SkySQL MariaDB 云数据组件
SkySQL MariaDB 云数据组件
YUCHENG HU789 views
Getting the most out of MariaDB MaxScale by MariaDB plc
Getting the most out of MariaDB MaxScaleGetting the most out of MariaDB MaxScale
Getting the most out of MariaDB MaxScale
MariaDB plc1.9K views

Similar to CCV: migrating our payment processing system to MariaDB

How THINQ runs both transactions and analytics at scale by
How THINQ runs both transactions and analytics at scaleHow THINQ runs both transactions and analytics at scale
How THINQ runs both transactions and analytics at scaleMariaDB plc
738 views49 slides
In memory grids IMDG by
In memory grids IMDGIn memory grids IMDG
In memory grids IMDGPrateek Jain
2.1K views18 slides
Datastax - Why Your RDBMS fails at scale by
Datastax - Why Your RDBMS fails at scaleDatastax - Why Your RDBMS fails at scale
Datastax - Why Your RDBMS fails at scaleRuth Mills
138 views29 slides
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas... by
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...DataStax Academy
1.2K views35 slides
Accelerate and modernize your data pipelines by
Accelerate and modernize your data pipelinesAccelerate and modernize your data pipelines
Accelerate and modernize your data pipelinesPaul Van Siclen
110 views21 slides
How KeyBank Used Elastic to Build an Enterprise Monitoring Solution by
How KeyBank Used Elastic to Build an Enterprise Monitoring SolutionHow KeyBank Used Elastic to Build an Enterprise Monitoring Solution
How KeyBank Used Elastic to Build an Enterprise Monitoring SolutionElasticsearch
3.2K views34 slides

Similar to CCV: migrating our payment processing system to MariaDB(20)

How THINQ runs both transactions and analytics at scale by MariaDB plc
How THINQ runs both transactions and analytics at scaleHow THINQ runs both transactions and analytics at scale
How THINQ runs both transactions and analytics at scale
MariaDB plc738 views
In memory grids IMDG by Prateek Jain
In memory grids IMDGIn memory grids IMDG
In memory grids IMDG
Prateek Jain2.1K views
Datastax - Why Your RDBMS fails at scale by Ruth Mills
Datastax - Why Your RDBMS fails at scaleDatastax - Why Your RDBMS fails at scale
Datastax - Why Your RDBMS fails at scale
Ruth Mills138 views
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas... by DataStax Academy
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...
C* Summit 2013: Optimizing the Public Cloud for Cost and Scalability with Cas...
DataStax Academy1.2K views
Accelerate and modernize your data pipelines by Paul Van Siclen
Accelerate and modernize your data pipelinesAccelerate and modernize your data pipelines
Accelerate and modernize your data pipelines
Paul Van Siclen110 views
How KeyBank Used Elastic to Build an Enterprise Monitoring Solution by Elasticsearch
How KeyBank Used Elastic to Build an Enterprise Monitoring SolutionHow KeyBank Used Elastic to Build an Enterprise Monitoring Solution
How KeyBank Used Elastic to Build an Enterprise Monitoring Solution
Elasticsearch3.2K views
Le novità di sql server 2019 by Gianluca Hotz
Le novità di sql server 2019Le novità di sql server 2019
Le novità di sql server 2019
Gianluca Hotz171 views
How to Empower a Platform With a Data Pipeline At a Scale by Deepak Sood
How to Empower a Platform With a Data Pipeline At a ScaleHow to Empower a Platform With a Data Pipeline At a Scale
How to Empower a Platform With a Data Pipeline At a Scale
Deepak Sood205 views
Webinar: SQL for Machine Data? by Crate.io
Webinar: SQL for Machine Data?Webinar: SQL for Machine Data?
Webinar: SQL for Machine Data?
Crate.io293 views
Enterprise architectsview 2015-apr by MongoDB
Enterprise architectsview 2015-aprEnterprise architectsview 2015-apr
Enterprise architectsview 2015-apr
MongoDB2.6K views
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ... by Mike Rossi
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Mike Rossi2.2K views
IT Modernization in Practice by Tom Diederich
IT Modernization in PracticeIT Modernization in Practice
IT Modernization in Practice
Tom Diederich179 views
Webinar: An Enterprise Architect’s View of MongoDB by MongoDB
Webinar: An Enterprise Architect’s View of MongoDBWebinar: An Enterprise Architect’s View of MongoDB
Webinar: An Enterprise Architect’s View of MongoDB
MongoDB7.1K views
Hybrid Transactional/Analytics Processing with Spark and IMDGs by Ali Hodroj
Hybrid Transactional/Analytics Processing with Spark and IMDGsHybrid Transactional/Analytics Processing with Spark and IMDGs
Hybrid Transactional/Analytics Processing with Spark and IMDGs
Ali Hodroj1K views
iFood on Delivering 100 Million Events a Month to Restaurants with Scylla by ScyllaDB
iFood on Delivering 100 Million Events a Month to Restaurants with ScyllaiFood on Delivering 100 Million Events a Month to Restaurants with Scylla
iFood on Delivering 100 Million Events a Month to Restaurants with Scylla
ScyllaDB1.7K views
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim... by jaxLondonConference
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...
jaxLondonConference1.4K views
You've Got Mail! with Michael van der Haven by HostedbyConfluent
You've Got Mail! with Michael van der HavenYou've Got Mail! with Michael van der Haven
You've Got Mail! with Michael van der Haven
HostedbyConfluent135 views
Ops Jumpstart: MongoDB Administration 101 by MongoDB
Ops Jumpstart: MongoDB Administration 101Ops Jumpstart: MongoDB Administration 101
Ops Jumpstart: MongoDB Administration 101
MongoDB1.1K views
MonogDB Admin 101 - MonogDBDays Munich by Marc Schwering
MonogDB Admin 101 - MonogDBDays MunichMonogDB Admin 101 - MonogDBDays Munich
MonogDB Admin 101 - MonogDBDays Munich
Marc Schwering318 views
Laboratorio práctico: Data warehouse en la nube by Software Guru
Laboratorio práctico: Data warehouse en la nubeLaboratorio práctico: Data warehouse en la nube
Laboratorio práctico: Data warehouse en la nube
Software Guru421 views

More from MariaDB plc

MariaDB Paris Workshop 2023 - MaxScale 23.02.x by
MariaDB Paris Workshop 2023 - MaxScale 23.02.xMariaDB Paris Workshop 2023 - MaxScale 23.02.x
MariaDB Paris Workshop 2023 - MaxScale 23.02.xMariaDB plc
11 views17 slides
MariaDB Paris Workshop 2023 - Newpharma by
MariaDB Paris Workshop 2023 - NewpharmaMariaDB Paris Workshop 2023 - Newpharma
MariaDB Paris Workshop 2023 - NewpharmaMariaDB plc
24 views19 slides
MariaDB Paris Workshop 2023 - Cloud by
MariaDB Paris Workshop 2023 - CloudMariaDB Paris Workshop 2023 - Cloud
MariaDB Paris Workshop 2023 - CloudMariaDB plc
12 views24 slides
MariaDB Paris Workshop 2023 - MariaDB Enterprise by
MariaDB Paris Workshop 2023 - MariaDB EnterpriseMariaDB Paris Workshop 2023 - MariaDB Enterprise
MariaDB Paris Workshop 2023 - MariaDB EnterpriseMariaDB plc
40 views32 slides
MariaDB Paris Workshop 2023 - Performance Optimization by
MariaDB Paris Workshop 2023 - Performance OptimizationMariaDB Paris Workshop 2023 - Performance Optimization
MariaDB Paris Workshop 2023 - Performance OptimizationMariaDB plc
36 views33 slides
MariaDB Paris Workshop 2023 - MaxScale by
MariaDB Paris Workshop 2023 - MaxScale MariaDB Paris Workshop 2023 - MaxScale
MariaDB Paris Workshop 2023 - MaxScale MariaDB plc
32 views15 slides

More from MariaDB plc(18)

MariaDB Paris Workshop 2023 - MaxScale 23.02.x by MariaDB plc
MariaDB Paris Workshop 2023 - MaxScale 23.02.xMariaDB Paris Workshop 2023 - MaxScale 23.02.x
MariaDB Paris Workshop 2023 - MaxScale 23.02.x
MariaDB plc11 views
MariaDB Paris Workshop 2023 - Newpharma by MariaDB plc
MariaDB Paris Workshop 2023 - NewpharmaMariaDB Paris Workshop 2023 - Newpharma
MariaDB Paris Workshop 2023 - Newpharma
MariaDB plc24 views
MariaDB Paris Workshop 2023 - Cloud by MariaDB plc
MariaDB Paris Workshop 2023 - CloudMariaDB Paris Workshop 2023 - Cloud
MariaDB Paris Workshop 2023 - Cloud
MariaDB plc12 views
MariaDB Paris Workshop 2023 - MariaDB Enterprise by MariaDB plc
MariaDB Paris Workshop 2023 - MariaDB EnterpriseMariaDB Paris Workshop 2023 - MariaDB Enterprise
MariaDB Paris Workshop 2023 - MariaDB Enterprise
MariaDB plc40 views
MariaDB Paris Workshop 2023 - Performance Optimization by MariaDB plc
MariaDB Paris Workshop 2023 - Performance OptimizationMariaDB Paris Workshop 2023 - Performance Optimization
MariaDB Paris Workshop 2023 - Performance Optimization
MariaDB plc36 views
MariaDB Paris Workshop 2023 - MaxScale by MariaDB plc
MariaDB Paris Workshop 2023 - MaxScale MariaDB Paris Workshop 2023 - MaxScale
MariaDB Paris Workshop 2023 - MaxScale
MariaDB plc32 views
MariaDB Paris Workshop 2023 - novadys presentation by MariaDB plc
MariaDB Paris Workshop 2023 - novadys presentationMariaDB Paris Workshop 2023 - novadys presentation
MariaDB Paris Workshop 2023 - novadys presentation
MariaDB plc24 views
MariaDB Paris Workshop 2023 - DARVA presentation by MariaDB plc
MariaDB Paris Workshop 2023 - DARVA presentationMariaDB Paris Workshop 2023 - DARVA presentation
MariaDB Paris Workshop 2023 - DARVA presentation
MariaDB plc18 views
MariaDB Tech und Business Update Hamburg 2023 - MariaDB Enterprise Server by MariaDB plc
MariaDB Tech und Business Update Hamburg 2023 - MariaDB Enterprise Server MariaDB Tech und Business Update Hamburg 2023 - MariaDB Enterprise Server
MariaDB Tech und Business Update Hamburg 2023 - MariaDB Enterprise Server
MariaDB plc31 views
MariaDB SkySQL Autonome Skalierung, Observability, Cloud-Backup by MariaDB plc
MariaDB SkySQL Autonome Skalierung, Observability, Cloud-BackupMariaDB SkySQL Autonome Skalierung, Observability, Cloud-Backup
MariaDB SkySQL Autonome Skalierung, Observability, Cloud-Backup
MariaDB plc31 views
Einführung : MariaDB Tech und Business Update Hamburg 2023 by MariaDB plc
Einführung : MariaDB Tech und Business Update Hamburg 2023Einführung : MariaDB Tech und Business Update Hamburg 2023
Einführung : MariaDB Tech und Business Update Hamburg 2023
MariaDB plc39 views
Hochverfügbarkeitslösungen mit MariaDB by MariaDB plc
Hochverfügbarkeitslösungen mit MariaDBHochverfügbarkeitslösungen mit MariaDB
Hochverfügbarkeitslösungen mit MariaDB
MariaDB plc48 views
Die Neuheiten in MariaDB Enterprise Server by MariaDB plc
Die Neuheiten in MariaDB Enterprise ServerDie Neuheiten in MariaDB Enterprise Server
Die Neuheiten in MariaDB Enterprise Server
MariaDB plc12 views
Introducing workload analysis by MariaDB plc
Introducing workload analysisIntroducing workload analysis
Introducing workload analysis
MariaDB plc906 views
What’s new in Galera 4 by MariaDB plc
What’s new in Galera 4What’s new in Galera 4
What’s new in Galera 4
MariaDB plc6.4K views
Beyond the basics: advanced SQL with MariaDB by MariaDB plc
Beyond the basics: advanced SQL with MariaDBBeyond the basics: advanced SQL with MariaDB
Beyond the basics: advanced SQL with MariaDB
MariaDB plc1.3K views
Inside CynosDB: MariaDB optimized for the cloud at Tencent by MariaDB plc
Inside CynosDB: MariaDB optimized for the cloud at TencentInside CynosDB: MariaDB optimized for the cloud at Tencent
Inside CynosDB: MariaDB optimized for the cloud at Tencent
MariaDB plc709 views
Migrating from InnoDB and HBase to MyRocks at Facebook by MariaDB plc
Migrating from InnoDB and HBase to MyRocks at FacebookMigrating from InnoDB and HBase to MyRocks at Facebook
Migrating from InnoDB and HBase to MyRocks at Facebook
MariaDB plc44.4K views

Recently uploaded

MS PowerPoint.pptx by
MS PowerPoint.pptxMS PowerPoint.pptx
MS PowerPoint.pptxLitty Sylus
5 views14 slides
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h... by
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...Deltares
9 views31 slides
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra... by
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra....NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...Marc Müller
40 views62 slides
DSD-INT 2023 The Danube Hazardous Substances Model - Kovacs by
DSD-INT 2023 The Danube Hazardous Substances Model - KovacsDSD-INT 2023 The Danube Hazardous Substances Model - Kovacs
DSD-INT 2023 The Danube Hazardous Substances Model - KovacsDeltares
10 views17 slides
Airline Booking Software by
Airline Booking SoftwareAirline Booking Software
Airline Booking SoftwareSharmiMehta
6 views26 slides
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J... by
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...Deltares
12 views24 slides

Recently uploaded(20)

DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h... by Deltares
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
Deltares9 views
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra... by Marc Müller
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra....NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...
Marc Müller40 views
DSD-INT 2023 The Danube Hazardous Substances Model - Kovacs by Deltares
DSD-INT 2023 The Danube Hazardous Substances Model - KovacsDSD-INT 2023 The Danube Hazardous Substances Model - Kovacs
DSD-INT 2023 The Danube Hazardous Substances Model - Kovacs
Deltares10 views
Airline Booking Software by SharmiMehta
Airline Booking SoftwareAirline Booking Software
Airline Booking Software
SharmiMehta6 views
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J... by Deltares
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...
DSD-INT 2023 3D hydrodynamic modelling of microplastic transport in lakes - J...
Deltares12 views
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action by Márton Kodok
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionGen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
Márton Kodok6 views
Quality Engineer: A Day in the Life by John Valentino
Quality Engineer: A Day in the LifeQuality Engineer: A Day in the Life
Quality Engineer: A Day in the Life
John Valentino6 views
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ... by Donato Onofri
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Donato Onofri860 views
SUGCON ANZ Presentation V2.1 Final.pptx by Jack Spektor
SUGCON ANZ Presentation V2.1 Final.pptxSUGCON ANZ Presentation V2.1 Final.pptx
SUGCON ANZ Presentation V2.1 Final.pptx
Jack Spektor23 views
Headless JS UG Presentation.pptx by Jack Spektor
Headless JS UG Presentation.pptxHeadless JS UG Presentation.pptx
Headless JS UG Presentation.pptx
Jack Spektor8 views
Dev-Cloud Conference 2023 - Continuous Deployment Showdown: Traditionelles CI... by Marc Müller
Dev-Cloud Conference 2023 - Continuous Deployment Showdown: Traditionelles CI...Dev-Cloud Conference 2023 - Continuous Deployment Showdown: Traditionelles CI...
Dev-Cloud Conference 2023 - Continuous Deployment Showdown: Traditionelles CI...
Marc Müller41 views
FOSSLight Community Day 2023-11-30 by Shane Coughlan
FOSSLight Community Day 2023-11-30FOSSLight Community Day 2023-11-30
FOSSLight Community Day 2023-11-30
Shane Coughlan5 views
Sprint 226 by ManageIQ
Sprint 226Sprint 226
Sprint 226
ManageIQ5 views
tecnologia18.docx by nosi6702
tecnologia18.docxtecnologia18.docx
tecnologia18.docx
nosi67025 views
Navigating container technology for enhanced security by Niklas Saari by Metosin Oy
Navigating container technology for enhanced security by Niklas SaariNavigating container technology for enhanced security by Niklas Saari
Navigating container technology for enhanced security by Niklas Saari
Metosin Oy14 views

CCV: migrating our payment processing system to MariaDB

  • 1. Key payment processing system running on MariaDB Galera Cluster
  • 2. Introduction March 7, 2019 2 Harry Dijkstra Senior Database Specialist • 18 years experience in Oracle databases • 2 years experience in DB2 and SQL Server databases • 3 years MariaDB experience Ernst Wernicke Senior Database and Storage Specialist • Over 15 years experience in DB2, SQL Server and Oracle databases • Over 15 years experience in payment processing systems • 3 years MariaDB experience
  • 3. CCV Processing • Arnhem based • Family owned • 60 years old • Payment processor – Retail – Parking – Petrol – Travel & Entertainment • Loyalty provider March 7, 2019 3
  • 4. CCV @home in Europe March 7, 2019 4
  • 5. Fact & Figures 1.100 Employees € 190 Mio. Revenue 220.000 Customers +770 Mio. Transactions 15.000 Webshops 600.000 Terminals (touch points) CCV Group
  • 6. Presence CCV Easy solutions 6 Including local scheme (if applicable) Only for international brands No presence yet, but on target list March 7, 2019
  • 7. Databases@CCV March 7, 2019 7 • MariaDB – private cloud – future processing platform – strategic future choice • SQL server – current processing platform • DB2 – current back-office • Oracle – limited installed base
  • 8. MariaDB@CCV March 7, 2019 8 • CCV360 – Development of a new, omni-channel portfolio – Terminal, cash-register app, webshop, loyalty, merchant boarding and MyCCV • jSwitch – Operational 2021 – Future processing system
  • 9. jSwitch@CCV • Requirements • Database architectures • PoC • Issues, considerations and discussions • Next steps • Realization March 7, 2019 9
  • 10. jSwitch Requirements summary March 7, 2019 10 • Two geographical sites • No SPOF at any level • System must be scalable to be future proof • Max 3 sec. data loss during disaster • 4000 database transactions per second (min 2 hours) – Upscaling to 12000 • Near zero downtime (planned and unplanned)
  • 11. Considered architectures scenario A March 7, 2019 11 • Asynchronous connection between datacenters.
  • 12. Considered architectures scenario B March 7, 2019 12 • Preferred configuration, but requires a third datacenter, third datacenter is out-of-scope.
  • 13. Considered architectures scenario B’ March 7, 2019 13 • Evolved from scenario B. • No third datacenter. • Nodes@DC2 needs human action to continue processing when DC1 is out.
  • 14. Considered architectures C March 7, 2019 14 • Asynchronous connection between datacenters. • Semi-sync within datacenters • Possible more than 3 sec. data loss
  • 15. Considered architectures scenario D March 7, 2019 15 • Cross datacenter latency • Possible more than 3 sec. data loss
  • 16. jSwitch Database Architecture 2 March 7, 2019 16 • 5 node Galera cluster doing all transaction processing • In DC1 and in DC2 an asynchronous intermediate master to offload data for – offside monitoring, – reporting, – ad-hoc queries and – backup.
  • 17. jSwitch Database Architecture 1 March 7, 2019 17
  • 18. jSwitch High level design March 7, 2019 18
  • 19. jSwitch PoC March 7, 2019 19 • 5 node Galera cluster, stretched over 2 datacenters • Asynchronous slave in DC1 and DC2 • X-86 Hardware – Bare metal, no virtualization – Local storage – 256GB RAM – 1 cpu 6 cores HT 3.6 Ghz • Maxscale at all application servers
  • 20. Issues, considerations and discussions March 7, 2019 20 • Issues & discussions: – Periodical performance drops – 5 node Galera performance problems – Open source – Support or no support – Enterprise vs non-enterprise – Small installed base (especially in The Netherlands) – External support/consultancy hard to find • Pros: – Solid database solution – Full support from MariaDB – Short lines to MariaDB support and developers – Fast and adequate support from account manager • PoC Outcome: Go
  • 21. Next steps March 7, 2019 21 • Building test environment • Building acceptance and production environment • Automation • Fault tolerant • Monitoring using Monyog • Sharding – Logical – Spyder
  • 22. Realization Test March 7, 2019 22 • 3 Teams • 9 environments • Automation – Ansible • Discussion technical concepts • Discussion responsibilities • First real world transaction
  • 23. Realization Acceptance and Production March 7, 2019 23 • Migration path • Building Accp environment • Connection to other CCV systems – Fraud detection – Front - Back office – MQ Services – Ewacs alerting – Other shared services
  • 24. Questions? March 7, 2019 24 h.dijkstra@nl.ccv.eu e.wernicke@nl.ccv.eu