Deploying Magento on OCI with MDS

Frédéric Descamps
Community Manager
MySQL
May 2021
Deploying Magento on
MySQL Database Service
E-Commerce on OCI

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purpose only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied up in
making purchasing decisions. The development, release, timing and pricing of any features
or functionality described for Oracle´s product may change and remains at the sole
discretion of Oracle Corporation.
Copyright @ 2021 Oracle and/or its affiliates.
3

Who am I ?
about.me/lefred
4

Frédéric Descamps
@lefred
MySQL Evangelist
Managing MySQL since 3.20
devops believer
living in Belgium
h ps://lefred.be
5

Frédéric Descamps
@lefred
MySQL Evangelist
Managing MySQL since 3.20
devops believer
living in Belgium
h ps://lefred.be
DISCLAIMER: I'm not a Magento Developer
5

What is Magento ?
Open-Source E-Commerce
6

Magento
Magento is an open-source e-commerce platform wri en in PHP.
It uses multiple other PHP frameworks such as Laminas and Symfony.
Magento source code is distributed under Open Software License v3.0.
The source code is available on GitHub: h ps://github.com/magento/magento2
Magento supports MySQL 8.0 since version 2.4.0 (July 28th 2020).
7

Magento (2)
From the website, there is a warning about Magento not supporting GTIDs...
This is not a problem since MySQL 8.0.13. In OCI, MDS uses the latest MySQL version.
8

Requirements
Using MySQL Database Service on OCI
10

Requirements
an Internet Connection
11

Requirements
an OCI account
11

Requirements
an OCI account
you can get a free trial on h ps://www.oracle.com/mysql/
11

Requirements
an OCI account
you can get a free trial on h ps://www.oracle.com/mysql/
Nothing else !
11

OCI Dashboard
12

It's Easy !
Installing Magento on OCI with MySQL Database Service
13

OCI Resource Manager - stack
Download the Terraform stack from h ps://github.com/lefred/oci-magento-mds:
14

OCI Resource Manager - stack (2)
Download the Terraform stack from h ps://github.com/lefred/oci-magento-mds:
15

Or click directly on the deploy bu on from the main GitHub page:
16

If you choose the rst option you need to go to the Resource Manager section, if you
clicked on the "Deploy to Oracle Cloud" bu on you will be directly redirect to the right
section.
17

Follow the wizard by rst accepting the Oracle Terms of Use:
18

19

20

21

22

It's possible to deploy di erent architectures:
23

Possible Architectures - Single Magento Server
MySQL Database Service Instance
VCN
10.0.0.0/16
Magento
Private Subnet
10.0.1.0/24
Public Subnet
10.0.0.0/24
OpenDistroES
24

Possible Architectures - Multiple Magento Servers
Sharing one single MDS instance
VCN
10.0.0.0/16
Magento
Private Subnet
10.0.1.0/24
Public Subnet
10.0.0.0/24
OpenDistroES
Magento
Magento
25

Possible Architectures - Multiple Magento Servers (2)
Using dedicated MDS instance per Webservers
VCN
10.0.0.0/16
Magento
Public Subnet
10.0.0.0/24
OpenDistroES
OpenDistroES
Private Subnet
10.0.1.0/24
OpenDistroES
Magento
Magento
26

It's also possible to use existing resources:
27

OCI Resource Manager - Plan
Now we can plan the Terraform architecture and see if we don't have errors:
28

OCI Resource Manager - Plan (2)
29

OCI Resource Manager - Apply
Time to deploy !
30

OCI Resource Manager - Apply (2)
Terraform is creating all resources on OCI...
31

OCI Resource Manager - New
It's now possible to also directly apply the stack when creating it:
32

OCI Resource Manager - Output
33

OCI Resource Manager - Output (2)
All done, the required information can be always retrieved from the Outputs section.
You can also retrieve the ssh key to connect to the Magento Webserver on this screen.
34

OCI Created Resources
35

Magento
Let's use it !
36

Magento
37

Magento - Admin Url
38

Magento - Admin Dashboard
39

Magento - Admin Dashboard (2)
40

Magento - Connecting in SSH
Get the generated SSH Private Key:
41

Magento - Connecting in SSH
Get the generated SSH Private Key:
Paste it into a le on your local machine (oci.key).
41

Magento - Connecting in SSH (2)

[fred@imac ~/keys] $ chmod 600 oci.key
[fred@imac ~/keys] $ ssh -i oci.key opc@130.xx.xx.xxx
The authenticity of host '130.xx.xx.xxx (130.xx.xx.xxx)' can't be established.
ECDSA key ngerprint is SHA256:+gVvfYsXMfqoUEHuw6myhIfm9ov748jN+Vf20zr573o.
Are you sure you want to continue connecting (yes/no/[ ngerprint])? yes
Warning: Permanently added '130.xx.xx.xxx' (ECDSA) to the list of known hosts.
Activate the web console with: systemctl enable --now cockpit.socket
Last login: Mon Mar 15 11:38:21 2021 from 132.xxx.xxx.xxx
[opc@magentoserver1 ~]$
42

Magento - Install Cron Jobs
[opc@magentoserver1 ~]$ cd /var/www/html
[opc@magentoserver1 html]$ sudo -u apache bin/magento cron:install
Crontab has been generated and saved
43

Magento - Install Cron Jobs
[opc@magentoserver1 ~]$ cd /var/www/html
[opc@magentoserver1 html]$ sudo -u apache bin/magento cron:install
Crontab has been generated and saved
If you want to retrieve the admin URI:
[opc@magentoserver1 html]$ sudo -u apache bin/magento info:adminuri
Admin URI: /admin_1s35px
43

Magento Demo
Let's add some data !
44

Adding Data
We will add Magento2's sample data to our installation:
[opc@magentoserver1 ~]$ sudo dnf -y install git
...
[opc@magentoserver1 ~]$ cd /var/www/html/
[opc@magentoserver1 html]$ sudo -u apache git
clone https://github.com/magento/magento2-sample-data
...
[opc@magentoserver1 html]$ sudo -u apache php -f
magento2-sample-data/dev/tools/build-sample-data.php
-- --ce-source="/var/www/html/"
All symlinks you can see at les:
/var/www/html/magento2-sample-data/dev/tools/exclude.log
45

Adding Data (2)
We also need to increase the max memory allowed for PHP processes:
[opc@magentoserver1 html]$ sudo sed -i
's/memory_limits*=.*/memory_limit=512M/g' /etc/php.ini
[opc@magentoserver1 html]$ sudo systemctl reload httpd
46

Adding Data (2)
We also need to increase the max memory allowed for PHP processes:
[opc@magentoserver1 html]$ sudo sed -i
's/memory_limits*=.*/memory_limit=512M/g' /etc/php.ini
[opc@magentoserver1 html]$ sudo systemctl reload httpd
And we can now nish the installation of the sample data:
[opc@magentoserver1 html]$ sudo -u apache bin/magento setup:upgrade
...
block_html: 1
full_page: 1
Nothing to import.
[opc@magentoserver1 html]$ sudo -u apache bin/magento cache: ush
46

Magento - Sample Website
47

MySQL HeatWave
Let's speed up !
48

HeatWave dramatically speeds up MySQL queries
400G, 64 cores
(*)Benchmark queries are derived from TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with TPC-H speci cation.
49

Deploying MySQL HeatWave
First, we need to add HeatWave Cluster to the MDS instance:
50

Deploying MySQL HeatWave (2)
 You need to deploy the MDS instance using a shape ready for HeatWave like MySQL.HeatWave.VM.Standard.E3
51

52

53

54

Using MySQL HeatWave
Let's verify that HeatWave is ready:
SQL> SHOW GLOBAL STATUS LIKE 'rapid_plugin_bootstrapped';
+---------------------------+-------+
| Variable_name | Value |
+---------------------------+-------+
| rapid_plugin_bootstrapped | YES |
+---------------------------+-------+
1 row in set (0.0018 sec)
55

Using MySQL HeatWave (2)
Some new status variables available:
SQL> show status like 'rapid%' ;
+---------------------------------+------------+
+---------------------------------+------------+
| rapid_change_propagation_status | ON |
| rapid_cluster_ready_number | 2 |
| rapid_cluster_status | ON |
| rapid_core_count | 16 |
| rapid_heap_usage | 67109005 |
| rapid_load_progress | 100.000000 |
| rapid_net_authentication | ON |
| rapid_preload_stats_status | Available |
| rapid_query_of oad_count | 0 |
| rapid_service_status | ONLINE |
+---------------------------------+------------+
56

Choosing the tables to be used with HeatWave
It's necessary to tell to MySQL which tables can be used for HeatWave.
I will use all the catalog tables.
This is an example using catalog_product_index_price:
SQL> ALTER TABLE catalog_product_index_price SECONDARY_ENGINE = RAPID;
SQL> ALTER TABLE catalog_product_index_price SECONDARY_LOAD;
59

MySQL HeatWave
To see if HeatWave is used, we can verify the status variable rapid_query_of oad_count:
SQL> SHOW STATUS LIKE 'rapid_query_of oad%' ;
+---------------------------+-------+
+---------------------------+-------+
+---------------------------+-------+
60

MySQL HeatWave (2)
As some queries were o oaded to HeatWave, we can also see which ones:
SQL> SELECT query_text, JSON_PRETTY(QEXEC_TEXT)
FROM performance_schema.rpd_query_statsG
************************** 1. row ***************************
query_text: SELECT MAX(count) AS `count` FROM (
SELECT count(value_table.value_id) AS `count`
FROM `catalog_product_entity_varchar` AS `value_table`
GROUP BY `entity_id`,
`store_id`) AS `max_value`
json_pretty(QEXEC_TEXT): {
"timings": {
"queryEndTime": "2021-03-17 09:26:29.208009",
"queryStartTime": "2021-03-17 09:26:29.016203",
"joinOrderStartTime": "2021-03-17 09:26:29.016116"
},
...
61

MySQL HeatWave (3) - comparison
We can try the query with or without HeatWave to compare:
62

MySQL HeatWave (3) - comparison
We can try the query with or without HeatWave to compare:
SQL> SELECT MAX(count) AS `count` FROM (SELECT count(value_table.value_id)
AS `count` FROM `catalog_product_entity_varchar` AS `value_table`
GROUP BY `entity_id`, `store_id`) AS `max_value`;
+-------+
| count |
+-------+
| 10 |
+-------+
SQL> SET SESSION use_secondary_engine=OFF;
SQL> SELECT MAX(count) AS `count` FROM (SELECT count(value_table.value_id)
AS `count` FROM `catalog_product_entity_varchar` AS `value_table`
GROUP BY `entity_id`, `store_id`) AS `max_value`;
+-------+
| count |
+-------+
| 10 |
+-------+
62

Magento & MySQL HeatWave - maintenance
For some operations, like reindexing everything, Magento runs some DDL that are not
supported while HeatWave is active.
So if you encounter errors similar to this one:
SQLSTATE[HY000]: General error: 3890 DDLs on a table with a secondary engine
de ned are not allowed., query was:
TRUNCATE TABLE `catalog_category_product_index_store1_replica`
Product Categories index process unknown error
You only need to disable HeatWave for the time of the maintenance:
SQL> ALTER TABLE catalog_product_index_store1 SECONDARY_ENGINE NULL;
63

Magento & MySQL HeatWave - maintenance (2)
You can now perform the index maintenance task:
$ sudo -u apache bin/magento indexer:reindex catalog_product_price
Product Price index has been rebuilt successfully in 00:14:03
And active again HeatWave:
SQL> ALTER TABLE catalog_product_index_store1 SECONDARY_ENGINE = RAPID;
SQL> ALTER TABLE catalog_product_index_store1 SECONDARY_LOAD;
64

Want to improve the
performance of slow
queries ?
Sign up for a performance health check
mysql.com/healthcheck
65

Questions ?
66

Deploying Magento on OCI with MDS

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Deploying Magento on OCI with MDS

Similar to Deploying Magento on OCI with MDS (20)

More from Frederic Descamps

More from Frederic Descamps (9)

Recently uploaded

Recently uploaded (20)

Deploying Magento on OCI with MDS