This document provides an overview of MySQL shell utilities including the Upgrade Checker Utility, Table Export Utility, Parallel Table Import Utility, Dump Utility, Dump Loading Utility, and JSON Import Utility. It describes the purpose and notable options of each utility for upgrading databases, exporting and importing tables in parallel, taking backups, and importing JSON data.

1. MySQL shell and It's utilities
Praveen GR
Associate database consultant,
Mydbops

2. Services on top open source databases
Founded in 2016
80 Member team
Assisted over 500+ Customers
AWS Partner and a PCI Certified Organisation
About Mydbops

3. Database
Consulting
Services
Managed
Database
Services
Focuses on Top Opensource database MySQL,MariaDB,
MongoDB and PostgreSQL ON Premises and Cloud
Mydbops Services

4. About MySQL shell
MySQL shell Utilities
Upgrade Checker Utility
Table Export Utility
Parallel Table Import Utility
Dump utility
Dump Loading Utility
JSON Import Utility
Agenda

5. About MySQL Shell

6. MySQL shell is an addon utility
JavaScript, Python and SQL
Results - table, tabbed, vertical format, JSON
MySQL Shell

7. MySQL Shell Utilities

8. MySQL Shell Utilities
Shell utility
Backup Restore
Other
Table Export
Utility
Dump Utility
Table Import
Utility
Dump Loading
Utility
JSON Import
Utility
Upgrade
Checker Utility

9. Upgrade Checker Utility

10. Avoid data corruption
Unwanted downtime extention
Safe migration with proper pre-checks
Upgrade Checker Utility - Purpose

11. Checks compatibility on server migration 5.7 to 8.0
Reserved keywords
Supported variables (config - Shell 8.0.16 & global)
Specific version check (Shell - 8.0.13)
Upgrade Checker Utility

12. targetVersion - MySQL version to check the compactibility for
upgrade
configPath - Config file path
outputFormat - TEXT (Default), JSON
Upgrade Checker Utility - Notable options

13. Upgrade Checker Utility

14. Table Export Utility

15. Faster table export
Controlled Export to avoid load
Rough estimation on completion
Table Export Utility - Purpose

16. Table export with parallel thread
Progress monitor
Compression - None (Default), gzip, zstd
Supported output format - CSV, TSV (Default)
Output to local or oracle cloud infra
Table Export Utility

17. maxRate - bytes per second per thread
compression - gzip, zstd , none(default)
dialect - Export format - csv|csv-unix|tsv
Table Export Utility - Notable options

18. Table Export Utility

19. Parallel Table Import Utility

20. Import the data with parallel thread
Controlled import
Replace the duplicate values of primary key/ unique
Mutiple files at a time from different server
Parallel Table Import Utility - Purpose

21. Loading the table with a parallel thread
Progress tracking
Can restore compressed ( > Shell - 8.0.22 )
Restore multiple file to single table ( > Shell - 8.0.23 shell version)
Option to avoid duplicate entry failure.
Parallel Table Import Utility

22. threads - No of thread for restoring
maxRate - bytes per second per thread
replaceDuplicates - Replace existing row of PK/UK (Default - yes)
skipRows - Skip the no of row from the begining of file.
Parallel Table Import Utility - Notable options

23. Parallel Table Import Utility
Syntax :

24. Parallel Table Import Utility
Duplicate entry :

25. Dump Utility

26. Dump Utility
Instance dump
Dump utility
Schema dump Table dump

27. Exporting the data with parallel thread
Dry-run before exporting
Compatability checks
Default compression
Dump utility - Purpose

28. Object names in the instance or schema must be in the latin1 or utf8 characterset.
Data consistency is guaranteed only for tables that use the InnoDB storage engine.
Group Replication, primary keys are required on every table.
Dump Utility - Notable requirement

29. dryRun - Information about what will be dumped
threads - Thread used to export data
maxRate - The maximum number of bytes per second per thread.
consistent - Lock the instance while taking backup
chunking - Split the data for each table into multiple files
compression - No , gzip , zstd (default)
Dump Utility - Notable options

30. Dump utility - Instance dump

31. Dump utility - Schema dump

32. Dump utility - Table dump

33. Dump loading utility

34. Speed the restoration by a parallel thread.
Ignore the index at the target to speed up restoration.
Need to restore the only specified schema from the full dump.
Dump loading utility - Purpose

35. Restore the dump data with parallel thread ( > Shell - 8.0.21 )
Restore only the required table or schema
Analyze table post restore
Index creation post-restoration to boost loading (Default - Full text index)
Dump loading utility

36. threads - No.of thread used to restore the data
backgroundThreads - No.of thread used to fetch data
loadIndexes - Restore index at target (Default - true)
deferTableIndexes - Index creation post restoration.
Dump loading utility - Notable options

37. Dump loading utility

38. JSON import Utility

39. Migration of Mongo DB to MySQL
Create the table structure based on JSON
JSON import Utility - Purpose

40. Import both JSON and BJSON to MySQL ( > Shell - 8.0.13 )
Import to an existing table or new table
The default column name is doc
Auto conversion of BJSON to JSON ( > Shell - 8.0.14 )
JSON import Utility

41. tableColumn - Columns need to be restored.
convertBsonTypes - Convertion is required (Default - true)
JSON import Utility - Notable options

42. JSON import Utility

43. Reach Us : Info@mydbops.com
Thank You