SlideShare a Scribd company logo
1 of 23
Download to read offline
DATABASEDATABASE
BACKUP AND RECOVERYBACKUP AND RECOVERY
By - Soumya Dash
Session Overview
When do we need backups?
What needs to be backed up?
When should backups be performed?
Where will the backups be stored?
How can backups be performed?
Restoring from backups
Backup strategy
Backup – Why do it?
● In business today,'You are your data'
● Lose data,lose business
● Lost productivity, customer relationships,etc
Types of Backup
● Logical backup
● Physical backup
● Local backup
● Remote backup
● Full backup
● Incremental backup
When do we need backup?
● Hardware Failures
– A system crash may cause some of the data in the database to be lost.
– Hardware failure leads to data loss.
● User/Application Failure
– Accidental DROP or DELETE statements
– Editing table files with text editors,usually leading to
corrupt tables.
What needs to be backed up?
● Database content
– For full backups
– Logical or physical backup
● Log files
– For incremental backups
– Point in time recovery
● Configuration information
– /etc/my.cnf
– Cron jobs
When should backups be performed?
● On a regular basis
● Not during high usage peaks(off hours)
● Static data can be backed up less frequently
● Schedule it at particular time intervals
Where to store backup?
● On the database server
On a separate file system/volume or hard disk drive
● Copied to another server
On or off site
Cloud storage
● Backed up to tape/disk
● Choose multiple locations
Database Backup Methods
● Backup programs
Mysqldump
Mysqlhotcopy
● Copying table files (*.frm, *.MYD, and *.MYI files)
● Delimited-Text files
● Incremental Backups using Binary Log
● Backups using Replication Slaves
Using mysqldump for backups
Mysqldump is a backup program originally written by Igor Romanenko.
Used to dump a database or a collection of databases for backup or transfer to
another server(not necessarily MySQL).
Mysqldump writes SQL statements to the standard output.
This output consists of CREATE statements to create dumped objects (databases,
tables, stored routines etc) and INSERT statements to load data into tables.
The output can be saved in a file and reloaded later using mysql to recreate the
dumped objects.
Options are available to modify the format of the SQL statements, and to control
which objects are dumped.
Generates files in CSV, other delimited text, or XML format also.
Backup using mysqldump
Set of one or more tables
$ mysqldump -u [uname] -p[pass] db_name table1 > table_backup.sql
$ mysqldump -u [uname] -p[pass] db_name table1 table2 > table_backup.sql
Set of one or more complete databases
$ mysqldump -u [uname] -p[pass] db_name1 db_name2 > db_backup.sql
All databases
$ mysqldump -u [uname] -p[pass] –all-databases > all_db_backup.sql
An entire MySQL
$ mysqldump -u [uname] -p[pass] db_name > db_backup.sql
Copying data from one server to another
$ mysqldump --opt db_name |mysql –host = remote_host -C db_name
Auto-compressing the output using gzip
$ mysqldump -u [uname] -p[pass] db_name | gzip > db_backup.sql.gz
Remote Backup
$ mysqldump -P 3306 -h [ip_address] -u [uname] -p[pass] db_name > db_backup.sql
Restore backup from mysqldump
● Create a database on the target machine
● Load the file using the mysql command:
$ mysql -u [uname] -p[pass] [db_to_restore] < [backupfile.sql]
● To restore to an existing database
$ mysqlimport -u [uname] -p[pass] [dbname] < [backupfile.sql]
Making delimited text file backups
● This method saves only table data, not the table structure.
● Writes the selected rows to a file on the server host
Syntax
SELECT * INTO OUTFILE 'file_name' FROM tbl_name
● Example of file in the comma-separated values (CSV) format
SELECT a,b,a+b INTO OUTFILE '/tmp/result.txt' FIELDS TERMINATED BY ','
OPTIONALLY ENCLOSED BY '"' LINES TERMINATED BY 'n' FROM table;
Making Incremental Backups by Enabling the Binary Log
● By default, the server creates binary log files in the data directory.
● The binary log files provide you with the information you need to replicate changes to
the database that are made subsequent to the point at which you performed a
backup.
● To see a listing of all binary log files
mysql> SHOW BINARY LOGS;
● An incremental backup only backs up data that changed since the previous backup.
● Start the server with the --log-bin option to enable binary logging.
● mysqlbinlog utility converts the events in the binary log files from binary format to text
so that they can be executed or viewed. mysqlbinlog has options for selecting
sections of the binary log based on event times or position of events within the log.
● Copy to the backup location,all binary logs from the moment the last backup was
taken to the last but one.
Enable binary logging
Configure mysql to do binary logging.
Edit : /etc/mysql/my.cnf:
Add : log-bin = mybinlog
Specify which databases to do binary logging for, or which databases NOT to do binary
logging for.
1) “binlog_do_db” turns binary logging on for a given database.
binlog_do_db = mydb
2) “binlog_ignore_db” turns binary logging on for all databases except the database(s)
names.
binlog_ignore_db = mydb
Restart mysql server.
Restore from binary logs
● Go to the folder where mysqlbinlog utility is placed and convert binary log file into
sql
C:xamppmysqlbin>mysqlbinlog C:xamppmysqldatabinlogbin-log.000001 >
sql.txt
● Directly execute sql on the database
C:xamppmysqlbin>mysqlbinlog C:xamppmysqldatabinlogbin-log.000001 |
mysql -u root -p
● Specify specific duration to extract sql
C:xamppmysqlbin>mysqlbinlog --start-datetime="2014-06-01 10:31:44"
C:xamppmysqldatabinlogbin-log.000001 > sql.txt
This will extract sql after the date of 2014-06-01 10:31:44.
Point In Time Recovery using binary logs
1) Point-in-Time Recovery Using Event Times
C:xamppmysqlbin>mysqlbinlog --start-datetime="2014-05-27 10:01:00"
C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p
C:xamppmysqlbin>mysqlbinlog --stop-datetime="2014-05-27 9:59:59"
C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p
2) Point-in-Time Recovery Using Event Position
C:xamppmysqlbin>mysqlbinlog --stop-position=368312
C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p
C:xamppmysqlbin>mysqlbinlog --start-position=368315
C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p
Making Backups Using Replication Slaves
● Used when there are performance problems with your master server while making
backups.
● Set up replication and perform backups on the slave rather than on the master.
● Put the master server db in a read-only state by executing these statements:
mysql> FLUSH TABLES WITH READ LOCK;
mysql> SET GLOBAL read_only = ON;
● While Master is read only, perform the backup using mysqldump.
● Restore Master to its normal operational state by executing these statements:
mysql> SET GLOBAL read_only = OFF;
mysql> UNLOCK TABLES;
Recovering from Backups
● Restoring tables to the state before a crash requires both the backup files and the
binary log.
Backup files restore the table to the state they were at the time of
backup.
The synchronised binary logs are used to extract queries issued between
the backup and now.
● If recovering data lost due to unwise queries,dont issue them again.
DB Recovery = Last full backup & binlogs
Recovering from Corrupt tables
● Bring the database in recovery mode
Shut down incase it's still running
Add innodb_force_recovery=1 to my.cnf
Change the port from 3306 to some random value.
● Check for the corrupt tables using mysqlcheck –all-databases
● Backup and drop corrupted tables using mysqldump
● Restart mysql in normal mode without changing the port
● Import the backup file
● Change port
Backup Strategy
Perform backups regularly and frequently
Performing Backups Before and After You Make Structural Changes
Turn on the binary update log
Synchronise update logs with the backup files
Store the backups on a different file system than where your databases are
Make periodic full backups, using the mysqldump command
Make periodic incremental backups by flushing the logs
Scheduling backups
Choose the right storage platform for backups
References
● http://dev.mysql.com/doc/refman/5.6/en
● http://www.techflirt.com/
● http://planet.mysql.com/
THANK YOU

More Related Content

What's hot

Percona Xtrabackup - Highly Efficient Backups
Percona Xtrabackup - Highly Efficient BackupsPercona Xtrabackup - Highly Efficient Backups
Percona Xtrabackup - Highly Efficient BackupsMydbops
 
Getting started with postgresql
Getting started with postgresqlGetting started with postgresql
Getting started with postgresqlbotsplash.com
 
Users and groups in Linux
Users and groups in LinuxUsers and groups in Linux
Users and groups in LinuxKnoldus Inc.
 
Introduction to Shell script
Introduction to Shell scriptIntroduction to Shell script
Introduction to Shell scriptBhavesh Padharia
 
MongoDB Performance Tuning
MongoDB Performance TuningMongoDB Performance Tuning
MongoDB Performance TuningMongoDB
 
DNUG HCL Domino 11 First Look
DNUG HCL Domino 11 First LookDNUG HCL Domino 11 First Look
DNUG HCL Domino 11 First Lookdaniel_nashed
 
Backup & recovery with rman
Backup & recovery with rmanBackup & recovery with rman
Backup & recovery with rmanitsabidhussain
 
2.6 backup and recovery
2.6 backup and recovery2.6 backup and recovery
2.6 backup and recoverymrmwood
 
Postgresql database administration volume 1
Postgresql database administration volume 1Postgresql database administration volume 1
Postgresql database administration volume 1Federico Campoli
 
Less06 networking
Less06 networkingLess06 networking
Less06 networkingAmit Bhalla
 
Linux standard file system
Linux standard file systemLinux standard file system
Linux standard file systemTaaanu01
 
Oracle ACFS High Availability NFS Services (HANFS)
Oracle ACFS High Availability NFS Services (HANFS)Oracle ACFS High Availability NFS Services (HANFS)
Oracle ACFS High Availability NFS Services (HANFS)Anju Garg
 
Introduction to Oracle Database
Introduction to Oracle DatabaseIntroduction to Oracle Database
Introduction to Oracle Databasepuja_dhar
 
PostgreSQL Deep Internal
PostgreSQL Deep InternalPostgreSQL Deep Internal
PostgreSQL Deep InternalEXEM
 

What's hot (20)

Percona Xtrabackup - Highly Efficient Backups
Percona Xtrabackup - Highly Efficient BackupsPercona Xtrabackup - Highly Efficient Backups
Percona Xtrabackup - Highly Efficient Backups
 
Getting started with postgresql
Getting started with postgresqlGetting started with postgresql
Getting started with postgresql
 
MS-SQL SERVER ARCHITECTURE
MS-SQL SERVER ARCHITECTUREMS-SQL SERVER ARCHITECTURE
MS-SQL SERVER ARCHITECTURE
 
Users and groups in Linux
Users and groups in LinuxUsers and groups in Linux
Users and groups in Linux
 
Introduction to Shell script
Introduction to Shell scriptIntroduction to Shell script
Introduction to Shell script
 
MongoDB Performance Tuning
MongoDB Performance TuningMongoDB Performance Tuning
MongoDB Performance Tuning
 
DNUG HCL Domino 11 First Look
DNUG HCL Domino 11 First LookDNUG HCL Domino 11 First Look
DNUG HCL Domino 11 First Look
 
Backup & recovery with rman
Backup & recovery with rmanBackup & recovery with rman
Backup & recovery with rman
 
2.6 backup and recovery
2.6 backup and recovery2.6 backup and recovery
2.6 backup and recovery
 
PostgreSQL replication
PostgreSQL replicationPostgreSQL replication
PostgreSQL replication
 
Linux File System
Linux File SystemLinux File System
Linux File System
 
Postgresql database administration volume 1
Postgresql database administration volume 1Postgresql database administration volume 1
Postgresql database administration volume 1
 
Ibm db2
Ibm db2Ibm db2
Ibm db2
 
Less06 networking
Less06 networkingLess06 networking
Less06 networking
 
Linux standard file system
Linux standard file systemLinux standard file system
Linux standard file system
 
Partitioning
PartitioningPartitioning
Partitioning
 
Cassandra Database
Cassandra DatabaseCassandra Database
Cassandra Database
 
Oracle ACFS High Availability NFS Services (HANFS)
Oracle ACFS High Availability NFS Services (HANFS)Oracle ACFS High Availability NFS Services (HANFS)
Oracle ACFS High Availability NFS Services (HANFS)
 
Introduction to Oracle Database
Introduction to Oracle DatabaseIntroduction to Oracle Database
Introduction to Oracle Database
 
PostgreSQL Deep Internal
PostgreSQL Deep InternalPostgreSQL Deep Internal
PostgreSQL Deep Internal
 

Viewers also liked

MySQL Server Backup, Restoration, And Disaster Recovery Planning Presentation
MySQL Server Backup, Restoration, And Disaster Recovery Planning PresentationMySQL Server Backup, Restoration, And Disaster Recovery Planning Presentation
MySQL Server Backup, Restoration, And Disaster Recovery Planning PresentationColin Charles
 
MySQL Enterprise Backup & Oracle Secure Backup
MySQL Enterprise Backup &  Oracle Secure BackupMySQL Enterprise Backup &  Oracle Secure Backup
MySQL Enterprise Backup & Oracle Secure BackupSanjay Manwani
 
MySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsMySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsRonald Bradford
 
Backing Up the MySQL Database
Backing Up the MySQL DatabaseBacking Up the MySQL Database
Backing Up the MySQL DatabaseSanjay Manwani
 
Pdb my sql backup london percona live 2012
Pdb my sql backup   london percona live 2012Pdb my sql backup   london percona live 2012
Pdb my sql backup london percona live 2012Pythian
 
Riding the Binlog: an in Deep Dissection of the Replication Stream
Riding the Binlog: an in Deep Dissection of the Replication StreamRiding the Binlog: an in Deep Dissection of the Replication Stream
Riding the Binlog: an in Deep Dissection of the Replication StreamJean-François Gagné
 
MySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery PlanningMySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery PlanningLenz Grimmer
 
Become a MySQL DBA - slides: Deciding on a relevant backup solution
Become a MySQL DBA - slides: Deciding on a relevant backup solutionBecome a MySQL DBA - slides: Deciding on a relevant backup solution
Become a MySQL DBA - slides: Deciding on a relevant backup solutionSeveralnines
 
Rafeeq Rehman - Breaking the Phishing Attack Chain
Rafeeq Rehman - Breaking the Phishing Attack ChainRafeeq Rehman - Breaking the Phishing Attack Chain
Rafeeq Rehman - Breaking the Phishing Attack Chaincentralohioissa
 
Learn PHP MySQL with Project
Learn PHP MySQL with ProjectLearn PHP MySQL with Project
Learn PHP MySQL with Projectayman diab
 
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRA
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRACYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRA
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRAKrishnakant Mishra
 
Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Ontico
 
CFMA Cyber Crime Presentation
CFMA Cyber Crime PresentationCFMA Cyber Crime Presentation
CFMA Cyber Crime PresentationSteve Machesney
 

Viewers also liked (20)

MySQL Server Backup, Restoration, And Disaster Recovery Planning Presentation
MySQL Server Backup, Restoration, And Disaster Recovery Planning PresentationMySQL Server Backup, Restoration, And Disaster Recovery Planning Presentation
MySQL Server Backup, Restoration, And Disaster Recovery Planning Presentation
 
MySQL Enterprise Backup & Oracle Secure Backup
MySQL Enterprise Backup &  Oracle Secure BackupMySQL Enterprise Backup &  Oracle Secure Backup
MySQL Enterprise Backup & Oracle Secure Backup
 
MySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsMySQL Backup and Recovery Essentials
MySQL Backup and Recovery Essentials
 
Backing Up the MySQL Database
Backing Up the MySQL DatabaseBacking Up the MySQL Database
Backing Up the MySQL Database
 
Pdb my sql backup london percona live 2012
Pdb my sql backup   london percona live 2012Pdb my sql backup   london percona live 2012
Pdb my sql backup london percona live 2012
 
Riding the Binlog: an in Deep Dissection of the Replication Stream
Riding the Binlog: an in Deep Dissection of the Replication StreamRiding the Binlog: an in Deep Dissection of the Replication Stream
Riding the Binlog: an in Deep Dissection of the Replication Stream
 
MySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery PlanningMySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery Planning
 
Become a MySQL DBA - slides: Deciding on a relevant backup solution
Become a MySQL DBA - slides: Deciding on a relevant backup solutionBecome a MySQL DBA - slides: Deciding on a relevant backup solution
Become a MySQL DBA - slides: Deciding on a relevant backup solution
 
10135 b 08
10135 b 0810135 b 08
10135 b 08
 
Rafeeq Rehman - Breaking the Phishing Attack Chain
Rafeeq Rehman - Breaking the Phishing Attack ChainRafeeq Rehman - Breaking the Phishing Attack Chain
Rafeeq Rehman - Breaking the Phishing Attack Chain
 
Mysql
MysqlMysql
Mysql
 
Learn PHP MySQL with Project
Learn PHP MySQL with ProjectLearn PHP MySQL with Project
Learn PHP MySQL with Project
 
Apache
ApacheApache
Apache
 
MySQL database
MySQL databaseMySQL database
MySQL database
 
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRA
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRACYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRA
CYBER CRIME PRESENTATION PART 2 BY KRISHNAKNT ARUNKUMAR MISHRA
 
Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)Maria db the new mysql (Colin Charles)
Maria db the new mysql (Colin Charles)
 
CFMA Cyber Crime Presentation
CFMA Cyber Crime PresentationCFMA Cyber Crime Presentation
CFMA Cyber Crime Presentation
 
Automated master failover
Automated master failoverAutomated master failover
Automated master failover
 
FBI Cybercrime Presentation
FBI Cybercrime PresentationFBI Cybercrime Presentation
FBI Cybercrime Presentation
 
Xampp Ppt
Xampp PptXampp Ppt
Xampp Ppt
 

Similar to MySQL Backup & Recovery

MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAsMark Leith
 
7. backup & restore data
7. backup & restore data7. backup & restore data
7. backup & restore dataTrần Thanh
 
[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery[Altibase] 13 backup and recovery
[Altibase] 13 backup and recoveryaltistory
 
Data Guard New Features
Data Guard New FeaturesData Guard New Features
Data Guard New Featuresxiangrong
 
MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)Mydbops
 
All types of backups and restore
All types of backups and restoreAll types of backups and restore
All types of backups and restoreVasudeva Rao
 
Les 06 Perform Rec
Les 06 Perform RecLes 06 Perform Rec
Les 06 Perform Recvivaankumar
 
Les 05 Create Bu
Les 05 Create BuLes 05 Create Bu
Les 05 Create Buvivaankumar
 
Upgrade to MySQL 5.6 without downtime
Upgrade to MySQL 5.6 without downtimeUpgrade to MySQL 5.6 without downtime
Upgrade to MySQL 5.6 without downtimeOlivier DASINI
 
Loadays MySQL
Loadays MySQLLoadays MySQL
Loadays MySQLlefredbe
 
Restore MySQL database from mysqlbackup
Restore MySQL database from mysqlbackup Restore MySQL database from mysqlbackup
Restore MySQL database from mysqlbackup AllDatabaseSolutions
 
Highly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupHighly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupNilnandan Joshi
 
Oracle 12c New Features_RMAN_slides
Oracle 12c New Features_RMAN_slidesOracle 12c New Features_RMAN_slides
Oracle 12c New Features_RMAN_slidesSaiful
 
Training Slides: 203 - Backup & Recovery
Training Slides: 203 - Backup & RecoveryTraining Slides: 203 - Backup & Recovery
Training Slides: 203 - Backup & RecoveryContinuent
 
24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes
24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes
24 HOP edición Español - Sql server 2014 backup encryption - Percy ReyesSpanishPASSVC
 
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...Zarafa
 

Similar to MySQL Backup & Recovery (20)

MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs
 
7. backup & restore data
7. backup & restore data7. backup & restore data
7. backup & restore data
 
[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery[Altibase] 13 backup and recovery
[Altibase] 13 backup and recovery
 
Les 07 rman_rec
Les 07 rman_recLes 07 rman_rec
Les 07 rman_rec
 
Data Guard New Features
Data Guard New FeaturesData Guard New Features
Data Guard New Features
 
Mydumper
MydumperMydumper
Mydumper
 
MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)
 
All types of backups and restore
All types of backups and restoreAll types of backups and restore
All types of backups and restore
 
Xpp c user_rec
Xpp c user_recXpp c user_rec
Xpp c user_rec
 
Les 06 Perform Rec
Les 06 Perform RecLes 06 Perform Rec
Les 06 Perform Rec
 
Les 05 Create Bu
Les 05 Create BuLes 05 Create Bu
Les 05 Create Bu
 
Upgrade to MySQL 5.6 without downtime
Upgrade to MySQL 5.6 without downtimeUpgrade to MySQL 5.6 without downtime
Upgrade to MySQL 5.6 without downtime
 
Loadays MySQL
Loadays MySQLLoadays MySQL
Loadays MySQL
 
Restore MySQL database from mysqlbackup
Restore MySQL database from mysqlbackup Restore MySQL database from mysqlbackup
Restore MySQL database from mysqlbackup
 
Highly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackupHighly efficient backups with percona xtrabackup
Highly efficient backups with percona xtrabackup
 
Oracle 12c New Features_RMAN_slides
Oracle 12c New Features_RMAN_slidesOracle 12c New Features_RMAN_slides
Oracle 12c New Features_RMAN_slides
 
Training Slides: 203 - Backup & Recovery
Training Slides: 203 - Backup & RecoveryTraining Slides: 203 - Backup & Recovery
Training Slides: 203 - Backup & Recovery
 
24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes
24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes
24 HOP edición Español - Sql server 2014 backup encryption - Percy Reyes
 
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...
Zararfa SummerCamp 2012 - Performing fast backups in large scale environments...
 
Les 05 create_bu
Les 05 create_buLes 05 create_bu
Les 05 create_bu
 

More from Mindfire Solutions (20)

Physician Search and Review
Physician Search and ReviewPhysician Search and Review
Physician Search and Review
 
diet management app
diet management appdiet management app
diet management app
 
Business Technology Solution
Business Technology SolutionBusiness Technology Solution
Business Technology Solution
 
Remote Health Monitoring
Remote Health MonitoringRemote Health Monitoring
Remote Health Monitoring
 
Influencer Marketing Solution
Influencer Marketing SolutionInfluencer Marketing Solution
Influencer Marketing Solution
 
ELMAH
ELMAHELMAH
ELMAH
 
High Availability of Azure Applications
High Availability of Azure ApplicationsHigh Availability of Azure Applications
High Availability of Azure Applications
 
IOT Hands On
IOT Hands OnIOT Hands On
IOT Hands On
 
Glimpse of Loops Vs Set
Glimpse of Loops Vs SetGlimpse of Loops Vs Set
Glimpse of Loops Vs Set
 
Oracle Sql Developer-Getting Started
Oracle Sql Developer-Getting StartedOracle Sql Developer-Getting Started
Oracle Sql Developer-Getting Started
 
Adaptive Layout In iOS 8
Adaptive Layout In iOS 8Adaptive Layout In iOS 8
Adaptive Layout In iOS 8
 
Introduction to Auto-layout : iOS/Mac
Introduction to Auto-layout : iOS/MacIntroduction to Auto-layout : iOS/Mac
Introduction to Auto-layout : iOS/Mac
 
LINQPad - utility Tool
LINQPad - utility ToolLINQPad - utility Tool
LINQPad - utility Tool
 
Get started with watch kit development
Get started with watch kit developmentGet started with watch kit development
Get started with watch kit development
 
Swift vs Objective-C
Swift vs Objective-CSwift vs Objective-C
Swift vs Objective-C
 
Material Design in Android
Material Design in AndroidMaterial Design in Android
Material Design in Android
 
Introduction to OData
Introduction to ODataIntroduction to OData
Introduction to OData
 
Ext js Part 2- MVC
Ext js Part 2- MVCExt js Part 2- MVC
Ext js Part 2- MVC
 
ExtJs Basic Part-1
ExtJs Basic Part-1ExtJs Basic Part-1
ExtJs Basic Part-1
 
Spring Security Introduction
Spring Security IntroductionSpring Security Introduction
Spring Security Introduction
 

Recently uploaded

Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024SimonedeGijt
 
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...OnePlan Solutions
 
BusinessGPT - Security and Governance for Generative AI
BusinessGPT  - Security and Governance for Generative AIBusinessGPT  - Security and Governance for Generative AI
BusinessGPT - Security and Governance for Generative AIAGATSoftware
 
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaNeo4j
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Chirag Panchal
 
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024MulesoftMunichMeetup
 
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypseTomasz Kowalczewski
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfkalichargn70th171
 
Lessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdfLessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdfSrushith Repakula
 
Effective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeConEffective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeConNatan Silnitsky
 
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-CloudAlluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-CloudAlluxio, Inc.
 
What is a Recruitment Management Software?
What is a Recruitment Management Software?What is a Recruitment Management Software?
What is a Recruitment Management Software?NYGGS Automation Suite
 
Jax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined DeckJax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined DeckMarc Lester
 
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbankkasambamuno
 
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...Abortion Clinic
 
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...Lisi Hocke
 

Recently uploaded (20)

Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
 
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
 
BusinessGPT - Security and Governance for Generative AI
BusinessGPT  - Security and Governance for Generative AIBusinessGPT  - Security and Governance for Generative AI
BusinessGPT - Security and Governance for Generative AI
 
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024
 
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
 
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
Anypoint Code Builder - Munich MuleSoft Meetup - 16th May 2024
 
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse
[GeeCON2024] How I learned to stop worrying and love the dark silicon apocalypse
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 
Lessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdfLessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdf
 
Effective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeConEffective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeCon
 
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-CloudAlluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud
 
What is a Recruitment Management Software?
What is a Recruitment Management Software?What is a Recruitment Management Software?
What is a Recruitment Management Software?
 
Abortion Clinic In Polokwane ](+27832195400*)[ 🏥 Safe Abortion Pills in Polok...
Abortion Clinic In Polokwane ](+27832195400*)[ 🏥 Safe Abortion Pills in Polok...Abortion Clinic In Polokwane ](+27832195400*)[ 🏥 Safe Abortion Pills in Polok...
Abortion Clinic In Polokwane ](+27832195400*)[ 🏥 Safe Abortion Pills in Polok...
 
Jax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined DeckJax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined Deck
 
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
 
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank
^Clinic ^%[+27788225528*Abortion Pills For Sale In witbank
 
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
 
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
 
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
 

MySQL Backup & Recovery

  • 1. DATABASEDATABASE BACKUP AND RECOVERYBACKUP AND RECOVERY By - Soumya Dash
  • 2. Session Overview When do we need backups? What needs to be backed up? When should backups be performed? Where will the backups be stored? How can backups be performed? Restoring from backups Backup strategy
  • 3. Backup – Why do it? ● In business today,'You are your data' ● Lose data,lose business ● Lost productivity, customer relationships,etc
  • 4. Types of Backup ● Logical backup ● Physical backup ● Local backup ● Remote backup ● Full backup ● Incremental backup
  • 5. When do we need backup? ● Hardware Failures – A system crash may cause some of the data in the database to be lost. – Hardware failure leads to data loss. ● User/Application Failure – Accidental DROP or DELETE statements – Editing table files with text editors,usually leading to corrupt tables.
  • 6. What needs to be backed up? ● Database content – For full backups – Logical or physical backup ● Log files – For incremental backups – Point in time recovery ● Configuration information – /etc/my.cnf – Cron jobs
  • 7. When should backups be performed? ● On a regular basis ● Not during high usage peaks(off hours) ● Static data can be backed up less frequently ● Schedule it at particular time intervals
  • 8. Where to store backup? ● On the database server On a separate file system/volume or hard disk drive ● Copied to another server On or off site Cloud storage ● Backed up to tape/disk ● Choose multiple locations
  • 9. Database Backup Methods ● Backup programs Mysqldump Mysqlhotcopy ● Copying table files (*.frm, *.MYD, and *.MYI files) ● Delimited-Text files ● Incremental Backups using Binary Log ● Backups using Replication Slaves
  • 10. Using mysqldump for backups Mysqldump is a backup program originally written by Igor Romanenko. Used to dump a database or a collection of databases for backup or transfer to another server(not necessarily MySQL). Mysqldump writes SQL statements to the standard output. This output consists of CREATE statements to create dumped objects (databases, tables, stored routines etc) and INSERT statements to load data into tables. The output can be saved in a file and reloaded later using mysql to recreate the dumped objects. Options are available to modify the format of the SQL statements, and to control which objects are dumped. Generates files in CSV, other delimited text, or XML format also.
  • 11. Backup using mysqldump Set of one or more tables $ mysqldump -u [uname] -p[pass] db_name table1 > table_backup.sql $ mysqldump -u [uname] -p[pass] db_name table1 table2 > table_backup.sql Set of one or more complete databases $ mysqldump -u [uname] -p[pass] db_name1 db_name2 > db_backup.sql All databases $ mysqldump -u [uname] -p[pass] –all-databases > all_db_backup.sql An entire MySQL $ mysqldump -u [uname] -p[pass] db_name > db_backup.sql Copying data from one server to another $ mysqldump --opt db_name |mysql –host = remote_host -C db_name Auto-compressing the output using gzip $ mysqldump -u [uname] -p[pass] db_name | gzip > db_backup.sql.gz Remote Backup $ mysqldump -P 3306 -h [ip_address] -u [uname] -p[pass] db_name > db_backup.sql
  • 12. Restore backup from mysqldump ● Create a database on the target machine ● Load the file using the mysql command: $ mysql -u [uname] -p[pass] [db_to_restore] < [backupfile.sql] ● To restore to an existing database $ mysqlimport -u [uname] -p[pass] [dbname] < [backupfile.sql]
  • 13. Making delimited text file backups ● This method saves only table data, not the table structure. ● Writes the selected rows to a file on the server host Syntax SELECT * INTO OUTFILE 'file_name' FROM tbl_name ● Example of file in the comma-separated values (CSV) format SELECT a,b,a+b INTO OUTFILE '/tmp/result.txt' FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY '"' LINES TERMINATED BY 'n' FROM table;
  • 14. Making Incremental Backups by Enabling the Binary Log ● By default, the server creates binary log files in the data directory. ● The binary log files provide you with the information you need to replicate changes to the database that are made subsequent to the point at which you performed a backup. ● To see a listing of all binary log files mysql> SHOW BINARY LOGS; ● An incremental backup only backs up data that changed since the previous backup. ● Start the server with the --log-bin option to enable binary logging. ● mysqlbinlog utility converts the events in the binary log files from binary format to text so that they can be executed or viewed. mysqlbinlog has options for selecting sections of the binary log based on event times or position of events within the log. ● Copy to the backup location,all binary logs from the moment the last backup was taken to the last but one.
  • 15. Enable binary logging Configure mysql to do binary logging. Edit : /etc/mysql/my.cnf: Add : log-bin = mybinlog Specify which databases to do binary logging for, or which databases NOT to do binary logging for. 1) “binlog_do_db” turns binary logging on for a given database. binlog_do_db = mydb 2) “binlog_ignore_db” turns binary logging on for all databases except the database(s) names. binlog_ignore_db = mydb Restart mysql server.
  • 16. Restore from binary logs ● Go to the folder where mysqlbinlog utility is placed and convert binary log file into sql C:xamppmysqlbin>mysqlbinlog C:xamppmysqldatabinlogbin-log.000001 > sql.txt ● Directly execute sql on the database C:xamppmysqlbin>mysqlbinlog C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p ● Specify specific duration to extract sql C:xamppmysqlbin>mysqlbinlog --start-datetime="2014-06-01 10:31:44" C:xamppmysqldatabinlogbin-log.000001 > sql.txt This will extract sql after the date of 2014-06-01 10:31:44.
  • 17. Point In Time Recovery using binary logs 1) Point-in-Time Recovery Using Event Times C:xamppmysqlbin>mysqlbinlog --start-datetime="2014-05-27 10:01:00" C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p C:xamppmysqlbin>mysqlbinlog --stop-datetime="2014-05-27 9:59:59" C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p 2) Point-in-Time Recovery Using Event Position C:xamppmysqlbin>mysqlbinlog --stop-position=368312 C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p C:xamppmysqlbin>mysqlbinlog --start-position=368315 C:xamppmysqldatabinlogbin-log.000001 | mysql -u root -p
  • 18. Making Backups Using Replication Slaves ● Used when there are performance problems with your master server while making backups. ● Set up replication and perform backups on the slave rather than on the master. ● Put the master server db in a read-only state by executing these statements: mysql> FLUSH TABLES WITH READ LOCK; mysql> SET GLOBAL read_only = ON; ● While Master is read only, perform the backup using mysqldump. ● Restore Master to its normal operational state by executing these statements: mysql> SET GLOBAL read_only = OFF; mysql> UNLOCK TABLES;
  • 19. Recovering from Backups ● Restoring tables to the state before a crash requires both the backup files and the binary log. Backup files restore the table to the state they were at the time of backup. The synchronised binary logs are used to extract queries issued between the backup and now. ● If recovering data lost due to unwise queries,dont issue them again. DB Recovery = Last full backup & binlogs
  • 20. Recovering from Corrupt tables ● Bring the database in recovery mode Shut down incase it's still running Add innodb_force_recovery=1 to my.cnf Change the port from 3306 to some random value. ● Check for the corrupt tables using mysqlcheck –all-databases ● Backup and drop corrupted tables using mysqldump ● Restart mysql in normal mode without changing the port ● Import the backup file ● Change port
  • 21. Backup Strategy Perform backups regularly and frequently Performing Backups Before and After You Make Structural Changes Turn on the binary update log Synchronise update logs with the backup files Store the backups on a different file system than where your databases are Make periodic full backups, using the mysqldump command Make periodic incremental backups by flushing the logs Scheduling backups Choose the right storage platform for backups