Linux Backup System using rsync, tar, gzip

8,855 views

Published on

Presentation from my first project in the unclass at BYU. Link to writeup -- https://island.byu.edu/wiki/final-report-linux-backup-system-using-rsync-and-tar-and-amazon-s3

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
8,855
On SlideShare
0
From Embeds
0
Number of Embeds
117
Actions
Shares
0
Downloads
253
Comments
0
Likes
7
Embeds 0
No embeds

No notes for slide

Linux Backup System using rsync, tar, gzip

  1. 1. Linux backup system <ul><li>Backup files from Linux laptop to Linux server </li></ul><ul><li>All automated (ie I don't think about it) </li></ul><ul><li>Use simple standard Linux command-line tools </li></ul>
  2. 2. Motivation
  3. 3. My situation <ul><li>Laptop that goes everywhere – my primary workstation </li></ul><ul><li>Server, sits in my apartment. Doesn't do much other then hold files + serve as test bed for the occassional wacky experiment </li></ul><ul><li>Wireless network </li></ul>
  4. 4. What I did <ul><li>Cron job on laptop which runs rsync script to mirror changes nightly at 10:10pm </li></ul><ul><li>Monthly which takes a snapshot of subset of files and pushes these to Amazon S3 </li></ul><ul><li>[Still in the future] Nightly rsync from server to Amazon S3 </li></ul>
  5. 5. S3FOX
  6. 6. Rsync <ul><li>Is awesome! </li></ul><ul><li>” is an open source utility that provides fast incremental file transfer” - samba.anu.edu.au/rsync/ </li></ul><ul><li>Used for mirroring + backup purpose </li></ul>
  7. 7. Cron <ul><li>” Program that enables unix users to execute commands or scripts automatically at a specified time/date.” - Wikipedia </li></ul><ul><li>Used extensively by all *nix systems and aspiring amateur Linux sysadmins </li></ul>
  8. 8. Tar + gzip <ul><li>Tar turns many files into one file – no built-in compression </li></ul><ul><li>Commonly used with gzip or bzip2 (making, respectively *.tar.gz and *.tar.bz2 files </li></ul>
  9. 9. Unix Philosophy <ul><li>Do one thing and do it well </li></ul><ul><li>Rsync, tar, gzip, cron all do one task well </li></ul>
  10. 10. Small pieces loosly joined <ul><li>Tools reusable </li></ul><ul><li>Designed to interoperate </li></ul><ul><li>Can be used together in scripts in 1000s of different ways </li></ul>
  11. 11. Easier to learn <ul><li>Use these different tools all the time </li></ul><ul><li>Rsync to mirror changes from laptop to production (or devel) server </li></ul><ul><li>Tar to uncompress files from internet </li></ul><ul><li>Makes it easier to start a new scripting project </li></ul>
  12. 12. K.I.S.S <ul><li>Keep It Simple Stupid </li></ul><ul><li>Simple tools make for simple systems that are easy to build, understand, and maintain </li></ul>
  13. 13. Odes to Simplicity <ul><li>” Everything should be made as simple as possible, but no simpler.” – Albert Einstein </li></ul><ul><li>&quot;Simplicity is the ultimate sophistication&quot; – Leonardo Da Vinci </li></ul><ul><li>&quot;It seems that perfection is reached not when there is nothing left to add, but when there is nothing left to take away&quot; – Antoine de Saint Exupéry </li></ul>
  14. 14. Backups = peace of mind

×