Tayra

6,415 views

Published on

With MongoDB, you usually use the mongodump and mongorestore utility to dump and restore a new node, and optionally you can use the --oplog option to do the point-in-time snapshotting. However, with high volume data typically running in to TBs, the dump and restore activity every-time can be quite time-consuming. Another approach is to do rsync of the db filesystem, but here subsequent backups can cause the data on disk to grow quickly.
This is where the incremental back-ups can help. One can then use any of the above approaches to initially seed the database and subsequently back-up data in an incremental fashion using a tool.

Published in: Technology, Self Improvement
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
6,415
On SlideShare
0
From Embeds
0
Number of Embeds
2,750
Actions
Shares
0
Downloads
24
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Tayra

  1. 1. An Incremental Backup and Restore Tool for Tayra
  2. 2. Smart Hoarding Capabilities
  3. 3. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore Features
  4. 4. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore • Rotating Backup Files Features
  5. 5. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore • Rotating Backup Files • Selective Backup Features
  6. 6. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore • Rotating Backup Files • Selective Backup • Selective Restore Features
  7. 7. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore • Rotating Backup Files • Selective Backup • Selective Restore • Survive Node Crash Features
  8. 8. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore Survive Master Crash
  9. 9. 27019 27018 27017 27022 27025 Target Mongo Secured Replica Set Backup Restore Survive Master Crash
  10. 10. Replay Performance Tayra
  11. 11. -2 0 2 5 7 9 1GB 2GB 4GB 8GB 16GB 32GB 0.36 0.51 1.02 2.20 4.52 8.78 Tayra Replay Performance ReplayTime(Hrs) Backup File Size Fixed Buffer Size = 8 MB
  12. 12. 0 18 35 53 70 4KB 8KB 32KB 64KB 256KB 1MB 2MB 4MB 8MB 61.12 61.30 60.57 60.67 62.28 64.08 62.25 62.78 60.83 31.40 31.57 30.80 39.02 50.35 35.32 34.53 33.42 35.72 20.73 17.50 15.28 15.72 17.45 17.15 14.82 14.60 14.67 Tayra Replay Performance using Custom Buffer Size Time(Mins) Buffer Size FileSize: 1GB Trend 1 FileSize: 2GB Trend 2 FileSize: 4GB Trend 3
  13. 13. Tayra What we used?
  14. 14. Codebase spock Tests Build fit.c2.com
  15. 15. How we Deliver? Tayra
  16. 16. Continuous Delivery
  17. 17. Continuous Delivery •Test Driven Development
  18. 18. Continuous Delivery •Test Driven Development •Acceptance Tests using FIT
  19. 19. Tayra Design Overview
  20. 20. Key Abstractions
  21. 21. Notifiers & Listeners
  22. 22. Anuja Dongoankar Bhagyashree Mandora Dhaval Dalal Sameer Soni Samridhi Gupta Swanand Pethe Vivek Dhapola The Team
  23. 23. github.com/EqualExperts/Tayra Thank-You

×