Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments

442 views
326 views

Published on

Slides for my presentation during the Open Source Conference in Amsterdam - 6th of December 2013, around 800 participants.
Agility, flexibility and data growth are key challenges in todays IT world.Virtualization, Internet and Cloud are buzz words which seems to help the IT department to fullfil the requirements.

More flexibility often means also more complexity.What does it mean for modern backup strategies? Is backup still necessary? What to do with growing amount of data?
How to secure the flexible, growing number of servers, databases and application?

SEP sesam and Red Hat Storage are the base for a smart backup architecture based on Linux and Open Source solutions.

This session will provide you an approach how backup and recovery plannings may be handled to secure modern server environments

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
442
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Smart Backup Architectures for Big Data in Complex, Open Source Based IT Environments

  1. 1. Smart Backup Architectures for • Textmasterformate Big Data in complex, durch Klicken Open Source based IT Environments bearbeiten Zweite Ebene Dritte Ebene Vierte Ebene Fünfte Ebene Hubert Schweinesbein hs@sep.de
  2. 2. Hot IT Topics Forrester Research Inc. The Top 10 Strategic Technology Trends • • • • • • Mobile device battles Mobile applications and HTML5 The personal cloud The Internet of Things Hybrid IT and cloud computing Strategic big data Session title IT Projects 2013 Virtualization Master Data Management Enterprise Security Integration of Standard and Individual Software • Data Quality Management • • • • Cap Gemini
  3. 3. Big Data Cloud Computing Cost driven by OSS Session title
  4. 4. SEP sesam B A CKU P RESTORE RECOVERY Competencies
  5. 5. Big Data Session title
  6. 6. SEP & Big Data SMART Architecture Multiple Stream Multilocation Backup Deduplication Session title
  7. 7. Cloud Computing Session title
  8. 8. SEP & Cloud It's about Agility - Flexibility Hybrid Backup Widest DB & OS support Dedup & Replication Session title
  9. 9. Cost Session title
  10. 10. SEP & Costs Unlimited Usage Reduce your invest COO instead COG One subscribtion – use alle SEP backup modules Session title
  11. 11. The Real World • Founded 1998 - Spin-off from the Institute of Clinical Chemistry at the University Hospital Grosshadern of the LudwigMaximilians University • Specialized in genetic and immunological diagnostics • Health Care - very cost sensitive • Open Source is a key strategy of their IT • Use of Standard Hardware instead of expensive dedicated Storage solutions • Special Linux Distribution - Scientific Linux www.scientificlinux.org • Different databases – huge amount of Data
  12. 12. Requirements • Sophisticated backup strategy with different medias, retention times, remove of backup media to external locations, single servers with 5TB of data • Integrated Bare System Recovery for all Servers – Linux and Windows • Variety of Linux Distributions - “old” Linux Distributions (RH 7.1) • Each backup has to be available 2 times – at least • Backup to Disk and Tape • Wide range of Databases – mySQL, MS SQL, Sybase, PostgreSQL • Upredictable data growth – 100 GB to 500 GB per month
  13. 13. Data Growth 16.000 14.000 12.000 10.000 8.000 6.000 4.000 2.000 0 00010010000000000000000000000010000000000000000000000000000001111011001010001011010 6. 3. 5. 0. 6. 2. 7. 6. 1. 6. 3. 1. 6. 2. 5. 8. 3. 7. 5. 2. 6. 4. 3. 8. 3. 9. 7. 4. 2. 6. 3. 1. 5. 4. 7. 5. 2. 6. 6. 3. 1. 5. 3. 7. 4. 2. 6. 4. 1. 5. 5. 2. 7. 4. 2. 6. 3. 1. 5. 3. 7. 1. 0. 4. 2. 9. 4. 1. 8. 6. 0. 8. 2. 9. 9. 6. 1. 8. 3. 0. 7. 2. 9. 00000000011100000000011100000000011100000000011100000000011100000000011100000000011 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 2. 1. 2. 3. 4. 5. 6. 7. 8. 9. 0. 1. 00000000000000000000000000000000000011111111111111111111111111111111111111111111111 77777777777788888888888899999999999900000000000011111111111122222222222233333333333 Jan 2007 Nov 2013
  14. 14. Actual Implementation • Cluster FS Storage Cluster with Replication – 50TB of Backup Data ==> 100 TB soon • SEP sesam Server on Linux • File, Database and Bare System Recovery Backup of Linux and Windows Servers to Cluster FS (Storage Cluster) • Automated replication of the backup data via Cluster FS • Migration of dedicated backups to tape • Automated restore possible from all Nodes and from tape
  15. 15. Ongoing Projects • Enlarge the storage capacity • Deduplication of Backup Data by SEP Si3T Technology • Conflict of interest - performance vs. invest for storage • New Storage HW – Standard Server with 130 TB net capacity • Slow disks slow down the backup - „smart“ backup tasks speeds up to 2,5 TB / hour
  16. 16. Red Hat Storage & SEP Sesam Session title
  17. 17. Free technical Workshop Free technical Workshop • SEP sesam & Red Hat Storage • 1 Day @ Dupaco Leusden • 18th of March 2014 • www.dupaco.de Session title
  18. 18. Backup issues 88% Capability related challanges 84% Complexity 87% Cost Veeam,Annual Data Protection Report 2013 Session title
  19. 19. Backup is not important All backup is done to ensure a fast and reliable restore! The restore and disaster recovery requirements define the backup strategy – not the other way around!
  20. 20. SEP sesam can do it
  21. 21. • Q&A Textmasterformate durch Klicken bearbeiten Zweite Ebene Dritte Ebene Vierte Ebene Fünfte Ebene Hubert Schweinesbein hs@sep.de

×