Db virtualization and consolidation at iTEC 2011

846 views

Published on

A presentation I gave with Mike Radomski on ITECs consolidation and virtualization approach. We discuss OVM and VMWare server consolidation, as well as database and application server consolidation. I also discuss the DBA 2.0 organizational structure we are engaging to enable us to better manage highly virtualized Oracle databases and WebLogic implementations.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
846
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Db virtualization and consolidation at iTEC 2011

  1. 1. Information Technology Exchange Center • Dan Brint • Mike Radomski 1Friday, June 17, 2011 1
  2. 2. SUNY OIT (Office of Information Technology) SUNYNet 2Friday, June 17, 2011 2
  3. 3. Todays Agenda • Virtualization & Consolidation • Database Consolidation WRT: • Database Virtualization • Network • Server • Storage • Eye to the Cloud 3Friday, June 17, 2011 3
  4. 4. 4http://about.me/MichaelRadomski 4 Friday, June 17, 2011
  5. 5. Infrastructure Agenda • Strategy for Consolidation • Strategy for Virtualization • Server • Cloud Definition • Operating System • Private Cloud vs. Public Cloud • Network • Future Services • Storage 5Friday, June 17, 2011 5
  6. 6. ITEC’s Consolidation Strategy • Server • Operating System • Network • Storage 6Friday, June 17, 2011 6
  7. 7. Banner to Linux • Took advantage of Banner 8 upgrade to standardize • Several campuses migrated from *nix/ VMS to Linux • Most campuses adopted 3-tier Banner Architecture 7Friday, June 17, 2011 7
  8. 8. Campus Banner Status 8Friday, June 17, 2011 8
  9. 9. Consolidation of Technology • Server: Dell m610 servers 48-96GB, pick the “sweet spot” • Operating System: Linux preferred, Windows when necessary. • Virtualization: Oracle VM for Linux,VMware ESX for Windows • Fiber Channel: HP EVA Platform • iSCSI: Dell EqualLogic • Network: Cisco Core, Nexus, Firewall, NAC, Access Switches/APs 9Friday, June 17, 2011 9
  10. 10. Consolidation Opens Doors • Technology Stacks • Capacity planning • Test and R&D Hardware • Enterprise Purchases • Interoperability 10Friday, June 17, 2011 10
  11. 11. ITEC’s Virtualization Strategy • Cloud Definition • Private Cloud vs. Public Cloud • Future Services 11Friday, June 17, 2011 11
  12. 12. The Cloud 12Friday, June 17, 2011 12
  13. 13. NIST Definition of Cloud • Cloud computing is a model for enabling ubiquitous, convenient, on- demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model promotes availability and is composed of five essential characteristics, three service models, and four deployment models. • Full NIST Definition: http://goo.gl/PLu7J 13Friday, June 17, 2011 13
  14. 14. Cloud Ingredients 14Friday, June 17, 2011 14
  15. 15. Essential Characteristics • On-demand self-service • Broad network access • Resource pooling • Rapid elasticity • Measured Service 15Friday, June 17, 2011 15
  16. 16. Service Models Software as a Service Platform as a Service Infrastructure as a Service (SaaS) (PaaS) (IaaS) Consumer deploys acquired or custom Consumer provisions OS, processing, Applications running in the cloud, access applications onto cloud infrastructure, storage, network, etc resources. through thin client (i.e. web browser) does not manage underlying cloud Consumer controls OS & resources, infrastructure provider manages cloud infrastructure SalesForce CRM, Google Apps, Bungee Connect, Google AppEngine, Amazon S3/EC2,VMware vCloud, Microsoft Online Microsoft Azure Services Platform Rackspace 16Friday, June 17, 2011 16
  17. 17. Service Models 17Friday, June 17, 2011 17
  18. 18. Deployment Models • Private cloud - single organization • Community cloud - several organizations with shared concerns • Public cloud - a cloud service provider • Hybrid cloud - composed of two or more of the above 18Friday, June 17, 2011 18
  19. 19. Hybrid Cloud 19Friday, June 17, 2011 19
  20. 20. Current Offerings Software Platform Infrastructure Knowledge as a Service as a Service as a Service as a service •Confluence •Banner •@task •ITEC Helpdesk •Banner DR •On Demand Servers •Exchange E-mail •Remote Services •Angel •DR for OIT •Ensemble Video •Consulting •SUNYConnect SUNY •Elluminate Cloud est. 1988 20Friday, June 17, 2011 20
  21. 21. Future Services • Software as a Service • Infrastructure as a Service • Academic Software as a Service • Storage as a Service • Desktop as a Service • Server as a Service • Platform as a Service • Database as a Service 21Friday, June 17, 2011 21
  22. 22. Road to Ubiquity • “Technology is a utility just like electric and water.” ~Ron Brown • Evaluating vendor’s self service offerings • Dell Advanced Infrastructure Manager (AIM) & Self-Service Creator • HP CloudSystem & CloudSystem Matrix • Oracle Enterprise Manager Cloud Management • Use self-service internally • FY2011-2012 - One Virtual Machine Per Member 22Friday, June 17, 2011 22
  23. 23. http://about.me/DanBrint 23Friday, June 17, 2011 23
  24. 24. Database Agenda • No boring what or why ‘filler’ • 3 specific case studies • Library • Business Intelligence • Student Information System 24Friday, June 17, 2011 24
  25. 25. Library 2010 56 8.4 M 303 K 1.3 M • 52 databases • 3 largish servers Seneca Saranac Delaware Mohawk Union • Virtualized via IBM lPar technology • Schema based consolidation with ≤ 3 campuses per DB 8 CPU 10 CPU 8 CPU 4 CPU 1 CPU • 2 Oracle code trees per 40 GB RAM 1 TB Disk 50 GB RAM 2 TB Disk 37 GB RAM 2 TB Disk 5 GB RAM <1 TB Disk 10 GB RAM 3 TB Disk server • 1+X application code trees 18 DB (p&d) 18 DB (p&d) 16 DB (p&d) 6 DB 6 Campuses 1 DB per server (Aleph 500 by 19 Campuses 19 Campuses 18 Campuses 56 Campuses ExLibris) • Advantage - Campus demand lifecycle 25Friday, June 17, 2011 25
  26. 26. search.sunyconnect.suny.edu 10,0 mo 00 nth / + = + • Replaces a dedicated database, server and somewhat specialized vendor software implementation • Provides u-wide search capabilities 26Friday, June 17, 2011 26
  27. 27. SUNYConnect (Library) • Utilizes schema based consolidation • Union catalog = read only uber consolidation • Multi-tenent friendly application • Replaced Union with an AWS based • ~ 18 databases per server search service (very modest resources) • 2 Oracle code trees per server • Draws upon existing catalog services • A single database failure affects < 4 • Little bit of custom code campuses • ... and yes it was impacted by the AWS • But a single server failure affects 19 outage in April 2011. However, each library specific search remained operational and a campuses workaround was implemented prior to full AWS service restoration 27Friday, June 17, 2011 27
  28. 28. Business ITEC RF Intelligence (Hosted ODS, (???) SUNY DataCenter BI, Online Goodness Learning) OAS Campus (Financial, Library ?) (ODS) enrollment grades courses Institution curriculum majors demographics programs Projections Information Trends budget Analysis Insight Knowledge Decisions Campus ERP Campus ERP 28 SUNY BI Cloud by D. Brint (2010)Friday, June 17, 2011 28
  29. 29. Primary Site Admin Server DR Site Admin Server OS: Windows Server 2003 OS: Windows Server 2003 32bit 32bit CPU: 1 CPU: 1 Windows Admin RAM: 4 GB RAM: 4GB Storage: 80gb Windows Admin Storage: 80gb Toolset Toolset IdM IdM (Identity (Identity Service) Middleware Service) Middleware OS: OEL Linux 5.x 64bit OS: OEL Linux 5.x 64bit CPU: 2 CPU: 2 3 Node WebLogic RAM: 8 GB RAM: 8 GB OBIEE Cluster Storage: 80GB OBIEE 2 Node WebLogic Storage: 80GB Cluster Database Database OS: OEL Linux 5.x 64bit OS: OEL Linux 5.x 64bit CPU: 6 CPU: 6 Multitenant Multitenant RAM: 32 GB RAM: 32 GB ODS via VPD Storage: 7300 GB ODS via VPD Storage: 7300 GB SIS BI Cloud SIS 29Friday, June 17, 2011 29
  30. 30. SICAS BI Cloud • Shared infrastructure (consolidation AND virtualization) • ‘schema like’ data consolidation via VPD (Virtual Private Database) • Consolidation of application via a single shared OBIEE implementation • Facilitates campus unique data and campus specific BI development as well • Sized for 24 Campuses • 12,750 active users • 10% concurrency • 3.6 TB Operational Data Store • Dramatic reduction in infrastructure management costs (one database, one application) 30Friday, June 17, 2011 30
  31. 31. SIS Student Information System (SIS) • Built upon SunGardHE Banner • Managed in conjunction with SICAS and each campus • Evolved over time • Increasing value to campus • Increasing complexity • Increasing number of moving parts 31Friday, June 17, 2011 31
  32. 32. Banner Server (PROD) Banner Server (Dev) SIS Databases Accessed Databases Accessed Web (App) Server PROD PPRD DEVL Databases Accessed PROD PPRD DEVL Apps Apps SQR Proc Cob Proc C SQR Proc Cob Proc C Apps SQL / OS Shell Scripts SQL / OS Shell Scripts Forms Reports mod pl/sql OC4J Software Software Oracle SQR Oracle SQR Software Oracle Precompilers Pro C, Pro Cobol Oracle Precompilers Pro C, Pro Cobol Oracle Internet Application Server (10gR2,R3) Oracle Client Oracle Client DB Server 1 DB Server 2 Software Software Oracle RDBMS Oracle RDBMS Databases Databases PPRD PROD DEVL 32Friday, June 17, 2011 32
  33. 33. SIS App D App D App C App C App B App B Banner Server (PROD) Banner Server (Dev) App A App A Databases Accessed Databases Accessed Databases Accessed Databases Accessed Web (App) Server PROD PPRD DEVL PPRD DEVL PROD Databases Accessed PROD PPRD DEVL Apps Apps Apps Apps SQR Pro Cob Proc C SQR Pro Cob Proc C Comp 1 Comp 2 Comp 1 Comp 2 Apps SQL / OS Shell Scripts SQL / OS Shell Scripts Forms Reports mod pl/sql OC4J Software Software Software Software Oracle SQR Oracle SQR Software Java Java Oracle Precompilers Pro C, Pro Cobol Oracle Precompilers Pro C, Pro Cobol Oracle Internet Application Server (10gR2,R3) Oracle Client Oracle Client Oracle Client Oracle Client DB Server 1 DB Server 2 DB Server 3 DB Server 4 Software Software Software Software Oracle RDBMS Oracle RDBMS Oracle RDBMS Oracle RDBMS Databases Databases Databases Databases PPRD A A A A PROD DEVL A B C D A A A A 32Friday, June 17, 2011 32
  34. 34. 11 Ban Cam ner pus es Thats a lot of ‘stuff’ to us manage ! ro ps me Ap u r N e th o ... O to Or acle 193 atab ases D 33Friday, June 17, 2011 33

×