Data fabric and VMware


Published on

How VMware simplifies your need to manage data

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • With new frameworks – the ambition has been to make developers more productive. The role of frameworks has been to offer developers pre-packaged, ready to use components so that they don’t have to write code for the most elemental recurring tasksFor example when you look at the Spring frame work for Java (that we acquired 2 yrs ago), it makes it dramatically simpler to write a java application…. There is enormous ferment in the application space. There continue to emerge new frameworks like RoR and Note.js. There also new user requirements for enterprise applications – like social and integration with mobile devices. To give you one simple example – we use Oracle Financials internally. And a nagging painpoint for our field was the inability to approve an expense report or a purchase requisition on your BB/iPhone. How cool / no brainer would be it to be able to send my boss a hyperlink to the purchase request that I want him to approve. But all of that social interaction embedded into apps does not come free. The amt of data that applications need to access, process and display continues to rise inexorably. Big data has come to the fore as one of the most significant enterprise challenges. There are interesting new approaches to solving the data challenges. It is clear that the relational database has become a bottleneck. New big data mgmt techniques like memory caching provide the parallel processing of vast amt of data in memory.
  • vFabric Data Director is a new product we are introducing, using Data Director to offer Database-as-a-Service in the Cloud solves these problems. Data Director enables our customers to standup their own database as a service in side their own datacenter. Data Director is built on vSphere platform to extend the virtualization benefits to the database layer. It’s a self-service database provisioning and cloud automation platform that enables organizations to offer database-as-a-service inside their own datacenter and in turn dramatically simplifies database deployment, operations and scaling in the cloud, further, this allows enterprise to keep their data behind the firewall and maintain control. Our longer term goal is for data director to become the unified database virtualization platform, both for traditional and new database. The first database we have enabled on top of this platform is a vSphere-optimized PostgreSQL database.
  • Let’s take a closer look at data director, data director provides a single pane to monitor and manage 1000’s of database. The core capabilities of Data Director can be view from two perspectives.The first set of capabilities are targeted at the database users which are DBAs or application developers. We talked about a few slides ago on long lead time required for database operations to be carried out due semi-manual database operations, involvement from multiple IT teams. With data director, we have fully automated common database operations and cut across the silos of the IT organization. Now operations like provisioning, backup, restore, cloning and HA, can be done through a few clicks in a self service fashion. The result is for application developer to spend more time coding and less time waiting. This second set is are targeted at DBaaS operators, that provides IT with the necessary tools to enforce control and compliance over databases. With self-service to empower developers, at the same time, it’s also important for IT to maintain control. Data Director provides a myriad of features to allow IT to control resource usage, access and templates to maintain standardization, so you can feel comfortable empowering your developers.
  • Databases are the “last frontier” for virtualization~15-20% of all x86 servers run databasesDatabase virtualization challenges, fundamentallyTraditional database assumesIt is running on a dedicated physical machine with unchanging resourcesDBAs are expected to tune their database to a specific “hardware” setupIn virtual environmentUnderlying physical resources allocated to a database change over timeMobility of VMs add to the issue as the underlying hardware characteristics changeData Director is the only ANSI SQL database platform on the market that built for the virtualization cloud infrastructurevSphere-optimized PostgreSQL database with Elastic database memory to handle dynamic resource allocationSelf tuning to adjust database settings to suit resource allocationExtend vSphere capabilities to databaseSnapshot, HA, cloning, linked clone etc.
  • Data fabric and VMware

    1. 1. Data Fabric and VMware<br />
    2. 2. The Changing World of Applications<br />New Types of Interactions<br />Mobile, social networking interactions<br />New Devices<br />Smart phones, Tablets, Smart TVs, future devices, software delivered as a service<br />New Frameworks<br />Developer productivity through increasing abstraction<br />Data Growth & New Data Types<br />Data growing at 60% per year, Big Data, new data models<br />New Infrastructures & Platforms<br />Virtualization, cloud<br />Increasing number of cores, larger memory, flash storage<br />Abstraction<br />Time<br />
    3. 3. Data Renaissance<br />VMware Confidential<br />The explosive growth of data and an increasing need to get a greater return on those data assets<br />New types of applications' evolving data demands<br />scale, multi-site, real-time, social, mobile, SaaS<br />Big shifts in underlying infrastructure changed database system design assumptions<br />In software (virtualization) and <br />In hardware (multi-core, large memory, flash storage) <br />Cloud-inspired IT-as-a-Service delivery model both inside and outside enterprise firewalls<br />As a result, there has been a “Data Renaissance”, the boom in new techniques and technologies for managing data that aims to satisfy these new demands <br />
    4. 4. Customer Challenges around Databases Today<br />Improve Operational Agility<br />Get More out of Virtual Infrastructure<br />Control Database Sprawl<br />Corporate IT<br />Shadow IT<br />…<br />Databaseprovision or clone request<br />Lead time of weeks<br />Provision & <br />Manage<br />Provision & <br />Manage<br /><ul><li>Thousands of under-managed and under-secured databases
    5. 5. Difficult to enforce policy and compliance
    6. 6. Database operations not fully automated
    7. 7. Long lead time for database services for developers
    8. 8. More workloads in virtual machines than in physical machines
    9. 9. Database accounts for ~15%-20% of the total workloads</li></li></ul><li>Customer Insights from NYSE Technologies<br />Feargal O’Sullivan, VP of Platform Development, NYSE Technologies<br />
    10. 10.
    11. 11. Historical Trade and Quote Volumes<br />On average – in August 2011 – an entire trading day of US Equities and Options trade and quote data requires over 200GB of database storage<br />
    12. 12. Historical Trade and Quote Use Cases<br />Post-trade Risk Applications<br />Continually validate that holdings meet all fund and regulatory requirements<br />Strategy Back Testing<br />Run complex analytical studies on portfolios of instruments, over periods of time, looking for ‘alpha’ tradeable moments<br />Regulatory Reporting<br />Process all transactions and validate regulatory compliance e.g. Best Execution Rule under Regulation NMS<br />
    13. 13. User Database Requirements<br />Ease of Use<br />Traders are Developers – Developers are Traders<br />Agility<br />Regulations constantly change<br />New trading opportunities arise and old ones sink as rapidly as the news hits the web<br />Reliability<br />Users must be shielded from Infrastructure issues<br />
    14. 14. Introducing Data Fabric<br />
    15. 15. Reduce cost,minimize disruption<br />Ready for new appsto deliver differentiation<br />Existing Applications<br />New Applications<br />Platform as a Service<br />Data Fabric<br />Cloud Infrastructure<br />Private<br />Public<br />Existing<br />Cloud Era<br />Cloud Platforms for Today’s and Tomorrow’s Apps<br />
    16. 16. Data Fabric<br />VMware Confidential<br />Database engine technology is going from one-size-fits-all to let-100-flowers-bloom<br />Create to common deployment and operational model for diverse database technologies<br />Fully leverage the underlying cloud infrastructure platform<br />Supplement traditional RDBMS with new elastic data technologies<br />
    17. 17. Introducing vFabric Data Director<br /><ul><li>Database provisioning and operations platform
    18. 18. Enables enterprises to offer “database as a service” to their organizations
    19. 19. Reduce “database sprawl” through automation and consistent policy enforcement
    20. 20. Streamline application development with self-service database provisioning
    21. 21. Increase datacenter efficiency by bringing virtual infrastructure benefits to the database tier
    22. 22. Built on vSphere 5
    23. 23. First database enabled is PostgreSQLdatabase
    24. 24. Sybase, Greenplum announced future support
    25. 25. Other databases to follow</li></ul>New<br />
    26. 26. Powering DBaaS for Your Cloud<br />Existing Applications<br />New Applications<br />vFabric Data Director<br />One click <br />HA<br />Clone<br />AutomationSelf-Service<br />Backup/<br />Restore<br />Provisioning<br />DBA<br />App Dev<br />Monitor<br />Policy Based<br />Control<br />Database <br />Templates<br />Security <br />Mgmt<br />Resource<br />Mgmt<br />IT Admin<br />DBA<br />VMware vSphere<br />
    27. 27. vFabricPostgres<br /><ul><li>First database enabled on vFabric Data Director
    28. 28. Based on PostgreSQL 9.0
    29. 29. Fully ACID compliant, ANSI SQL compliant relational database
    30. 30. Proven architecture known for reliability and wildly used across industries
    31. 31. Added vSphere-Optimization include
    32. 32. Elastic database memory
    33. 33. Self-tuning and automatic configuration
    34. 34. Database-aware high availability
    35. 35. Live on on 8/29
    36. 36. Soon to be included in Micro Cloud Foundry </li></li></ul><li>Control Database Sprawl<br />After<br />Before<br />…<br />Corporate IT<br />Shadow IT<br />App<br />App<br />App<br />App<br />App<br />App<br />vFabric Data Director<br />Self Service & Automation<br />Policy based Control<br />VMware vSphere<br /><ul><li>Enable IT to provide DBaaS for their users
    37. 37. Centralized management of 1000s of databases
    38. 38. Order of magnitude saving on OPEX and CAPEX
    39. 39. Consistent standardization and policy enforcement
    40. 40. Thousands of under-managed and under-secured databases
    41. 41. Difficult to enforce policy and compliance</li></li></ul><li>Increase Operational Agility<br />Before<br />After<br />Shadow IT<br />provision orclone<br />Lead time of weeks<br />vFabric Data Director<br />Provision & <br />Manage<br />Provision & <br />Manage<br />VMware vSphere<br /><ul><li>Long lead time for database services
    42. 42. Manual provisioning, tuning, cloning
    43. 43. Frustrated developers and overworked DBAs
    44. 44. Empower developer to self-service database needs
    45. 45. Database provisioning and cloning in minutes
    46. 46. Less time waiting, more time coding</li></li></ul><li>Getting More out of Virtual Infrastructure<br />After<br />Before<br />…<br />App<br />App<br />App<br />App<br />App<br />App<br />X<br />HA<br />…<br />X<br />vFabric Data Director<br />X<br />HA<br />HA<br />Self Service & Automation<br />X<br />HA<br />Policy based Control<br />X<br />X<br />HA<br />HA<br />HA<br />HA<br />HA<br />VMware vSphere<br /><ul><li>Dedicated hardware with unchanging resources
    47. 47. DBA tunes databases to specific setup
    48. 48. No resource pooling or sharing
    49. 49. Database HA is expensive and complex
    50. 50. Many databases without HA
    51. 51. Protect against hardware, OS, database failures
    52. 52. One-click Database-aware High Availability
    53. 53. Lowers OPEX and better service level</li></li></ul><li>vFabric Data Director Delivers…<br />
    54. 54. Meet Data Challenges for the Cloud Era<br />Elastic scalability/Low-latency<br />How do I architect my data tier for highly variable application usage? My app has 10,000 users on a normal day but 10,000,000 on Mother’s Day.<br />Multi-Site / Multi-Cloud<br />How do I distribute data efficiently to my compute clouds? I have applications and users in multiple places that need access to the same data in real-time.<br />Data-Centric Computing<br />How do I process these large quantities of data in an efficient manner to allow for better real-time decision-making?<br />
    55. 55. vFabricGemfire and SQLfire<br />Memory-oriented database with elastic scalability and lightning-fast performance <br />Client<br />Client<br />Client<br />*Fire Node<br />*Fire Node<br />*Fire Node<br />WAN<br />Object interface: GemFire<br />SQL interface: SQLFire<br />Co-locate compute with data<br />
    56. 56. Elastic Scalability / Low Latency<br />Before<br />After<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />As load increases, virtualization allows stateless web and app tier to be rapidly scaled<br />As load increases, virtualization allows stateless web and app tier to be rapidly scaled<br />App <br />Server<br />App<br />Server<br />App <br />Server<br />App <br />Server<br />App<br />Server<br />App <br />Server<br />Pushing data into memory<br /><ul><li>Reduces databases required
    57. 57. Allows for linear application scalability</li></ul>In-Memory tier<br />But stateful Database tier must be over-provisioned in advanced – and sit idle<br />
    58. 58. Multi-Site / Multi-Cloud<br />Before<br />After<br />System of record<br />GemFire Node<br />Batch load to ODS<br />Real-time<br />WAN<br />WAN<br />Nightly replication<br />GemFire Node<br />Object interface: GemFire<br />SQL interface: SQLFire<br />
    59. 59. Look Ahead<br /><ul><li>Address the needs of today’s problems while providing path to tomorrow’s
    60. 60. Extend support to traditional and new databases
    61. 61. Fully leverage virtual infrastructure benefits
    62. 62. Integrate with Cloud Foundry</li></ul>Existing Applications<br />New Applications<br />Public Cloud<br />Cloud Foundry<br />Data Director<br />SQLFire<br />vPostgres<br />Add. DB<br />Add. DB<br />…<br />…<br />Hybrid Cloud<br /> Private Cloud<br />Cloud Infrastructure<br />