Your SlideShare is downloading. ×

Data fabric and VMware

1,628
views

Published on

How VMware simplifies your need to manage data

How VMware simplifies your need to manage data

Published in: Technology

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,628
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
83
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • With new frameworks – the ambition has been to make developers more productive. The role of frameworks has been to offer developers pre-packaged, ready to use components so that they don’t have to write code for the most elemental recurring tasksFor example when you look at the Spring frame work for Java (that we acquired 2 yrs ago), it makes it dramatically simpler to write a java application…. There is enormous ferment in the application space. There continue to emerge new frameworks like RoR and Note.js. There also new user requirements for enterprise applications – like social and integration with mobile devices. To give you one simple example – we use Oracle Financials internally. And a nagging painpoint for our field was the inability to approve an expense report or a purchase requisition on your BB/iPhone. How cool / no brainer would be it to be able to send my boss a hyperlink to the purchase request that I want him to approve. But all of that social interaction embedded into apps does not come free. The amt of data that applications need to access, process and display continues to rise inexorably. Big data has come to the fore as one of the most significant enterprise challenges. There are interesting new approaches to solving the data challenges. It is clear that the relational database has become a bottleneck. New big data mgmt techniques like memory caching provide the parallel processing of vast amt of data in memory.
  • vFabric Data Director is a new product we are introducing, using Data Director to offer Database-as-a-Service in the Cloud solves these problems. Data Director enables our customers to standup their own database as a service in side their own datacenter. Data Director is built on vSphere platform to extend the virtualization benefits to the database layer. It’s a self-service database provisioning and cloud automation platform that enables organizations to offer database-as-a-service inside their own datacenter and in turn dramatically simplifies database deployment, operations and scaling in the cloud, further, this allows enterprise to keep their data behind the firewall and maintain control. Our longer term goal is for data director to become the unified database virtualization platform, both for traditional and new database. The first database we have enabled on top of this platform is a vSphere-optimized PostgreSQL database.
  • Let’s take a closer look at data director, data director provides a single pane to monitor and manage 1000’s of database. The core capabilities of Data Director can be view from two perspectives.The first set of capabilities are targeted at the database users which are DBAs or application developers. We talked about a few slides ago on long lead time required for database operations to be carried out due semi-manual database operations, involvement from multiple IT teams. With data director, we have fully automated common database operations and cut across the silos of the IT organization. Now operations like provisioning, backup, restore, cloning and HA, can be done through a few clicks in a self service fashion. The result is for application developer to spend more time coding and less time waiting. This second set is are targeted at DBaaS operators, that provides IT with the necessary tools to enforce control and compliance over databases. With self-service to empower developers, at the same time, it’s also important for IT to maintain control. Data Director provides a myriad of features to allow IT to control resource usage, access and templates to maintain standardization, so you can feel comfortable empowering your developers.
  • Databases are the “last frontier” for virtualization~15-20% of all x86 servers run databasesDatabase virtualization challenges, fundamentallyTraditional database assumesIt is running on a dedicated physical machine with unchanging resourcesDBAs are expected to tune their database to a specific “hardware” setupIn virtual environmentUnderlying physical resources allocated to a database change over timeMobility of VMs add to the issue as the underlying hardware characteristics changeData Director is the only ANSI SQL database platform on the market that built for the virtualization cloud infrastructurevSphere-optimized PostgreSQL database with Elastic database memory to handle dynamic resource allocationSelf tuning to adjust database settings to suit resource allocationExtend vSphere capabilities to databaseSnapshot, HA, cloning, linked clone etc.
  • Transcript

    • 1. Data Fabric and VMware
    • 2. The Changing World of Applications
      New Types of Interactions
      Mobile, social networking interactions
      New Devices
      Smart phones, Tablets, Smart TVs, future devices, software delivered as a service
      New Frameworks
      Developer productivity through increasing abstraction
      Data Growth & New Data Types
      Data growing at 60% per year, Big Data, new data models
      New Infrastructures & Platforms
      Virtualization, cloud
      Increasing number of cores, larger memory, flash storage
      Abstraction
      Time
    • 3. Data Renaissance
      VMware Confidential
      The explosive growth of data and an increasing need to get a greater return on those data assets
      New types of applications' evolving data demands
      scale, multi-site, real-time, social, mobile, SaaS
      Big shifts in underlying infrastructure changed database system design assumptions
      In software (virtualization) and
      In hardware (multi-core, large memory, flash storage)
      Cloud-inspired IT-as-a-Service delivery model both inside and outside enterprise firewalls
      As a result, there has been a “Data Renaissance”, the boom in new techniques and technologies for managing data that aims to satisfy these new demands 
    • 4. Customer Challenges around Databases Today
      Improve Operational Agility
      Get More out of Virtual Infrastructure
      Control Database Sprawl
      Corporate IT
      Shadow IT

      Databaseprovision or clone request
      Lead time of weeks
      Provision &
      Manage
      Provision &
      Manage
      • Thousands of under-managed and under-secured databases
      • 5. Difficult to enforce policy and compliance
      • 6. Database operations not fully automated
      • 7. Long lead time for database services for developers
      • 8. More workloads in virtual machines than in physical machines
      • 9. Database accounts for ~15%-20% of the total workloads
    • Customer Insights from NYSE Technologies
      Feargal O’Sullivan, VP of Platform Development, NYSE Technologies
    • 10.
    • 11. Historical Trade and Quote Volumes
      On average – in August 2011 – an entire trading day of US Equities and Options trade and quote data requires over 200GB of database storage
    • 12. Historical Trade and Quote Use Cases
      Post-trade Risk Applications
      Continually validate that holdings meet all fund and regulatory requirements
      Strategy Back Testing
      Run complex analytical studies on portfolios of instruments, over periods of time, looking for ‘alpha’ tradeable moments
      Regulatory Reporting
      Process all transactions and validate regulatory compliance e.g. Best Execution Rule under Regulation NMS
    • 13. User Database Requirements
      Ease of Use
      Traders are Developers – Developers are Traders
      Agility
      Regulations constantly change
      New trading opportunities arise and old ones sink as rapidly as the news hits the web
      Reliability
      Users must be shielded from Infrastructure issues
    • 14. Introducing Data Fabric
    • 15. Reduce cost,minimize disruption
      Ready for new appsto deliver differentiation
      Existing Applications
      New Applications
      Platform as a Service
      Data Fabric
      Cloud Infrastructure
      Private
      Public
      Existing
      Cloud Era
      Cloud Platforms for Today’s and Tomorrow’s Apps
    • 16. Data Fabric
      VMware Confidential
      Database engine technology is going from one-size-fits-all to let-100-flowers-bloom
      Create to common deployment and operational model for diverse database technologies
      Fully leverage the underlying cloud infrastructure platform
      Supplement traditional RDBMS with new elastic data technologies
    • 17. Introducing vFabric Data Director
      • Database provisioning and operations platform
      • 18. Enables enterprises to offer “database as a service” to their organizations
      • 19. Reduce “database sprawl” through automation and consistent policy enforcement
      • 20. Streamline application development with self-service database provisioning
      • 21. Increase datacenter efficiency by bringing virtual infrastructure benefits to the database tier
      • 22. Built on vSphere 5
      • 23. First database enabled is PostgreSQLdatabase
      • 24. Sybase, Greenplum announced future support
      • 25. Other databases to follow
      New
    • 26. Powering DBaaS for Your Cloud
      Existing Applications
      New Applications
      vFabric Data Director
      One click
      HA
      Clone
      AutomationSelf-Service
      Backup/
      Restore
      Provisioning
      DBA
      App Dev
      Monitor
      Policy Based
      Control
      Database
      Templates
      Security
      Mgmt
      Resource
      Mgmt
      IT Admin
      DBA
      VMware vSphere
    • 27. vFabricPostgres
      • First database enabled on vFabric Data Director
      • 28. Based on PostgreSQL 9.0
      • 29. Fully ACID compliant, ANSI SQL compliant relational database
      • 30. Proven architecture known for reliability and wildly used across industries
      • 31. Added vSphere-Optimization include
      • 32. Elastic database memory
      • 33. Self-tuning and automatic configuration
      • 34. Database-aware high availability
      • 35. Live on cloudfoundry.com on 8/29
      • 36. Soon to be included in Micro Cloud Foundry
    • Control Database Sprawl
      After
      Before

      Corporate IT
      Shadow IT
      App
      App
      App
      App
      App
      App
      vFabric Data Director
      Self Service & Automation
      Policy based Control
      VMware vSphere
      • Enable IT to provide DBaaS for their users
      • 37. Centralized management of 1000s of databases
      • 38. Order of magnitude saving on OPEX and CAPEX
      • 39. Consistent standardization and policy enforcement
      • 40. Thousands of under-managed and under-secured databases
      • 41. Difficult to enforce policy and compliance
    • Increase Operational Agility
      Before
      After
      Shadow IT
      provision orclone
      Lead time of weeks
      vFabric Data Director
      Provision &
      Manage
      Provision &
      Manage
      VMware vSphere
      • Long lead time for database services
      • 42. Manual provisioning, tuning, cloning
      • 43. Frustrated developers and overworked DBAs
      • 44. Empower developer to self-service database needs
      • 45. Database provisioning and cloning in minutes
      • 46. Less time waiting, more time coding
    • Getting More out of Virtual Infrastructure
      After
      Before

      App
      App
      App
      App
      App
      App
      X
      HA

      X
      vFabric Data Director
      X
      HA
      HA
      Self Service & Automation
      X
      HA
      Policy based Control
      X
      X
      HA
      HA
      HA
      HA
      HA
      VMware vSphere
      • Dedicated hardware with unchanging resources
      • 47. DBA tunes databases to specific setup
      • 48. No resource pooling or sharing
      • 49. Database HA is expensive and complex
      • 50. Many databases without HA
      • 51. Protect against hardware, OS, database failures
      • 52. One-click Database-aware High Availability
      • 53. Lowers OPEX and better service level
    • vFabric Data Director Delivers…
    • 54. Meet Data Challenges for the Cloud Era
      Elastic scalability/Low-latency
      How do I architect my data tier for highly variable application usage? My app has 10,000 users on a normal day but 10,000,000 on Mother’s Day.
      Multi-Site / Multi-Cloud
      How do I distribute data efficiently to my compute clouds? I have applications and users in multiple places that need access to the same data in real-time.
      Data-Centric Computing
      How do I process these large quantities of data in an efficient manner to allow for better real-time decision-making?
    • 55. vFabricGemfire and SQLfire
      Memory-oriented database with elastic scalability and lightning-fast performance
      Client
      Client
      Client
      *Fire Node
      *Fire Node
      *Fire Node
      WAN
      Object interface: GemFire
      SQL interface: SQLFire
      Co-locate compute with data
    • 56. Elastic Scalability / Low Latency
      Before
      After
      Web
      Server
      Web
      Server
      Web
      Server
      Web
      Server
      Web
      Server
      Web
      Server
      As load increases, virtualization allows stateless web and app tier to be rapidly scaled
      As load increases, virtualization allows stateless web and app tier to be rapidly scaled
      App
      Server
      App
      Server
      App
      Server
      App
      Server
      App
      Server
      App
      Server
      Pushing data into memory
      • Reduces databases required
      • 57. Allows for linear application scalability
      In-Memory tier
      But stateful Database tier must be over-provisioned in advanced – and sit idle
    • 58. Multi-Site / Multi-Cloud
      Before
      After
      System of record
      GemFire Node
      Batch load to ODS
      Real-time
      WAN
      WAN
      Nightly replication
      GemFire Node
      Object interface: GemFire
      SQL interface: SQLFire
    • 59. Look Ahead
      • Address the needs of today’s problems while providing path to tomorrow’s
      • 60. Extend support to traditional and new databases
      • 61. Fully leverage virtual infrastructure benefits
      • 62. Integrate with Cloud Foundry
      Existing Applications
      New Applications
      Public Cloud
      Cloud Foundry
      Data Director
      SQLFire
      vPostgres
      Add. DB
      Add. DB


      Hybrid Cloud
      Private Cloud
      Cloud Infrastructure