With new frameworks – the ambition has been to make developers more productive. The role of frameworks has been to offer developers pre-packaged, ready to use components so that they don’t have to write code for the most elemental recurring tasksFor example when you look at the Spring frame work for Java (that we acquired 2 yrs ago), it makes it dramatically simpler to write a java application…. There is enormous ferment in the application space. There continue to emerge new frameworks like RoR and Note.js. There also new user requirements for enterprise applications – like social and integration with mobile devices. To give you one simple example – we use Oracle Financials internally. And a nagging painpoint for our field was the inability to approve an expense report or a purchase requisition on your BB/iPhone. How cool / no brainer would be it to be able to send my boss a hyperlink to the purchase request that I want him to approve. But all of that social interaction embedded into apps does not come free. The amt of data that applications need to access, process and display continues to rise inexorably. Big data has come to the fore as one of the most significant enterprise challenges. There are interesting new approaches to solving the data challenges. It is clear that the relational database has become a bottleneck. New big data mgmt techniques like memory caching provide the parallel processing of vast amt of data in memory.
vFabric Data Director is a new product we are introducing, using Data Director to offer Database-as-a-Service in the Cloud solves these problems. Data Director enables our customers to standup their own database as a service in side their own datacenter. Data Director is built on vSphere platform to extend the virtualization benefits to the database layer. It’s a self-service database provisioning and cloud automation platform that enables organizations to offer database-as-a-service inside their own datacenter and in turn dramatically simplifies database deployment, operations and scaling in the cloud, further, this allows enterprise to keep their data behind the firewall and maintain control. Our longer term goal is for data director to become the unified database virtualization platform, both for traditional and new database. The first database we have enabled on top of this platform is a vSphere-optimized PostgreSQL database.
Let’s take a closer look at data director, data director provides a single pane to monitor and manage 1000’s of database. The core capabilities of Data Director can be view from two perspectives.The first set of capabilities are targeted at the database users which are DBAs or application developers. We talked about a few slides ago on long lead time required for database operations to be carried out due semi-manual database operations, involvement from multiple IT teams. With data director, we have fully automated common database operations and cut across the silos of the IT organization. Now operations like provisioning, backup, restore, cloning and HA, can be done through a few clicks in a self service fashion. The result is for application developer to spend more time coding and less time waiting. This second set is are targeted at DBaaS operators, that provides IT with the necessary tools to enforce control and compliance over databases. With self-service to empower developers, at the same time, it’s also important for IT to maintain control. Data Director provides a myriad of features to allow IT to control resource usage, access and templates to maintain standardization, so you can feel comfortable empowering your developers.
Databases are the “last frontier” for virtualization~15-20% of all x86 servers run databasesDatabase virtualization challenges, fundamentallyTraditional database assumesIt is running on a dedicated physical machine with unchanging resourcesDBAs are expected to tune their database to a specific “hardware” setupIn virtual environmentUnderlying physical resources allocated to a database change over timeMobility of VMs add to the issue as the underlying hardware characteristics changeData Director is the only ANSI SQL database platform on the market that built for the virtualization cloud infrastructurevSphere-optimized PostgreSQL database with Elastic database memory to handle dynamic resource allocationSelf tuning to adjust database settings to suit resource allocationExtend vSphere capabilities to databaseSnapshot, HA, cloning, linked clone etc.
Data fabric and VMware
Data Fabric and VMware<br />
The Changing World of Applications<br />New Types of Interactions<br />Mobile, social networking interactions<br />New Devices<br />Smart phones, Tablets, Smart TVs, future devices, software delivered as a service<br />New Frameworks<br />Developer productivity through increasing abstraction<br />Data Growth & New Data Types<br />Data growing at 60% per year, Big Data, new data models<br />New Infrastructures & Platforms<br />Virtualization, cloud<br />Increasing number of cores, larger memory, flash storage<br />Abstraction<br />Time<br />
Data Renaissance<br />VMware Confidential<br />The explosive growth of data and an increasing need to get a greater return on those data assets<br />New types of applications' evolving data demands<br />scale, multi-site, real-time, social, mobile, SaaS<br />Big shifts in underlying infrastructure changed database system design assumptions<br />In software (virtualization) and <br />In hardware (multi-core, large memory, flash storage) <br />Cloud-inspired IT-as-a-Service delivery model both inside and outside enterprise firewalls<br />As a result, there has been a “Data Renaissance”, the boom in new techniques and technologies for managing data that aims to satisfy these new demands <br />
Customer Challenges around Databases Today<br />Improve Operational Agility<br />Get More out of Virtual Infrastructure<br />Control Database Sprawl<br />Corporate IT<br />Shadow IT<br />…<br />Databaseprovision or clone request<br />Lead time of weeks<br />Provision & <br />Manage<br />Provision & <br />Manage<br /><ul><li>Thousands of under-managed and under-secured databases
Historical Trade and Quote Volumes<br />On average – in August 2011 – an entire trading day of US Equities and Options trade and quote data requires over 200GB of database storage<br />
Historical Trade and Quote Use Cases<br />Post-trade Risk Applications<br />Continually validate that holdings meet all fund and regulatory requirements<br />Strategy Back Testing<br />Run complex analytical studies on portfolios of instruments, over periods of time, looking for ‘alpha’ tradeable moments<br />Regulatory Reporting<br />Process all transactions and validate regulatory compliance e.g. Best Execution Rule under Regulation NMS<br />
User Database Requirements<br />Ease of Use<br />Traders are Developers – Developers are Traders<br />Agility<br />Regulations constantly change<br />New trading opportunities arise and old ones sink as rapidly as the news hits the web<br />Reliability<br />Users must be shielded from Infrastructure issues<br />
Reduce cost,minimize disruption<br />Ready for new appsto deliver differentiation<br />Existing Applications<br />New Applications<br />Platform as a Service<br />Data Fabric<br />Cloud Infrastructure<br />Private<br />Public<br />Existing<br />Cloud Era<br />Cloud Platforms for Today’s and Tomorrow’s Apps<br />
Data Fabric<br />VMware Confidential<br />Database engine technology is going from one-size-fits-all to let-100-flowers-bloom<br />Create to common deployment and operational model for diverse database technologies<br />Fully leverage the underlying cloud infrastructure platform<br />Supplement traditional RDBMS with new elastic data technologies<br />
Introducing vFabric Data Director<br /><ul><li>Database provisioning and operations platform
Enables enterprises to offer “database as a service” to their organizations
Reduce “database sprawl” through automation and consistent policy enforcement
Streamline application development with self-service database provisioning
Increase datacenter efficiency by bringing virtual infrastructure benefits to the database tier
Soon to be included in Micro Cloud Foundry </li></li></ul><li>Control Database Sprawl<br />After<br />Before<br />…<br />Corporate IT<br />Shadow IT<br />App<br />App<br />App<br />App<br />App<br />App<br />vFabric Data Director<br />Self Service & Automation<br />Policy based Control<br />VMware vSphere<br /><ul><li>Enable IT to provide DBaaS for their users
Consistent standardization and policy enforcement
Thousands of under-managed and under-secured databases
Difficult to enforce policy and compliance</li></li></ul><li>Increase Operational Agility<br />Before<br />After<br />Shadow IT<br />provision orclone<br />Lead time of weeks<br />vFabric Data Director<br />Provision & <br />Manage<br />Provision & <br />Manage<br />VMware vSphere<br /><ul><li>Long lead time for database services
Less time waiting, more time coding</li></li></ul><li>Getting More out of Virtual Infrastructure<br />After<br />Before<br />…<br />App<br />App<br />App<br />App<br />App<br />App<br />X<br />HA<br />…<br />X<br />vFabric Data Director<br />X<br />HA<br />HA<br />Self Service & Automation<br />X<br />HA<br />Policy based Control<br />X<br />X<br />HA<br />HA<br />HA<br />HA<br />HA<br />VMware vSphere<br /><ul><li>Dedicated hardware with unchanging resources
Lowers OPEX and better service level</li></li></ul><li>vFabric Data Director Delivers…<br />
Meet Data Challenges for the Cloud Era<br />Elastic scalability/Low-latency<br />How do I architect my data tier for highly variable application usage? My app has 10,000 users on a normal day but 10,000,000 on Mother’s Day.<br />Multi-Site / Multi-Cloud<br />How do I distribute data efficiently to my compute clouds? I have applications and users in multiple places that need access to the same data in real-time.<br />Data-Centric Computing<br />How do I process these large quantities of data in an efficient manner to allow for better real-time decision-making?<br />
vFabricGemfire and SQLfire<br />Memory-oriented database with elastic scalability and lightning-fast performance <br />Client<br />Client<br />Client<br />*Fire Node<br />*Fire Node<br />*Fire Node<br />WAN<br />Object interface: GemFire<br />SQL interface: SQLFire<br />Co-locate compute with data<br />
Elastic Scalability / Low Latency<br />Before<br />After<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />Web <br />Server<br />As load increases, virtualization allows stateless web and app tier to be rapidly scaled<br />As load increases, virtualization allows stateless web and app tier to be rapidly scaled<br />App <br />Server<br />App<br />Server<br />App <br />Server<br />App <br />Server<br />App<br />Server<br />App <br />Server<br />Pushing data into memory<br /><ul><li>Reduces databases required
Allows for linear application scalability</li></ul>In-Memory tier<br />But stateful Database tier must be over-provisioned in advanced – and sit idle<br />