V fabric overview


Published on

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

V fabric overview

  1. 1. vFabric | Cloud Application PlatformPronam Chatterjeepronamc@vmware.comtwitter:pronamc © 2011 VMware Inc. All rights reserved
  2. 2. VMware Solutions for Cloud Computing End User Computing vFabric vCloud Infrastructure2 2
  3. 3. VMware vFabric Cloud Application PlatformvFabricThe ideal applicationplatform environment torun and manage yourcustom, Java applications– in the datacenter,virtualized environment, orthe cloud. Messaging Data Management 3
  4. 4. Use Case: App Intelligence for “Just-in-Time” InfrastructureHotel room promotion Hotel room comes online Users are booking rooms promotion ends Traffic PST 8 am 9 am 10 am 11 am 12 pm 1 pm 2 pm 3 pm 4 pm 5 pm Policy-based Capacity 4
  5. 5. New Applications Need To Be Portable vCloud partners Private Cloud Hybrid Cloud vFabric vFabric Your Java vSphere vSphere Spring App “In partnership with VMware, we are bringing Spring to Force.com.” Build your application “With VMware, we are making it easySelect the runtime platform for developers to create Spring Java apps in the cloud.” Deploy your application The industry’s first open PaaS 5
  6. 6. VMware Cloud Application Platform for Spring/Java Apps Programming Rich Social and Data Integration Batch Spring WaveMaker Code2Cloud Model Web Mobile Access Patterns Framework Tool Suite Services Java Runtime Web Runtime Messaging Global Data In-mem SQL App Monitoring Performance Mgmt (tc Server) (ERS) (RabbitMQ) (GemFire) (ElasticSQL) (Spring Insight) (Hyperic) Java Automated Optimizations Virtual Datacenter App Provisioning (EM4J, …) (AppDirector) Cloud Infrastructure and Management6
  7. 7. Operational Control: tc Server Spring Edition vFabric tc Server7
  8. 8. STS - Developer Efficiency SpringSource Tool Suite Spring Roo Grails Spring Java (Core, Rich Web, Integration) Groovy tc Server (Spring Insight) §  Agile Development - Integrated Testing •  Tight integration with tc Server minimizes application redeploys/restarts •  Links performance issues to code traces highlighted in Spring Insight §  Supports flexible deployment targets •  tc Server, Java EE servers, VMware, Cloud, etc.8
  9. 9. Tomcat is a Proven Standard WebLogic 26% Spring Applications JBoss 38% WebSphere 43%Apache Tomcat 68% 0% 10% 20% 30% 40% 50% 60% 70% Java Application Server Usage, Source: 2008 Evans Data Survey “ The adoption of Tomcat reflects the Java developers preference for lighter, simpler technologies ”9
  10. 10. tc Server Fills the Gap10
  11. 11. Developer Efficiency: Deep Performance Insight into Spring Apps11
  12. 12. Developer Efficiency: Deep Performance Insight into Spring Apps12
  13. 13. Monitor: VM, OS, JVM, tcRuntime Container… " Monitor Application Server Status, Health, and Response Times " Availability, Session Count, Throughput, Utilization, Connection & Thread Pool Health, Deadlock Detection, Garbage Collection13
  14. 14. vFabric EM4J (Elastic Memory for Java)Use ESX to Share Memory Between VMs Running Java Description Benefits •  Use virtualization to •  Higher consolidation through memory over-commit for overcome the Java workloads limitation of Java’s •  Protect Java applications against workload spikes static heap without wasting memory •  New ‘memory balloon’ •  Lets you give Java more memory than it needs under runs inside JVM to normal load. Memory your application doesn’t need is capture unused returned to ESX but remains available in case it is memory and return it needed to avoid Java out-of-memory errors to ESX •  Memory returned to JVM when it is under pressure14
  15. 15. Lightweight Application Platform Harmonizes Lifecycle App Developer App Operator Create Apps Quickly Meet Business Goals Applications Spring tc Server Build Run Manage“ Setting up the infrastructure for an application used to take days. With “ Everything we did in Tomcat works the same way in tc Server, plus we Spring, we can do it in two hours. - Sahana Hussein Visa Europe ” have the additional advantages. ” - Jeffrey Hickman Arizona State Retirement System15
  16. 16. Deployment Flexibility: Distribute or Combine tc Server tc Server tc Server Instance 1 Instance m ... Instance X Spring Spring Spring Spring Spring tc Server ver X (shared binaries) ... tc Server ver Y (shared binaries) Operating System & JVM16
  17. 17. Breaking free of the RDBMS bottleneck Data Management17
  18. 18. Scaling the Tiers The web and application tiers can be easily combined and virtualized. Nodes can be added or Load Balancer Add/remove web/ removed on the fly. application servers Web Tier Application Tier The database only grows by moving the VM to a larger Database Tier machineThe disk systems can bevirtualized and can grow on Storage Tierdemand18
  19. 19. Linear Scalability GemFire can achieve near linear scalability with nodes that can be added or removed on the fly. Scale Add/remove web/ application/data servers Disks may be direct or network attached Web, Application and Data tiers can be collapsed into aOptional reliable, asynchronous feed to Data Warehouse or single virtual machine. Archival Database 19
  20. 20. What is GemFire? Database •  Storage •  High Availability = •  Persistence •  Load Balancing •  Transactions •  Data Replication •  Queries •  L1 Caching + Messaging System + Service Bus •  Data Distribution •  System Integration •  Event Propagation •  Data Transformation •  Guaranteed Delivery •  Service Loose Coupling + Grid Controller + Complex Event Processor •  Task Decomposition •  Business Event Detection •  Distributed Task Assignment •  Real-time Analysis •  Map-Reduce, Scatter-Gather •  Event Driven Architectures •  Result Summarization GemFire combines select features from all of these products and combines them into a low-latency, linearly scalable, memory-based data fabric 20
  21. 21. Memory-based Performance GemFire uses memory on a peer machine to make data updates Perform durable, allowing the updating thread to return 10x to 100x faster than updates that must be written through to disk, without risking any data loss. Typical latencies are in the few hundreds of microseconds instead of in the tens to hundreds of milliseconds. GemFire can optionally write updates to disk, or to a data warehouse, asynchronously and reliably.21
  22. 22. Data-Aware Function Routing Data Aware Function Execute Batch Controller or Client Scatter-Gather (Map-Reduce) Function GemFire provides ‘data aware function routing’ – moving the behavior to the correct data instead of moving the data to the behavior.22
  23. 23. Data Distribution DistributeGemFire can keep clusters that are distributed around the world synchronized in real-time and can operate reliably in Disconnected, Intermittent and Low-Bandwidth networkenvironments.23
  24. 24. GemFire virtualizes the database into the application tier Cloud Ready Add/remove web/ application/data servers Add/remove disk GemFire server is a small Java jar file that can be easily deployed with Java applications. Optional reliable, asynchronous feed to Data Warehouse or Archival Database24
  25. 25. vFabric SQLFire Data Management25
  26. 26. vFabric SQLFire: Scalability at the Data Tier§  Speed: In-memory, distributed SQL database.§  Scale: More scalable design than traditional RDBMS.§  SQL: Familiar SQL interface, accessible from Java and C#.26
  27. 27. vFabric SQLFire: Speed Through In-Memory Design 1Writes are 2Later asynchronously synchronously persisted across persisted to disk two servers SQLFire Database 27
  28. 28. vFabric SQLFire: Dynamic Scalability 3Remove nodes 1Add new nodes when load returnsany time load spikes. to normal SQLFire Database 2Data is automatically rebalanced to new nodes. 28
  29. 29. vFabric SQLFire: A Real SQL Interface §  SQLFire syntax is based on the SQL-92 standard. §  SQLFire extensions are to Data Definition Language (DDL) only, e.g. CREATE TABLE. §  DML 100% standards compatible. §  JDBC and ADO.NET drivers. •  Built-in, transparent high availability. §  Easily accessible via Spring Data 29
  30. 30. Breaking free of the RDBMS bottleneck vFabric data director Powering Database-as-a-Service for Your Cloud30
  31. 31. Data Problems Addressed by Cloud Database Sprawl Long Lead Time DB Tuning for VirtualizationCorporate IT Shadow IT Database Lead time of provision or weeks clone request Server & Storage Database Implementation Provisioning & Tuning•  Thousands of under-managed and •  Database operations not fully •  Database not designed for under-secured databases automated virtualized environments with •  Long lead time for database dynamic resources•  Difficult to enforce policy and compliance services for developers •  DBA tunes databases to specific setup 31
  32. 32. vFabric Data Director• Powers database-as-a-service across private and public App App App App App App App App clouds vFabric Data Director Graphical User Interface/API• Self-service database virtualization platform for Self-service IT Control vSphere-Optimized traditional and new databases• First database enabled is PostgreSQL database with optimization for vSphere VMware vSphere 5• Built on vSphere platform -- extends virtualization benefits to database layer32
  33. 33. vFabric Postgres§  First database enabled on vFabric Data Director§  Based on PostgreSQL 9.0 •  Fully ACID compliant, ansi-SQL compliant relational database •  Proven architecture known for reliability and wildly used across industries§  Added vSphere-Optimization include •  Elastic database memory •  Self-tuning and automatic configuration •  Database-aware high availability•  Live on cloudfoundry.com on 8/29•  Soon to be included in Micro Cloud Foundry33
  34. 34. vFabric rabbitMQAn enterprise messagesolution is critical to today’sbusinesses. MessagingThat Just Works Messaging34
  35. 35. Customers love RabbitMQ – banking, web, social media, ...Estimate 300-500 in production, 20,000 in dev35 vfabric.co/rabbitmq
  36. 36. RabbitMQ  and  AMQP:  technical  overview   Consumers create queues; these buffer messages for push to consumers Queues are stateful, ordered, and can be persistent, transient, private, shared. Exchanges are stateless routing tables. Consumers tell queues to bind to named exchanges; each binding has a pattern e.g. “tony” or “*.ibm.*” Producers send messages to exchanges with a routing key e.g. “tony”, or ordered set of keys e.g. “buy.ibm.nyse” Exchanges route messages to queues whose binding pattern matches the message routing key or keys36 vfabric.co/rabbitmq
  37. 37. UID – a lifetime digital identity for 1.2bn India residents37 vfabric.co/rabbitmq
  38. 38. Breaking free of the RDBMS bottleneck vFabric App Director Powering Database-as-a-Service for Your Cloud38
  39. 39. What is vFabric Application Director 1.0?§  vFabric Application Director automates application deployments on hybrid clouds, specifically on VCD 1.5 Applications Custom  or  Packaged   App  binaries,  config   .war,  .jar,  .tar,  .zip  etc   Application Stack Middleware,  OS   App  servers,    messaging,  web   servers,  databases,    opera7ng   systems,  load  balancers,  etc   vCloud Director 1.539
  40. 40. vFabric Application Director – “Model-driven” cloud-ready App provisioning Application Blueprint Logical Application Topology with Application Binaries Application Policies, Configurations Pre-instrumented with App Monitoring Application Stack - (Middleware, OS) Architect Deployment Deployment Deployment Collection of deployment settings Profile Profile Profile Makes blueprints portable across clouds (dev) (test) (prod) App Dev, QA, Release Standardized configurations of OS, Middleware Automated Deployment Plans with Orchestration Catalog Deployment Environments Dev Org VDC Test Org VDC Prod Org VDC Middleware AdminCloud Admin 40
  41. 41. vFabric Application Director Application Blueprint Application Binaries Application Stack - (Middleware, OS) Architect Deployment Deployment Deployment Profile Profile Profile Simplified (dev) (test) (prod) Standardized App Dev, QA, Release Cloud-Ready Automated Deployment Plans with Orchestration Extensible Deployment Environments Dev Org VDC Test Org VDC Prod Org VDCCloud Admin 41
  42. 42. VMware’s Active Application Management strategy for IaaSIntegrate with Application Performance Management (vFabric APM) for pre-instrumented monitoring & scaling of deployed apps App Provisioning App Performance Collaborate Monitoring Add Policy Capacity Deploy Monitor Components, Optimize Resources, Topology, resource Isolate, trouble Topology compliancy, allocation, Update Reboot shoot, remediate, transactions, users, environment change change impact binding . Burst Scale Policy compute42
  43. 43. Application Director provisions vFabric and third party components 43
  44. 44. NPC International vFabric Helps NPC International Stay Connected to 1,200 Locations “ Application performance is considerably faster since we moved from JBoss to vFabric … We have been very happy with the performance – it is fantastic.” Jon Brisbin, Portal Webmaster, NPC International Challenge Solution ResultsApplication not performing well on JBoss Replaced JBoss Application Severs with Enhanced Application Performancecausing downtime; load often exceeded VMware vFabric planned capacity Server Costs Reduced by 75% vFabric instances running on VMwareApplication experienced regular lockups ESX Server-based private cloud High Availability every time JBoss received out of infrastructure memory errors causing server restarts Greater Scalability Since all web applications built inCostly downtime and other performance Spring, transition to vFabric was Virtual Private Cloud Infrastructure issues caused problems for users and seamless required substantial attention from Increased Developer Productivity development team 44
  45. 45. Use Case - ForEx real-life use case: Global Foreign Exchange Trading SystemThe project achieved:Ø Low-latency trade insertionØ Permanent Archival of every tradeØ Kept pace with fast ticking market dataØ Rapid, Event Based Position CalculationØ Distribution of Position Updates GloballyØ Consistent Global Views of PositionsØ Pass the BookØ Regional Close-of-dayØ High AvailabilityØ Disaster RecoveryØ Regional Autonomy45