Master VMware Performance and Capacity ManagementIwan Rahabok
12 Sep 2016 update: See this http://virtual-red-dot.info/operationalize-sddc-program-2/ for details.
-------------
Based on the book http://virtual-red-dot.info/performance-and-capacity-management/
Master performance and capacity management of VMware SDDC
VMworld 2013: Protection for All - VMware vSphere Replication & SRM Technical...VMworld
VMworld 2013
Lee Dilworth, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Ken Werneburg, VMware
VMworld 2013: VMware vCenter Site Recovery Manager – Solution Overview and Le...VMworld
VMworld 2013
Mauricio Barra, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Thomas McQuillan, UnitedHealth Group
VMworld 2013: VMware vSphere Replication: Technical Walk-Through with Enginee...VMworld
VMworld 2013
Jeff Hunter, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Vahid Fereydouny, VMware
What’s New in VMware vCenter Site Recovery Manager v5.0Eric Sloof
Summary of SRM v5.0 New Features
New user interface
Planned migration – with replication update
Failback
vSphere Replication
Faster IP customization
Shadow VM icons
In guest scripts
VM dependency
Master VMware Performance and Capacity ManagementIwan Rahabok
12 Sep 2016 update: See this http://virtual-red-dot.info/operationalize-sddc-program-2/ for details.
-------------
Based on the book http://virtual-red-dot.info/performance-and-capacity-management/
Master performance and capacity management of VMware SDDC
VMworld 2013: Protection for All - VMware vSphere Replication & SRM Technical...VMworld
VMworld 2013
Lee Dilworth, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Ken Werneburg, VMware
VMworld 2013: VMware vCenter Site Recovery Manager – Solution Overview and Le...VMworld
VMworld 2013
Mauricio Barra, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Thomas McQuillan, UnitedHealth Group
VMworld 2013: VMware vSphere Replication: Technical Walk-Through with Enginee...VMworld
VMworld 2013
Jeff Hunter, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Vahid Fereydouny, VMware
What’s New in VMware vCenter Site Recovery Manager v5.0Eric Sloof
Summary of SRM v5.0 New Features
New user interface
Planned migration – with replication update
Failback
vSphere Replication
Faster IP customization
Shadow VM icons
In guest scripts
VM dependency
VMware Site Recovery Manager - Architecting a DR Solution - Best Practicesthephuck
This was the slide deck from the Philadelphia VMUG User Conference for the VMware Site Recovery Manager - Architecting a DR Solution session on May 15th, 2014.
Always On - Wydajność i bezpieczeństwo naszych danych - High Availability SQL...SQLExpert.pl
SQL Server 2012 udostępnia zupełnie nowe spojrzenie na zagadnienia związanie z Wysoką dostępnością (High Avability). Najbardziej oczekiwaną nową funkcjonalnością jest AlwaysOn.
W trakcie sesji chcemy pokazać praktyczne zastosowanie AlwaysOn, odpowiadając na pytania:
• Co daje AlwaysOn czego nie było do tej pory
• W jakim stopniu AlwaysOn może zastąpić mirroring oraz logshiping
• Jak zbudować High Avability na potrzeby naszej organizacji
• Jak efektywnie skorzystać z wielu replik danych.
• Czym jest AlwaysOn Failover Cluster
W ramach sesji przedstawiona będzie koncepcja budowy rozwiązania spełniające oczekiwania w zakresie High Avability, dotyczące wydajności jak i bezpieczeństwa naszych danych, a także zgodne z potrzebami Distaster Recovery.
Sql Server High Availability & DR TechnologiesRockSolid SQL
There are many different disaster recovery and high availability options for SQL Server. Making decisions on the most effective DR & HA strategies can be complex, especially when you throw into the mix various SAN and network topologies.
This presentation is focused on the management and operational decisions that are made when planning DR and HA for production SQL Server environments. It is targeted towards Senior DBAs, CIO, IT Manager, database services managers.
Topics include:
Log Shipping
Database Mirroring
Always On High Availability groups
Replication
Clustering
Licensing
vCenter Site Recovery Manager: Architecting a DR SolutionRackspace
VMware’s vCenter Site Recovery Manager is the market-leading disaster-recovery management product. It ensures the simplest and most reliable disaster protection for all virtualized applications. However, it is not a turn-key DR solution. Architecting your SRM solution requires deep thought and heavy planning. This presentation will help you with planning and architecting your SRM solution as well as addressing specific configuration and installation challenges. Our goal is to help you deploy and maintain a solid SRM solution to enable your DR Plan.
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...VMworld
VMworld 2013
Kannan Mani, VMware
Brad Pinkston, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Virtualization performance: VMware vSphere 5 vs. Red Hat Enterprise Virtualiz...Principled Technologies
Using a hypervisor that offers better resource management and scalability can deliver excellent virtual machine performance on your servers. In our testing, VMware vSphere 5 allowed our host’s virtual machines to outperform those running on RHEV 3 by over 28 percent in total OPM performance. Furthermore, VMware vSphere 5 performance continued to improve when going from 39 VMs to 42 VMs: Total performance for VMware vSphere 5 increased by 2.8 percent, whereas it decreased by 7.2 percent with RHEV 3.
With the capabilities and scalability that VMware vSphere 5 offers, you are able to utilize the full capacity of your servers with confidence and purchase fewer servers to handle workload spikes; this can translate to fewer racks in the data center, lower costs for your business, and more consistent overall application performance.
Metro Cluster High Availability or SRM Disaster Recovery?David Pasek
Presentation explains the difference between multi site high availability (aka metro cluster) and disaster recovery. General concepts are similar for any products but presentation is more tailored for VMware technologies.
A basic overlook for some configurations when running SQL Server, SSRS and SSAS. Some configurations are also when the services are ran on the same stand alone server. There are also basic hardware considerations.
As opposed to databases for which established benchmarks have been driving the advancement of the field since a long time, workflow engines still lack a well-accepted benchmark that allows to give a fair comparison of their performance. In this talk we discuss the reasons and propose how to address the main challenges related to benchmarking these complex middleware systems at the core of business process automation and service composition solutions. In particular, we look at how to generate a representative workload and how to define suitable performance metrics. You will learn how to use our framework to measure the performance and resource consumption of your BPMN engine and compare different configurations to tune its performance in your concrete real-life project. The talk will also present preliminary experimental results obtained while benchmarking popular open source engines.
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld
VMworld 2013
Mark Achtemichuk, VMware
Michael Webster, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
VMware Site Recovery Manager - Architecting a DR Solution - Best Practicesthephuck
This was the slide deck from the Philadelphia VMUG User Conference for the VMware Site Recovery Manager - Architecting a DR Solution session on May 15th, 2014.
Always On - Wydajność i bezpieczeństwo naszych danych - High Availability SQL...SQLExpert.pl
SQL Server 2012 udostępnia zupełnie nowe spojrzenie na zagadnienia związanie z Wysoką dostępnością (High Avability). Najbardziej oczekiwaną nową funkcjonalnością jest AlwaysOn.
W trakcie sesji chcemy pokazać praktyczne zastosowanie AlwaysOn, odpowiadając na pytania:
• Co daje AlwaysOn czego nie było do tej pory
• W jakim stopniu AlwaysOn może zastąpić mirroring oraz logshiping
• Jak zbudować High Avability na potrzeby naszej organizacji
• Jak efektywnie skorzystać z wielu replik danych.
• Czym jest AlwaysOn Failover Cluster
W ramach sesji przedstawiona będzie koncepcja budowy rozwiązania spełniające oczekiwania w zakresie High Avability, dotyczące wydajności jak i bezpieczeństwa naszych danych, a także zgodne z potrzebami Distaster Recovery.
Sql Server High Availability & DR TechnologiesRockSolid SQL
There are many different disaster recovery and high availability options for SQL Server. Making decisions on the most effective DR & HA strategies can be complex, especially when you throw into the mix various SAN and network topologies.
This presentation is focused on the management and operational decisions that are made when planning DR and HA for production SQL Server environments. It is targeted towards Senior DBAs, CIO, IT Manager, database services managers.
Topics include:
Log Shipping
Database Mirroring
Always On High Availability groups
Replication
Clustering
Licensing
vCenter Site Recovery Manager: Architecting a DR SolutionRackspace
VMware’s vCenter Site Recovery Manager is the market-leading disaster-recovery management product. It ensures the simplest and most reliable disaster protection for all virtualized applications. However, it is not a turn-key DR solution. Architecting your SRM solution requires deep thought and heavy planning. This presentation will help you with planning and architecting your SRM solution as well as addressing specific configuration and installation challenges. Our goal is to help you deploy and maintain a solid SRM solution to enable your DR Plan.
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...VMworld
VMworld 2013
Kannan Mani, VMware
Brad Pinkston, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Virtualization performance: VMware vSphere 5 vs. Red Hat Enterprise Virtualiz...Principled Technologies
Using a hypervisor that offers better resource management and scalability can deliver excellent virtual machine performance on your servers. In our testing, VMware vSphere 5 allowed our host’s virtual machines to outperform those running on RHEV 3 by over 28 percent in total OPM performance. Furthermore, VMware vSphere 5 performance continued to improve when going from 39 VMs to 42 VMs: Total performance for VMware vSphere 5 increased by 2.8 percent, whereas it decreased by 7.2 percent with RHEV 3.
With the capabilities and scalability that VMware vSphere 5 offers, you are able to utilize the full capacity of your servers with confidence and purchase fewer servers to handle workload spikes; this can translate to fewer racks in the data center, lower costs for your business, and more consistent overall application performance.
Metro Cluster High Availability or SRM Disaster Recovery?David Pasek
Presentation explains the difference between multi site high availability (aka metro cluster) and disaster recovery. General concepts are similar for any products but presentation is more tailored for VMware technologies.
A basic overlook for some configurations when running SQL Server, SSRS and SSAS. Some configurations are also when the services are ran on the same stand alone server. There are also basic hardware considerations.
As opposed to databases for which established benchmarks have been driving the advancement of the field since a long time, workflow engines still lack a well-accepted benchmark that allows to give a fair comparison of their performance. In this talk we discuss the reasons and propose how to address the main challenges related to benchmarking these complex middleware systems at the core of business process automation and service composition solutions. In particular, we look at how to generate a representative workload and how to define suitable performance metrics. You will learn how to use our framework to measure the performance and resource consumption of your BPMN engine and compare different configurations to tune its performance in your concrete real-life project. The talk will also present preliminary experimental results obtained while benchmarking popular open source engines.
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld
VMworld 2013
Mark Achtemichuk, VMware
Michael Webster, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
WSO2 Customer Webinar: WEST Interactive’s Deployment Approach and DevOps Prac...WSO2
To view recording please use below URL:
http://wso2.com/library/webinars/2016/06/west-interactives-deployment-approach-and-devops-practices/
For nearly 30 years West Interactive Services has been creating communication solutions that empower enterprises worldwide to strengthen customer engagement. As a customer of WSO2 since 2012, WEST has built solutions using WSO2 API Manager, WSO2 Business Activity Monitor (WSO2 BAM), WSO2 Enterprise Service Bus (WSO2 ESB), WSO2 Data Services Server (WSO2 DSS), WSO2 Application Server and WSO2 Identity Server which facilitate nearly 300 million unique customer interactions each month.
The most recent deployment with WSO2 allows WEST interactive to expose client connections, data sources and application logic through a common protocol and messaging architecture. This is achieved using a combination of WSO2 API Manager, WSO2 ESB, WSO2 DSS, WSO2 Application Server and WSO2 Message Broker. This webinar will discuss the DevOps related theories and practices that have been followed by WEST during the process of designing, building and maintaining this part of the solution. These will address the following areas:
Design process of the solution
Deployment and production hardening practices
Runtime artifacts and lifecycle management
DevOps, virtualization and automation
Troubleshooting and debugging practices
Veritas NetBackup benchmark comparison: Data protection in a large-scale virt...Principled Technologies
In an enterprise environment, a data center VM footprint can grow quickly; large-scale deployments of thousands of virtual machines are becoming increasingly common. Risk of failure grows proportionally to the number of systems deployed and critical failures are unavoidable. Your ability to offer data protection from a backup solution is critical to business continuity. Elongated, inefficient protection windows can create resource contention with production environments, therefore, it is critical to execute system backup in a finite window of time.
The Veritas NetBackup Integrated Appliance running NetBackup 7.6 offered application protection to 1,000 VMs in 80.3 percent less time in SAN testing and used NetApp array-based snapshots to create recovery points in 93.8 percent less time than Competitor “C.” In addition, the Veritas NetBackup Integrated Appliance with NetBackup 7.6 created backup images that offered granular recovery without additional steps and in a backup window 69.0 percent shorter than the backup window needed for Competitor “C.” These time savings can scale as your VM footprint grows, allowing you to execute both system protection and user-friendly, simplified recovery.
VMware vSphere vMotion: 5.4 times faster than Hyper-V Live MigrationVMware
Businesses using a virtualized infrastructure have many reasons to move active virtual machines (VMs) from one physical server to another. Whether the migrations are for routine maintenance, balancing performance needs, work distribution (consolidating VMs onto fewer servers during non-peak hours to conserve resources), or another reason, the best virtual infrastructure platform executes the move as quickly as possible and with minimal impact to end users.
We tested two competing features that move active VMs from one server to another, VMware vSphere 5 vMotion and Microsoft® Windows Server® 2008 R2 SP1 Hyper-V Live Migration. While both perform these moves with no VM downtime, in our testing the VMware solution did so faster, with greater application stability, and with less impact to application performance – clearly showing that not all live migration technologies are the same. VMware also holds an enormous advantage in concurrency: VMware vSphere 5 can move eight VMs at a time while a Microsoft Hyper-V cluster node can take part only as the source or destination in one live migration at a time. In our two test scenarios, the VMware vMotion solution was up to 5.4 times faster than the Microsoft Hyper-V Live Migration solution.
WebSphere App Server vs JBoss vs WebLogic vs Tomcat (InterConnect 2016)Roman Kharkovski
Presented at InterConnect 2016 in Las Vegas, this presentation provides a view on the differences between WebSphere Application Server and Liberty Profile vs. competitive offerings, such as Apache Tomcat, Red Hat JBoss and Oracle WebLogic. It covers both the technical (feature/function) as well as cost considerations (TCA, TCO).
WebSphere Technical University: Top WebSphere Problem Determination FeaturesChris Bailey
Problem determination is an important focus area in the IBM WebSphere Application Server. Serviceability improvements have been added that have greatly improved the ability to find root causes of problems in both the full IBM WebSphere Application Server profile, and the newer Liberty profile. The session focuses on how to effectively use serviceability improvements added to the application server since V8.0. This includes high performance extensibe logging, cross-component trace, IBM Support Assistant data collector, timed operations, memory leak detection/prevention, and IBM Support Assistant 5.
Presented at the WebSphere Technical University 2014, Dusseldorf
VMworld 2015: Monitoring and Managing Applications with vRealize Operations 6...VMworld
This year VMware vSphere 6 combined with vRealize Operations 6.1 (vR Ops 6) adds critical features to increase technical agility in the infrastructure, and reduce Mean time to Repair. With a new Automated remediation action framework in vR Ops, vSphere 6’s ability to vMotion Physical Raw Device mappings (RDMs), and a complete Management Pack Ecosystem for monitoring Infrastructure to applications, administrators have the tools needed to get to maintain 5 9’s uptime, shorten Mean Time to Repair (MTTR), and predict capacity requirements as and when the business requires.. This session will be a deep technical explanation, and live demonstration of these tools. It will give administrators a solid understanding of how they can use these tools to monitor and manage their application clusters, keep applications running during Infrastructure maintenance, and get deep holistic visibility into the entire Application ecosystem, from Storage to Networking.
VMworld 2015: Advanced SQL Server on vSphereVMworld
Microsoft SQL Server is one of the most widely deployed “apps” in the market today and is used as the database layer for a myriad of applications, ranging from departmental content repositories to large enterprise OLTP systems. Typical SQL Server workloads are somewhat trivial to virtualize; however, business critical SQL Servers require careful planning to satisfy performance, high availability, and disaster recovery requirements. It is the design of these business critical databases that will be the focus of this breakout session. You will learn how build high-performance SQL Server virtual machines through proper resource allocation, database file management, and use of all-flash storage like XtremIO. You will also learn how to protect these critical systems using a combination of SQL Server and vSphere high availability features. For example, did you know you can vMotion shared-disk Windows Failover Cluster nodes? You can in vSphere 6! Finally, you will learn techniques for rapid deployment, backup, and recovery of SQL Server virtual machines using an all-flash array.
VMworld 2015: Virtualize Active Directory, the Right Way!VMworld
Active Directory Domain Services (ADDS) allows organizations to deploy a scalable and secure directory service for managing users, resources and applications. Virtualization of ADDS has been supported for many years now, however has required careful management to avoid pitfalls around replication, time management, and access. Windows Server 2012 provides greater support for virtualization by including virtualization-safe features and support for rapid domain controller deployment.
VMworld 2015: Site Recovery Manager and Policy Based DR Deep Dive with Engine...VMworld
Policy based management greatly simplifies the work of IT Administrators making it easy to ensure that applications and VMs receive the resources, protection and functionality required. Learn about the latest enhancements of Site Recovery Manager in this space, which represent a huge step towards providing policy based DR. In this session we'll dive deep into how this approach works and how to work with them.
Not content to simply describe the Virtual Volume (VVOL) framework, this session instead examines practical use cases: How different configurations and workloads benefit from VVOLs. Learn how Storage Policy Based Management (SPBM) couples with VVOLs to provide VM configuration options not previously available. We demonstrate a handful of real-life scenarios, specifically covering how VVOLs benefits oversubscribed systems, disaster recovery preparation and multi-tenant requirements for customers. Specific configuration options and constraints are covered in detail, including how they work with underlying storage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
2. 2
About the Speaker
I have been with VMware for the last 8 years, working on Java
and vSphere
20 years experience as a Software Engineer/Architect, with last 15
years focused on Java development
Open source contributions
Prior work with Cisco, Oracle, and Banking/Trading Systems
Authored the following books:
• Virtualizing and Tuning Large Scale Java Platforms
• Enterprise Java Applications Architecture on VMware
3. 3
Disclaimer
This session may contain product features that are
currently under development.
This session/overview of the new technology represents
no commitment from VMware to deliver these features in
any generally available product.
Features are subject to change, and must not be included in
contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new technologies or features
discussed or presented have not been determined.
4. 4
Agenda
Overview
Design and Sizing Java Platforms
Performance
Best Practices and Tuning
Customer Success Stories
Questions
6. 6
Conventional Java Platforms
Java Platforms are multitier and multi org
DB ServersJava Applications
Load Balancer Tier
Load Balancers Web Servers
IT Operations
Network Team
IT Operations
Server Team
IT Apps – Java
Dev Team
IT Ops & Apps
Dev Team
Organizational Key Stakeholder Departments
Web Server Tier Java App Tier DB Server Tier
7. 7
Middleware Platform Architecture on vSphere
SHARED,ALWAYS-ON
INFRASTRUCTURE
SHAREDINFRASTRUCTURESERVICES
Capacity On Demand High AvailabilityDynamic
APPLICATIONSERVICES
DBServersJavaApplicationsLoadbalancers WebServers
VMwarevSphere
HighUptime, Scalable, and DynamicEnterprise JavaApplicationsLoad Balancers as VMs
Web Servers
Java Application Servers
9. 9
Design and Sizing of Java Platforms on vSphere
Step 1 –
EstablishLoad profile
From production
logs/monitoring
reports measure:
Concurrent
Users
Requests Per
Second
Peak
ResponseTime
Average
ResponseTime
Establishyour
response time SLA
Step 2
EstablishBenchmark
Iterate through
Benchmark test until
youare satisfied with
the Load profile
metrics and your
intendedSLA
after each
benchmarkiteration
youmay have to
adjustthe Application
Configuration
Adjust the vSphere
environmentto scale
out/upin order to
achieveyour desired
number of VMs,
number of vCPU and
RAM configurations
Step 3 –
Size Production Env.
The size of the
production
environmentwould
havebeen
establishedin
Step2, hence either
you roll out the
environmentfrom
Step-2 or build a
new one based on
the numbers
established
10. 10
Step 2 – Establish Benchmark
DETERMINE HOW MANY VMs
Establish Horizontal Scalability
Scale Out Test
How many VMs do you need to
meet your Response Time SLAs
without reaching 70%-80%
saturation of CPU?
Establish your Horizontal scalability
Factor before bottleneck appear in
your application
Scale Out Test
Building Block VM Building Block VM
SLA
OK?
Test
complete
Investigate bottlnecked layer
Network, Storage,
Application Configuration, &
vSphere
If scale out
bottlenecked
layer is
removed, iterate
scale out test
If building block
app/VM config
problem, adjust
& iterate No
Building Block VM
ESTABLISH BUILDING BLOCK VM
Establish Vertical scalability
Scale Up Test
Establish how many JVMs on a VM?
Establish how large a VM would be
in terms of vCPU and memory
ScaleUpTest
Building Block VM
11. 11
Design and Sizing HotSpot JVMs on vSphere
JVM
Max
Heap
-Xmx
JVM
Memory
Perm Gen
Initial
Heap
Guest OS
Memory
VM
Memory
-Xms
Java Stack
-Xss per thread
-XX:MaxPermSize
Other mem
Direct native
Memory
“off-the-heap”
Non
Direct
Memory
“Heap”
12. 12
Design and Sizing of HotSpot JVMs on vSphere
Guest OS Memory approx 1G (depends on OS/other processes)
Perm Size is an area additional to the –Xmx (Max Heap) value and
is not GC-ed because it contains class-level information.
“other mem” is additional mem required for NIO buffers, JIT code
cache, classloaders, Socket Buffers (receive/send), JNI, GC
internal info
If you have multiple JVMs (N JVMs) on a VM then:
• VM Memory = Guest OS memory + N * JVM Memory
VM Memory = Guest OS Memory + JVM Memory
JVM Memory = JVM Max Heap (-Xmx value) + JVM Perm Size (-XX:MaxPermSize) +
NumberOfConcurrentThreads * (-Xss) + “other Mem”
13. 13
Sizing Example
JVM Max
Heap
-Xmx
(4096m)
JVM
Memory
(4588m) Perm Gen
Initial
Heap
Guest OS
Memory
VM
Memory
(5088m)
-Xms (4096m)
Java Stack -Xss per thread (256k*100)
-XX:MaxPermSize (256m)
Other mem (=217m)
500m used by OS
set mem Reservation to
5088m
14. 14
Perm Gen
Initial
Heap
Java Stack
Larger JVMs for In-Memory Data Management Systems
JVM Max
Heap
-Xmx
(30g)
Guest OS
Memory
-Xms (30g)
-Xss per thread (1M*500)
-XX:MaxPermSize (0.5g)
Other mem (=1g)
0.5-1g used by OS
Set memory reservation to
34g
JVM
Memory for
SQLFire
(32g)
VM
Memory for
SQLFire
(34g)
15. 15
NUMA Local Memory with Overhead Adjustment
Physical RAM
On vSphere host
Physical RAM
On vSphere host
Number of VMs
On vSphere host
1% RAM
overhead
vSphere RAM
overhead
Number of Sockets
On vSphere host
16. 16
Middleware ESXi Cluster
96GB RAM
2 sockets
8 pCPU per
socket
Middleware
components
47GB RAM VMs
with
8vCPU
Locator/heart beat
for middleware
DO NOT VMotion
Memory Available for all VMs =
96*0.98 -1GB => 94GB
Per NUMA memory => 94/2
47GB
17. 17
96 GB RAM
on Server
Each NUMA
Node has 94/2
47GB
8 vCPU VMs
less than
47GB RAM
on each VMESX
Scheduler
If VM is sized greater
than 47GB or 8 CPUs,
Then NUMA interleaving
Occurs and can cause
30% drop in memory
throughput performance
18. 18
1
128 GB RAM
on server
2vCPU VMs
less than
20GB RAM
on each VM
4vCPU VM
40GB RAM
split by ESXi into
2 NUMA Clients
available in ESX4.1
ESXi
Scheduler 2
3
4
5
19. 19
Java Platform Categories – Category 1
Smaller JVMs < 4GB heap,
4.5GB Java process, and 5GB
for VM
vSphere hosts with <96GB
RAM is more suitable, as by
the time you stack the many
JVM instances, you are likely
to reach CPU boundary before
you can consume all of the
RAM. For example if instead
you chose a vSphere host with
256GB RAM, then 256/4.5GB =>
57JVMs, this would clearly
reach CPU boundary
Multiple JVMs per VM
Use Resource pools to
manage different LOBs Category 1: 100s to 1000s of JVMs
Resource Pool 1
Gold LOB 1
Resource Pool 2
SilverLOB 2
Use 4 sockets servers
to get more cores
20. 20
Most Common Sizing and Configuration Question
JVM-1 JVM-2
JVM-1A
JVM-1 JVM-2 JVM-1 JVM-2
JVM-2A
JVM-3 JVM-4 Option-1 Scale out VM and JVM ( best)
Option-2 Scale Up JVM heap size (2nd best)
JVM-2JVM-1
Option-3 Scale up VM and JVM (3rd best)
2GB 2GB 2GB 2GB
2vCPU2vCPU 2vCPU 2vCPU
2vCPU2vCPU
4GB4GB
21. 21
What Else to Consider When Sizing?
Job
Web
JVM-1
Job
Web
JVM-2
Job
Web
Job
Web
JVM-3
Job
Web
JVM-4
Vertical
Horizontal
Mixed workloads Job Scheduler vs Web app require
different GC Tuning
Job Schedulers care about Throughput
Web apps care about minimize latency and response time
You can’t have both reduced response time and increased
throughput, without compromise
Separate the concerns for optimal tuning
22. 22
Java Platform Categories – Category 2
Fewer JVMs < 20
Very large JVMs, 32GB to 128GB
Always deploy 1 VM per NUMA node
and size to fit perfectly
1 JVM per VM
Choose 2 socket vSphere hosts, and
install ample memory128GB to 512GB
Example is in memory databases, like
SQLFire and GemFire
Apply latency sensitive BP disable
interrupt coalescing pNIC and vNIC
Dedicated vSphere cluster
Category 2: a dozen of very large JVMs
Use 2 sockets servers
to get larger NUMA
nodes
23. 23
Java Platform Categories – Category 3
Category 3: Category-1 accessing data from Category-2
Resource Pool 1
Gold LOB 1
Resource Pool 2
SilverLOB 2
25. 25
Performance Perspective
See the Performance of Enterprise Java Applications on VMware
vSphere 4.1 and SpringSource tc Server at
http://www.vmware.com/resources/techresources/10158 .
26. 26
Performance Perspective
See the Performance of Enterprise Java Applications on VMware
vSphere 4.1 and SpringSource tc Server at
http://www.vmware.com/resources/techresources/10158 .
80% Threshold
% CPU
R/T
27. 27
SQLFire vs. Traditional RDBMS
SQLFire scaled 4x compared to RDBMS
Response times of SQLFire are 5x to 30x
faster than RDBMS
Response times on SQLFire are more
stable and constant with increased load
RDBMS response times increase with
increased load
28. 28
Load Testing SpringTrader Using Client-Server Topology
SpringTrader
Integration Services
Application Tier SpringTrader
Application Service
SQLFire
Member 2
Redundant
Locators
SpringTrader Data Tier
SQLFire
Member1
Integration
Patterns
4 Application Services
29. 29
vFabric Reference Architecture Scalability Test
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
4.00
0
2000
4000
6000
8000
10000
12000
1 2 3 4
Scalingfrom1AppServicesVM
NumberofUsers
Number of Application Services VMs
Maximum Passing Users and Scaling
With this topology
10400 users session
30. 30
10k Users Load Test Response Time
0
1
2
3
4
5
6
7
0 2000 4000 6000 8000 10000 12000
Seconds
Number of Users
Operation 90th-Percentile Response-Time
Four Application Services VMs
HomePage Register Login DashboardTab PortfolioTab
TradeTab GetHoldingsPage GetOrdersPage SellOrder GetQuote
BuyOrder Logout MarketSummary
10400 users session
Approx. 0.25 seconds
response time
32. 32
Most Common VM Size for Java Workloads
2 vCPU VM with 1 JVM, for tier-1 production workloads
Maintain this ratio as you scale out or scale-up, i.e. 1 JVM : 2vCPU
Scale out preferred over Scale-up, but both can work
You can diverge from this ratio for less critical workloads
2 vCPU VM
1 JVM (-Xmx 4096m)
Approx 5GB RAM Reservation
33. 33
However for Large JVMs + CMS
For large JVMs
4+ vCPU VM
1 JVM (8-128GB)
Start with 4+ vCPU VM with 1 JVM, for
tier-1 in memory data management
systems type of production workloads
Likely increase JVM size, instead of
launching a second JVM instance
Multiple 4vCPU+ will allow for
ParallelGCThreads to be allocated 50% of
the available vCPUs to the JVM, i.e. 2 GC
Threads +
Ability to increase ParallelGCThreads is
critical to YoungGen scalability for large
JVMs
ParallelGCThreads should be allocated
50% of available vCPU to the JVM and not
more. You want to ascertain there other
vCPUs available for other txns
34. 34
Which GC?
ESX doesn’t care which GC you select, because of the degree of
independence of Java to OS and OS to Hypervisor
35. 35
GC Policy Types
GC Policy Type Description
Serial GC •Mark, sweep and compact algorithm
•Both minor and full GC are stop the world threads
•Stop the world GC means application is stopped while GC is
executing
•Not very scalable algorithm
•Suited for smaller <200MB JVMs like Client machines
Throughput
GC
•Parallel GC
•Similar to Serial GC, but uses multiple worker Threads in
parallel to increase throughput
•Both Young and Old Generation collection are multi thread, but
still stop-the-world
• number of threads allocated by -
XX:ParallelGCThreads=<nThreads>
•NOT Concurrent, meaning when the GC worker threads run,
they will pause your application threads. If this is a problem
move to CMS where GC threads are concurrent.
36. 36
GC Policy Types
GC Policy Type Description
Concurrent GC •Concurrent Mark and Sweep, no compaction
•Concurrent implies when GC is running it doesn't pause your
application threads – this is the key difference to
throughput/parallel GC
•Suited for application that care more about response time than
throughput
•CMS does use more heap when compared to
throughput/ParallelGC
•CMS works on OLD gen concurrently, but young generation is
collected using ParNewGC, a version of the throughput collector
•Has multiple phases:
• Initial mark (short pause)
• concurrent mark (no pause)
• Pre-cleaning (no pause)
• re-mark (short pause)
• Concurrent sweeping (no pause)
G1 • Only in J7 and mostly experimental, equivalent to CMS + compacting
37. 37
Tuning GC – Art Meets Science!
Either you tune for Throughput or Latency, one at the cost of the other
Increase
Throughput
Reduce
Latency Tuning
Decisions
• improved R/T
• reduce latency impact
• slightly reduced throughput
• improved throughput
• longer R/T
• increased latency impact
Job
Web
38. 38
Parallel Young Gen and CMS Old Gen
application threadsminor GC threads concurrent mark and sweep GC
Young Generation Minor GC
Parallel GC in YoungGen using
XX:ParNewGC & XX:ParallelGCThreads
-Xmn
Old Generation Major GC
Concurrent using in OldGen using
XX:+UseConcMarkSweepGC
Xmx minus Xmn
S
0
S
1
39. 39
High Level GC Tuning Recipe
Measure
Minor GC
Duration
and
Frequency
Adjust –Xmn
Young Gen size
and /or
ParallelGCThreads
Measure
Major GC
Duration
And
Frequency
Adjust
Heap space
–Xmx
Adjust –Xmn
And/or
SurvivorSpaces
Step A-Young Gen Tuning
Step B-Old Gen Tuning
Step C-
Survivor Spaces
Tuning
40. 40
CMS Collector Example
java –Xms30g –Xmx30g –Xmn10g -XX:+UseConcMarkSweepGC -XX:+UseParNewGC –
XX:CMSInitiatingOccupancyFraction=75
–XX:+UseCMSInitiatingOccupancyOnly -XX:+ScavengeBeforeFullGC
-XX:TargetSurvivorRatio=80 -XX:SurvivorRatio=8 -XX:+UseBiasedLocking
-XX:MaxTenuringThreshold=15 -XX:ParallelGCThreads=4
-XX:+UseCompressedOops -XX:+OptimizeStringConcat -XX:+UseCompressedStrings
-XX:+UseStringCache
This JVM configuration scales up and down effectively
-Xmx=-Xms, and –Xmn 33% of –Xmx
-XX:ParallelGCThreads=< minimum 2 but less than 50% of available
vCPU to the JVM. NOTE: Ideally use it for 4vCPU VMs plus, but if
used on 2vCPU VMs drop the -XX:ParallelGCThreads option and let
Java select it
41. 41
IBM JVM – GC Choice
-Xgc:mode Usage Example
-Xgcpolicy:Optthruput
(Default)
Performs the mark and sweep operations
during garbage collection when the
application is paused to maximize
application throughput. Mostly not
suitable for multi CPU machines.
Apps that demand a
high throughput but
are not very sensitive
to the occasional long
garbage collection
pause
-
Xgcpolicy:Optavgpause
Performs the mark and sweep
concurrently while the application is
running to minimize pause times; this
provides best application response times.
There is still a stop-the-world GC, but the
pause is significantly shorter. After GC,
the app threads help out and sweep
objects (concurrent sweep).
Apps sensitive to long
latencies transaction-
based systems where
Response Time are
expected to be stable
-Xgcpolicy:Gencon Treats short-lived and long-lived objects
differently to provide a combination of
lower pause times and high application
throughput.
Before the heap is filled up, each app
helps out and mark objects
(concurrent mark).
Latency sensitive
apps, objects in the
transaction don't
survive beyond the
transaction commit
Job
Web
Web
42. 42
Middleware on VMware – Best Practices
Enterprise Java
Applications on
VMware Best
Practices Guide
http://www.vmware.com/resources/techresources/1087
Best Practices for
Performance Tuning
of Latency-Sensitive
Workloads in vSphere
VMs
http://www.vmware.com/resources/techresources/10220
vFabric SQLFire Best
Practices Guide
http://www.vmware.com/resources/techresources/10327
vFabric Reference
Architecture
http://tinyurl.com/cjkvftt
43. 43
Middleware on VMware – Best Practices Summary
Follow the design and sizing examples we discussed thus far
Set appropriate memory reservation
Leave HT enabled, size bases on vCPU=1.25pCPU if needed
RHEL6 and SLES 11 SP1 have tickless kernel that does not rely on
a high frequency interrupt-based timer, and is therefore much
friendlier to virtualized latency-sensitive workloads
Do not overcommit memory
Locators/heartbeat process should not be vMotion® migrated, it
otherwise would lead to network split brain problems
vMotion over 10Gbps when doing scheduled maintenance
Use Affinity and Anti-Affinity rules to avoid redundant copies on
the same VMware ESX®/ESXi host
44. 44
Middleware on VMware – Best Practices
Disable NIC interrupt coalescing on physical and virtual NIC
Extremely helpful in reducing latency for latency-sensitive
virtual machines
Disable virtual interrupt coalescing for VMXNET3
• It can lead to some performance penalties for other virtual machines on the
ESXi host, as well as higher CPU utilization to deal with the higher rate of
interrupts from the physical NIC
This implies it is best to use dedicated ESX cluster for
Middleware Platforms
• All host are configured the same way for latency sensitivity and this insures
non middleware workloads, such as other enterprise applications are not
negatively impacted
• This is applicable in category 2 workloads
45. 45
Middleware on VMware – Benefits
Flexibility to change compute resources, VM sizes, add more hosts
Ability to apply hardware and OS patches while
minimizing downtime
Create more manageable system through reduced
middleware sprawl
Ability to tune the entire stack within one platform
Ability to monitor the entire stack within one platform
Ability to handle seasonal workloads, commit resources when
they are needed and then remove them when not needed
47. 47
NewEdge
Virtualized GemFire workload
Multiple geographic active-
active datacenters
Multiple Terabytes of data
kept in memory
1000s of transactions per
second
Multiple vSphere clusters
Each cluster 4 vSphere hosts
and 8 large 98GB+ JVMs
http://www.vmware.com/files/pdf/customers/VMware-Newedge-12Q4-EN-Case-Study.pdf
48. 48
Cardinal Health Virtualization Journey
4
Consolidation
< 40% Virtual
<2,000 VMs
<2,355 physical
Data Center Optimization
30 DCs to 2 DCs
Transition to Blades
<10% Utilization
<10:1 VM/Physical
Low Criticality Systems
8X5 Applications
Internal cloud
>58% Virtual
>3,852 VMs
<3,049 physical
Power Remediation
P2Vs on refresh
HW Commoditization
15% Utilization
30:1 VM/Physical
Business Critical Systems
SAP ~ 382
WebSphere ~ 290
Unix to Linux ~ 655
Cloud Resources
• >90% Virtual
>8,000 VMs
<800 physical
Optimizing DCs
Internal disaster recovery
Metered service offerings
(SAAS, PAAS, IAAS)
Shrinking HW Footprint
> 50% Utilization
> 60:1 VM/Physical
Heavy Lifting Systems
Database Servers
Virtual
HW
SW
Timeline 2005 – 2008 2009 – 2011 2012 – 2015
Theme
Centralized IT
Shared Service
Capital Intensive - High
Response
Variable Cost
SubscriptionServices
DC
49. 49
Virtualization Why Virtualize WebSphere on VMWare
DC strategy alignment
• Pooled resources capacity ~15% utilization
• Elasticity – for changing workloads
• Unix to Linux
• Disaster Recovery
Simplification and manageability
• High availability for thousands instead of thousands of high
availability solutions
• Network & system management in DMZ
Five year cost savings ~ $6 million
• Hardware Savings ~ $660K
• WAS Licensing ~ $862K
• Unix to Linux ~ $3.7M
• DMZ – ports~ >$1M
50. 50
Thank you and are there any Questions?
Emad Benjamin,
ebenjamin@vmware.com
You can get the book here:
https://www.createspace.com/3632131
51. 51
Second Book
Emad Benjamin,
ebenjamin@vmware.com
Preview chapter available at
VMworld bookstore
You can get the book here:
Safari: http://tinyurl.com/lj8dtjr
Later on Amazon
http://tinyurl.com/kez9trj
52. 52
Other VMware Activities Related to This Session
HOL:
HOL-SDC-1304
vSphere Performance Optimization
Group Discussions:
VAPP1010-GD
Java with Emad Benjamin