This document provides an overview and agenda for a presentation on virtualizing SQL Server workloads on VMware vSphere. The presentation will cover designing SQL Server virtual machines for performance in production environments, consolidating multiple SQL Server workloads, and ensuring SQL Server availability using vSphere features. It emphasizes understanding the workload, optimizing for storage and network performance, avoiding swapping, using large memory pages, and accounting for NUMA when configuring SQL Server virtual machines.
Five common customer use cases for Virtual SAN - VMworld US / 2015Duncan Epping
This session was presented by Lee Dilworth and Duncan Epping at VMworld in the US in 2015. Five common customer use cases of the last 12-18 months are discussed in this deck.
What is coming for VMware vSphere?
Delivered at VMUG DK/UK/BE in November 2014. Session is all about vSphere futures, what can be expected in the near future.
VMworld 2015: Site Recovery Manager and Policy Based DR Deep Dive with Engine...VMworld
Policy based management greatly simplifies the work of IT Administrators making it easy to ensure that applications and VMs receive the resources, protection and functionality required. Learn about the latest enhancements of Site Recovery Manager in this space, which represent a huge step towards providing policy based DR. In this session we'll dive deep into how this approach works and how to work with them.
Five common customer use cases for Virtual SAN - VMworld US / 2015Duncan Epping
This session was presented by Lee Dilworth and Duncan Epping at VMworld in the US in 2015. Five common customer use cases of the last 12-18 months are discussed in this deck.
What is coming for VMware vSphere?
Delivered at VMUG DK/UK/BE in November 2014. Session is all about vSphere futures, what can be expected in the near future.
VMworld 2015: Site Recovery Manager and Policy Based DR Deep Dive with Engine...VMworld
Policy based management greatly simplifies the work of IT Administrators making it easy to ensure that applications and VMs receive the resources, protection and functionality required. Learn about the latest enhancements of Site Recovery Manager in this space, which represent a huge step towards providing policy based DR. In this session we'll dive deep into how this approach works and how to work with them.
The popularity of Virtual SAN is growing daily. Server admins are finally free to aggregate storage in their servers to create a shared storage system that scales with their compute needs. The underlying key to making it all work is networking. All Virtual SAN data flows through it, and correct selection and configuration of networking components will mean the difference between disruptive success or dramatic failure. This session will give deep insight in the do's and don'ts of Virtual SAN networking. Best practices for physical and virtual switch configuration and performance testing will be discussed. Virtual SAN 5.5 and 6.0 will be covered, and the networking differences discussed. Methods of troubleshooting network issues will be covered. For those configuring a Virtual SAN network for the first time, for labs or enterprise scale, this session is a must-see.
VMworld 2015: vSphere Distributed Switch 6 –Technical Deep DiveVMworld
VMware’s latest 6.0 version of the vSphere Distributed Switch (VDS) provides unparalleled networking features, control mechanisms, and new ways to construct a LAN topology. In this year’s version of one of the highest rated VMworld sessions, you’ll get front row seats to a deep dive on the VDS in a variety of real world use cases. Gain new knowledge for building multi-tenant capable configurations with NIOC version 3 and CoS marking, learn how to protect critical vSphere management workloads consuming the VDS, and follow along as we review the steps necessary to leverage the TCP/IP stack for routed vMotion.
VMworld 2015: Just Because You COULD, Doesn’t Mean You SHOULD – vSphere 6.0 A...VMworld
This session discusses the lessons learned from VMware Professional Services Engineering during development of collateral for customers. It brings real world experiences to light, so that common issues can be addressed prior to deployment of the solution, rather than after the fact.
VMworld 2015: Advanced SQL Server on vSphereVMworld
Microsoft SQL Server is one of the most widely deployed “apps” in the market today and is used as the database layer for a myriad of applications, ranging from departmental content repositories to large enterprise OLTP systems. Typical SQL Server workloads are somewhat trivial to virtualize; however, business critical SQL Servers require careful planning to satisfy performance, high availability, and disaster recovery requirements. It is the design of these business critical databases that will be the focus of this breakout session. You will learn how build high-performance SQL Server virtual machines through proper resource allocation, database file management, and use of all-flash storage like XtremIO. You will also learn how to protect these critical systems using a combination of SQL Server and vSphere high availability features. For example, did you know you can vMotion shared-disk Windows Failover Cluster nodes? You can in vSphere 6! Finally, you will learn techniques for rapid deployment, backup, and recovery of SQL Server virtual machines using an all-flash array.
VMworld 2015: Managing Users: A Deep Dive into VMware User Environment ManagerVMworld
Take a deep dive into UEM, including an architectural overview, available settings and configurations, user environment management options, UEM deployment considerations and best practices, and UEM integration with Horizon 6.
VMworld 2015: Containers without Compromise - Persistent Storage for Docker C...VMworld
Containers are showing rising interest in the enterprise world for cloud-native applications, but there remain significant roadblocks to adoption. For example, containers have had significant issues in using existing storage for interacting with persistent, stateful applications and data. VMware is developing new features that leverage vSphere to help provide persistent storage and data lifecycle management for Docker containers. In this technical session, we will go over use cases for container-based storage, describe how VMware is providing solutions for storage pain points, and showcase a demo so you can see some solutions in action. Come see how VMware provides Containers without Compromise.
Where to start? - the first 2 hours of performance troubleshooting
• The performance cheat sheet: cover all the basics before you start
• Data collections and mining the logs
• Common techniques to improve performance
VMworld 2013: How SRP Delivers More Than Power to Their Customers VMworld
VMworld 2013
Sheldon Brown, SRP
Girish Manmadkar, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Windows Server 2012 Deep-Dive - EPC GroupEPC Group
Windows Server 2012 Deep-Dive - EPC Group
Web: www.epcgroup.net | E-mail: contact@epcgroup.net | Phone: (888) 381-9725 | Twitter: @epcgroup
* SharePoint Server 2013, Office 365, Windows Azure, Amazon Web Services (AWS), SharePoint Server 2010 & SharePoint 2007: Review, Architecture Development, Planning, Configuration & Implementations, Upgrades, Global Initiatives, Training, and Post Go-live Support with Extensive Knowledge Transfer | Custom Branding and Responsive Web Design (RWD)
* Health Check & Assessments (Roadmap Preparation to Upgrade to 2013 or 2010) - Including Custom Code & Solution Review
* Enterprise Content Management Systems based on Microsoft SharePoint 2013, Office 365 Hybrid Cloud (Both On-premises and cloud)
* Enterprise Metadata Design, Taxonomy | Retention Schedule Dev | Disposition Workflow, and Records Management | eDiscovery | Microsoft Exchange 2013 Migration \ Integration | Roadmap, Requirements Gathering, Planning, Designing & Performing the Actual Implementation
* Best Practices Consulting on SharePoint 2013, Office 365, SharePoint 2010, 2007 | EPC Group has completed over 900+ initiatives
* Intranet, Knowledge Management, Internet & Extranet-Facing as Well as Mobility (BYOD Roadmap), Cloud, Hybrid, and Cross-Browser | Cross-Platform Solutions for SharePoint 2013 with Proven Past-performance
*Upgrades or Migrations of Existing Deployments or Other LOB Systems (Documentum, LiveLink, FileNet, SAP, etc.)
* Custom Apps, Custom Application Development, Custom Feature, Master Pages, Web Parts, Security Model, Usability (UI) & Workflow Development (Visual Studio 2012, Visual Studio 2013)
* Migration Initiatives to SharePoint 2013 \ Office 365 and those organizations with both on-premises and cloud assets for a SharePoint Hybrid Architecture and Deployment
* Key Performance Indicators, Dashboard & Business Intelligence Reporting Solutions (PerformancePoint 2013, SQL Server 2012 R2, SQL Server 2014, BI, KPIs, PowerPivot, Scorecards, Big Data) and Power BI
* Experts in Global \ Enterprise Infrastructure, Security, Hardware Configuration & Disaster Recovery (Global performance considerations)
* Tailored SharePoint "in the trenches" Training on SharePoint 2013, 2010, 2007 + Office 365
* Support Contracts (Ongoing Support your Organization's 2013, 2010, or 2007 Implementations)
* .NET Development, Custom applications, BizTalk Server experts
* Project Server 2013, 2010, and 2007 Implementations
* SharePoint Roadmap & Governance Development: 6, 12, 18, 24 and 36 months (Steering Committee & Code Review Board Development)
* EPC Group's HybridCloudAdvisor.com - Navigating the Ever Changing World of the Hybrid Cloud to include SLA development & consulting services | advisory | best practices around PaaS, IaaS, SaaS, VDI, Windows Azure, AWS as well as security, compliance & and regulatory issues facing cloud and Hybrid Cloud deployments throughout the globe.
* Corporate Change Management & End User
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...NetApp
Keynote Presentation: How Storage Function Follows Architecture
Presented by Howard Marks, Founder and Chief Scientist, Deep Storage, LLC
Storage buyers today are faced with a broader variety of choices than ever before. Unfortunately, the architecture of the storage system they select will forever determine how well that system adapts to changes in their data center. While flash does make almost every storage system faster, the system's scalability, flexibility and manageability are determined not by the media but by the system's architecture.
This session will examine how storage system architectures predetermine how systems behave in the real world. We'll see how common storage architectures affect performance, scalability, quality of service, snapshots and vVol support.
Hvordan administrerer og bruker du din VDI-løsning best mulig? Hva kan Microsoft tilby av VDI-drift og hvordan benyttes det i praksis? Vi ser på hvordan bl.a. System Center kan benyttes i en VDI-løsning.
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld
VMworld 2013
Eric Deadwyler, IBM
Joseph Russell, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
VMworld 2015: Monitoring and Managing Applications with vRealize Operations 6...VMworld
This year VMware vSphere 6 combined with vRealize Operations 6.1 (vR Ops 6) adds critical features to increase technical agility in the infrastructure, and reduce Mean time to Repair. With a new Automated remediation action framework in vR Ops, vSphere 6’s ability to vMotion Physical Raw Device mappings (RDMs), and a complete Management Pack Ecosystem for monitoring Infrastructure to applications, administrators have the tools needed to get to maintain 5 9’s uptime, shorten Mean Time to Repair (MTTR), and predict capacity requirements as and when the business requires.. This session will be a deep technical explanation, and live demonstration of these tools. It will give administrators a solid understanding of how they can use these tools to monitor and manage their application clusters, keep applications running during Infrastructure maintenance, and get deep holistic visibility into the entire Application ecosystem, from Storage to Networking.
VMworld 2015: Virtualize Active Directory, the Right Way!VMworld
Active Directory Domain Services (ADDS) allows organizations to deploy a scalable and secure directory service for managing users, resources and applications. Virtualization of ADDS has been supported for many years now, however has required careful management to avoid pitfalls around replication, time management, and access. Windows Server 2012 provides greater support for virtualization by including virtualization-safe features and support for rapid domain controller deployment.
Not content to simply describe the Virtual Volume (VVOL) framework, this session instead examines practical use cases: How different configurations and workloads benefit from VVOLs. Learn how Storage Policy Based Management (SPBM) couples with VVOLs to provide VM configuration options not previously available. We demonstrate a handful of real-life scenarios, specifically covering how VVOLs benefits oversubscribed systems, disaster recovery preparation and multi-tenant requirements for customers. Specific configuration options and constraints are covered in detail, including how they work with underlying storage.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
VMworld Europe 2014: Advanced SQL Server on vSphere Techniques and Best Practices
1.
2. Disclaimer
• This presentation may contain product features that are currently under development.
• This overview of new technology represents no commitment from VMware to deliver these
features in any generally available product.
• Features are subject to change, and must not be included in contracts, purchase orders, or
sales agreements of any kind.
• Technical feasibility and market demand will affect final delivery.
• Pricing and packaging for any new technologies or features discussed or presented have not
been determined.
CONFIDENTIAL 2
3. Agenda / Table of Contents
• Introduction – Why Virtualize SQL Server?
• Designing for Performance (Tier-1 Production)
– Data Volume and Protocol Considerations
– Database Workload Types and Characteristics
– Understanding Memory Management
– Memory Best Practices in SQL Server Guests
– Networking Best Practices
– NUMA
• Consolidating Multiple SQL Server Workloads
– Consolidation Options
– Mixing Workload Types
• SQL Server Availability
– vSphere Features
– Supported SQL Server Clustering Configurations
CONFIDENTIAL 4
5. Quick Facts
• SQL Server database servers account for ~10% of all x86 workloads and are
typically underutilized (6-20% CPU utilization)
• Many Database Administrators (DBAs) are hesitant to virtualize database
servers due to perceived issues with performance, availability, and licensing
• Running SQL Server workloads on vSphere can help to reduce physical server
and licensing costs while increasing availability without sacrificing performance
• The VMware SDDC platform offers management benefits that extend to both
the infrastructure administrator and the DBA
• In-depth application monitoring and trend analysis
• Automation and provisioning of database components for developers (self-service)
• Application and site resilliency
6. Reduce hardware costs by > 50%
• Consolidate servers by 4X – 20X
Provision databases on demand
• Minutes to provision in production and in the lab
Reduce licensing costs
• Potentially increase utilization of SQL Server licenses
(depending on degree of consolidation)
Increase application Quality of Service
• Scale dynamically
• Built-in high availability and simple disaster recovery
DB On Demand
Quality of Service
DB Consolidation
Why Deploy Databases on VMware SDDC?
7
Licensing
Complete isolation between systems on the same host
• Protects databases and applications against network-based
threats
Security
9. Performance Best Practices Summary
• Design for performance in addition to capacity; more disks = faster
• Dedicate DataStores for performance critical workloads
• Avoid Lazy Zeroing; use VAAI array or eagerzeroedthick
• Pre-test your workload
• Use PVSCSI adapters when possible (non-clustered databases)
• Use multiple paths to storage array (minimum 2 HBAs)
• Use Large Memory Pages at the host
• Avoid host-level swapping; don’t disable TPS and ballooning
• Optimize network for IP-based storage protocols
• Use PVSCSI adapters when possible (non-clustered databases)
• Use multiple vSCSI adapters (up to 4)
• Avoid CPU and Memory overcommit; alternatively, use reservations
• Use Large Memory Pages in the guest; enable LockPagesInMemory user right
• Place t-logs, tempdb, and data files on separate LUNs
10. VMFS
Design for Storage Performance (not just Capacity)
• The fundamental relationship between consumption and
supply has not changed
– Spindle count and RAID configuration are still important
– But host demand is an aggregate of virtual machines
• DataStores (work with Storage Engineer early in Design)
– Create dedicated data stores to service BCA database workloads
– svMotion / SDRS to balance workloads across DataStores
– Load Balance your workloads across as many disk spindles as
possible
– Follow storage vendor’s best practices when laying out database
– Storage Multipathing – Set up a minimum of four paths from an
ESX Server to a storage array (requires at least two HBA ports)
• Factors that affect storage performance include storage
protocols, storage configuration, and Virtual Machine File
System (VMFS) configuration
11. Design for Storage Performance (cont.)
• Ensure storage adapter cards are installed in slots with enough bandwidth to support their
expected throughput
• Ensure appropriate read/write controller cache is enabled
• Pick the right multipathing policy based on vendor storage array design
• Configure maximum queue depth if needed for Fibre Channel HBA cards. See:
– http://kb.vmware.com/kb/1267
– http://kb.vmware.com/kb/1267
12. VMFS or RDM?
• Generally similar performance http://www.vmware.com/files/pdf/performance_char_vmfs_rdm.pdf
• vSphere 5.5 supports up to 62TB VMDK files
• Disk size no longer a limitation of VMFS
VMFS RDM
Better storage consolidation – multiple virtual disks/virtual machines per
VMFS LUN. But still can assign one virtual machine per LUN
Enforces 1:1 mapping between virtual machine and
LUN
Consolidating virtual machines in LUN – less likely to reach vSphere
LUN Limit of 256
More likely to hit vSphere LUN limit of 256
Manage performance – combined IOPS of all virtual machines in LUN <
IOPS rating of LUN
Not impacted by IOPS of other virtual machines
• When to use raw device mapping (RDM)
– Required for shared-disk failover clustering
– Required by storage vendor for SAN management tools such as backup and snapshots
• Otherwise use VMFS
13. VMDK Lazy Zeroing *
• Default VMDK allocation policy lazy zeroes 1M VMFS
blocks on first write
• Write penalty on an untouched VMDK
• SQL Server operations could be affected by lazy zeroing
– Write operations
– Read operations that use tempdb extensively
– Bulk load/index maintenance
• For best performance, format VMDK as eagerzeroedthick *
• * Zero offload capability in VAAI improves zeroing in
supported arrays 0
20
40
60
80
100
120
140
160
180
200
1 host 2 hosts4 hosts8 hosts 16
hosts
Throughput(MBps)
Effect of Zeroing on
Storage Performance
"Post-zeroing" "Zeroing"
Choose Storage which supports VMware vStorage
APIs for Array Integration (VAAI)
14. Eagerzeroed Thick in the GUI
• When using VMFS for SQL Server data, create VMDK files as eagerzeroed thick or uncheck
Windows “Quick Format” option
vSphere 4
vSphere 5
16. OLTP
Large amount of small queries
Sustained CPU utilization during working hours
Sensitive to peak contentions (slow downs affects SLA)
Generally Write intensive
May generate many chatty network round trips
Typically runs during off-peak hours, low CPU utilization during
normal working hours
Can withstand peak contention, but sustain activity is key
Batch / ETL
DSS
Small amount of large queries
CPU, memory, disk IO intensive
Peaks during month end, quarter end, year end
Can benefit from inter-query parallelism with large number of threads
Database Workloads Types
17. SQL Server I/O Characteristics
• Understanding the I/O characteristics of common SQL Server operations and scenarios can
help determine how to configure storage
• Some of the more common scenarios below
• Monitor I/O to determine specifics of each scenario
Operation Random/Sequential Read/Write Size Range
OLTP – Log Sequential Write Up to 64K
OLTP – Data Random Read/Write 8K
Bulk Insert Sequential Write Any multiple of 8K up to 256K
Read Ahead – DSS and Index Scans Sequential Read Any multiple of 8KB up to 512K
Backup Sequential Read 1MB
18. Storage – Test Before Deployment
• Simulate SQL Server disk I/O patterns using a generic tool, such as the native SQLIOSim or
Iometer
• Test to make sure requirements, such as throughput and latency, have been met
• Example SQL I/O patterns to tests
R/W% Type Block Threads/ Queue Simulates
80/20 Random 8K # cores/files Typical OLTP data files
0/100 Sequential 60K 1/32 Transaction log
100/0 Sequential 512K 1/16 Table scans
0/100 Sequential 256K 1/16 Bulk load
100/0 Random 32K # cores/1 SSAS workload
100/0 Sequential 1MB 1/32 Backup
0/100 Random 64K-256K # cores/files Checkpoints
19. Storage – Best Practices Summary
• Size for performance, not just capacity (apps often drive performance requirements)
• Format database VMDK files as Eager Zeroed Thick* for demanding workload database
– * Required ONLY if the storage array is not VAAI-compliant. See VMware KB #1021976
(http://kb.vmware.com/kb/1021976)
• Ensure that blocks are aligned at both the ESXi and Windows levels
• Understand the path to the drives, such as storage protocol and multipathing
• Understand the I/O requirements of the workload and TEST
• Use small LUNs for better manageability and performance
• Optimize IP network for iSCSI and NFS
– NOTE: Network protocol processing for software-initiated iSCSI / NFS operations take place on the
host system, requiring CPU resources
• Use multiple vSCSI adapters to evenly distribute target devices and increase parallel access for
databases with demanding workloads
20. Performance Best Practices Summary
• Design for performance in addition to capacity; more disks = faster
• Dedicate DataStores for performance critical workloads
• Avoid Lazy Zeroing; use VAAI array or eagerzeroedthick
• Pre-test your workload
• Use multiple paths to storage array (minimum 2 HBAs)
• Use Large Memory Pages at the host
• Avoid host-level swapping; don’t disable TPS and ballooning
• Optimize network for IP-based storage protocols
• Design with NUMA in mind; use Virtual NUMA to extend awareness to guest
• Use PVSCSI adapters when possible (non-clustered databases)
• Use multiple vSCSI adapters (up to 4)
• Avoid CPU and Memory overcommit; alternatively, use reservations
• Use Large Memory Pages in the guest; enable LockPagesInMemory user right
• Place t-logs, tempdb, and data files on separate LUNs
21. Large Pages
• Use ESXi Large Pages (2MB)
– Improves performance by significantly reducing TLB misses (applications with large active memory
working sets)
– Does not share large pages unless memory pressure (KB 1021095 and 1021896)
– Slightly reduces the per-virtual-machine memory space overhead
• For systems with Hardware-assisted Virtualization
– Recommend use guest-level large memory pages
– ESXi will use large pages to back the GOS memory pages even if the GOS does not make use of large
memory pages(full benefit of huge pages is when GOS use them as well as ESXi does)
22. “Large Pages Do Not Normally SWAP”
http://kb.vmware.com/kb/1021095
In the cases where host memory is overcommitted, ESX may have
to swap out pages. Since ESX will not swap out large pages,
during host swapping, a large page will be broken into small
pages. ESX tries to share those small pages using the pre-
generated hashes before they are swapped out. The motivation of
doing this is that the overhead of breaking a shared page is
much smaller than the overhead of swapping in a page if the
page is accessed again in the future.
23. Swapping is Bad!
• Swapping happens when:
– The host is trying to service more memory than it has physically AND
– ESXi memory optimization features (TPS and Ballooning) are insufficient to provide relief
• Swapping Occurs in Two Places
– Guest VM Swapping
– ESXi Host Swapping
• Swapping can slow down I/O performance of disks for other VM’s
• Two ways to keep swapping from affecting your workload:
– At the VM: Set memory reservation = allocated memory (avoid ballooning/swapping)
• Use active memory counter with caution and always confirmed usage by checking memory counter in Perfmon
– At the Host: Do not overcommit memory until vCenter reports that steady state usage is < the amount
of RAM on the server
24. ESXi Memory Features that Help Avoid Swapping
• Transparent Page Sharing
– Optimizes use of memory on the host by “sharing” memory pages
that are identical between VMs
– More effective with similar VMs (OS, Application, configuration)
– Very low overhead
• Ballooning
– Allows the ESXi host to “borrow” memory from one VM to satisfy
requests from other VMs on that host
– The host exerts artificial memory pressure to the VM via the
“balloon driver” and returns to the pool usable by other VMs
– Ballooning is the host’s last option before being forced to swap
– Ballooning is only effective if VMs have “idle” memory
• DON’T TURN THESE OFF
25. Memory Reservations
• Allows you to guarantee a certain share of the physical
memory for an individual VM
• The VM is only allowed to power on if the CPU and
memory reservation is available (strict admission)
• The amount of memory can be guaranteed even under
heavy loads.
• In many cases, the configured size and reservation size
could be the same
27. Network Best Practices
• Allocate separate NICs for vMotion, FT logging traffic, and ESXi console access management
– Alternatively use VLAN-trunking support to separate production users, management, VM network, and
iSCSI storage traffic
• vSphere 5.0 supports the use of more than 1 NIC for vMotion allowing more simultaneous
vMotions; added specifically for memory intensive applications like Databases
• Use NIC load-based teaming (route based on physical NIC load) for availability, load balancing,
and improved vMotion speeds
• Have minimum 4 NICs per host to ensure performance and redundancy of network
• Recommend the use of NICs that support:
– Checksum offload , TCP segmentation offload (TSO)
– Jumbo frames (JF), Large receive offload (LRO)
– Ability to handle high-memory DMA (i.e. 64-bit DMA addresses)
– Ability to handle multiple Scatter Gather elements per Tx frame
– NICs should support offload of encapsulated packets (with VXLAN)
28. Network Best Practices (continued)
• Separate SQL workloads with chatty network traffic (Microsoft Always On – Are you there) from
the one with chunky access into different physical NICs
• Use Distributed Virtual Switches for cross-ESX network convenience
• Optimize IP-based storage (iSCSI and NFS)
– Enable Jumbo Frames
– Use dedicated VLAN for ESXi host's vmknic & iSCSI/NFS server to minimize network interference from
other packet sources
– Exclude iSCSI NICs from Windows Failover Cluster use
– Be mindful of converged networks; storage load can affect network and vice versa as they use the
same physical hardware; ensure no bottlenecks in the network between the source and destination
• Use VMXNET3 Paravirtualized adapter drivers to increase performance
– Reduces overhead versus vlance or E1000 emulation
– Must have VMware Tools to enable VMXNET3
• Tune Guest OS network buffers, maximum ports
29. Jumbo Frames
• Use Jumbo Frames – confirm there is no MTU mismatch
• To configure, see iSCSI and Jumbo Frames configuration on ESX 3.x and ESX 4.x
http://kb.vmware.com/kb/1007654
30. AlwaysOn Availability Group Cluster Settings
• Depending on YOUR network, tuning may be necessary – work with Network Team and
Microsoft to determine appropriate settings
Cluster Heartbeat
Parameters
Default
Value
CrossSubnetDelay 1000 ms
CrossSubnetThreshold 5hb
SameSubnetDelay 1000 ms
SameSubnetThreshold 5 hb
View: cluster /cluster:<clustername> /prop
Modify: cluster /cluster:clustername> /prop <prop_name> = <value>
31. Non-Uniform Memory Access (NUMA)
• Designed to avoid the performance hit when several
processors attempt to address the same memory by
providing separate memory for each NUMA Node.
• Speeds up Processing
• NUMA Nodes Specific to Each Processor Model
32. Virtual NUMA in vSphere 5
• Extends NUMA awareness to the guest OS
• Enabled through multicore UI
– On by default for 8+ vCPU multicore VM
– Existing VMs are not affected through upgrade
– For smaller VMs, enable by setting numa.vcpu.min=4
• Do NOT turn on CPU Hot-Add
• For wide virtual machines, confirm feature is on for best
performance
• SQL Server
– Automatically detects NUMA architecture
– SQL Server process and memory allocation optimized for
NUMA architecture
33. NUMA Best Practices
• http://www.vmware.com/files/pdf/techpaper/VMware-vSphere-CPU-Sched-Perf.pdf
• Avoid Remote NUMA access
– Size # of vCPUs to be <= the # of cores on a NUMA node (processor socket)
• Hyperthreading
– Initial conservative sizing: set vCPUs to # of cores
– HT benefit around 20-25%, < for CPU intensive batch jobs (based on OLTP workload tests )
– Increase vCPUs to get HT benefit, but consider “numa.vcpu.preferHT” option – individual case basis
• # of virtual sockets and # of cores / virtual socket
– Recommendation , keep default 1 core / socket
• Align VMs with physical NUMA boundaries
• ESXTOP to monitor NUMA performance at vSphere
• If vMotioning, move between hosts with the same NUMA architecture to avoid performance hit
(until reboot)
34. Performance Best Practices Summary
• Design for performance in addition to capacity; more disks = faster
• Dedicate DataStores for performance critical workloads
• Avoid Lazy Zeroing; use VAAI array or eagerzeroedthick
• Pre-test your workload
• Use PVSCSI adapters when possible (non-clustered databases)
• Use multiple paths to storage array (minimum 2 HBAs)
• Use Large Memory Pages at the host
• Avoid host-level swapping; don’t disable TPS and ballooning
• Optimize network for IP-based storage protocols
• Use PVSCSI adapters when possible (non-clustered databases)
• Use multiple vSCSI adapters (up to 4)
• Avoid CPU and Memory overcommit; alternatively, use reservations
• Use Large Memory Pages in the guest; enable LockPagesInMemory user right
• Place t-logs, tempdb, and data files on separate LUNs
35. PVSCSI Adapters
• The latest and most advanced vSphere SCSI controller drivers; recommended for workloads
with a high performance requirement
• Larger queue depth per-device (256, actual 254) and per-adapter(1024)
– Default values are 64 and 254
• Less CPU overhead
• Requires VMware Tools
– Drivers not native to Windows
– Cannot be used for OS partition without some work-around
• Increase queue depth in Windows Guest OS by increase request ring to 32
– HKLMSYSTEMCCSservicespvscsiParametersDeviceDriverParameter
"RequestRingPages=32,MaxQueueDepth=254”
– ESX 5.0 U3 and above only
• Not currently supported for ANY type of Windows Clustering configuration
36. NFS, In-guest iSCSI, and vSCSI Adapters
• NFS
– Supported for SQL Server (must meet data write ordering requirements and guarantee write-through)
– Not supported by VMware for Windows Clustering
• In-guest iSCSI
– Supported for Standalone and Clustered
• No VMware-mandated considerations
– Facilitates easy storage zoning and access masking
– Useful for minimizing number of LUNs zoned to an ESXi host
– Offloads storage processing resources away from ESXi hosts
– Should use dedicated network and NIC
• vSCSI Adapters (configured in VM properties)
– Use multiple vSCSI adapters to evenly distribute target devices and increase parallel access for
databases with demanding workloads
37. Guest Memory – Best Practices Summary
• Avoid overcommitment of memory at the host level (HostMem >= Sum of VMMem – overhead)
– If overcommitment is unavoidable, use reservations to protect important VMs
• To avoid NUMA remote memory access, size VM memory equal to or less than the memory
per NUMA node if possible
– Utilize ESXi virtual NUMA features (especially for wide VMs)
• Use Large Pages in the guest – start SQL Server with trace flag -T834
• Enable Lock Pages in Memory right for SQL Server service account
• Use Max Server Memory and Min Server Memory when running multiple instances of SQL
Server in the same VM
• Disable unnecessary processes within Windows
38. Large Pages in SQL Server Configuration Manager (Guest)
• Use Large Pages in the guest – start SQL Server with trace flag -T834
39. Lock Pages in Memory User Right (Guest)
• May keep SQL Server more responsive
when paging occurs
• ON by default in 32/64 bit Standard
Edition and higher if rights are granted
• The SQL Server Service Account
(sqlservr.exe) must have “Lock pages in
memory” rights
http://msdn.microsoft.com/en-us/library/ms178067.aspx
40. CPU Sizing Considerations
• Understand existing workload, average and peak; consider future growt
• Properly manage pCPU allocation
– For Tier 1 workload, avoid pCPU overcommitment or use reservations
– For lower-tiered databases workload
• Reasonable overcommitment can increase aggregate throughput and maximize license savings – consolidation
ratio varies depending on workloads
• Leverage vMotion and DRS for resource load balancing
– Monitor to optimize
• Host level – %RDY, %MLMTD, and %CSTP
• Virtual machine level – processor queue length
• Keep NUMA node size in mind
– For smaller virtual machine, try to stay inside a NUMA node if possible
– For wide virtual machine – vSphere 5.x
• Align vCPUs to physical NUMA boundaries
• Enable vNUMA on vSphere host to allow SQL Server NUMA optimization
41. CPU Sizing Considerations (cont.)
• Leverage hardware-assisted virtualization (enabled by default)
• Be aware of hyper-threading, a hyper-thread does not provide the full power of a physical core
• In high performance environment, consider adding additional hosts when avg. host CPU
utilization exceeds 65%
• Ensure Power Saving Features are “OFF”
• Use vCOPs for consumption & capacity metrics
42. SQL Server Guest Storage Best Practices
• Follow SQL Server storage best practices – http://technet.microsoft.com/en-us/library/cc966534.aspx
• Pre-allocate data files to avoid autogrow during peak time
– If using auto-growth, use MB and not % increments
• Use multiple data files for data and tempdb – start with 1 file per CPU core
– Multiple TempDB files can co-exist on the same volume – Not encouraged
• Database file placement priority – fastest to slowest drive
– Transaction Log Files > TempDB Data Files > Data Files
• Place data and log files on separate LUNs
• Perform routine maintenance with index rebuild/reorg, dbcc checkdb
• Number of Data Files Should Be <= Number of Processor Cores
• Use multiple vSCSI adapters to evenly distribute target devices and increase parallel access for
databases with demanding workloads
43. Block Alignment
• Configure storage presented to vSphere hosts using
vCenter to ensure VMFS block alignment
• Even though Windows is supposed to automatically align
as of Windows 2008, Microsoft recommends double
checking
– http://msdn.microsoft.com/en-us/library/dd758814.aspx
– http://blogs.msdn.com/b/jimmymay/archive/2014/03/14/disk-
partition-alignment-for-windows-server-2012-sql-server-2012-
and-sql-server-2014.aspx (Jimmy May - MSDN Blogs)
• Whatever the operating system, confirm that new
partitions are properly aligned
Unaligned partitions result in additional I/O
Aligned partitions reduce I/O
stripe unit size value should be an integer
45. Consolidation Options
• Scale-up approach
– Multiple databases or SQL instances per
virtual machine
– Fewer virtual machines
– Poor workload management
– Potential reduction in SQL licensing cost
• Scale-out approach
– Single database per VM
– Potential increase in mgmt. overhead
– Better isolation/performance
– Easier security and change mgmt.
– DRS more effective with smaller VMs
– Faster migration (vMotion)
46
46. OLTP vs. Batch Workloads
• What this says:
– Average 15% Utilization
– Moderate sustained activity (around 28% during working
hours 8am-6pm)
– Minimum activities during non working hours
– Peak utilization of 58%
• What this says:
– Average 15% Utilization
– Very quiet during the working day (less than 8% utilization)
– Heavy activity during 1am-4am, with avg. 73%, and peak 95%
Batch Workload (avg. 15%)
OLTP Workload (avg. 15%)
47. OLTP vs. Batch Workloads
• What This Means
– Better Server Utilization
– Improved Consolidation Ratios
– Less Equipment To Patch, Service, Etc
– Saves Money/Less Licensing
OLTP/Batch Combined Workload
48. Running with Mixed SQL Server Workloads
• Consider workload characteristics, and manage pCPU overcommitment as a function of typical
utilization
– OLTP workloads can be stacked up to a sustained utilization level
– OLTP workloads that are high usage during daytime and batch workloads that run during off-peak hours
mix well together
– Batch/ETL workloads with different peak periods are mixed well together
• Consider operational history, such as month-end and quarter-end
– Additional virtual machines can be added to handle peak period during month-end, quarter-end, and
year-end, if scale out is a possibility
– CPU and memory hot add can be used to handle workload peak
– Reduce virtual machine density, or add more hosts to the cluster
• Use DRS as your insurance policy, but don’t rely on it for resource planning
50. Business-Level Approach
• What are you trying to protect?
– i.e. What does the business care about protecting?
• What are your RTO/RPO requirements?
• What is your Service Level Agreement (SLA)?
• How will you test and verify your solution?
51. vSphere 5 Availability Features
• vSphere vMotion
– Can reduce virtual machine planned downtime
– Relocate SQL Server VMs without end-user interruption
– Perform host maintenance any time of the day
• vSphere DRS
– Monitors state of virtual machine resource usage
– Can automatically and intelligently locate virtual machine
– Can create a dynamically balanced SQL deployment
• VMware vSphere High Availability (HA)
– Does not require Microsoft Cluster Server
– Uses VMware host clusters
– Automatically restarts failed SQL virtual machine in minutes
– Heartbeat detects hung virtual machines
– Application HA can provide availability at the SQL Server service level!
52. Microsoft
Clustering on
VMware
vSphere support
VMware HA
support
vMotion DRS
support
Storage vMotion
support
MSCS Node Limits
Storage Protocols support Shared Disk
FC
In-Guest
OS iSCSI
Native
iSCSI
In-Guest
OS SMB
FCoE RDM VMFS
Shared
Disk
MSCS with
Shared Disk
Yes Yes1 No No
2
5 (5.1 only)
Yes Yes No Yes5 Yes4 Yes2 Yes3
Exchange Single
Copy Cluster
Yes Yes1 No No
2
5 (5.1 only)
Yes Yes No Yes5 Yes4 Yes2 Yes3
SQL Clustering Yes Yes1 No No
2
5 (5.1 only)
Yes Yes No Yes5 Yes4 Yes2 Yes3
SQL AlwaysOn
Failover Cluster
Instance
Yes Yes1 No No
2
5 (5.1 only)
Yes Yes No Yes5 Yes4 Yes2 Yes3
Non
shared
Disk
Network Load
Balance
Yes Yes1 Yes Yes
Same as
OS/app
Yes Yes Yes N/A Yes N/A N/A
Exchange CCR Yes Yes1 Yes Yes
Same as
OS/app
Yes Yes Yes N/A Yes N/A N/A
Exchange DAG Yes Yes1 Yes Yes
Same as
OS/app
Yes Yes Yes N/A Yes N/A N/A
SQL AlwaysOn
Availability
Group
Yes Yes1 Yes Yes
Same as
OS/app
Yes Yes Yes N/A Yes N/A N/A
Shared Disk Configurations: Supported on
vSphere with additional considerations for storage
protocols and disk configs
Non-Shared Disk Configurations: Supported on
vSphere just like on physical
* Use affinity/anti-affinity rules when using vSphere HA
** RDMs required in “Cluster-across-Box” (CAB) configurations, VMFS required in “Cluster-in-Box” (CIB) configurations
VMware Knowledge Base Article: http://kb.vmware.com/kb/1037959
VMware Support for Microsoft Clustering on vSphere
53. Shared Disk Clustering (Failover Clustering and AlwaysOn FCI)
• Provides application high-availability through a shared-disk architecture
• One copy of the data, rely on storage technology to provide data redundancy
• Automatic failover for any application or user
• Suffers from restrictions in storage and VMware configuration
54. vSphere HA with Shared Disk Clustering
• Supports up to five-node cluster in vSphere 5.1 and above
• Failover cluster nodes can be physical or virtual or any
combination of the two
• Host attach (FC) , FCoE* or in-guest (iSCSI)
• Supports RDM only
• vSphere HA + failover clustering
– Seamless integration, virtual machines rejoin clustering session
after vSphere HA recovery
– Can shorten time that database is in unprotected state
– Use DRS affinity/anti-affinity rules to avoid running cluster
virtual machines on the same host
Failover clustering supported with vSphere HA as of vSphere 4.1
http://kb.vmware.com/kb/1037959
55. Non-Shared Disk Clustering (Always On Availability Groups)
• Database-level replication over IP; no shared storage requirement
• Same advantages as failover clustering (service availability, patching, etc.)
• Readable secondary
• Automatic or manual failover through WSFC policies
56. vSphere HA with AlwaysOn Availability Groups
• Seamless integration
• Protect against hardware/software failure
• Support multiple secondary and readable secondary
• Provide local and remote availability
• Full feature compatibility with availability group
• VMware HA shortens time that database is in unprotected
state
• DRS anti-affinity rule avoids running virtual machines on
the same host
EMC Study – SQL Server AlwaysOn running vSphere 5 and EMC FAST VP
http://www.emc.com/collateral/hardware/white-papers/h10507-mission-critical-sql-server-2012.pdf
57. WSFC – Cluster Validation Wizard
• Use this to validate support for your configuration
– Required by Microsoft Support for condition of support for YOUR configuration
• Run this before installing AAG(AlwayOn Availabilty Group), and every time you make changes
– Save resulting html reports for reference
• If running non-symmetrical storage, possible hotfixes required
– http://msdn.microsoft.com/en-us/library/ff878487(SQL.110).aspx#SystemReqsForAOAG
58
58. Patching Non-clustered Databases
• Benefits
– No need to deploy an MS cluster simply for patching /
upgrading the OS and database
– Ability to test in a controlled manner (multiple times if
needed)
– Minimal impact to production site
until OS patching completed
and tested
– Patching of secondary VM
can occur during regular
business hours
• Requires you to layout VMDKs correctly to support this
scenario
59. Resources
• Visit us on the web to learn more on specific apps
– http://www.vmware.com/solutions/business-critical-apps/
– Specific page for each major app
– Includes Best Practices and Design/Sizing information
• Visit our Business Critical Application blog
– http://blogs.vmware.com/apps/
60. New RDBMS books from VMware Press
61
vmwarepress.com
http://www.pearsonitcertification.com/store/virtu
alizing-oracle-databases-on-vsphere-
9780133570182
http://www.pearsonitcertification.com/store/virtuali
zing-sql-server-with-vmware-doing-it-right-
9780321927750