This document discusses virtualization for database administrators. It begins by introducing the speaker and defining key virtualization terms like guest, host, and hypervisor. It then covers the major benefits of virtualization like reduced hardware costs and improved availability. The document provides recommendations for optimizing SQL Server in virtual environments, such as enabling large memory pages and reserving memory. It emphasizes the importance of monitoring both the virtual machines and the hypervisor management layer.
Veeam Backup & Replication v8 for VMware — General OverviewVeeam Software
Veeam Backup & Replication is much more than backup – it provides fast, flexible, and reliable recovery of virtualized applications and data. We bring backup and replication together in a single solution to reinvent data protection and deliver the #1 VM backup for VMware vSphere and Hyper-V environments. This poster provides a high-level overview of the architecture of Veeam Backup & Replication running in a VMware environment.
Real world experience with provisioning servicesCitrix
If you use Citrix NetScaler for secure remote access to your Citrix XenApp/Citrix XenDesktop deployment, you may be wondering if there’s more that it can do. You are correct! NetScaler also offers load balancing, global server load balancing, web interface integration, HDX traffic inspection and much more. It can enhance Citrix ShareFile StorageZones and Citrix mobile deployments. Join this session for a quick NetScaler refresher.
VMworld 2013: Storage DRS: Deep Dive and Best Practices to Suit Your Storage ...VMworld
VMworld 2013
Sachin Manpathak, VMware
Mustafa Uysal, VMware
Sunil Muralidhar, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Five common customer use cases for Virtual SAN - VMworld US / 2015Duncan Epping
This session was presented by Lee Dilworth and Duncan Epping at VMworld in the US in 2015. Five common customer use cases of the last 12-18 months are discussed in this deck.
OpenStack is rapidly gaining popularity with businesses as they realize the benefits of a private cloud architecture. This presentation was delivered by Dave Page, Chief Architect, Tools & Installers at EnterpriseDB & PostgreSQL Core Team member during PG Open 2014. He addressed some of the common components of OpenStack deployments, how they can affect Postgres servers, and how users might best utilize some of the features they offer when deploying Postgres, including:
• Different configurations for the Nova compute service
• Use of the Cinder block store
• Virtual networking options with Neutron
• WAL archiving with the Swift object store
Veeam Backup & Replication v8 for VMware — General OverviewVeeam Software
Veeam Backup & Replication is much more than backup – it provides fast, flexible, and reliable recovery of virtualized applications and data. We bring backup and replication together in a single solution to reinvent data protection and deliver the #1 VM backup for VMware vSphere and Hyper-V environments. This poster provides a high-level overview of the architecture of Veeam Backup & Replication running in a VMware environment.
Real world experience with provisioning servicesCitrix
If you use Citrix NetScaler for secure remote access to your Citrix XenApp/Citrix XenDesktop deployment, you may be wondering if there’s more that it can do. You are correct! NetScaler also offers load balancing, global server load balancing, web interface integration, HDX traffic inspection and much more. It can enhance Citrix ShareFile StorageZones and Citrix mobile deployments. Join this session for a quick NetScaler refresher.
VMworld 2013: Storage DRS: Deep Dive and Best Practices to Suit Your Storage ...VMworld
VMworld 2013
Sachin Manpathak, VMware
Mustafa Uysal, VMware
Sunil Muralidhar, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Five common customer use cases for Virtual SAN - VMworld US / 2015Duncan Epping
This session was presented by Lee Dilworth and Duncan Epping at VMworld in the US in 2015. Five common customer use cases of the last 12-18 months are discussed in this deck.
OpenStack is rapidly gaining popularity with businesses as they realize the benefits of a private cloud architecture. This presentation was delivered by Dave Page, Chief Architect, Tools & Installers at EnterpriseDB & PostgreSQL Core Team member during PG Open 2014. He addressed some of the common components of OpenStack deployments, how they can affect Postgres servers, and how users might best utilize some of the features they offer when deploying Postgres, including:
• Different configurations for the Nova compute service
• Use of the Cinder block store
• Virtual networking options with Neutron
• WAL archiving with the Swift object store
Shawn Kormondy of Reis Group is a top producing real estate agent at a prestigious Beverly Hills real estate firm, Keller Williams Realty. He specializes in Hollywood Hills, West Hollywood, and Miracle Mile real estate. Shawn can be contacted by visiting one of his web sites, www.reisgroup.org or www.developweho.com
Prezentacja Tomasza Kudły z ESK 2016 o projekcie "27 mostów, 27 wydarzeń, 10 dronów – jedno miasto. Case study #mostyWRO - projekt realizowany w ramach Europejskiej Stolicy Kultury Wrocław 2016.", która została przedstawiona podczas konferencji Social Media Day Poland & Inside Culture 3 grudnia w Kinie Nowe Horyzonty we Wrocławiu.
Prezentacja "Muzeum w świecie hyperconnected" podczas SMD'2015Agencja Publicon
Prezentacja Eweliny Czechowicz z Muzeum Sztuki Współczesnej w Krakowie - "Muzeum w świecie hyperconnected. Nowe technologie w komunikacji i wspieraniu doświadczenia zwiedzających.", która została przedstawiona podczas konferencji Social Media Day Poland & Inside Culture 3 grudnia w Kinie Nowe Horyzonty we Wrocławiu.
The have no fear guide to virtualizing databasesSolarWinds
When it comes to a successful database virtualization journey, there are things you must know before you start. In this presentation you will:
-Review terms and concepts for VMware, by far the most common virtualization platform
-Examine how to use vSphere (the VMware admin console)
-Explore the differences between virtual and physical host metrics a
-Learn to overcome the shortcomings of virtualizing your database environment
This exam measures your ability to accomplish the technical tasks listed below. The percentages indicate the relative weight of each major topic area on the exam. http://www.allpass4sure.com/microsoft-pdf-70-410.html
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld
VMworld 2013
Mark Achtemichuk, VMware
Michael Webster, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Azure Virtual Machines Deployment ScenariosBrian Benz
Architecture and Scenarios for deploying Database and middleware applications on Azure Virtual Machines including SQL Server, Oracle, Hadoop, and others.
Building the Perfect SharePoint 2010 Farm - SPS Brisbane 2011Michael Noel
SharePoint 2010 has matured over the past year, with improvements in scalability, enterprise search, and administration. Best practices from SharePoint 2007 are no longer relevant, and new guidance has emerged from the last year worth of SharePoint deployments. In addition, new features such as SharePoint FAST Search capabilities can have a significant effect on how an environment is architected. In addition, the popularity of server virtualization technologies have created new design options for SharePoint administrators, allowing for new and unique high availability and provisioning options. This session goes right to the heart of the matter, providing for physical and virtual architecture guidelines and specific configuration settings that can immediately be used to construct SharePoint 2010 environments that can be used to replace existing SharePoint 2007 farms. Architectural specifics are based on best practices obtained from existing SharePoint 2010 environments of multiple sizes and performance metrics gathered from both physical and virtual SQL Server and SharePoint environments will help you to build the ‘perfect’ SharePoint 2010 farm for your organization.
Hyper v® 2012 vs v sphere™ 5.1 understanding the differencesSolarWinds
With Hyper-V 2012, Microsoft® has closed many of the gaps it previously had with VMware®, and this webcast will walk through a comparison of the scalability and features of both hypervisors:
· Architecture & footprint
· CPU & memory management
· Storage capabilities
· Mobility & availability
The discussion will provide a technical basis for understanding the pros and cons of both platforms for users looking to either choose one or who are considering using both.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
6. Server Room Sprawl
Server sprawl
SQL sprawl
Power and Cooling Issues in DCs
Broader availability of SAN storage
7. Terminology
Guest—The virtual server running
underneath the physical host and hypervisor
(instance of an Operating System)
Host—The physical server that your virtual
machines run on
Hypervisor—The underlying software that
performs the load balancing and sharing of
resources between guest operating systems
8. Terminology (cont’d)
Thin Provisioning—Allowance in virtual
environments to overallocate physical
resources (more to come later)
Deduplication—Process of compressing
memory/disk space by saving only one copy
of common bits
vMotion/LiveMigration—Process which
moves guest OS’s from host with high
resource utilization to lower. Also an HA
function with the hypervisor
9. Terminology (cont’d)
Snapshot—A full point in time backup of your
guest OS (very handy for
upgrades/patches/code releases)
Cloning—The process of building a gold
guest image in order to rapid deployment
10. Costs
VMWare isn’t cheap
Licensing about $25k per server for a Enterprise
plus on a decent sized server
Licensing changed from CPU—to CPU with
memory grants, allowed 96 GB per CPU license
Hyper-V
Included with your Windows Server Licenses
(amount of VMs vary based on edition)
SCOM, while not required is recommended
11. Benefits of Virtualization
Lower cooling and power
Higher utilization of hardware
Can be used for HA configurations
Rapid Deployment of new environments
Use Gold Standard servers and rollout
SQL Server Licensing
Snapshots
17. Typical Hardware
Virtualization hosts are the typical servers
you might run SQL Server on.
2 x 4-6 core processors (Dual socket servers
represent 80% of install base)
A Lot of RAM
18. Thin Provisioning
Allows over allocation
of resources
Increases storage
provisioning
Management console
allows for easy
management of this
along with SAN
NOT GOOD FOR
PRODUCTION DB
SERVERS!!!
20. Multi-Tenant Environments
This can make monitoring and baselining
your server more challenging
You will want to have open communications
with your VM administrators
Ask for view access into VCenter—it will
show you what else is going on in the
environment
21. CPUs
Can be over allocated
Use servers with the newest chips—they are
optimized for Virtual Workloads
Maintain 1:1 ratio of physical cores to vCPU
for production boxes
For production workloads you may want to
dedicate CPUs to the machine
22. Memory Management
Memory can be
over allocated (but
don’t do it for
production!!!)
Hypervisor handles
it by de-duplicating
memory.
Host Page Files
26. I/O Concerns
Two choices of file types—VMFS (VMWare
File System) and RDM (Raw Device
Mapping)
Performance between two is similar
RDM is required for clustering
VMFS generally more flexible
Use Shared Storage (SAN) to get HA and DR
functionality
27. I/O Concerns
Partition alignments still matters < Windows
2008
Work with storage team to monitor I/O—
Hypervisors can have strange I/O patterns
28. Datastores
• It can be easy to overwhelm
storage if not enough storage
devices are presented
• Modern SANs tend to be
designed with this in mind
29. Windows Server 2012
Introduces concept of “Storage Spaces”
Allows storage to be pooled and shared
between multiple VM hosts
Can be created from non Microsoft platforms
32. Virtualizing SQL Server
Use Trace Flag –T834—large pages enabled
Set min and max memory—this will lock SQL’s
memory to prevent possible balloon driver
impact
Also reserve memory in HyperVisor for Prod
Servers
Follow the same storage best practices you
would for a physical box (Separate TempDB,
Data, Logs)
Test out I/O performance before beginning
33. Monitoring SQL Server
From the server perspective everything stays
the same
Everything may not match at times
Ask for access to the vSphere client!
It’s the only way to have an overview into the
broader system
34. Performance Issues
Troubleshoot as you normally would, then
check VMWare
Similarly with a SAN—try to identify what you
apps are sharing your resources
Can adjust load on the fly by using vMotion
(or Live Migration)
35. Summary
Virtualization is the future, and the future is
now!
Virtual servers work from a shared resource
pool and that can impact your workloads
Identify changes you need to make to your
SQL Servers for Virtual Environments
Get access to your virtualization
management layer
37. Contact Info
Twitter: @jdanton
Email: jdanton1@yahoo.com
Blog (slides): joedantoni.wordpress.com
Editor's Notes
This is what we’re going to discuss today—the major players in Virtualization (warning—this talk will be VMWare centric). We’ll go through all of the terminology involved in virtualization, then discuss some of the costs and benefits. Next we’ll take a dive into the technology underlying virtualization. Lastly we will talk about what you need to consider when running SQL Server on a VM. My goal for this session is for you to have a good understanding of Virtualization and how it works.
Typically the push for Virtualization comes from your data centre and Windows folks, who hear it from their management, who wants to get higher server and CPU utilization out of their hardware investment. These are the major players in the space—VMWare is by far the market leader, and I’ll do most of my talking about them today. Hyper V is catching up, but is still pretty far behind on the feature set. Most of the terminology in this presentation will be VMWare centric—it’s the market leader, and it’s what I have the most experience with.
If you just want to play with Virtualization, Virtual Box is a really good solution, it’s free and easy to play with.
So in the 2000s as we were starting to try and consolidate SQL servers, something else happened, our application server environments started to sprawl tremendously. Each new project needed a new app server for each of its environments. And we ended up with server rooms that look like bad subdivisions.
So what did this lead to? More servers needed more power, and servers got more power hungry in recent years. Most servers now come with 2 750w power supplies—that’s a lot of juice. It also cranks out a lot of heat—this might not be an issue in a small environment, but as you start to reach capacity in any data center, it’s hard to add more a/c and more power capacity after the fact.
The other thing that lead us to virtualization was that servers have gotten WAY more powerful—we can have 16 cores in a standard two-socket server that we get for under $10,000. Additionally, having a SAN has become way more common in the last decade. You don’t NEED a SAN for virtualization, but many of the advanced features take advantage of shared storage.
The next few slides are about the terminology we use in virtualization. I’ll slow down for a minute to let you take notes.
So what does this cost you? There has been some controversy in this space in the last few months, as VMWare changed it’s pricing model. It used to be purely CPU based, and the change was to take it in the direction of using memory+cpu based licensing. It’s a more confusing model, but it hasn’t seem to have hurt VMWare sales much.
Hyper-V is included in the cost of your Windows licensing. So it’s basically free, but it’s feature set isn’t as robust as VMWare’s, and has less multi-platform support (it doesn’t support RedHat)
So here is what you gain by going with a virtualization solution. You get higher density of servers—so you get benefits there. Your power and cooling is reduce for that. As I’ll show in a few slides this can be used for HA solutions and even DR—you have some level of hardware protection.
You can have a new server built in less than 10 minutes—VMWare allows you to create a template image and rename it to create a server. For example you could have a Windows Server with SQL installed with all of your best practices implemented, and it will spin up while you are getting coffee.
Additionally, it’s a great place to park an app that requires a legacy version of Windows or SQL Server.
O/S snapshots are also a wonderful thing—more on that later.
This is a pretty simplified example of a server, running 3 VMs. Host, will always refer to the physical box you are running on—the Hypervisor is the software that allows guest creation, and manages host resources amongst the guest servers.
In this case we are running 3 guest O/Ss. They could be running any version of Windows, Linux, mix or match, it doesn’t matter.
So the hypervisor does a number of things—the guest O/S’s are operating out of a shared resource pool, so it allocates CPU and memory resources between them. In the case of VMWare, it may move a guest from a high utilization host to a low utilization host. This process is basically seamless (there are a few seconds of degraded performance). It can also manage failover and DR, I’ll go into details on that in a few slides. Backups can also be managed through the VMWare layer—this is the most efficient way to backup VMs.
This is a better picture of what a VMWare architecture looks like—the density here could be pushed more. vMotion is the process of moving VMs between servers. DRS is VMWares multi-site DR solution, which requires SAN replication, and if any of you were in my last session, you’ll know that it’s expensive and complicated to set up, but pretty cool.
Snapshots are a wonderful technology that’s built into the virtualization solution. In a nutshell it’s a way of rapidly doing a full backup of your systems. The hypervisor takes a block level snapshot of the guest O/S and tracks the changes in a snapshot file. This is great for patching, Cus, code deployments, SQL upgrades, and whatever.
The one caveat to this is that you need to delete your snapshots as soon as you are done needing them. As they are capturing the delta of your server, they can grow very big very quickly.
This is a picture of how VMWare’s DR scenario works—it’s relatively straightforward. If you lose a server VMWare vmotions the VMs to another host. This is seemless to the VM and your app. Also, just in case you wondering you can set up clustering within VMWare.
So the hardware on these VMWare boxes are pretty similar to what you run your SQL Servers on—standard 2 socket x86 servers, with a lot of RAM. CPU isn’t the biggest deal, though it is important to be on the newer processing lines which have much better processor support for virtualization.
Thin provisioning mostly applies in the storage world (your SAN folks can do it as well). In a nutshell, if you ask for 100Gb drive thin provisioning may only give out 10 Gb, until you need it. And much like expanding a data file in SQL Server is an expensive task, expanding a VMWare disk, is an expensive proposition. I think this is fine for non-production environments, but if you are doing production work, make sure you are fully provisioned up front.
In a virtual environment by definition, you are in a multi-tenant environment. It’s like living in that big building in that last slide. So you don’t want to have noisy neighbors. The big consideration here is that this can make your baselining and monitoring processes more challenging than just a straight physical server.
This is a little bit political, especially in big organizations. Ask your VMWare admins, about what servers you are sharing your environment (and storage) with. As your environment grows, you may want to have a dedicated cluster of VMWare for your database servers.
Also, and I will bring this up again you will want to have visibility into vCenter—this way you can see what’s going on in your entire VMWare infrastructure.
CPUs may be overallocated—what this means is that you can grant more CPUs to VMs than are physically available to the box—this can be a bad idea under high loads. For development it’s less of an issue. Another interesting thing to notes is that VMWare gets slightly less efficient as you add more CPUs to servers—their ideal number is 4. Basically each processor you add becomes progressively less powerful when compared to a physical processor.
Like I mentioned earlier, you want to use processors that are optimized for virtual workloads—any new server will be, but keep this in mind if you are deploying to older hardware.
And lastly on production VMs, maintain a 1:1 of vCPUs to Physical Cores. You can also reserve the CPUs in VMWare so that they aren’t allocated to other VMs.
So through the magic of VMWare we can over allocate memory to a servers. Much like CPU what that means is we can allocate more memory than is physically available. The hypervisor handles it behind the scenes, by deduplicating blocks in memory.
NEVER DO THIS IN PRODUCTION!!!!
If your environment comes under memory pressure the host server will begin paging and performance will degrade very rapidly.
Ah, balloons we all loved them as children, but as we know they can be very dangerous—this gentleman’s house was stolen by a bunch of balloons.
What the balloon driver does is reclaims memory from guests that VMWare thinks isn’t using it. If your SQL Server wants to use this memory, that is a very very bad thing.
To prevent this from happening, use the lock pages in memory option in SQL, and for production VMs have your VMWare admin set a memory reservation for your server. Additionally, I recommend setting the min and max memory in SQL to the same value—that’s not a guarantee though.
One of a the caveats with raw device mapping is that your are limited to 256 RDMs in a given VM cluster.
Partitions alignment still matters if you running an OS that is below Windows 2008.
VMWare tends to do a lot of random I/O when you think it should be sequential. So pay attention to I/O related perfmon counters