The event, held on 11th December 2018, was a technical presentation about running MS SQL Server 2017 on Linux. We started off by using containers and proceeded in looking at High Availability and Data Protection, more specifically:
- Supported features & Linux differences
- Installing SQL Server on a Linux Container
- Accessing SMB 3.0 shared storage using Samba
- Setting up a Fail over Cluster using Pacemaker
- Setting up AlwaysOn Availability Groups using Pacemaker
- Authenticating to SQL Server using AD Authentication
- Setting up Read-Scale Cross-Platform Availability Groups
https://techspark.mt/sql-server-on-linux-11th-december-2018/
This session shows an overview of the features and architecture of SQL Server on Linux and Containers. It covers install, config, performance, security, HADR, Docker containers, and tools. Find the demos on http://aka.ms/bobwardms
With MySQL being the most popular open source DBMS in the world and with an estimated growth of 16 percent anually until 2020,we can assume that sooner or later an Oracle DBA will be handling a MySQL database in their shop. This beginner/intermediate-level session will take you through my journey of an Oracle DBA and my first 100 days of starting to administer a MySQL database, show several demos and all the roadblocks and the success I had along this path.
Do you wonder how to contribute to MariaDB? Have you considered writing a plugin? MariaDB ships many plugins (over a hundred) and you could also be one of them. Find out what they do, how to use them, and so forth. A lightning talk given for the MySQL NL User Group meetup in Amsterdam.
In September 2016, the PostgreSQL community is rolling out PostgreSQL 9.6 which includes improvements in parallelism for query performance, overall performance improvements and the integration of foreign data sources.
This presentation introduces the new features of 9.6 and how they will benefit you.
- Parallel sequential scans, joins and aggregates
- Elimination of repetitive scanning of old data by autovacuum
- Synchronous replication now allows multiple standby servers for increased reliability
- Full-text search for phrases
- Support for remote joins, sorts, and updates in postgres_fdw
- Substantial performance improvements, especially in the area of improving scalability on many-CPU servers
If you have any questions on how to get started with Postgres, please email sales@enterprisedb.com
Python Utilities for Managing MySQL DatabasesMats Kindahl
Managing a MySQL database server can become a full time job. What we need are tools that bundle a set of related tasks into a common utility. While there are several such utility libraries to choose, it is often the case that you need to customize them to your needs. The MySQL Utilities library is the answer to that need. It is open source so you can modify and expand it as you see fit.
This is the presentation from OSCON 2011 in Portland.
Tips to drive maria db cluster performance for nextcloudSeveralnines
Nextcloud requires a database to store administrative data for the platform. A poorly performing database can have a serious impact on performance and availability of Nextcloud. MariaDB Cluster is the recommended database backend for production installations that require high availability and performance.
This talk is a deep dive into how to design and optimize MariaDB Galera Cluster for Nextcloud. We will cover 5 tips on how to significantly improve performance and stability.
Agenda:
Overview of Nextcloud architecture
Database architecture design
Database proxy
MariaDB and InnoDB performance tuning
Nextcloud performance tuning
Q&A
This session shows an overview of the features and architecture of SQL Server on Linux and Containers. It covers install, config, performance, security, HADR, Docker containers, and tools. Find the demos on http://aka.ms/bobwardms
With MySQL being the most popular open source DBMS in the world and with an estimated growth of 16 percent anually until 2020,we can assume that sooner or later an Oracle DBA will be handling a MySQL database in their shop. This beginner/intermediate-level session will take you through my journey of an Oracle DBA and my first 100 days of starting to administer a MySQL database, show several demos and all the roadblocks and the success I had along this path.
Do you wonder how to contribute to MariaDB? Have you considered writing a plugin? MariaDB ships many plugins (over a hundred) and you could also be one of them. Find out what they do, how to use them, and so forth. A lightning talk given for the MySQL NL User Group meetup in Amsterdam.
In September 2016, the PostgreSQL community is rolling out PostgreSQL 9.6 which includes improvements in parallelism for query performance, overall performance improvements and the integration of foreign data sources.
This presentation introduces the new features of 9.6 and how they will benefit you.
- Parallel sequential scans, joins and aggregates
- Elimination of repetitive scanning of old data by autovacuum
- Synchronous replication now allows multiple standby servers for increased reliability
- Full-text search for phrases
- Support for remote joins, sorts, and updates in postgres_fdw
- Substantial performance improvements, especially in the area of improving scalability on many-CPU servers
If you have any questions on how to get started with Postgres, please email sales@enterprisedb.com
Python Utilities for Managing MySQL DatabasesMats Kindahl
Managing a MySQL database server can become a full time job. What we need are tools that bundle a set of related tasks into a common utility. While there are several such utility libraries to choose, it is often the case that you need to customize them to your needs. The MySQL Utilities library is the answer to that need. It is open source so you can modify and expand it as you see fit.
This is the presentation from OSCON 2011 in Portland.
Tips to drive maria db cluster performance for nextcloudSeveralnines
Nextcloud requires a database to store administrative data for the platform. A poorly performing database can have a serious impact on performance and availability of Nextcloud. MariaDB Cluster is the recommended database backend for production installations that require high availability and performance.
This talk is a deep dive into how to design and optimize MariaDB Galera Cluster for Nextcloud. We will cover 5 tips on how to significantly improve performance and stability.
Agenda:
Overview of Nextcloud architecture
Database architecture design
Database proxy
MariaDB and InnoDB performance tuning
Nextcloud performance tuning
Q&A
Technical Introduction to PostgreSQL and PPASAshnikbiz
Let's take a look at:
PostgreSQL and buzz it has created
Architecture
Oracle Compatibility
Performance Feature
Security Features
High Availability Features
DBA Tools
User Stories
What’s coming up in v9.3
How to start adopting
How SQL Server was ported to Linux? The presentation goes through some of the concepts: SQLOS, Drawbridge and Containers. It shows the role of SQLPAL as a platform abstraction layer.
Skalierbarkeit mit MariaDB und MaxScale - MariaDB Roadshow Summer 2014 Hambur...MariaDB Corporation
Skalierbarkeit mit MariaDB und MaxScale
Presented by Ralf Gebhardt at the MariaDB Roadshow Germany: 4.7.2014 in Hamburg, 8.7.2014 in Berlin and 11.7.2014 in Frankfurt.
MySQL PHP native driver : Advanced Functions / PHP forum Paris 2013 Serge Frezefond
mysqlnd the MySQL native driver for PHP brings a lot of value to MySQL.
There is no change for developers that can still use the mysqli and PDO API.
This driver supports a plugins extension capability. Some very useful features have been implemented :
- mysqlnd_ms replication and load balancing plugin
- mysqlnd_qc query result cache plugin
- mysqlnd_memcache innoDB memcache plugin
- mysqlnd_uh user handler plugin
- mysqlnd_mux plugin to multiplex PHP connections
MySQL Fabric is the new sharding framework for MySQL. The mysqlnd_ms plugging the MySQL native driver makes it possible to use this sharding framework from PHP.
Implementing High Availability Caching with MemcachedGear6
Typical Memcached deployments do not comprehensively address web site requirements for high availability. Depending on your web architecture, a single failure can disable your web caches. This presentation offers real world solutions to solving <a>high availability</a> challenges common to large, dynamic websites with Memcached, specifically:
* Options and benefits for deploying high availability services within Memcached
* How companies are approaching high availability
* Considerations on building and deploying high availability
o Recommendations for a typical Memcached environment
o Open source tools available
o High level costs for deployment
Wars of MySQL Cluster ( InnoDB Cluster VS Galera ) Mydbops
MySQL Clustering over InnoDB engines has grown a lot over the last decade. Galera began working with InnoDB early and then Group Replication came to the environment later, where the features are now rich and robust. This presentation offers a technical comparison of both of them.
This talk shares the story of how SiteGround created an enterprise monitoring system for its Drupal VIP clients. As the person behind this SiteGround project I'll talk about the following topics in details:
1. What is an enterprise level monitoring system for Drupal sites and the underlying hosting infrastructure.
2. Why big enterprise Drupal sites need such a system and what is the business value for the customer.
3. What is the best way to technically implement a system which monitors and solves issues with sites that are extremely complicated.
4. Why a migration from reactive monitoring to SRE best methods is the only option for such sites.
At the end of the talk people will know the following:
- Why big enterprise Drupal sites need custom monitoring.
- Why traditional monitoring is not suitable for sites that use the latest technologies - Elasticsearch, Solr, Nginx, Redis, Docker, LXC.
- At the end of the talk the people will be familiar with the concepts of proactive system/site management. I'll talk about what site reliability engineers do and how a big part of this has been automated at SiteGround and why this is very important.
Hi! Ho! Hi! Ho! SQL Server on Linux We Go!SolarWinds
SQL Server has been running on Windows for years. Now Microsoft is making it available on Linux in order to provide a consistent database platform across Window and Linux servers, as well as on-premises and in the cloud. In this presentation, Janis Griffin, database performance evangelist at SolarWinds, discusses the advantages of using SQL Server on Linux, comparing architecture, cost and performance.
SQL Server 2017 will bring SQL Server to Linux for the first time. This presentation covers the scope, schedule, and architecture as well as a background on why Microsoft is making SQL Server available on Linux.
Technical Introduction to PostgreSQL and PPASAshnikbiz
Let's take a look at:
PostgreSQL and buzz it has created
Architecture
Oracle Compatibility
Performance Feature
Security Features
High Availability Features
DBA Tools
User Stories
What’s coming up in v9.3
How to start adopting
How SQL Server was ported to Linux? The presentation goes through some of the concepts: SQLOS, Drawbridge and Containers. It shows the role of SQLPAL as a platform abstraction layer.
Skalierbarkeit mit MariaDB und MaxScale - MariaDB Roadshow Summer 2014 Hambur...MariaDB Corporation
Skalierbarkeit mit MariaDB und MaxScale
Presented by Ralf Gebhardt at the MariaDB Roadshow Germany: 4.7.2014 in Hamburg, 8.7.2014 in Berlin and 11.7.2014 in Frankfurt.
MySQL PHP native driver : Advanced Functions / PHP forum Paris 2013 Serge Frezefond
mysqlnd the MySQL native driver for PHP brings a lot of value to MySQL.
There is no change for developers that can still use the mysqli and PDO API.
This driver supports a plugins extension capability. Some very useful features have been implemented :
- mysqlnd_ms replication and load balancing plugin
- mysqlnd_qc query result cache plugin
- mysqlnd_memcache innoDB memcache plugin
- mysqlnd_uh user handler plugin
- mysqlnd_mux plugin to multiplex PHP connections
MySQL Fabric is the new sharding framework for MySQL. The mysqlnd_ms plugging the MySQL native driver makes it possible to use this sharding framework from PHP.
Implementing High Availability Caching with MemcachedGear6
Typical Memcached deployments do not comprehensively address web site requirements for high availability. Depending on your web architecture, a single failure can disable your web caches. This presentation offers real world solutions to solving <a>high availability</a> challenges common to large, dynamic websites with Memcached, specifically:
* Options and benefits for deploying high availability services within Memcached
* How companies are approaching high availability
* Considerations on building and deploying high availability
o Recommendations for a typical Memcached environment
o Open source tools available
o High level costs for deployment
Wars of MySQL Cluster ( InnoDB Cluster VS Galera ) Mydbops
MySQL Clustering over InnoDB engines has grown a lot over the last decade. Galera began working with InnoDB early and then Group Replication came to the environment later, where the features are now rich and robust. This presentation offers a technical comparison of both of them.
This talk shares the story of how SiteGround created an enterprise monitoring system for its Drupal VIP clients. As the person behind this SiteGround project I'll talk about the following topics in details:
1. What is an enterprise level monitoring system for Drupal sites and the underlying hosting infrastructure.
2. Why big enterprise Drupal sites need such a system and what is the business value for the customer.
3. What is the best way to technically implement a system which monitors and solves issues with sites that are extremely complicated.
4. Why a migration from reactive monitoring to SRE best methods is the only option for such sites.
At the end of the talk people will know the following:
- Why big enterprise Drupal sites need custom monitoring.
- Why traditional monitoring is not suitable for sites that use the latest technologies - Elasticsearch, Solr, Nginx, Redis, Docker, LXC.
- At the end of the talk the people will be familiar with the concepts of proactive system/site management. I'll talk about what site reliability engineers do and how a big part of this has been automated at SiteGround and why this is very important.
Hi! Ho! Hi! Ho! SQL Server on Linux We Go!SolarWinds
SQL Server has been running on Windows for years. Now Microsoft is making it available on Linux in order to provide a consistent database platform across Window and Linux servers, as well as on-premises and in the cloud. In this presentation, Janis Griffin, database performance evangelist at SolarWinds, discusses the advantages of using SQL Server on Linux, comparing architecture, cost and performance.
SQL Server 2017 will bring SQL Server to Linux for the first time. This presentation covers the scope, schedule, and architecture as well as a background on why Microsoft is making SQL Server available on Linux.
Microsoft SQL server 2017 Level 300 technical deckGeorge Walters
This deck covers new features in SQL Server 2017, as well as carryover features from 2012 onwards. This includes high availability, columnstore, alwayson, In-memory tables, and other enterprise features.
SQL Server vNext is the next major release of SQL Server and the first release which will be available on Linux and Docker. This presentation covers all the details.
Brk3288 sql server v.next with support on linux, windows and containers was...Bob Ward
SQL Server is bringing its world-class RDBMS to Linux and Windows with SQL Server v.Next. In this session you will learn what´s next for SQL Server on Linux and how application developers and IT architects can now leverage the enterprise class features of SQL Server in every edition on Linux, Windows and containers.
Overview SQL Server on Linux
It is just SQL Server. Everything just works
Initially aimed at Database Engine
Currently around 95% features fully supported.
Hi! Ho! Hi! Ho! SQL Server on Linux We Go!SolarWinds
SQL Server has been running on Windows for years. Now Microsoft is making it available on Linux in order to provide a consistent database platform across Window and Linux servers, as well as on-premises and in the cloud. In this presentation, Janis Griffin, database performance evangelist at SolarWinds, discusses the advantages of using SQL Server on Linux, comparing architecture, cost and performance.
VMworld 2015: Advanced SQL Server on vSphereVMworld
Microsoft SQL Server is one of the most widely deployed “apps” in the market today and is used as the database layer for a myriad of applications, ranging from departmental content repositories to large enterprise OLTP systems. Typical SQL Server workloads are somewhat trivial to virtualize; however, business critical SQL Servers require careful planning to satisfy performance, high availability, and disaster recovery requirements. It is the design of these business critical databases that will be the focus of this breakout session. You will learn how build high-performance SQL Server virtual machines through proper resource allocation, database file management, and use of all-flash storage like XtremIO. You will also learn how to protect these critical systems using a combination of SQL Server and vSphere high availability features. For example, did you know you can vMotion shared-disk Windows Failover Cluster nodes? You can in vSphere 6! Finally, you will learn techniques for rapid deployment, backup, and recovery of SQL Server virtual machines using an all-flash array.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
2. Agenda
• Supported features & Linux differences
• Installing SQL Server on a Linux Container
• Accessing SMB 3.0 shared storage using Samba
• Setting up a Failover Cluster using Pacemaker
• Setting up Availability Groups using Pacemaker
• Authenticating to SQL Server using AD Authentication
• Setting up Read-Scale Cross-Platform Availability Groups
3. SQL Server on the platform of your choice
• Windows Server / Windows 10
• Docker: Windows and Linux
containers
• Linux distributions: Red Hat
Enterprise Linux (RHEL), Ubuntu, and
SUSE Linux Enterprise Server (SLES)
Linux
Docker Container
Windows
4. 1TB TPC-H non-clustered world record
benchmark
Great performance
Great value
$0.64
$0.47
SQL Server 2016
on Windows
SQL Server 2017 on SUSE
Linux Enterprise Server
678,492
1,009,065
SQL Server 2016
on Windows
SQL Server 2017 on SUSE
Linux Enterprise Server
Read the performance brief at hpe.com/servers/benchmarks.
Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Red Hat, Red Hat Enterprise Linux, and the Shadowman logo are registered trademarks of Red Hat, Inc. Linux is a registered trademark of
Linus Torvalds. Intel and Xeon are trademarks of Intel Corporation in the U.S. and other countries. TPC and TPC-H are trademarks of the Transaction Processing Performance Council. TPC-H results show the HPE
ProLiant DL380 Gen10 with a result of 1,009,065 QphH @ 1000GB and $0.47/QphH USD with system availability as of 02-28-18 (results published 11-17-2017; see www.tpc.org/3331); the HPE ProLiant DL380 Gen9 with a
result of 678,492 QphH @1000GB and $0.64/QphH @ 1000GB with system availability as of 07-31-2016 (results published 03-24-2016; see tpc.org/3320). The TPC believes that comparisons of TPC-H results published
with different scale factors are misleading and discourages such comparisons. Please see tpc.org for up-to-date information. Competitive claims valid as of 04-19-2017.
$/Query per hour ($/QPHH)
Query per hour (QPHH)
6. Making SQL Server run on Linux
Introducing SQL PAL - Platform Abstraction Layer
7. SQLOS + Drawbridge = SQLPAL
• Drawbridge a research prototype kicked off in 2011 intended to reduce
virtualization resource overhead of hosting multiple Virtual Machines.
• Library OS implemented host Application Binary Interface (ABI) for
address space & memory management, host synchronization, and IO.
• Capable of hosting other Windows components such as CLR & MSXML.
https://cloudblogs.microsoft.com/sqlserver/2016/12/16/sql-server-on-linux-how-introduction/
• SQLOS introduced in SQL Server 2005 as a layer between the SQL
Server and Windows.
• Handled user mode thread scheduling, memory management,
synchronization.
• Provided: Dynamic Management Views & Extended Events.
8. SQL Platform Abstraction Layer (SQLPAL)
a Cross-platform architecture
https://www.slideshare.net/TravisWright4/sql-server-2017-overview-and-partner-opportunities
9. What is it about?
Supported Platforms
Un/Supported Features
System Requirements
10. Supported platforms
Unofficially: CentOS 7, Debian 8+, Fedora 24+ and possibly others.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-setup?view=sql-server-2017
Platform Supported versions Supported file systems
Red Hat Enterprise Linux 7.3 or 7.4 XFS or Ext4
SUSE Linux Enterprise Server v12 SP2 Ext4
Ubuntu 16.04 Ext4
Docker Engine (on Windows, Mac,
or Linux)
1.8+ N/A
12. Unsupported Features on Linux
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-release-notes?view=sql-server-2017#Unsupported
• AD Authentication for Linked Servers
• AD Authentication for AGs
13. SQL Server on Linux investment roadmap
• SQL Server Agent transaction replication*
• Machine Learning Services in R & Python*
• PolyBase on Linux
• HA on Containers and Kubernetes*
• AD authentication for Linked Servers
• AD authentication for AGs
• Distributed Transactions (DTC)*
• 3rd party AD tools like Centrify*
* Supported in SQL Server 2019 Preview
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-container-ha-overview?view=sql-server-ver15
14. System minimum requirements
• Memory 2 GB
• File System XFS or EXT4
• Disk space 6 GB
• Processor speed 2 GHz
• Processor cores 2 cores
• Processor type x64-compatible only
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-setup?view=sql-server-2017
16. Install SQL Server in a Docker Container
# Download Image
docker pull mcr.microsoft.com/mssql/server:2017-latest
# Run Container
docker run --name sql1 `
-e "ACCEPT_EULA=Y" `
-e "SA_PASSWORD=Pa55.wrd" `
-e "MSSQL_PID=Developer" `
-p 1433:1433 `
-d mcr.microsoft.com/mssql/server:2017-latest
NB: SQL Server on Linux container images are based on Ubuntu 16.04 LTS and SQL Server for Linux.
https://hub.docker.com/r/microsoft/mssql-server/
21. Memory requirements & Usage
• My lab runs on 2210 MB of RAM.
• SQL Server uses 1532 MB of RAM.
22. Installation folders & basic commands
• SQL Server runtime and associated
libraries:
• /opt/mssql/bin/
• /opt/mssql/lib/
• Data files SQL Server databases:
• /var/opt/mssql/data/
• Log files
• /var/opt/mssql/log/
• systemctl is used to manage services:
• status
• start
• stop
• restart
• mssql-conf is a configuration script
that installs with SQL Server 2017.
24. mssql-conf
# Change default directories
/opt/mssql/bin/mssql-conf set filelocation.defaultdatadir /var/opt/mssql/userdata
/opt/mssql/bin/mssql-conf set filelocation.defaultlogdir /var/opt/mssql/userdata
# Enable Availability Groups
/opt/mssql/bin/mssql-conf set hadr.hadrenabled 1
# Reset SA password
/opt/mssql/bin/mssql-conf set-sa-password
# Change Server Collation – It also rebuild system database objects!
/opt/mssql/bin/mssql-conf set-collation
NB: Some settings can only be set whilst the service is switched off
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-configure-mssql-conf?view=sql-server-2017
25. Install SQL Server Agent
• For Versions 2017 CU3 and below – Install Package
• yum install –y mssql-server-agent
• For Versions 2017 CU4 and above – Enable Setting
• /opt/mssql/bin/mssql-conf set sqlagent.enabled true
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-setup-sql-agent?view=sql-server-2017
29. AG & FCI Configurations : Linux vs Windows
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-ha-basics?view=sql-server-2017
30. HA Differences – Clustering Layer
• WSFC – Windows Server Failover Cluster
• Highly integrated with SQL Server – Separate SQL Installation Option.
• SQL FCI created as a clustered resource.
• SQL Server knows WSFC state information.
• SQL AG Failover done from SQL.
• External – Pacemaker
• Not coupled as WSFC.
• SQL installed per node, FCI managed as a single instance.
• SQL Server not aware about clustering layer.
• SQL AG Failover done from PCS.
31. HA Requirements - Pacemaker
• All of the currently supported distributions ship a high availability add-
on/extension, which is based on the Pacemaker clustering stack.
• This stack incorporates two key components: Pacemaker and Corosync. All the
components of the stack are:
• Pacemaker – A cluster resource manager that coordinates cluster resources and services.
• Corosync – A set of APIs that provides cluster membership and messaging capabilities.
• pcs – The Pacemaker Configuration System.
• libQB – A library that provides high performance logging, tracing, ipc, and poll.
• Resource agent – Support application integration through Open Cluster Framework.
• Fence agent – Assist in isolating nodes and deal with them if they are having issues.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-ha-basics?view=sql-server-2017#ha-add-onextension-basics
32. HA Requirements - Resource Agents
https://github.com/Microsoft/mssql-server-ha
33. HA Requirements - STONITH
• Pacemaker requires STONITH (Shoot The Other Node In The Head) to
automatically power down a node that is not working correctly.
• Hyper-V does not have a solution for STONITH. This also impacts Azure-based
Pacemaker deployments using certain distributions such as RHEL.
• Thus, might be forced to disable it.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-ha-basics?view=sql-server-2017#quorum-fence-agents-and-stonith
34. Pacemaker Configuration
• migration-threshold=N
• resource will be banned from the original node after N failures.
• failure-timeout=Xs
• resource can move back after X seconds.
• start-failure-is-fatal=true
• Default is true. A START failure sets fail count to INFINITY and forces a move.
• Set to false to retry a start on the same node.
• stonith-enabled=true
• When true, a STOP error will fence the node to bring it down.
• When false, a STOP command fails, a STOP will be retired on failure-timeout.
https://clusterlabs.org/pacemaker/doc/en-US/Pacemaker/1.1/html/Pacemaker_Explained/_failure_response.html
35. Pacemaker Commands
• pcs cluster auth Authenticate nodes
• pcs cluster setup Link nodes together
• pcs cluster start/stop Control nodes
• pcs property set Configure pcs settings
• pcs resource show Show configured resources
• pcs resource create Add new resources to pcs
• pcs status Show cluster status
• pcs resource move Failover resources between nodes
• pcs cluster destroy Remove cluster
36. HA Differences – AG Listener
• The listener is an optional functionality for an AG. It provides a single point of entry for all connections:
• read/write to the primary replica.
• read-only to secondary replicas.
• In a WSFC, this is the combination of a network name resource and an IP resource:
• Creates a Computer object in AD DS.
• Registers DNS record automatically.
• The listener under Linux is configured differently, but its functionality is the same:
• Pacemaker has no concept of a “network name resource”.
• No object is created in AD DS.
• DNS needs to be registered manually.
• Based on AG cluster type the listener’s IP should
• External – match the IP assigned to the pacemaker resource.
• None – be that assigned to the primary replica.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-availability-group-overview?view=sql-server-2017#the-listener-under-linux
38. FCI & Shared Storage
• A Failover Cluster Instance requires storage
that can be accessed by all cluster nodes.
• You can use:
• iSCSI – configurable using iscsiadm
• NFS – mount using nfs4
• SMB 3.0 – mount using smbclient
• Configuring shared storage:
1. Install and configure a stand-alone SQL Server
2. Mount shared storage
3. Move system databases to shared storage
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-shared-disk-cluster-configure?view=sql-server-2017
39. Smbclient & Scale-Out File Server
• Force SMB3.0 by specifying client minimum protocol.
• Use Scale-Out File Server (SOFS) Shared Folders with a minimum of 2-Node Windows
Server 2016 Cluster with shared storage mounted in an Active-Active manner as Cluster
Shared Volume (CSV) to benefit from RDMA, Multichannel, and Transparent Failover.
https://www.petri.com/windows-server-2012-smb-3-scale-out-file-server/sofs
40. Configuring Failover Clusters on Linux
• Linux prerequisites
• Create a pacemaker SQL login
• Create shared storage
• Configure Linux
• Configure samba client
• Mount shared storage
• Move system databases
• Copy machine key
• Create pacemaker password file
• Install pacemaker & dependencies
• Set hacluster password
• Install MSSQL HA
• Configure Firewall
• Configure Pacemaker
• Authenticate Cluster Nodes
• Create Cluster
• Disable STONITH
• Enable Services
• Create storage resource
• Create ip resource
• Create cluster resource
46. Configuring Availability Groups on Linux
Network subnet Network subnet
Storage
Node NodeNodeNodeNode
SQL Server
instance
SQL Server
instance
SQL Server
instance
Always On SQL Server
failover cluster instance
Always On availability group
Instance
network name
Pacemaker
configuration
Pacemaker
configuration
Pacemaker
configuration
Pacemaker
configuration
Pacemaker
configuration
Instance
network name
Instance
network name
Instance
network name
Pacemaker cluster virtual IP
Storage Storage Shared storage
Secondary
replica
DNS name (manual registration)
Secondary
replica
Secondary
replica
Primary
replica
47. New Cluster Types
New to SQL Server 2017 (14.x) is
the introduction of a cluster type
for AGs:
• WSFC – Windows Server Failover
Cluster.
• External – Pacemaker will be used
underneath the AG on Linux.
• None – No cluster manager:
• Only supports manual failover.
• Used for the read-scale scenarios.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-availability-group-overview?view=sql-server-2017#cluster-type-and-failover-mode
48. Configuration-only replica and quorum
• A two-node setup is not enough for Availability Groups.
• For an FCI, the quorum mechanisms provided by Pacemaker can be fine because all FCI failover arbitration
happens at the cluster layer.
• For an AG, arbitration under Linux happens in SQL Server, where all the metadata is stored.
• External Availability Groups can maintain quorum and enable automatic failovers by using:
• Three synchronous replicas (SQL Server Enterprise only); or
• Two replicas (primary and secondary) + a configuration only replica.
• A configuration-only replica
• Stores the AG configuration in the master database, same as the other replicas in the AG.
• Does not have the user databases participating in the AG.
• Configuration data is sent synchronously from the primary.
• Can be SQL Server Express to minimize licensing costs and support AGs on 2-node Standard Edition.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-availability-group-overview?view=sql-server-2017#configuration-only-replica-and-quorum
49. required_synchronized_secondaries_to_commit
• New to SQL Server 2017 (14.x), this tells the AG the number of secondary replicas
that must be in lockstep with the primary.
• Enables automatic failover when integrated with Pacemaker and a cluster type of
External.
• The behaviour is as follows under Linux:
• 0 - No automatic failover is possible since no synchronized secondary replica is required.
• 1 - One secondary replica must be in a synchronized state; automatic failover is possible. The
primary database is unavailable until a secondary synchronous replica is available.
• 2 - Both secondary replicas in a three or more node AG configuration must be synchronized
with the primary; automatic failover is possible.
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-availability-group-overview?view=sql-server-2017#configuration-only-replica-and-quorum
50. required_synchronized_secondaries_to_commit
# [centos4]
pcs resource update sqlag required_synchronized_secondaries_to_commit=1
# [centos3]
shutdown now
# [centos4]
Msg 988, Level 14, State 1, Line 11
Unable to access database 'testdb' because it lacks a quorum of nodes for high availability. Try the operation again later.
# [centos4]
pcs resource update sqlag required_synchronized_secondaries_to_commit=0
# [centos4]
Works!
51. Configuring Availability Groups on Linux
• Linux prerequisites
• Configure hosts file
• Enable MSSQL
• Enable MSSQL HA
• Configure Firewall
• Configure SQL Server
• Create Master Key
• Create Login & User per node
• Create, Copy, Restore Certificates
• Create HADR endpoint
• Create & Backup database
• Enable Event Sessions
• Create Availability Group
• Create pacemaker login
• Configure Linux
• Create pacemaker password file
• Install pacemaker & dependencies
• Set hacluster password
• Install MSSQL HA
• Configure Firewall
• Configure Pacemaker
• Authenticate Cluster Nodes
• Create Cluster
• Disable STONITH
• Enable Services
• Create ag resource
• Create ip resource
• Set resource dependencies
55. Setting Active Directory Authentication
• Linux prerequisites
• Install realmd, kerberos, &
dependencies
• Confirm AD is set as DNS Server
• Set hosts file with FQDN
• Configure AD
• Create AD user
• Set Service Principal Name (SPN)
• Add DNS records
• Configure Linux
• Join the AD Domain
• Test user info retrieval from AD
• Get Kerberos ticket for the AD account
• Check Key Version Number (kvno) for
SPN
• Configure SQL Server keytab
• Create keytab file for SPNs
• Add machine account
• Secure keytab file
• Set SQL Server for kerberos
authentication with keytab file
• Optimise AD connectivity
• Disable Kerberos UDP connections
• Disable SSSD calls to use LDAP directly
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-active-directory-authentication?view=sql-server-2017
58. Register Service Principal Names (SPN)
# AES256-CTS-HMAC-SHA1-96
256-bit AES key with ciphertext stealing and an SHA-1 HMAC truncated at 96 bits.
#RC4-HMAC
RC4 encryption with an MD5 HMAC.
60. Cross-Platform Availability Groups
• Usually used for read-scale scenarios. It is not a high
availability setup and only manual failover are allowed!
• Up to 17 readable secondary replicas
• Only an AG with a cluster type of NONE can have its replicas
cross OS boundaries.
• E.g. a Windows-based primary replica and Linux-based
secondary.
• A Distributed AG can also cross OS boundaries and provide
geographic read-scale. Each AG must obey it’s platform rules:
• WSFC – Windows only
• External – Linux only
• Drive and folder structure for user databases in an AG should
be identical; However cross-platform paths are different:
• X:MSSQLDATAtestdb.mdf – Windows
• /var/opt/mssql/data/testdb.mdf – Linux
https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-availability-group-cross-platform?view=sql-server-2017
65. Glossary
• STONITH (Shoot The Other Node In The Head) maintains the integrity of a high-availability
clusters by shutting down malfunctioning nodes.
• REALM is a command line tool that can be used to manage enrolment in kerberos realms, like
Active Directory domains or IPA domains.
• SSSD (System Security Services Daemon) provides a set of daemons to manage access to remote
directories and authentication mechanisms.
• SPN (Service Principal Name) is the name by which a Kerberos client uniquely identifies an
instance of a service for a given Kerberos server.
• kinit command obtains and caches an initial ticket-granting ticket for principal.
• kvno command acquires a service ticket for the specified Kerberos principals and prints out the
key version numbers of each.
• keytab files allow server applications to accept authentications from clients, but can also be used
to obtain initial credentials for client applications.
• ktutil command invokes a command interface from which an administrator can read, write, or
edit entries in a keytab or Kerberos srvtab file.
68. Also happening this month
SQL Server 2019: More intelligent than ever
by Malta Microsoft Data Platform User Group
A webcast on December 20th at 7PM.
More info: https://malta.pass.org
Registration: https://www.eventbrite.com/e/sql-server-2019-more-
intelligent-than-ever-tickets-53216519041
69. Call for speakers
• We are working on our 2019 calendar of events and thus looking for speakers on
a variety of subjects, including:
o AI & Machine Learning
o Azure & Cloud Computing *
o Containerisation and Orchestration
o IOT
o Micro Services & Event Sourcing
o Real-time Data warehousing
• The Global Azure Bootcamp 2019 happening on April 27! *
• http://tech-spark.com/become-a-speaker/
• http://tech-spark.com/sponsorships/