Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Geek Sync | Linux, Containers, and SQL Server—Get Ready for Big Data Clusters in SQL Server


Published on

You can find the webinar replay in the IDERA Resource Center:

Microsoft introduced Big Data Clusters at the recent Ignite conference. SQL Server Big Data Clusters only run on Kubernetes—a container orchestration platform that lets you run SQL Server on Linux, offering high availability and disaster recovery. While high availability and disaster recovery were a challenge on Linux in SQL Server 2017, Kubernetes makes this process painless and simplifies the overall deployment process.

Join IDERA and Joey D’Antoni as he walks through how to deploy, configure, and maintain your SQL Server containers so they are available and meet your performance needs.

Speaker: Joey D'Antoni is a Senior Consultant and SQL Server MVP with over a decade of experience working in both Fortune 500 and smaller firms. He is a Principal Architect for Denny Cherry and Associates and lives in Malvern, PA. He is a frequent speaker at major tech events, and blogger about all topics technology. He believes that no single platform is the answer to all technology problems. He holds a BS in Computer Information Systems from Louisiana Tech University and an MBA from North Carolina State University, and is the co-author of the Microsoft white paper "Using Power BI in a Hybrid Environment.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Geek Sync | Linux, Containers, and SQL Server—Get Ready for Big Data Clusters in SQL Server

  1. 1. © 2018 IDERA, Inc. All rights reserved. LINUX, CONTAINERS, AND SQL SERVER— GET READY FOR BIG DATA CLUSTERS IN SQL SERVER Joey D’Antoni 05 December 2018
  2. 2. Joey D’Antoni Joey has over 20 years of experience with a wide variety of data platforms, in both Fortune 50 companies as well as smaller organizations He is a frequent speaker on database administration, big data, and career management MVP, MCSE BI and Data Platform VMWare vExpert He is the co-president of the Philadelphia SQL Server User’s Group He wants you to make sure you can restore your data
  3. 3. Why Now?
  4. 4. Increase analytics and apps performance Compute pool SQL Compute Node SQL Compute Node SQL Compute Node … Compute pool SQL Compute Node IoT data Directly read from HDFS Persistent storage … Storage pool SQL Serve r Spark HDFS Data Node SQL Serve r Spark HDFS Data Node SQL Serve r Spark HDFS Data Node Kubernetes pod Analytics Custom apps B I SQL Server master instance Node Node Node Node Node Node Node SQL Data pool SQL Data Node SQL Data Node Compute pool SQL Compute Node Storage Storage
  5. 5. Simplified deployment with containers & Kubernetes A container is a standardized unit of software that includes everything needed to run it Kubernetes is a container hosting platform Benefits of containers and Kubernetes: 1. Fast to deploy 2. Self-contained – no installation required 3. Upgrades are easy because - just upload a new image 4. Scalable, multi-tenant, designed for elasticity Kubernetes pod SQL Server HDFS Data Node Spark
  6. 6. Concepts SQL Server in Containers still has some limitations •AD Authentication •Availability Groups •A few other features—most of the Linux footprint 1 So why bother learning about this? •Containers right now are where virtualization was in 2003 •This is the future of infrastructure 2
  7. 7. Agenda • What Are Containers? • Storage Persistence • What is Kubernetes? • SQL Server and Kubernetes • The Future?
  8. 8. Benefits of Containers • Containers are faster to deploy than VMs • Fully software defined • Containers themselves are ephemeral • Storage is persisted • Better density than VMs • Lower performance overhead than a VM • Built natively around cloud services
  9. 9. If Containers Are Ephemeral What About my Data All container platforms allow for some measure of persisted storage This is the notion of separating data from compute which has always been hard in RDBMS
  10. 10. SQL Server and Docker Demo
  11. 11. That’s Cool— But What About HA/DR You can have multiple hosts (servers) in your Docker Swarm to protect against hardware failure Service failure is a little bit difference Wait for the next slide
  12. 12. Introducing Kubernetes
  13. 13. Kubernetes at 10,000 ft Kubernetes (K8s) is a container orchestration system that was developed at Google and referred to as “Borg” Performs scaling, self-healing, load-balancing, rolling updates and much more.. Written in Go Frequently deployed in conjunction with Docker using containerd service and Docker registry
  14. 14. Kubernetes Arch Concepts
  15. 15. SQL Server on Kubernetes Physical Architecture
  16. 16. Concepts Masters—head nodes that run the cluster Nodes—Individual hosts (servers or VMs) that run the cluster Declarative Model—Template for your service Pods—K8s unit of deployment Services—provide reliable network endpoint for a set of pods Load Balancer—provides persisted IP address for your container
  17. 17. SQL Server and Kubernetes Demo
  18. 18. Summary Containers are the now and the future of infrastructure Kubernetes has won the container wars and looks to be the leading platform going forward This changes the way we think about servers, but you still need to protect your data
  19. 19. References The Kubernetes Book— Nigel Poulton Kubernetes Up and Running—Beda, Burns, and Hightower Designing Distributed Systems—Burns Site Reliability Engineering—Beyer et al.
  20. 20. 22© 2017 IDERA, Inc. All rights reserved. Proprietary and confidential. THANKS! Any questions? You can find me at: @jdanton