Eladio Rincón discusses Microsoft SQL Server 2016's Stretch Database capability. Stretch Database allows organizations to migrate cold, historical data from on-premises SQL Server databases to Microsoft Azure for cost savings while still allowing the data to be queried locally and on Azure. The key benefits are reducing storage costs for large datasets, providing indefinite data retention within a consolidated datacenter in Azure, and ensuring business service level agreements are met. Stretch Database uses secure connections and provides backup, restore, and auditing functionality across the on-premises and Azure environments.
This document discusses Live Query Statistics and the Query Store in Microsoft SQL Server 2016 for troubleshooting query performance issues. Live Query Statistics allows viewing execution plans and metrics of in-flight queries. The Query Store provides a dedicated store for query performance data, capturing plan histories and metrics to help identify regressed queries and other issues. Enabling these tools helps DBAs monitor performance and address issues like slow queries and plans impacted by upgrades or data changes.
Live Query Statistics and Query Store are new features in SQL Server 2016 that provide insights into query performance. Live Query Statistics allows users to view live execution plans and operator statistics to troubleshoot long-running or problematic queries. Query Store automatically captures query histories, plans, and runtime statistics to help users identify performance regressions and force previous high-performing plans. Both features aim to simplify performance troubleshooting and provide greater visibility into the query optimization and execution process.
This document provides an overview of Always Encrypted in Microsoft SQL Server 2016, which allows customers to securely store sensitive data outside of their trust boundary while protecting data from highly privileged users. Key capabilities of Always Encrypted include client-side encryption of sensitive data using keys never provided to the database system and support for queries on encrypted data, with minimal application changes required.
A walkthrough on implementing Always Encrypted Encryption on sensitive information to reduce your attack surface area and develop an active data security posture.
The document discusses technologies within the Microsoft SQL family and Azure SQL that can help organizations address requirements of the General Data Protection Regulation (GDPR). It covers features for discovering and classifying personal data, managing access and controlling how data is used, and protecting data through encryption, auditing and other security controls. Built-in technologies like dynamic data masking, row-level security, authentication options, and transparent data encryption are described as ways SQL Server and Azure SQL Database can help organizations comply with GDPR.
This document summarizes new features in SQL Server 2016. It discusses improvements to columnstore indexes, in-memory OLTP, the query store, temporal tables, always encrypted, stretch database, live query statistics, row level security, and dynamic data masking. It provides links to documentation and demos for these features. It also suggests what may be included in future CTP releases and lists resources for learning more about SQL Server 2016.
This document provides an introduction and background about the presenter along with information about SQL Database. The presenter has over 30,000 hours of training experience with SQL Server and various Microsoft certifications. They created SQL School Greece as a resource for IT professionals and others interested in SQL Server. The presentation will cover what SQL Database is on Azure, its service tiers including basic, standard, and premium, database transaction units (DTUs), the Azure SQL Database logical server, management tools for SQL Database, and securing SQL Database. It concludes with an invitation to sign up for SQL PASS and follow the presenter on social media.
Row Level Security (RLS) enables implementation of row-level access restrictions in SQL Server. RLS uses predicate functions to define the security logic and filters rows for queries based on that logic. Security predicates bind the predicate functions to tables and are defined as filter predicates to silently filter rows or blocking predicates to prevent write operations. Best practices include keeping the security logic simple and on separate schemas for maintenance. RLS has some limitations including incompatibility with Filestream and Polybase.
This document discusses Live Query Statistics and the Query Store in Microsoft SQL Server 2016 for troubleshooting query performance issues. Live Query Statistics allows viewing execution plans and metrics of in-flight queries. The Query Store provides a dedicated store for query performance data, capturing plan histories and metrics to help identify regressed queries and other issues. Enabling these tools helps DBAs monitor performance and address issues like slow queries and plans impacted by upgrades or data changes.
Live Query Statistics and Query Store are new features in SQL Server 2016 that provide insights into query performance. Live Query Statistics allows users to view live execution plans and operator statistics to troubleshoot long-running or problematic queries. Query Store automatically captures query histories, plans, and runtime statistics to help users identify performance regressions and force previous high-performing plans. Both features aim to simplify performance troubleshooting and provide greater visibility into the query optimization and execution process.
This document provides an overview of Always Encrypted in Microsoft SQL Server 2016, which allows customers to securely store sensitive data outside of their trust boundary while protecting data from highly privileged users. Key capabilities of Always Encrypted include client-side encryption of sensitive data using keys never provided to the database system and support for queries on encrypted data, with minimal application changes required.
A walkthrough on implementing Always Encrypted Encryption on sensitive information to reduce your attack surface area and develop an active data security posture.
The document discusses technologies within the Microsoft SQL family and Azure SQL that can help organizations address requirements of the General Data Protection Regulation (GDPR). It covers features for discovering and classifying personal data, managing access and controlling how data is used, and protecting data through encryption, auditing and other security controls. Built-in technologies like dynamic data masking, row-level security, authentication options, and transparent data encryption are described as ways SQL Server and Azure SQL Database can help organizations comply with GDPR.
This document summarizes new features in SQL Server 2016. It discusses improvements to columnstore indexes, in-memory OLTP, the query store, temporal tables, always encrypted, stretch database, live query statistics, row level security, and dynamic data masking. It provides links to documentation and demos for these features. It also suggests what may be included in future CTP releases and lists resources for learning more about SQL Server 2016.
This document provides an introduction and background about the presenter along with information about SQL Database. The presenter has over 30,000 hours of training experience with SQL Server and various Microsoft certifications. They created SQL School Greece as a resource for IT professionals and others interested in SQL Server. The presentation will cover what SQL Database is on Azure, its service tiers including basic, standard, and premium, database transaction units (DTUs), the Azure SQL Database logical server, management tools for SQL Database, and securing SQL Database. It concludes with an invitation to sign up for SQL PASS and follow the presenter on social media.
Row Level Security (RLS) enables implementation of row-level access restrictions in SQL Server. RLS uses predicate functions to define the security logic and filters rows for queries based on that logic. Security predicates bind the predicate functions to tables and are defined as filter predicates to silently filter rows or blocking predicates to prevent write operations. Best practices include keeping the security logic simple and on separate schemas for maintenance. RLS has some limitations including incompatibility with Filestream and Polybase.
This document provides information about a webinar on SQL Server 2016 Stretch Database presented by Antonios Chatzipavlis. The webinar covers an introduction to Stretch Database, its limitations and pricing, backup and restore of Stretch databases, and frequently asked questions. Antonios Chatzipavlis has over 30 years of experience working with computers and SQL Server. He is a Microsoft Certified Trainer and SQL Server Evangelist who runs the SQL School Greece training organization.
SQL Server 2016 includes several new features such as columnstore indexes, in-memory OLTP, live query statistics, temporal tables, and row-level security. It also features improved manage backup functionality, support for multiple tempdb files, and new ways to format and encrypt query results. Advanced capabilities like PolyBase and Stretch Database further enhance analytics and management of historical data.
SQL Server 2016 introduces new editions that provide varying levels of capabilities for different workloads. The key editions are Express, Standard, and Enterprise. Express is free and ideal for small applications. Standard provides core data management and business intelligence. Enterprise delivers comprehensive datacenter capabilities for mission critical workloads and advanced analytics. All editions now support new security features and hybrid cloud capabilities like stretch database.
Geek Sync | How to Be the DBA When You Don't Have a DBA - Eric Cobb | IDERAIDERA Software
Not everyone has a full time database administrator on staff, and in many cases the responsibility of managing the SQL Server falls on the developers. But as long as the backups are running successfully you’re good, right? Not exactly. Your databases could be heading for trouble! Without proper tuning and maintenance, your database performance can grind to a halt.
Tailored to the “Non-DBA”, this session will show you how to configure your SQL Server like a DBA would, and why some SQL Servers default settings may be slowing you down. Discussing server settings, database configurations, and recommended maintenance, you will leave this session with the knowledge and scripts you need to help configure your SQL Server instance to fit your workload, and ensure that your SQL Server and databases are running smoothly.
View the original webcast: https://register.gotowebinar.com/register/8360496614712105997
The document discusses SQL Server monitoring and troubleshooting. It provides an overview of SQL Server monitoring, including why it is important and common monitoring tools. It also describes the SQL Server threading model, including threads, schedulers, states, the waiter list, and runnable queue. Methods for using wait statistics like the DMVs sys.dm_os_waiting_tasks and sys.dm_os_wait_stats are presented. Extended Events are introduced as an alternative to SQL Trace. The importance of establishing a performance baseline is also noted.
Dynamic data masking is a data protection feature in SQL Server 2016 that masks sensitive data in query results without altering the actual data. It can help protect private information by exposing only obfuscated data to unauthorized users. Administrators can configure masking rules for specific columns using various masking functions like default, email, random, or custom string masking. The underlying data remains intact but masked data is returned for users without unmask permissions. It provides data security with minimal performance impact by masking results on-the-fly.
SQL Server 2016: Just a Few of Our DBA's Favorite ThingsHostway|HOSTING
Join Rodney Landrum, Senior DBA Consultant for Ntirety, a division of HOSTING, as he demonstrates his favorite new features of the latest Microsoft SQL Server 2016 Service Pack 1.
During the accompanying webinar and slides, Rodney will touch on the following:
• A demo of his favorite new features in SQL Server 2016 and SP1 including:
o Query Store
o Database Cloning
o Dynamic Data Masking
o Create or Alter
• A review of Enterprise features that are now available in standard edition
• New information in Dynamic Management Views and SQL Error Log that will make your DBAs job easier.
This document provides a summary of Antonios Chatzipavlis's background and experience working with SQL Server. It details his career starting with SQL Server 6.0 in 1996 and earning his first Microsoft certification. It lists the various Microsoft certifications and roles he has held, including becoming an MVP for SQL Server. It also introduces his creation of SQL School Greece in 2012 to share his knowledge.
Be Proactive: A Good DBA Goes Looking for Signs of Trouble | IDERAIDERA Software
A proactive approach to database maintenance helps DBAs prevent problems. This involves regular backups at intervals determined by recovery point objectives. Backup types include full, differential, and transaction log backups. DBAs should also regularly test restores, check for database integrity issues, set up agent alerts, and ensure proper indexing to optimize query performance.
Implementing Mobile Reports in SQL Sserver 2016 Reporting ServicesAntonios Chatzipavlis
The document provides an overview of implementing mobile reports in SQL Server 2016 Reporting Services. It discusses preparing data for mobile reports, using the SQL Server Mobile Report Publisher tool, and publishing mobile reports. The presenter has extensive experience with SQL Server and provides their qualifications. The presentation also provides information on optimizing reports, formatting time data, using filters and Excel files in reports, and designing reports using navigators and visualizations in the Mobile Report Publisher tool. It demonstrates the tool's interface and capabilities.
Advanced SQL Server Performance Tuning | IDERAIDERA Software
The document discusses tips for improving SQL Server performance for both on-premises and Azure databases. It notes that on-premises performance issues are often due to disk latency, while Azure databases may be impacted by storage limitations that can be addressed by adding virtual memory. The document recommends frequent monitoring of Azure databases and understanding wait types, blocking, and query statistics as techniques that can improve performance for both SQL Server and Azure SQL databases.
Geek Sync | SQL Security Principals and Permissions 101IDERA Software
You can watch the replay for this Geek Sync webcast, SQL Security Principals and Permissions 101, in the IDERA Resource Center, http://ow.ly/Sos650A4qKo.
Join IDERA and William Assaf for a ground-floor introduction to SQL Server permissions. This webinar will start with the basics and move into the security implications behind stored procedures, views, database ownership, application connections, consolidated databases, application roles, and much more. This session is perfect for junior DBAs, developers, and system admins of on-premises and Azure-based SQL platforms.
Speaker: William Assaf, MCSE, is a principal consultant and DBA Manager in Baton Rouge, LA. Initially a .NET developer, and later into database administration and architecture, William currently works with clients on SQL Server and Azure SQL platform optimization, management, disaster recovery and high availability, and manages a multi-city team of SQL DBAs at Sparkhound. William has written for Microsoft SQL Certification exams since 2011 and was the lead author of "SQL Server 2017 Administration Inside Out" by Microsoft Press, its second edition due out in 2019. William is a member of the Baton Rouge User Groups Board, a regional mentor for PASS, and head of the annual SQLSaturday Baton Rouge Planning Committee.
The document provides an overview and summary of new features in Microsoft SQL Server 2016. It discusses enhancements to the database engine, in-memory OLTP, columnstore indexes, R services, high availability, security, and Reporting Services. Key highlights include support for up to 2TB of durable memory-optimized tables, increased index key size limits, temporal data support, row-level security, and improved integration with Azure and Power BI capabilities. The presentation aims to help users understand and leverage the new and improved features in SQL Server 2016.
Azure database services for PostgreSQL and MySQLAmit Banerjee
The slide deck that Rachel and I had used to present on an overview of the managed PostgreSQL and MySQL service on Azure at SQL Saturday Redmond, 2018. This is part of the Azure Database family.
SQL Server 2016 New Features and EnhancementsJohn Martin
SQL Server 2016 new features session that I delivered at SQL Relay 2015 at; Reading, London, Cardiff and Birmingham.
Looking at some of the new features currently slated for inclusion in the next version of Microsoft SQL Server 2016.
Demo Code can be found at: http://1drv.ms/1PC5smY
En esta sesión revisamos las nuevas mejoras y funcionalidades que estarán implementadas en la siguiente versión de SQL Server principalmente en Seguridad, Rendimiento y Alta Disponibilidad
This document discusses Row-Level Security (RLS) and Dynamic Data Masking in Microsoft SQL Server 2016. It provides an overview of RLS benefits like fine-grained access control and increased security. Examples demonstrate how to create a security policy with a filter predicate. Dynamic Data Masking helps prevent data abuse by masking sensitive data for unauthorized users according to a defined policy, without affecting the underlying data. Limitations include that masking cannot be used on certain column types.
This document discusses new features in SQL Server 2012 that are useful for database administrators. It covers features like AlwaysOn availability groups for high availability and disaster recovery, columnstore indexes for analytics, contained databases, user-defined server roles, increased partition limits, IntelliSense improvements, new date/time and logical functions, and other features for the cloud, big data, and parallel data warehouses. The document encourages attendees to learn more through Microsoft Virtual Academy courses, TechEd conferences, and certification programs.
SQL Saturday 510 Paris 2016 - Query Store session - finalPhilippe Geiger
Session sur SQL Server 2016 - Query Store animée conjointe avec Sarah Bessard.
Titre complet de la session : Query Store
ou comment donner de la mémoire à sa base de données
This document provides information about a webinar on SQL Server 2016 Stretch Database presented by Antonios Chatzipavlis. The webinar covers an introduction to Stretch Database, its limitations and pricing, backup and restore of Stretch databases, and frequently asked questions. Antonios Chatzipavlis has over 30 years of experience working with computers and SQL Server. He is a Microsoft Certified Trainer and SQL Server Evangelist who runs the SQL School Greece training organization.
SQL Server 2016 includes several new features such as columnstore indexes, in-memory OLTP, live query statistics, temporal tables, and row-level security. It also features improved manage backup functionality, support for multiple tempdb files, and new ways to format and encrypt query results. Advanced capabilities like PolyBase and Stretch Database further enhance analytics and management of historical data.
SQL Server 2016 introduces new editions that provide varying levels of capabilities for different workloads. The key editions are Express, Standard, and Enterprise. Express is free and ideal for small applications. Standard provides core data management and business intelligence. Enterprise delivers comprehensive datacenter capabilities for mission critical workloads and advanced analytics. All editions now support new security features and hybrid cloud capabilities like stretch database.
Geek Sync | How to Be the DBA When You Don't Have a DBA - Eric Cobb | IDERAIDERA Software
Not everyone has a full time database administrator on staff, and in many cases the responsibility of managing the SQL Server falls on the developers. But as long as the backups are running successfully you’re good, right? Not exactly. Your databases could be heading for trouble! Without proper tuning and maintenance, your database performance can grind to a halt.
Tailored to the “Non-DBA”, this session will show you how to configure your SQL Server like a DBA would, and why some SQL Servers default settings may be slowing you down. Discussing server settings, database configurations, and recommended maintenance, you will leave this session with the knowledge and scripts you need to help configure your SQL Server instance to fit your workload, and ensure that your SQL Server and databases are running smoothly.
View the original webcast: https://register.gotowebinar.com/register/8360496614712105997
The document discusses SQL Server monitoring and troubleshooting. It provides an overview of SQL Server monitoring, including why it is important and common monitoring tools. It also describes the SQL Server threading model, including threads, schedulers, states, the waiter list, and runnable queue. Methods for using wait statistics like the DMVs sys.dm_os_waiting_tasks and sys.dm_os_wait_stats are presented. Extended Events are introduced as an alternative to SQL Trace. The importance of establishing a performance baseline is also noted.
Dynamic data masking is a data protection feature in SQL Server 2016 that masks sensitive data in query results without altering the actual data. It can help protect private information by exposing only obfuscated data to unauthorized users. Administrators can configure masking rules for specific columns using various masking functions like default, email, random, or custom string masking. The underlying data remains intact but masked data is returned for users without unmask permissions. It provides data security with minimal performance impact by masking results on-the-fly.
SQL Server 2016: Just a Few of Our DBA's Favorite ThingsHostway|HOSTING
Join Rodney Landrum, Senior DBA Consultant for Ntirety, a division of HOSTING, as he demonstrates his favorite new features of the latest Microsoft SQL Server 2016 Service Pack 1.
During the accompanying webinar and slides, Rodney will touch on the following:
• A demo of his favorite new features in SQL Server 2016 and SP1 including:
o Query Store
o Database Cloning
o Dynamic Data Masking
o Create or Alter
• A review of Enterprise features that are now available in standard edition
• New information in Dynamic Management Views and SQL Error Log that will make your DBAs job easier.
This document provides a summary of Antonios Chatzipavlis's background and experience working with SQL Server. It details his career starting with SQL Server 6.0 in 1996 and earning his first Microsoft certification. It lists the various Microsoft certifications and roles he has held, including becoming an MVP for SQL Server. It also introduces his creation of SQL School Greece in 2012 to share his knowledge.
Be Proactive: A Good DBA Goes Looking for Signs of Trouble | IDERAIDERA Software
A proactive approach to database maintenance helps DBAs prevent problems. This involves regular backups at intervals determined by recovery point objectives. Backup types include full, differential, and transaction log backups. DBAs should also regularly test restores, check for database integrity issues, set up agent alerts, and ensure proper indexing to optimize query performance.
Implementing Mobile Reports in SQL Sserver 2016 Reporting ServicesAntonios Chatzipavlis
The document provides an overview of implementing mobile reports in SQL Server 2016 Reporting Services. It discusses preparing data for mobile reports, using the SQL Server Mobile Report Publisher tool, and publishing mobile reports. The presenter has extensive experience with SQL Server and provides their qualifications. The presentation also provides information on optimizing reports, formatting time data, using filters and Excel files in reports, and designing reports using navigators and visualizations in the Mobile Report Publisher tool. It demonstrates the tool's interface and capabilities.
Advanced SQL Server Performance Tuning | IDERAIDERA Software
The document discusses tips for improving SQL Server performance for both on-premises and Azure databases. It notes that on-premises performance issues are often due to disk latency, while Azure databases may be impacted by storage limitations that can be addressed by adding virtual memory. The document recommends frequent monitoring of Azure databases and understanding wait types, blocking, and query statistics as techniques that can improve performance for both SQL Server and Azure SQL databases.
Geek Sync | SQL Security Principals and Permissions 101IDERA Software
You can watch the replay for this Geek Sync webcast, SQL Security Principals and Permissions 101, in the IDERA Resource Center, http://ow.ly/Sos650A4qKo.
Join IDERA and William Assaf for a ground-floor introduction to SQL Server permissions. This webinar will start with the basics and move into the security implications behind stored procedures, views, database ownership, application connections, consolidated databases, application roles, and much more. This session is perfect for junior DBAs, developers, and system admins of on-premises and Azure-based SQL platforms.
Speaker: William Assaf, MCSE, is a principal consultant and DBA Manager in Baton Rouge, LA. Initially a .NET developer, and later into database administration and architecture, William currently works with clients on SQL Server and Azure SQL platform optimization, management, disaster recovery and high availability, and manages a multi-city team of SQL DBAs at Sparkhound. William has written for Microsoft SQL Certification exams since 2011 and was the lead author of "SQL Server 2017 Administration Inside Out" by Microsoft Press, its second edition due out in 2019. William is a member of the Baton Rouge User Groups Board, a regional mentor for PASS, and head of the annual SQLSaturday Baton Rouge Planning Committee.
The document provides an overview and summary of new features in Microsoft SQL Server 2016. It discusses enhancements to the database engine, in-memory OLTP, columnstore indexes, R services, high availability, security, and Reporting Services. Key highlights include support for up to 2TB of durable memory-optimized tables, increased index key size limits, temporal data support, row-level security, and improved integration with Azure and Power BI capabilities. The presentation aims to help users understand and leverage the new and improved features in SQL Server 2016.
Azure database services for PostgreSQL and MySQLAmit Banerjee
The slide deck that Rachel and I had used to present on an overview of the managed PostgreSQL and MySQL service on Azure at SQL Saturday Redmond, 2018. This is part of the Azure Database family.
SQL Server 2016 New Features and EnhancementsJohn Martin
SQL Server 2016 new features session that I delivered at SQL Relay 2015 at; Reading, London, Cardiff and Birmingham.
Looking at some of the new features currently slated for inclusion in the next version of Microsoft SQL Server 2016.
Demo Code can be found at: http://1drv.ms/1PC5smY
En esta sesión revisamos las nuevas mejoras y funcionalidades que estarán implementadas en la siguiente versión de SQL Server principalmente en Seguridad, Rendimiento y Alta Disponibilidad
This document discusses Row-Level Security (RLS) and Dynamic Data Masking in Microsoft SQL Server 2016. It provides an overview of RLS benefits like fine-grained access control and increased security. Examples demonstrate how to create a security policy with a filter predicate. Dynamic Data Masking helps prevent data abuse by masking sensitive data for unauthorized users according to a defined policy, without affecting the underlying data. Limitations include that masking cannot be used on certain column types.
This document discusses new features in SQL Server 2012 that are useful for database administrators. It covers features like AlwaysOn availability groups for high availability and disaster recovery, columnstore indexes for analytics, contained databases, user-defined server roles, increased partition limits, IntelliSense improvements, new date/time and logical functions, and other features for the cloud, big data, and parallel data warehouses. The document encourages attendees to learn more through Microsoft Virtual Academy courses, TechEd conferences, and certification programs.
SQL Saturday 510 Paris 2016 - Query Store session - finalPhilippe Geiger
Session sur SQL Server 2016 - Query Store animée conjointe avec Sarah Bessard.
Titre complet de la session : Query Store
ou comment donner de la mémoire à sa base de données
Arthur Luz is a data insights consultant at Microsoft who gave a presentation on SQL Server 2016 temporal tables. The presentation included an overview of history tables, demonstrations of creating temporal tables and manipulating historical data, considerations for using temporal tables regarding resources, and differences between change data capture and temporal tables. New features for temporal tables include support for in-memory tables which allow for hybrid transactional/analytical processing scenarios.
An introduction to SQL Server in-memory OLTP EngineKrishnakumar S
This is an introduction to Microsoft SQL Server In-memory Engine that was earlier code named Hekaton. It describes the basic concepts and technologies involved in the in-memory engine - This has presented in Kerala - Microsoft Users Group Meeting on May 31, 2014
Back to the future - Temporal Table in SQL Server 2016Stéphane Fréchette
SQL Server 2016 CTP2 introduced support for temporal tables as a database feature that provides built-in support for provide information about data stored in the table at any point in time rather than only the data that is correct at the current moment in time.
Topics will cover:
What is a Temporal Table?, Why Temporal? How does this work?, When to use (use cases) and demos...
SQL Server Query Store allows administrators to monitor and troubleshoot query performance issues over time. It works by collecting and storing execution plans, runtime statistics, and configurations for queries running in the database. The Query Store can help identify queries that have recently experienced performance regressions, analyze overall resource consumption trends, and track the top resource-intensive queries. It provides views and stored procedures to help manage and retrieve stored query data. Best practices include using the latest SQL Server Management Studio, adjusting Query Store settings for the workload, and regularly checking forced plan statuses.
Stretch Database allows migrating historical transactional data from an on-premises SQL Server database transparently to Microsoft Azure cloud storage. It enables seamless queries of data regardless of its location. Some limitations include inability to enforce uniqueness on stretched tables and limitations on allowed actions. Performance can degrade due to the additional overhead of query translation and data movement between on-premises and cloud locations. Remote data files provide an alternative method of archiving to cloud storage without changes to table structures but only overhead is additional latency.
Travelling in time with SQL Server 2016 - Damian WideraITCamp
SQL Server 2016 comes up with a very exciting feature called Temporal tables. You can make queries to historical data lot easier by using this feature. The mechanism is very simple however you all should know it in depth to make sure you can use it efficiently. And this is exactly what I am going to do during this session – show you how to create temporal tables, how to use and manage them.
This document proposes a new approach called a temporal snapshot fact table to analyze insurance data daily over many decades in a space-efficient manner. Traditional solutions like transactional, accumulating, and periodic snapshot fact tables are not feasible due to the large volume of data. The new approach models each fact row as a time interval rather than a point in time. This reduces duplication and allows representing the data using temporal logic and operators. Technical challenges around data integration and cube modeling are addressed through refactoring the source data into a common set of time intervals and modeling the intervals relationally in the cube.
Live Presentation Transformation From Boring to Effective - Boris HristovITCamp
Are you being asked to present in front of your team or is presenting just part of your work? Have you seen one of those nasty PowerPoint slideshows that make you pick up your phone and do something more interesting on the second minute? If so, join me in this session where I will not just share, but show you how you can transform ineffective slides to such that are not just visually appealing, but also bringing value to both your audience and your session. Yes, this is a live demo, so prepare to have fun!
High Availability & Disaster Recovery with SQL Server 2012 AlwaysOn Availabil...turgaysahtiyan
The AlwaysOn Availability Groups feature is a high-availability and disaster-recovery solution that provides an enterprise-level alternative to database mirroring. Introduced in SQL Server 2012, AlwaysOn Availability Groups maximizes the availability of a set of user databases for an enterprise. In this session we will talk about what’s coming with Always On, and how does it help to improve high availability and disaster recovery solutions.
A small set of slides to explain big data, data warehousing and business intelligence to everyone. Easy as drinking a glass of freshly brewed orange juice.
This document provides an overview of In-Memory OLTP and other SQL Server 2016 features such as Stretch Database, Always Encrypted, Dynamic Data Masking, and Query Store. It discusses how In-Memory OLTP can significantly improve database application performance through its memory-optimized tables and natively compiled stored procedures. It also summarizes capabilities for several high availability and security features introduced in SQL Server 2016.
SQL Data Services is a cloud-based database service based on SQL Server technology that provides a highly available and scalable infrastructure for storing and querying data. It eliminates the need to manage database servers and storage. The data model uses a flexible schema-less approach based on entities, properties, and containers. SQL Data Services supports common scenarios like reporting, ETL, data mining, and data sync between applications and mobile users.
TDC2016POA | Trilha Cloud Computing - Microsoft Azure ? From Zero To Hero!tdc-globalcode
This document discusses several topics related to SQL Server and Azure:
- It lists the specifications of 3 Microsoft datacenters including their square footage, power capacity, and cooling methods.
- It outlines the architecture components of Remote Desktop Services including servers, databases, and connections.
- It provides an overview of options for hosting SQL Server including on physical machines, virtual machines, and Azure SQL Database.
- It describes the capabilities and benefits of stretching SQL Server databases from on-premises to Azure including querying remote data.
- It discusses tools for development including Team Projects, version control, and DevTest Labs templates.
- It outlines 3 common methodologies for migrating databases between SQL Server and Azure SQL Database.
Red Rock Consulting is an Australian IT services company focused on providing solutions using Microsoft SQL Server and Oracle technologies. They have developed RockSolid, an automated database management product that uses virtualization and automation to provide consistent high service levels for SQL Server instances. RockSolid monitors databases, analyzes issues, resolves problems automatically using predefined processes, and provides capacity planning to reduce management costs and improve support.
Azure SQL Database now has a Managed Instance, for near 100% compatibility for lifting-and-shifting applications running on Microsoft SQL Server to Azure. Contact me for more information.
Azure SQL DB Managed Instances Built to easily modernize application data layerMicrosoft Tech Community
The document discusses Azure SQL Database Managed Instance, a new fully managed database service that provides SQL Server compatibility. It offers seamless migration of SQL Server workloads to the cloud with full compatibility, isolation, security and manageability. Customers can realize up to a 406% ROI over on-premises solutions through lower TCO, automatic management and scaling capabilities.
Dans cette session nous vous présenterons les différentes manières d'utiliser SQL Server dans une infrastructure Cloud (Microsoft Azure). Seront présentés des scénarios hybrides, de migration, de backup, et d'hébergement de bases de données SQL Server en mode IaaS ou PaaS.
The new Microsoft Azure SQL Data Warehouse (SQL DW) is an elastic data warehouse-as-a-service and is a Massively Parallel Processing (MPP) solution for "big data" with true enterprise class features. The SQL DW service is built for data warehouse workloads from a few hundred gigabytes to petabytes of data with truly unique features like disaggregated compute and storage allowing for customers to be able to utilize the service to match their needs. In this presentation, we take an in-depth look at implementing a SQL DW, elastic scale (grow, shrink, and pause), and hybrid data clouds with Hadoop integration via Polybase allowing for a true SQL experience across structured and unstructured data.
Microsoft released SQL Azure more than two years ago - that's enough time for testing (I hope!). So, are you ready to move your data to the Cloud? If you’re considering a business (i.e. a production environment) in the Cloud, you need to think about methods for backing up your data, a backup plan for your data and, eventually, restoring with Red Gate Cloud Services (and not only). In this session, you’ll see the differences, functionality, restrictions, and opportunities in SQL Azure and On-Premise SQL Server 2008/2008 R2/2012. We’ll consider topics such as how to be prepared for backup and restore, and which parts of a cloud environment are most important: keys, triggers, indexes, prices, security, service level agreements, etc.
This document provides an agenda and summary for a Data Analytics Meetup (DAM) on March 27, 2018. The agenda covers topics such as disruption opportunities in a changing data landscape, transitioning from traditional to modern BI architectures using Azure, Azure SQL Database vs Data Warehouse, data integration with Azure Data Factory and SSIS, Analysis Services, Power BI reporting, and a wrap-up. The document discusses challenges around data growth, digital transformation, and the shrinking time for companies to adapt to disruption. It provides overviews and comparisons of Azure SQL Database, Data Warehouse, and related Azure services to help modernize analytics architectures.
SQL Azure Database provides a relational database service running on Microsoft's cloud platform. Future plans include improved database cloning for backups, scale-out support through dynamic database splitting and merging, and improved connectivity between on-premises and cloud databases using synchronization technologies. The goal is to provide a highly scalable database service with a seamless experience for both developers and administrators.
SQL Azure Database provides a relational database service running on Microsoft's cloud platform. Future plans include improved database cloning for backups, scale-out support through dynamic database splitting and merging, and improved connectivity between on-premises and cloud databases using synchronization technologies. The goal is to provide a highly scalable database service with a seamless experience for both developers and administrators.
Three key points from the document:
1. SQL Server 2005 introduces several new high availability and scalability features such as database mirroring and partitioning to protect against server failures and reduce database contention.
2. Database snapshots can be used to protect applications and users from errors by providing historical, read-only views of databases.
3. Optimistic concurrency controls and online index operations in SQL Server 2005 allow databases to remain available for reads and writes during maintenance operations.
This document provides an introduction and overview of Azure Data Lake. It describes Azure Data Lake as a single store of all data ranging from raw to processed that can be used for reporting, analytics and machine learning. It discusses key Azure Data Lake components like Data Lake Store, Data Lake Analytics, HDInsight and the U-SQL language. It compares Data Lakes to data warehouses and explains how Azure Data Lake Store, Analytics and U-SQL process and transform data at scale.
SQL Saturday Redmond 2019 ETL Patterns in the CloudMark Kromer
This document discusses ETL patterns in the cloud using Azure Data Factory. It covers topics like ETL vs ELT, scaling ETL in the cloud, handling flexible schemas, and using ADF for orchestration. Key points include staging data in low-cost storage before processing, using ADF's integration runtime to process data both on-premises and in the cloud, and building resilient data flows that can handle schema drift.
What is in a modern BI architecture? In this presentation, we explore PaaS, Azure Active Directory and Storage options including SQL Database and SQL Datawarehouse.
This document provides an overview of Microsoft Azure's database offerings, including SQL Server, Azure SQL Database, SQL Server on Azure Virtual Machines, Azure SQL Data Warehouse, and the Analytics Platform System. It describes features and differences between products, and includes sections on SQL Data Warehouse architecture, pricing, and PolyBase technology.
This document summarizes an SQL Server 2008 training course on implementing high availability features. It discusses database snapshots that allow querying from a point-in-time version of a database. It also covers configuring database mirroring, which provides redundancy by synchronizing a principal database to a mirror. Other topics include partitioned tables for improved concurrency, using SQL Agent proxies for job security, performing online index operations for minimal locking, and setting up mirrored backups.
SolidQ Summit 2018 - Qué necesita saber un DBA de Integration ServicesSolidQ
Este documento presenta una agenda para una charla sobre lo que necesita saber un administrador de base de datos sobre SQL Server Integration Services (SSIS). La charla cubrirá conceptos básicos como la arquitectura de SSIS, tareas administrativas comunes, sincronización de entornos, e importación y movimiento de datos. También incluirá consideraciones sobre instalación, seguridad, encriptación y desarrollo con SSIS.
SolidQ Summit 2018 - Seguridad a nivel datos. RLSSolidQ
http://bit.ly/SQSummit
Con el creciente despliegue de modelos tabulares y servicios de tiempo real conectados a ellos, nos surge siempre una misma pregunta: ¿Cómo controlo quien puede acceder a determinados datos en esos modelos y arquitecturas modernas? Abordaremos distintos escenarios de conexión de Power BI y modelos tabulares, su implementación, mantenimiento y buenas prácticas.
SolidQ Summit 2018 - Todo lo que un integrador de datos debería tener... y pa...SolidQ
http://bit.ly/SQSummit
A través de ejemplos vamos a ver porque las herramientas actuales de integración de datos han de experimentar una evolución significativa, tanto en su forma como en su fondo.
SolidQ Summit 2018 - ¿Dificultades gestionando relaciones muchos a muchos? De...SolidQ
Este documento introduce los grafos en SQL Server 2017. Explica que un grafo está compuesto de nodos y aristas que representan entidades y sus relaciones. SQL Server 2017 permite modelar grafos almacenando nodos y aristas como tablas tradicionales y usar el lenguaje Cypher para consultarlos. Aunque proporciona esta nueva funcionalidad, todavía tiene limitaciones como la falta de soporte para actualizaciones en aristas y algoritmos básicos de grafos.
http://bit.ly/SQSummit
En el último año el ecosistema de herramientas de visualización de Microsoft ha crecido, desarrollado y combinado entre sí. ¿Qué camino está tomando? ¿qué puedo hacer con Reporting Services que no pueda hacer con Power BI, Report Server o viceversa? Haremos un análisis de la característica que diferencian cada una, de forma muy rápida.
Vale, SQL Server 2017 corre en Linux, ¿me interesa? Sí, ¿por qué? Porque no hablamos simplemente de que corra un nuevo sistema operativo...sino que se pueden utilizar para despliegues rápidos en entornos escalables basados en docker, kubernetes, etc. Daremos un repaso a cómo aprovecharnos de los nuevos escenarios de despliegue en nuestras empresas, aunque sean tradicionalmente entornos Microsoft.
En la vida real, columnstore puede aplicar bien o mal. En esta sesión veremos qué podemos hacer para conseguir un verdadero real-time operational analytics en nuestros entornos OLTP.
En un mundo que se mueve rápido, la capacidad de reacción ante la toma de decisiones es primordial. Te enseñaremos a llevar tus datos allá donde vayas, visualizarlos como necesites y tomar el control. Para ello PowerApps permite visualizarlos como necesites y tomar el control. Para ello PowerApps permite integrar la suite de aplicaciones de Microsoft, de una manera ágil e intuitiva.
Jugando a ser rico: Machine Learning para predicción de stocksSolidQ
El documento presenta un resumen sobre el uso del machine learning para predecir acciones en el mercado de valores. Explica que se necesitan tendencias y periodicidad para hacer predicciones a futuro, y que tradicionalmente los análisis de acciones se han hecho de forma manual usando varios indicadores. Luego, describe cómo se puede aproximar este problema usando time series y agregando variables externas como indicadores económicos y de sentimiento a los modelos, transformando así los análisis de series temporales en problemas de regresión clásica.
Este documento describe una arquitectura propuesta para extraer datos de redes sociales de manera generalizada e independiente de cada plataforma. Se propone separar la extracción de datos en componentes genéricos para el manejo de autenticación, servicios de API y almacenamiento, con implementaciones específicas para cada red social. Esto permitiría extraer periódicamente datos de diferentes plataformas de manera unificada y almacenar la información de manera estructurada.
Cuando tomamos control de un servidor SQL Server en Flex Services, nosotros como operadores tenemos que sentirnos seguros con lo que estamos asumiendo. Para ello, hacemos un análisis del servidor donde revisamos elementos importantes del servidor como configuración del SQL, planes de mantenimiento, etc. En esta sesión, te enseñaremos lo importante de los diversos elementos básicos que revisamos para asegurarnos que tomamos el control de un servidos SQL Server que no nos va a dar sorpresas.
Este documento presenta información sobre bots y el framework de Microsoft para crear bots. Explica qué es un bot, los objetivos de crear uno, el ecosistema de Microsoft para bots, cómo crear un bot básico en .NET, los componentes como diálogos y tarjetas, y servicios adicionales como LUIS para entender el lenguaje natural. Finalmente, discute casos de uso y el futuro prometedor de los bots.
Las necesidades de análisis en los diferentes escenarios de negocio se vuelven cada vez más complejas. Dato histórico, dato en tiempo real, dato desde diferentes fuentes, dato predictivo, todo a la vez y en el mismo punto centralizado. ¿Nos hemos vuelto locos? ¿Es imposible? ¿No seremos capaces? Nada de eso, con Azure y una buena planificación conseguiremos una arquitectura con la última tecnología y que, sobre todo, cubre nuestras necesidades de análisis por complejas que sean.
Este documento presenta opciones de arquitectura para implementar soluciones de Business Intelligence (BI) de extremo a extremo en Azure. Describe los diferentes servicios de Azure para almacenamiento, eventos y streaming, y análisis de datos. También discute arquitecturas clásicas, en la nube y híbridas, con ejemplos de orígenes de datos para cada una. Finalmente, muestra demos de implementaciones de BI en Azure usando Azure Data Factory, SQL Server Integration Services y Azure Analysis Services.
¿Qué viene GDPR? Mi SQL está preparado- SolidQ Summit 2018SolidQ
El 25 de mayo entró en vigor el nuevo reglamento de protección de datos, en esta presentación te vamos a explicar qué es lo que tienes que tener en cuenta como un DBA para cumplir.
Hilando fino en SSAS multidimensional - SolidQ Summit 2018SolidQ
A raíz de un caso real, el equipo de SolidQ ha estado buscando la mejor manera de implementar una jerarquía padre-hijo de cuentas contables con un operador unitario que tuviera un buen rendimiento, a pesar de la gran cantidad de datos a la que tenía que enfrentarse. Veremos cómo aplanar la jerarquía, cómo implementarlo con SSAS, con una alternativa MDX, cómo añadir ordenación a las cuentas basadas en otro atributo, Time Balance Average y algún otro truco de tuning.
Adaptive Query Processing: Mejoras en el motor de consulta de SQL Server 2017...SolidQ
Este documento describe varias mejoras en el procesamiento de consultas adaptativas en SQL Server 2017, incluyendo el ámbito de la base de datos, el ajuste automático y el procesamiento de consultas adaptativas. El ámbito de la base de datos permite configuraciones específicas para cada base de datos. El ajuste automático incluye la administración automática de índices y la corrección automática de planes. El procesamiento de consultas adaptativas optimiza consultas durante la ejecución y mejora los joins adaptativos.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
20 Comprehensive Checklist of Designing and Developing a WebsitePixlogix Infotech
Dive into the world of Website Designing and Developing with Pixlogix! Looking to create a stunning online presence? Look no further! Our comprehensive checklist covers everything you need to know to craft a website that stands out. From user-friendly design to seamless functionality, we've got you covered. Don't miss out on this invaluable resource! Check out our checklist now at Pixlogix and start your journey towards a captivating online presence today.
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentations
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
2. Microsoft Stretch Database overview
Capabilities and functions
How Stretch Database works
Security, backup, and restoration features
Benefits of Stretch Database
3.
4. What do we have?
Massive tables
Cold data―infrequently accessed, always online
Maintenance challenges
Business service level agreements (SLAs) at risk
What do we need?
Expanded server and storage
Consolidated datacenter
Indefinite data storage
Flexible and safe options for moving and deleting data
Ever growing data, ever shrinking IT
5. Order History
Solution for securely stretching
cold tables to Microsoft Azure
with remote query processing
Capability
Stretches large operational tables from on-premises
to Azure with ability to query
Benefits
What is Microsoft Stretch Database?
Customers
Products
Order History
Stretch to cloud
Azure
SQL
Server
2016
SQL
App
Order History
Order History
6. With data continuously growing at a high rate, users generally want to retain
all of it—including closed business (archived) data—for purposes such as:
Regulatory compliance
Auditing
Planning
Nature of business
Determining what data can be safely deleted
Purpose
7. Accountants and auditors
Fraud investigators (insurance, banks)
Inventory and supply chain managers (retailers)
Business and planning analysts
Users
8.
9. Migrates your historical data to Microsoft Azure SQL Database
Offers option to pause data migration
Troubleshoots problems on local server
Maximizes available network bandwidth
Ensures no data is lost
Retries logic to handle connection issues
Uses dynamic management view to check migration status
Identifies databases and tables using Stretch Database Advisor, a
feature of Microsoft SQL Server 2016 Upgrade Advisor
Capabilities and functions
10. What can be used in it?
Transactional databases with large amounts of historical
data, typically stored in a small number of tables
Entire tables in Microsoft SQL Server 2016 Community
Technology Preview 3 (CTP 3.0)
11.
12. Creates a secure linked server
definition in the on-premises
SQL Server
Targets linked server definition as
the remote endpoint
Provisions remote resources and
begins to migrate eligible data, if
migration is enabled
Queries against tables run for both
local database and remote endpoint
On-premises instance Azure
Internetboundary
Linked servers
Remote
Endpoint
Remote Data
Local
Database
Eligible Data
Local Data
How Stretch Database works
13. -- Enable local server
EXEC sp_configure 'remote data archive' , '1';
RECONFIGURE;
-- Provide administrator credential to connect to
-- Azure SQL Database
CREATE CREDENTIAL <server_address> WITH
IDENTITY = <administrator_user_name>,
SECRET = <administrator_password>
-- Alter database for remote data archive
ALTER DATABASE <database name>
SET REMOTE_DATA_ARCHIVE = ON (SERVER = server name);
GO
-- Alter table for remote data archive
ALTER TABLE <table name>
ENABLE REMOTE_DATA_ARCHIVE
WITH ( MIGRATION_STATE = ON );
GO;
Typical workflow
High-level steps
Configure local server for remote
data archive
Create credential with
administrator permission
Alter specific database for remote
data archive
Alter table for remote data archive
14. Work without disruption
Business applications continue
working without disruption
Database administrator (DBA)
scripts and tools work as before;
all controls still held in local SQL
Server
Developers continue building or
enhancing applications with
existing tools and methods
Trickle migration
Orders Orders History
Orders History
15.
16. Security
Data in motion always via secure
channels (TLS1.1 / 1.2)
Always Encrypted supported if
enabled by user
Encryption key remains on-premises
Row-level security already works
with this feature
SQL Server and SQL Azure audit
already works with this feature
Trickle migration
Orders Orders History
Orders History
17. Backup and restoration
DBAs backup/restore local SQL
Server hot data only
Stretch Database ensures remote
data transactionally consistent with
local SQL Server
Upon completion of local
restoration, SQL Server reconciles
with remote using metadata―not
data copy―operation
SQL Server offers remote
restoration with time not
dependent on size of dataTrickle migration
Orders Orders History
Orders History
Backup/Restore
Auto reconcile
18. Enabling and disabling Stretch Database for SQL Server Instance
Configure databases for Stretch Database, migrate data, and query data on the remote endpoint
Enabling and Disabling Stretch Database for a database or table
CONTROL DATABASE permission
To configure a table for Stretch Database, you must have ALTER privilege
Data Access
Does not change the permissions model of an existing database
Capabilities and functions
19. Security and Permissions
On-premises instance Azure
Internetboundary
User Application
Linked servers
Local
Database
Eligible Data
Local Data
Remote
Endpoint
Remote Data
Objective: this slide introduces the overview section.
Talking points:
Traditional archiving solutions typically require:
Third-party software
Completely different data store and application to access
Some solutions depend on backups or offline storage
May be acceptable for some environments, but many enterprises want their archive stored where data was born
Also want archive to be accessible by using same application whenever needed, without having to wait for data to be restored or brought online
Objective: this slide shows the current IT landscape where data is growing while IT is shrinking in terms of resources and cost to maintain.
Talking points:
Typically, organizations have large transaction tables with enormous amounts of historical data. Think of a massive table with hundreds of millions or billions of rows with 70–80% cold data that users need to maintain online indefinitely. However, most of the time, only 20–30% of hot data gets accessed but cold data also needs to be online even though when accessed infrequently. This possesses a challenge for IT to maintain the continuity and management of hot and cold data and business service-level agreements (SLAs) at risk. In order to retain and maintain all the data, IT must:
Increase their resources, expand the server and storage capacity
Consolidate the data centers to have more IT resources pool
Traditional archiving solutions such as SSD + SAS + SATA for indefinite data storage
But all these resources burdens with large cost and maintenance complexity, they want low cost, flexible, and safe options for moving and deleting data.
Animation <<first click>> What do we have?
Animation <<second click>> What do we need?
Objective: this slide introduces the new feature of SQL Server 2016―Stretch Database, a solution for securely stretching cold tables to Microsoft Azure with remote query processing.
Talking points:
The Stretch Database feature securely and transparently archives your cold or historical data from a local SQL Server database to Azure SQL Database (the SQL Database service in Microsoft Azure Cloud is provided as a Platform as a Service [PaaS]) with remote query processing capability.
Animation <<On First Click>> Once you enable this feature for a table, SQL Server silently and transparently moves/migrates table data to Azure SQL Database
Animation <<On Second Click>> and no application change is required to access the data. You can still have a single query accessing these two types of data or tables
These are some of the benefits of using this feature:
Storage of cold data in Azure SQL Database is cost effective; that is, there is reduced cost and complexity in keeping cold data online in Azure SQL Database
Secure and transparent movement of cold or historical data without writing a data movement module; makes local queries and other database operations run faster as they have to work on hot data or local data most of the time
Archived data remains online and queryable like any other table in local SQL Server database
No application change is required to access these archived tables or data; a single query accessing these two types of data or tables at a given time or in the same query
The good part of this feature is (even though cold data is stored externally in Azure SQL Database but they are online), it is transitionally consistent and works with other SQL features like Always Encrypted, Row Level Security, etc.
Objective: this slide covers the purpose and reasons where Stretch Database provides great value.
Talking points:
Data is continuously growing at a high rate, and users generally want to retain all data—including closed business (archive/cold) data—for many possible reasons, such as:
Regulatory compliance; for example, taxes
Audit; for example, fraud investigation
Planning; for example, comparing past results
Nature of business; for example, retailer transaction details history
Inability to determine with certainty what can be safely deleted; for example, what might a government agency or major institutional investor ask for?
Objective: this slide covers the possible usage of Stretch Database in various user roles.
Talking points:
For accountants and auditors, Stretch Database makes it possible to expand the historical data kept for past audits and retain an elastic amount of storage for records that may be required in compliance with Tax, Securities Exchange Commissions (SEC), and Sarbanes-Oxley (SOX).
Fraud investigators are able to use Stretch Database to perform a thorough analysis of where fraud has occurred previously and determine areas of high risk.
Inventory and supply chain managers can use Stretch Database to analyze demographics and purchase history, using this information to forecast inventory needs.
By a similar token business and planning analysts can perform various analyses (such as statistics and forecasting) using the detailed metrics and historical data that Stretch Database helps these users archive.
Objective: this slide shows a brief overview of Stretch Database capabilities and functions and provides an understanding of what Stretch Database does.
Talking points:
After you enable Stretch Database for a local server instance, a database, and at least one table, it silently begins to migrate your historical data to an Azure SQL Database.
You can pause data migration to troubleshoot problems on the local server or to maximize the available network bandwidth.
Stretch Database ensures that no data is lost if a failure occurs during migration. It also has retry logic to handle connection issues that may occur during migration. A dynamic management view provides the status of migration.
You don't have to change existing queries and client apps. You continue to have seamless access to both local and remote data, even during data migration. There is a small amount of latency for remote queries, but you only encounter this latency when you query the historical data that's archived remotely.
Use Stretch Database Advisor, a feature of SQL Server 2016 Upgrade Advisor, to identify databases and tables for Stretch Database. Stretch Database Advisor helps you to adopt Stretch Database by analyzing existing database tables based on adjustable table size thresholds to identify candidates for Stretch Database. Stretch Database Advisor also identifies blocking issues.
Objective: this slide shows a brief overview of where Stretch Database can be used.
Talking points:
Archive transactional databases with large amounts of historical data, typically stored in a small number of tables. Archived transactional tables may contain more than a billion rows.
Migrate entire tables in Microsoft SQL Server 2016 Community Technology Preview 3 (CTP 3.0). In migrating tables in SQL Server 2016 Community Technology Preview 3 (CTP 3.0), this assumes that you already moved historical data into a table that's separate from current data.
Identify databases and tables using Stretch Database Advisor, a feature of Microsoft SQL Server 2016 Upgrade Advisor.
Objective: this slide shows the architecture and working components of Stretch Database. This slide also introduces some new terms that needs to be understood before diving into the architecture of Stretch Database.
Talking points:
Below are the terms and architecture concepts to understand regarding Stretch Database.
Terms
Local database: The on-premises SQL Server 2016 database.
Remote endpoint: The location in Microsoft Azure that contains the remote data for the database. In SQL Server 2016, this is an Azure SQL Database. This is subject to change in the future.
Local data: Data in a database with Stretch Database enabled that will not be moved to Azure based on the Stretch Database configuration of the tables in the database.
Eligible data: Data in a database with Stretch Database enabled that has not yet been moved, but will be moved to Azure based on the Stretch Database configuration of the tables in the database.
Remote data: Data in a database with Stretch Database enabled that has already been moved to Azure.
Architecture
Stretch Database leverages the resources in Microsoft Azure to offload archival data storage and query processing.
When you enable Stretch Database on a database, it creates a secure linked server definition in the on-premises SQL Server. This linked server definition has the remote endpoint as the target. When you enable Stretch Database on a table in the database, it provisions remote resources and begins to migrate eligible data, if migration is enabled.
Queries against tables with Stretch Database enabled automatically run against both the local database and the remote endpoint. Stretch Database leverages processing power in Azure to run queries against remote data by rewriting the query. You can see this rewriting as a “remote query” operator in the new query plan.
Source: https://msdn.microsoft.com/en-us/library/dn935011.aspx
Objective: this slide depicts the typical workflow to enable Stretch Database. At high level, this is three step process.
Talking points:
Before you configure a database for Stretch, we recommend that you run the Stretch Database Advisor to identify databases and tables that are eligible for Stretch. The Stretch Database Advisor also identifies blocking issues. Stretch Database migrates data to an Azure SQL Database. Therefore you have to have an Azure account and a subscription for billing. Here are the steps for typical workflow to enable Stretch Database.
Before you can enable Stretch Database on a database or a table, you have to enable it on the local server. This operation requires sysadmin or serveradmin permissions.
Enabling Stretch Database on a database also requires CONTROL DATABASE permissions. To configure a database for Stretch Database, the database has to have a database master key. The database master key secures the credentials that Stretch Database uses to connect to the remote database. When you configure a database for Stretch Database, you have to provide an administrator credential to connect to the associated Azure SQL Database.
To configure a database for Stretch Database, you need to alter the database for a remote data archive.
You can also alter tables for a remote data archive. In SQL Server 2016 Community Technology Preview 3 (CTP 3.0), Stretch Database migrates entire tables. This assumes that you already moved historical data into a table that's separate from current data.
Objective: with SQL Server 2016 Stretch Database, you can stretch large operational tables from on-premises to Azure with the ability to query with near-infinite capacity. This slide depicts that you don't have to change existing queries and client apps to work with Stretch Database.
Talking points:
With Stretch Database, you continue to have seamless access to both local and remote data, even during data migration. Once the selection is made, trickle data migration is used to move that data to Azure. The data can then be returned to on-premises storage. The data exchange is both transparent and bi-directional. During the stretching process, all the characteristics of the database stay intact. The code or stored procedures do not change. The user access control does not change either. This maintains the integrity of the data, while still enabling staff to work with it.
Applications continue to work without code changes or any disruption
Existing database administrator (DBA) skills and processes remain relevant, while the scripts and tools work as before and all controls still held in the local SQL Server
Developers can continue using current tools and APIs. Developers continue building or enhancing applications with existing tools and methods
Objective: this slide describes the various advanced security features that can combined with Stretch Database to provide a higher level of security to the data in motion or at rest.
Talking points:
Stretch Database can be used in tandem with the new Always Encrypted feature for data security. This new SQL Server 2016 technology applies to resting data as well as any data being transmitted. Transparent Data Encryption secures the data. Encryption key remains on-premises. Keys used are never provided to the database system or cloud service provider.
Stretch Database also works with Row Level Security. The SQL Server and SQL Azure audit is already currently working. The scenarios in which your organization may wish to use Stretch Database include a variety of data retention-related tasks, such as ensuring regulatory compliance, auditing, or business planning.
Objective: this slide talks about how backup and restoration takes place in Stretch Database.
Talking points:
You can continue to back up and restore Stretch-enabled databases by using the methods that you currently use.
A backup of a Stretch-enabled database is a shallow backup that does not include the data migrated to the remote serve. Backups on a database with Stretch Database enabled contain only local data and eligible data at the point in time when the backup runs. These backups also contain information about the remote endpoint where the remote data for the database resides. That means DBAs back up/restore local SQL Server hot data only.
When restoring a database that is Stretch-enabled, you'll have to reconnect the local database to the remote Azure SQL Database. You do this by running the stored procedure sys.sp_reauthorize_remote_data_archive as a database owner. Upon completion of local restoration, SQL Server reconciles with remote using metadata―not data copy―operation.
SQL Server offers remote restoration with time not dependent on size of data.
The backups for Azure SQL Databases for Basic, Standard, and Premium service tiers are taken every hour. The backup retention period varies depending on the service tier level. At time of writing, for basic it is 7 days, standard 14 days, and premium is 35 days. You can restore Azure SQL Databases by using the Microsoft Azure web portal.
Objective: this slide lists security and permissions considerations for Stretch Database.
Talking points:
Security and permissions considerations for Stretch Database include the following:
Enabling and disabling Stretch Database for SQL Server Instance
To begin configuring databases for Stretch Database, you must first change the “remote data archive” instance-level configuration option using sp_configure. This operation requires SYSADMIN or SERVERADMIN privileges. With this option enabled, you can configure databases for Stretch Database, migrate data, and query data on the remote endpoint. It's important to note that this option is not a switch that turns the Stretch Database feature on or off, and it's not a permission setting for configuring Stretch Database.
Enabling and Disabling a Stretch Database for a database or table
To configure a database for Stretch Database, you must have the CONTROL DATABASE permission. In addition, you have to have administrator permissions on the remote endpoint. (In CTP2, this means that, at configuration time, you have to provide the administrator login and password for the target Azure SQL Database.)
To configure a table for Stretch Database, you must have ALTER privilege on the table, and the database must already be configured for Stretch Database.
Data access
Only system processes can access the linked server definition behind Stretch Database. User logins can't issue queries through the linked server definition to the remote endpoint. Stretch Database does not change the permissions model of an existing database. User logins can query the data in a table with Stretch Database enabled through the local database. The local database performs permission checks for any actions initiated by the user in the same way as it does for any other objects. If you're authorized to access the table with Stretch Database enabled, you have access to all its contents for which you're authorized regardless of where the data physically resides.
Objective: this slide talks about the data access and permission flow in Stretch Database.
Talking points:
Only system processes can access the linked server definition behind Stretch Database. User logins can't issue queries through the linked server definition to the remote endpoint.
Stretch Database does not change the permissions model of an existing database. User logins can query the data in a table with Stretch Database enabled through the local database. The local database performs permission checks for any actions initiated by the user in the same way as it does for any other objects. If you're authorized to access the table with Stretch Database enabled, you have access to all its contents for which you're authorized regardless of where the data physically resides.