Windows azure sql_database_security_isug012013sqlserver.co.il
This document discusses security for Microsoft SQL Azure (now called Windows Azure SQL Database). It provides an overview of SQL Database and its security capabilities, best practices for securing SQL Database like using encryption and configuring firewall rules, and limitations compared to on-premises SQL Server. It also introduces GreenSQL as a software-based database proxy that can provide additional security functionality for SQL Database like preventing SQL injection, auditing, and data masking. GreenSQL aims to offer a more complete solution for security, compliance, and hybrid application support compared to the native capabilities in SQL Database.
The document discusses the SQL Server plan cache, which stores and reuses query execution plans. It describes what is stored in the plan cache, how plans are looked up and aged out, and dynamic management views for exploring the plan cache. Methods covered include identifying unoptimized ad hoc queries, parameterizing queries for better plan reuse, and handling cases where plan reuse is not possible like with local variables.
This document summarizes upcoming SQL Server events in January 2013 in Israel, including multi-day training sessions, user group meetings, and virtual chapter meetings on SQL Server administration and development topics. It also lists current job openings and previews the tips and presentations for an upcoming user group meeting, including how Database Administration Console improvements in SQL Server 2012 will impact administrators and real-world query tuning case studies.
The document discusses the evolution of data-tier applications (DACs) and database administration over time. It notes that in the past, database administrators (DBAs) and developers worked in silos, making development, deployment, and management challenging. Recent investments in tools like SQL Server Data-tier Applications (DACs) now allow for more integrated development workflows and easier deployment and management of databases at scale. The document outlines some key concepts and enhancements in DACs over multiple versions to improve collaboration and move developers to a more declarative model.
The document discusses the role of the SQL query optimizer in generating efficient query plans. It describes the optimizer's multi-stage process of parsing the SQL statement, binding objects, optimizing through different search levels, applying logical and physical properties and over 350 rules to simplify and optimize the query tree, and selecting the cheapest plan. It notes challenges like a large number of possible join orders and timeouts during complex optimizations.
The document describes several SQL server monitoring and management tools from Docco Labs, including ClipTable for data import, Database File Explorer for file usage monitoring, Log Table Viewer for logging, and SQL Stripes for server monitoring and control. SQL Stripes is a T-SQL based solution that monitors metrics like CPU, disk usage, locks, and pings and notifies users of issues by email, web, audio or visual alerts. It aims to fill the gap between generic monitoring tools and agent-specific alerts.
Introducing 3 FREE Smart solutions for SQL Server (Adi Sapir, Docco Labs)
As Database experts, we work with SQL Server Databases on a daily basis. We face the same problems every SQL Administrator and/or developer does. And – we spend our time writing solutions for these problems! In this session Adi will introduce the following 3, totally FREE solutions:
· ClipTable – A revolutionary new *anything* to SQL Table importer
· Database File Explorer – a much easier way to explore our database->filegroups->files->storage mapping
· Log Table Viewer – a complete client/server logger solution for SQL Server
Read committed snapshot isolation (RCSI) allows readers to see committed data without blocking writers or other readers. It can greatly reduce locking and deadlocking. SQL Server supports partition-level lock escalation, allowing concurrent access to different partitions. Filtered indexes improve performance by indexing a subset of table data. Optimize for ad hoc workloads improves plan caching for queries that are run infrequently. Enabling data compression reduces database size and storage costs without requiring application changes.
Windows azure sql_database_security_isug012013sqlserver.co.il
This document discusses security for Microsoft SQL Azure (now called Windows Azure SQL Database). It provides an overview of SQL Database and its security capabilities, best practices for securing SQL Database like using encryption and configuring firewall rules, and limitations compared to on-premises SQL Server. It also introduces GreenSQL as a software-based database proxy that can provide additional security functionality for SQL Database like preventing SQL injection, auditing, and data masking. GreenSQL aims to offer a more complete solution for security, compliance, and hybrid application support compared to the native capabilities in SQL Database.
The document discusses the SQL Server plan cache, which stores and reuses query execution plans. It describes what is stored in the plan cache, how plans are looked up and aged out, and dynamic management views for exploring the plan cache. Methods covered include identifying unoptimized ad hoc queries, parameterizing queries for better plan reuse, and handling cases where plan reuse is not possible like with local variables.
This document summarizes upcoming SQL Server events in January 2013 in Israel, including multi-day training sessions, user group meetings, and virtual chapter meetings on SQL Server administration and development topics. It also lists current job openings and previews the tips and presentations for an upcoming user group meeting, including how Database Administration Console improvements in SQL Server 2012 will impact administrators and real-world query tuning case studies.
The document discusses the evolution of data-tier applications (DACs) and database administration over time. It notes that in the past, database administrators (DBAs) and developers worked in silos, making development, deployment, and management challenging. Recent investments in tools like SQL Server Data-tier Applications (DACs) now allow for more integrated development workflows and easier deployment and management of databases at scale. The document outlines some key concepts and enhancements in DACs over multiple versions to improve collaboration and move developers to a more declarative model.
The document discusses the role of the SQL query optimizer in generating efficient query plans. It describes the optimizer's multi-stage process of parsing the SQL statement, binding objects, optimizing through different search levels, applying logical and physical properties and over 350 rules to simplify and optimize the query tree, and selecting the cheapest plan. It notes challenges like a large number of possible join orders and timeouts during complex optimizations.
The document describes several SQL server monitoring and management tools from Docco Labs, including ClipTable for data import, Database File Explorer for file usage monitoring, Log Table Viewer for logging, and SQL Stripes for server monitoring and control. SQL Stripes is a T-SQL based solution that monitors metrics like CPU, disk usage, locks, and pings and notifies users of issues by email, web, audio or visual alerts. It aims to fill the gap between generic monitoring tools and agent-specific alerts.
Introducing 3 FREE Smart solutions for SQL Server (Adi Sapir, Docco Labs)
As Database experts, we work with SQL Server Databases on a daily basis. We face the same problems every SQL Administrator and/or developer does. And – we spend our time writing solutions for these problems! In this session Adi will introduce the following 3, totally FREE solutions:
· ClipTable – A revolutionary new *anything* to SQL Table importer
· Database File Explorer – a much easier way to explore our database->filegroups->files->storage mapping
· Log Table Viewer – a complete client/server logger solution for SQL Server
Read committed snapshot isolation (RCSI) allows readers to see committed data without blocking writers or other readers. It can greatly reduce locking and deadlocking. SQL Server supports partition-level lock escalation, allowing concurrent access to different partitions. Filtered indexes improve performance by indexing a subset of table data. Optimize for ad hoc workloads improves plan caching for queries that are run infrequently. Enabling data compression reduces database size and storage costs without requiring application changes.
- Distributed Replay allows replaying a captured workload from multiple client computers to better simulate production loads.
- A controller coordinates the replay across clients to reproduce the original query rates or run in stress test mode faster than original rates.
- It improves on SQL Server Profiler for application compatibility testing, performance debugging, capacity planning, and benchmarking.
- Events are replayed in synchronization mode to match original order, or unsynchronized to stress test without timing constraints.
Predicates allow filtering events based on:
- Event properties (fields)
- Session properties
- System properties
They are evaluated synchronously when the event fires. This allows filtering events and reducing overhead compared to capturing all events.
Common predicates:
- event_name = 'sql_statement_completed'
- database_id = 5
- cpu_time > 1000
Predicates give granular control over what events are captured.
The document discusses enhancements to Extended Events in SQL Server 2012. It provides an overview of Extended Events, terminology used in Extended Events, and highlights key enhancements in SQL Server 2012 such as an improved user interface, expanded system coverage, and a managed code API.
SQL Explore 2012 - Michael Zilberstein: ColumnStoresqlserver.co.il
This document discusses how columnstore indexes in Microsoft SQL Server can boost query performance. It provides an overview of column-oriented databases and columnstore technology. Columnstore indexes store data by column rather than by row, allowing for improved compression techniques like dictionary encoding. This reduces storage space and I/O. It also allows for more efficient query processing through batch execution and new execution plan elements. The document outlines best practices, limitations, issues and workarounds, as well as how to load data with columnstore indexes. It provides references for further reading on columnstore performance tuning.
- The document discusses the challenges of database development and deployment processes and how the Data-Tier Application Framework (DAC Fx) addresses these challenges.
- DAC Fx allows developers to model the database in a declarative way and generates deployment scripts and files (.dacpac) that simplify the deployment process for both developers and DBAs.
- It also enables cross-platform deployment of databases to both on-premises and cloud platforms like SQL Azure.
SQL Server 2012 introduced new spatial data types like circular arcs and support for full globe objects. It also enhanced spatial indexing with automatic grid generation and index hints. Other improvements included additional methods for spatial aggregations and reorienting objects on the globe. Overall, the new capabilities expanded support for advanced geospatial analysis and improved performance of spatial queries.
Hadoop is an open-source framework for storing and processing large datasets in a distributed computing environment. It allows for the storage and analysis of datasets that are too large for single servers. The document discusses several key Hadoop components including HDFS for storage, MapReduce for processing, HBase for column-oriented storage, Hive for SQL-like queries, Pig for data flows, and Sqoop for data transfer between Hadoop and relational databases. It provides examples of how each component can be used and notes that Hadoop is well-suited for large-scale batch processing of data.
SQL Server allows for parallel processing to improve query performance. It uses multiple threads or workers that can run tasks such as reading, writing, and calculating in parallel across multiple CPU cores. The degree of parallelism (DOP) or number of threads used can be configured through settings like MAXDOP. Determining the optimal DOP requires testing different values and monitoring performance and waits to find the best setting for each workload type.
Common Errors That Effect Performance (Adi Cohen, Naya-Tech)
There are a few common errors that have a negative effect on performance. In this session we will review some of them, see why they impact performance and provide alternative solutions. Among the issues we will cover are:
· Misunderstanding of the query plan when using procedures
· Query plan differences between procedures and ad-hoc batches
· The differences between a temporary table and a table variable
· And many more…
Who is afraid of Columnstore Indexes? (Michael Zilberstein, DB-Art)
This talk describes new SQL Server 2012 feature called "columnstore index". In this session we will learn about the differences between columnstore indexes and B-Tree indexes we are used to work with. We will see when it is best to use and when not to use this new index. We will cover limitations that columnstore index imposes on the tables that use it and how to live with those limitations. Like in all my sessions, I won't let you go without some internals – how columnstore index is organized on a physical level and how Query Processor works this new type of index. And of course Demos, Demos, Demos…
Bi303 data warehousing with fast track and pdw - Assaf Fraenkelsqlserver.co.il
HP offers two solutions for data warehousing - Fast Track and Parallel Data Warehouse. Fast Track provides reference architectures using SQL Server for balanced deployments scaling from 8-80TB. Parallel Data Warehouse uses a massively parallel processing architecture to scale SQL Server deployments to petabytes of data. It uses a scale-out architecture with distributed data and query processing. This provides very high performance for large and complex workloads.
Trace flags are used to temporarily change SQL Server's behavior for debugging or diagnosing issues. This document discusses several trace flags including:
TF 652, 661, 834, 836 which disable certain SQL Server processes or enable large page allocations.
TF 1211, 1224 which avoid lock escalation. TF 1117 forces data files to auto grow equally. TF 1204, 1205, 1222 provide more information on deadlocks.
TF 1118 addresses tempdb contention. TFs 3226, 3014, 3004 provide more backup/restore details. TF 4199 enables query processor fixes. TF 3502 prints checkpoint messages.
The document provides explanations of these trace flags
Fast transition to sql server 2012 from mssql 2005 2008 for developers - Dav...sqlserver.co.il
Rafael Advanced Defense Systems is an Israeli defense technology company that designs, develops, manufactures and supplies defense systems for air, land, sea and space applications. It has annual sales exceeding $1.85 billion and employs about 7,000 people. The document discusses using analytic functions in SQL Server 2012, including new functions added in 2012 and enhanced window function support, and provides examples of how various analytic functions can be used to analyze sales data.
The document discusses Microsoft SQL Server 2008 R2's FILESTREAM feature. FILESTREAM allows storing unstructured binary large objects (BLOBs) such as documents, images, and videos on the file system rather than in a database. It integrates access to this file data into the database for transactional consistency. Some key points covered include FILESTREAM storage in NTFS directories, its security model using standard SQL Server permissions, and accessing BLOBs using both T-SQL queries and file streaming APIs.
This document summarizes Valinor's services as the leading company in Israel for professional database services. It lists that Valinor has:
- An expert consulting team specialized in all database layers
- Partnerships with Microsoft and Oracle
- Over 300 customers across all sectors
The document then discusses Valinor's agenda for an upcoming event which includes discussing the utility control point, detecting bottlenecks, and new performance monitoring features in Windows 2008 R2.
This document discusses different techniques for scaling out SQL Server databases including peer-to-peer replication and AlwaysOn availability groups. Peer-to-peer replication allows databases to scale out horizontally by replicating across multiple writable nodes. It provides redundancy and allows online upgrades but requires careful schema and topology design. AlwaysOn availability groups in SQL Server 2011 provide automatic failover between up to four read-only replicas of a database along with other high availability features. The document recommends using these technologies to scale out databases, increase performance, eliminate downtime, and reduce unplanned outages.
This document discusses various data compression methods that can be used to reduce the size of databases and improve performance. It covers physical compression techniques like data compression, archiving, and using smaller data types. It also covers logical compression methods like partitioning data horizontally and vertically, creating covering indexes, and filtered indexes. The goal of these compression methods is to address challenges of storing and accessing large amounts of data by minimizing the data size and amount of data that needs to be processed for queries and other operations.
The document discusses various techniques for managing performance and concurrency in SQL Server databases. It covers new features in SQL Server 2008/R2 such as read committed snapshot isolation, partition-level lock escalation, filtered indexes, and bulk loading. It also discusses tools for monitoring performance like the Utility Control Point and Performance Monitor. The document uses case studies to demonstrate how these techniques can be applied.
- Distributed Replay allows replaying a captured workload from multiple client computers to better simulate production loads.
- A controller coordinates the replay across clients to reproduce the original query rates or run in stress test mode faster than original rates.
- It improves on SQL Server Profiler for application compatibility testing, performance debugging, capacity planning, and benchmarking.
- Events are replayed in synchronization mode to match original order, or unsynchronized to stress test without timing constraints.
Predicates allow filtering events based on:
- Event properties (fields)
- Session properties
- System properties
They are evaluated synchronously when the event fires. This allows filtering events and reducing overhead compared to capturing all events.
Common predicates:
- event_name = 'sql_statement_completed'
- database_id = 5
- cpu_time > 1000
Predicates give granular control over what events are captured.
The document discusses enhancements to Extended Events in SQL Server 2012. It provides an overview of Extended Events, terminology used in Extended Events, and highlights key enhancements in SQL Server 2012 such as an improved user interface, expanded system coverage, and a managed code API.
SQL Explore 2012 - Michael Zilberstein: ColumnStoresqlserver.co.il
This document discusses how columnstore indexes in Microsoft SQL Server can boost query performance. It provides an overview of column-oriented databases and columnstore technology. Columnstore indexes store data by column rather than by row, allowing for improved compression techniques like dictionary encoding. This reduces storage space and I/O. It also allows for more efficient query processing through batch execution and new execution plan elements. The document outlines best practices, limitations, issues and workarounds, as well as how to load data with columnstore indexes. It provides references for further reading on columnstore performance tuning.
- The document discusses the challenges of database development and deployment processes and how the Data-Tier Application Framework (DAC Fx) addresses these challenges.
- DAC Fx allows developers to model the database in a declarative way and generates deployment scripts and files (.dacpac) that simplify the deployment process for both developers and DBAs.
- It also enables cross-platform deployment of databases to both on-premises and cloud platforms like SQL Azure.
SQL Server 2012 introduced new spatial data types like circular arcs and support for full globe objects. It also enhanced spatial indexing with automatic grid generation and index hints. Other improvements included additional methods for spatial aggregations and reorienting objects on the globe. Overall, the new capabilities expanded support for advanced geospatial analysis and improved performance of spatial queries.
Hadoop is an open-source framework for storing and processing large datasets in a distributed computing environment. It allows for the storage and analysis of datasets that are too large for single servers. The document discusses several key Hadoop components including HDFS for storage, MapReduce for processing, HBase for column-oriented storage, Hive for SQL-like queries, Pig for data flows, and Sqoop for data transfer between Hadoop and relational databases. It provides examples of how each component can be used and notes that Hadoop is well-suited for large-scale batch processing of data.
SQL Server allows for parallel processing to improve query performance. It uses multiple threads or workers that can run tasks such as reading, writing, and calculating in parallel across multiple CPU cores. The degree of parallelism (DOP) or number of threads used can be configured through settings like MAXDOP. Determining the optimal DOP requires testing different values and monitoring performance and waits to find the best setting for each workload type.
Common Errors That Effect Performance (Adi Cohen, Naya-Tech)
There are a few common errors that have a negative effect on performance. In this session we will review some of them, see why they impact performance and provide alternative solutions. Among the issues we will cover are:
· Misunderstanding of the query plan when using procedures
· Query plan differences between procedures and ad-hoc batches
· The differences between a temporary table and a table variable
· And many more…
Who is afraid of Columnstore Indexes? (Michael Zilberstein, DB-Art)
This talk describes new SQL Server 2012 feature called "columnstore index". In this session we will learn about the differences between columnstore indexes and B-Tree indexes we are used to work with. We will see when it is best to use and when not to use this new index. We will cover limitations that columnstore index imposes on the tables that use it and how to live with those limitations. Like in all my sessions, I won't let you go without some internals – how columnstore index is organized on a physical level and how Query Processor works this new type of index. And of course Demos, Demos, Demos…
Bi303 data warehousing with fast track and pdw - Assaf Fraenkelsqlserver.co.il
HP offers two solutions for data warehousing - Fast Track and Parallel Data Warehouse. Fast Track provides reference architectures using SQL Server for balanced deployments scaling from 8-80TB. Parallel Data Warehouse uses a massively parallel processing architecture to scale SQL Server deployments to petabytes of data. It uses a scale-out architecture with distributed data and query processing. This provides very high performance for large and complex workloads.
Trace flags are used to temporarily change SQL Server's behavior for debugging or diagnosing issues. This document discusses several trace flags including:
TF 652, 661, 834, 836 which disable certain SQL Server processes or enable large page allocations.
TF 1211, 1224 which avoid lock escalation. TF 1117 forces data files to auto grow equally. TF 1204, 1205, 1222 provide more information on deadlocks.
TF 1118 addresses tempdb contention. TFs 3226, 3014, 3004 provide more backup/restore details. TF 4199 enables query processor fixes. TF 3502 prints checkpoint messages.
The document provides explanations of these trace flags
Fast transition to sql server 2012 from mssql 2005 2008 for developers - Dav...sqlserver.co.il
Rafael Advanced Defense Systems is an Israeli defense technology company that designs, develops, manufactures and supplies defense systems for air, land, sea and space applications. It has annual sales exceeding $1.85 billion and employs about 7,000 people. The document discusses using analytic functions in SQL Server 2012, including new functions added in 2012 and enhanced window function support, and provides examples of how various analytic functions can be used to analyze sales data.
The document discusses Microsoft SQL Server 2008 R2's FILESTREAM feature. FILESTREAM allows storing unstructured binary large objects (BLOBs) such as documents, images, and videos on the file system rather than in a database. It integrates access to this file data into the database for transactional consistency. Some key points covered include FILESTREAM storage in NTFS directories, its security model using standard SQL Server permissions, and accessing BLOBs using both T-SQL queries and file streaming APIs.
This document summarizes Valinor's services as the leading company in Israel for professional database services. It lists that Valinor has:
- An expert consulting team specialized in all database layers
- Partnerships with Microsoft and Oracle
- Over 300 customers across all sectors
The document then discusses Valinor's agenda for an upcoming event which includes discussing the utility control point, detecting bottlenecks, and new performance monitoring features in Windows 2008 R2.
This document discusses different techniques for scaling out SQL Server databases including peer-to-peer replication and AlwaysOn availability groups. Peer-to-peer replication allows databases to scale out horizontally by replicating across multiple writable nodes. It provides redundancy and allows online upgrades but requires careful schema and topology design. AlwaysOn availability groups in SQL Server 2011 provide automatic failover between up to four read-only replicas of a database along with other high availability features. The document recommends using these technologies to scale out databases, increase performance, eliminate downtime, and reduce unplanned outages.
This document discusses various data compression methods that can be used to reduce the size of databases and improve performance. It covers physical compression techniques like data compression, archiving, and using smaller data types. It also covers logical compression methods like partitioning data horizontally and vertically, creating covering indexes, and filtered indexes. The goal of these compression methods is to address challenges of storing and accessing large amounts of data by minimizing the data size and amount of data that needs to be processed for queries and other operations.
The document discusses various techniques for managing performance and concurrency in SQL Server databases. It covers new features in SQL Server 2008/R2 such as read committed snapshot isolation, partition-level lock escalation, filtered indexes, and bulk loading. It also discusses tools for monitoring performance like the Utility Control Point and Performance Monitor. The document uses case studies to demonstrate how these techniques can be applied.
1. חברים יקרים,
לחגוג יום הולדת זה קל. עושים זאת כל שנה.
אף אנו כבר חגגנו עשרה ימי הולדת מאז שהקבוצה נוסדה.
לחגוג מאה מפגשים אפשר רק פעם אחת.
כולכם מוזמנים לחגוג איתנו את מפגש המאה. והפעם, באווירה מיוחדת ושונה.
ההרצאה המרכזית, הרצאת אורח של ניר טנצר ממיקרוסופט עוסקת בחדשנות. את
המהפכה הטכנולוגית של העשורים האחרונים כולנו חווים, רק נסו לדמיין את עצמכם לפני
חמש עשרה שנה, ועתה נסו לדמיין מה טומן בחובו העתיד, חמש עשרה שנה מהיום.
במיקרוסופט, בחרו בחדשנות ככוכב הצפון ובהרצאה זו נביט איך חברת תוכנה מובילה,
חוקרת ומיישמת חדשנות תוך כדי הצצה לעתיד.
בנוסף להרצאה האורח שתי הרצאות קצרות ומיוחדות של עמי ודובי, אשר מעדיפים לשמור
(ביחד וכל אחד לחוד) על זכות השתיקה ולא לפרט...
בין לבין: ברכות, הפתעות, כיבוד משובח ופרסים רבים ויקרי ערך!
הפרס הראשון, מנוי 0102 MSDN Ultimate VS
בשווי של 000,21~ דולר!
ISraeli User Group
2. המפגש יערך כהרגלנו ביום שני, הראשון של חודש ספטמבר,
בתאריך 0102.9.6 באולם דקל בבית מיקרוסופט, רחוב הפנינה 2 רעננה.
בתכנית:
התכנסות וכיבוד 03:71
פתיחה, הודעות וברכות 00:81
ניר טנצר – הצצה לעתיד כוחה של תוכנה 51:81
הפסקה קצרה 01:91
עוד ברכות, פרסים והפתעות 02:91
עמי לוין – חצאי סיכומים בנבכי האופטימייזר 03:91
דובי לבל - From CP to RDB 00:02
סיכומים, עוד ברכות והגרלת הפרס הראשון 03:02
בשל ההכנות המיוחדות הפעם,
נודה לכם אם תאשרו הגעתכם במייל חוזר על ידי לחיצה על הלינק הבא:
ISraeli User Group
3. כמו כן נחגוג במעמד זה את הצטרפות קבוצת המשתמשים באופן רשמי לארגון PASS
העולמי ונראה מה צופן העתיד (הורוד) לקבוצה.
המלצה חמה:
עוד לפני המפגש, כדאי לכם מאוד להקדים ולהרשם לאתר החדש של קבוצת
המשתמשים בכתובת /http://israel.sqlpass.org
* הלינק להרשמה נמצא מצד ימין למעלה בדף הראשי
יש לנו גם תיבת דוא"ל חדשה בכתובת ISUG@sqlpass.orgואתם מוזמנים לשלוח לנו כל
תגובה, רעיון, הצעה או סתם ברכה.
מחכים לראותכם במפגש!!!
ISraeli User Group