SQL Server "Yukon" and the Developer

Developer Track 8

Tom Davidson Program Manager SQL Server Development Microsoft Corporation SQL Server “Yukon” and the Developer

SQL Server “Yukon”
. NET Framework
Common Language Runtime Integration
User-defined Aggregates
User-defined Data Types
User-defined Functions
SQL Server .NET Data Provider
Extended Triggers
Data Types
Managed SQL Types
New XML Datatype
SQL Server Engine
New Message Service Broker
HTTP Support (Native HTTP)
Database Tuning Advisor
Enhanced Read ahead & scan
Extended Indexes
Multiple Active Result Sets
Persisted Computed Columns
Queuing Support
Snapshot Isolation Level
Scale Up Partitioning
VIA support
NUMA support
Database Failure and Redundancy
Fail-over Clustering (up to 8 node)
Enhanced Multi-instance Support
Database Mirroring
Database Views
XML
XQUERY Support (Server & Mid Tier)
XML Data Manipulation Language
FOR XML Enhancements
XML Schema (XSD) Support
MSXML 6.0 (Native)
.Net XML Framework
Database Maintenance
Backup and Restore Enhancements
Checksum Integrity Checks
Dedicated Administrator Connection
Dynamic AWE
Fast Recovery
Highly-available Upgrade
Online Index Operations
Online Restore
Parallel DBCC
Parallel Index Operations
Management Tools
MDX Query Editor
MDX Intellisense
T-SQL Intellisense
Version Control Support
XML/A
SQLCMD Command Line Tool
Performance Tuning
Profiler Enhancements
Profiling Analysis Services
Exportable Showplan
Exportable Deadlock Traces
Full-text Search
Indexing of XML Datatype
MDAC
Side by Side installation
Microsoft Installer based setup
Support for Active Directory Deployment
SQL Client .NET Data Provider
Server Cursor Support
Asynch
Security
All Permissions Grantable
Fine Grain Administration Rights
Separation of Users and Schema
Replication
Auto-tuning Replication Agents
Oracle Publication
Improved Blob Change Tracking
OLAP and Data Mining
Analysis Management Objects
Windows Integrated Backup and Restore
Web Service/XML for Analysis
DTS and DM Integration
Eight new DM algorithms
Auto Packaging and Deployment
Data Transformation Services
New Architecture (DTR + DTP)
Complex Control Flows
Control Flow Debugging
For Each Enumerations
Property Mappings
Full Data Flow Designer
Full DTS Control Flow Designer
Graphical Presentation of Pkg Execution
Immediate Mode and Project Mode
Package (Advanced) Deployment Tools
Custom Tasks and Transformations
Reporting Services
Multiple Output Formats
Parameters (Static, Dynamic, Hierarchical)
Bulk Delivery of Personalized Content
Support Multiple Data Sources
STS (Web Parts, Doc Libraries)
Visual Design Tool
Charting, Sorting, Filtering, Drill-Through
Scheduling, Caching
Complete Scripting Engine
Scale Out architecture
Open XML Report Definition
Notification Services

SQL Server “Yukon” The scalable, secure, enterprise-class data management platform
Enterprise Data Management
Scalability, availability, security advancements
Storage of all data types, formats
Focus on ease-of-use
Programmability
Leverage existing development skills
Share data across any platform
Provide end-to-end development tools
Business Intelligence
Scalable, comprehensive solution
Real time decision making tools
Extend information to employees, partners

Programmability
.NET Integration
XML support
T-SQL enhancements
Data Access API’s enhancements
Developer Tools Integration
Management API’s

Programmability: Goals
.NET Integration:
Convergence of database and mid-tier programming models
XML Support:
Data model evolution for storing semi-structured data/documents
T-SQL Enhancements:
API’s and Languages:
Modernizing the data access programming environment
Developer Tools:
Breakthrough integration between developer and database tools
Expanding the Engine:
Innovative technologies such as SQL Server Event Notification and SQL Server Service Broker

.NET Integration
Choice of where to run logic
Database, for logic that runs close to data
Mid-tier, for logic that scales out
Symmetric programming model
Choice of programming language
T-SQL, for data-intensive stored procedures
CLR languages, for a safe, modern execution environment and for extending the engine

Common Language Runtime (1)
Provides .NET programmability enhancements / extensions
VB, C++, C#
Assemblies are compiled .NET modules
Consistent programming model across tiers
Runs in SQL Server CLR memory space

two step process consists of
creating an assembly – create assembly
Persisted in the database
DLL File
May reference other assemblies in DB
creating assembly entry point using one of the following:
UDF function - create function
Stored procedure - create procedure
Trigger - create trigger
UDT - create type

.NET Stored Procedures
.NET methods registered as stored procedures
CREATE PROCEDURE…
AS EXTERNAL NAME method_name
References entry point in assembly
Use In-Proc ADO .NET
Take advantage of the richness of the .NET languages

CLR Objectives
Security
SQL and .NET permissions
Safe, External-Access (verifiable), Unsafe
Speed
In process, compiled
Scalability
Users, complex functions, threading
Safety
Type safe code

Yukon Dev: Feature Overview X Aggregates X User-Defined Types X X Triggers X X Stored Procedures X X User Defined Functions .NET Languages T-SQL

In-Proc ADO .NET
Familiar programming model for ADO .NET developers
SqlConnection, SqlCommand, SqlDataReader, …
Server side extensions
SqlRequestDefinition
New ISql interface
ISqlConnection, ISqlCommand, …

.NET Integration
Provides a programming environment for developing:
Functions
Procedures
Triggers
User Defined Types
Aggregates
In-Process Data Access provider (ADO .NET v2)
Symmetric data access
Mid-tier/data tier deployment decision
Security
Integration of SQL and CLR security
Three levels of code access security
Safe, External-Access (verifiable), Unsafe
Tight integration with Visual Studio
Authoring, debugging, profiling

Development Guidelines
TSQL…
For routines containing mostly data access
.NET…
For CPU-intensive functions and procedures
For implementing UDTs and UDAggs
For functionality currently performed by XPs
To leverage the .NET Framework (file access, image processing, XML)

The Developer Experience .NET Project SQL Queries: select sum( tax(sal,state) ) from Emp where county = ‘King’ Runtime hosted by SQL (in-proc) Assembly: “TaxLib.dll” VB,C#,C++ Build SQL Server SQL Data Definition: create assembly … create function … create procedure … create trigger … create type …

XML Support
XML benefits
Self-describing
Extensible (tags, annotations, multiple schemas)
provides data model flexibility
Store structured data relationally
Store semi-structured data and documents as XML
Example: email
Full integration between the two models
SELECT both relational columns and XML values
Can join relational columns and XML columns
XML provides interoperability
Accessible over HTTP and SOAP
Exposes all data as XML
Platform independence for loosely coupled systems
Can be programmed just like a Web service

XML Support
Native XML storage
XML Data type
Typed (XML schema defined) or untyped (no schema)
Tradeoff between flexibility and optimization
XML validation using schema constraints
XML Index
Can Index XML tags to search for values efficiently
XML query and data modification
XPath, XQuery, DML
XML views on the database
Maps relational to XML, XML to relational
Abstract the database as an XML source
Integrated support for Web Services
HTTP, SOAP, WSDL
Rich XML API’s – inside and outside DB

Example of XQuery
Return section heading of section 3 and beyond of document 123
SELECT xcol::query(
'for $s in /doc[@id = 123]//sec[@num > 3]
return <topic>$s/heading</topic>')
FROM xtable
FLWR — F OR/ L ET/ W HERE/ R ETURN
Path expressions
Element constructors
Ordered operators

Insert, update and delete statements
XQuery extensions – to be standardized
Supports tree-level modifications
Add or delete sub-trees
Update values
Add a new resume as child of root:
UPDATE xtable SET xcol::modify(
'INSERT <resume>John</resume> INTO /
AS LAST')
XML Data Modification

XML Views
Default XML view of relational data
User-defined XML views
Specified using mapping schema
Associates XML tag with column in table
Overflow from mapping goes into XML data type column
XQuery views on user-defined & default views
XQuery and XML DML against views
Does view resolution
Bulk load data through XML views

XML Support - Document Shredding XML Data Type XML Views map XML And Relational data XML Fax Phone Addr LName FName Shred

XML Support - Document Query XQuery SQL XML Data Type XML Fax Phone Addr LName FName

T-SQL Enhancements
Data types
varchar(max), nvarchar(max), varbinary(max)
XML
New operators
PIVOT, UNPIVOT, APPLY
ANSI Standard Recursive Queries
Common table expressions (WITH <common_table_expression>)
ANSI Standard Exception Handling
Handles transaction abort (TRY...CATCH)
Statement-level recompile
Fewer recompiles, less costly
DDL Triggers
Queuing Primitives (Service Broker)
WAITFOR
OUTPUT Clause
Query Notifications

Data Types
varchar/nvarchar/varbinary(1-8000)
Maximum column length still 8,000 bytes
Rows can now exceed page size (without text)
Varchar/nvarchar/varbinary(max)
Can hold greater than 8000 characters / bytes (max. 2GB)
varbinary(max) supports the filestream attribute
XML
A full-fledged data type
UDDTs
User-defined Data Types using CLR

Snapshot Isolation
New transaction isolation level
Increased Data Availability for read applications
Allows Non-Blocking consistent reads in an OLTP environment
Writers don’t block readers
Readers don’t block writers
Permits writes, which can cause conflicts
But… includes mandatory conflict detection
Great for Relational reporting Scenarios

Server Events
Events fire on DML, DDL
User can register to be notified when certain event occurs
User can register through WMI to be notified of certain DDL, DML, or trace events

Virtual Tables
System catalog has changed
‘ Tables’ that reflect the internal state
25+ virtual tables to help DBA’s
Monitor the server
Diagnose problems
For example syswaits
Check this first when server is making slow progress
Union of
Deadlock monitor wait-for graph
Waiting information as in sysprocesses
syswaits columns
waitingTask, spid, waitTime, waitType, resource, blockingTask

SOAP Connectivity
HTTP Access
In addition to TCP/IP, Named Pipes, and Shared Memory
SQL Server itself listens to HTTP requests
Can coexist with IIS, but IIS isn’t required
Disabled by default
Can configure which users, which stored procedures, and which databases can have HTTP access
Can configure whether ad hoc batches or queries can be submitted

Bulk Data Loading
XML-based format file
Provides full functionality of old format file and more
Easy to specify and understand
Supported by T-SQL commands and BCP
Old format files can still be used
Old data can be loaded using XML format files
Mitigate security concerns
Use Windows user privileges to read / write files used in bulk data loading
Improved performance and scaling

Bulk Data Loading
Bad-row logging
Bulk data loading succeeds despite invalid rows
Incorrectly formatted rows are redirected to error file for analysis along with error
Rows violating constraints redirected to error table along with errors
Uniform Insert command
T-SQL Insert-Select enhanced to support bulk data loading optimizations
Example: Logging
OPENROWSET enhanced to read from a data file

Data Access API’s
Data can be programmed using relational, object, or XML API’s
DataSet, ObjectSpaces, XmlReader
Same API’s available in-proc and on mid tier
In all three domains
Can seamlessly view and query all database data as XML
Relational types and XML type
Database logic can be invoked as a Web service

Data Access API’s
ADO.NET v2.0 Enhancements:
Multiple active result sets (MARS)
Object Persistence FX (ObjectSpaces)
Query notifications – for cache invalidation
Parity with ADO (ADOX, etc)
Server cursors (SqlResultSet)
Asynchronous client access
Bulk update, paging, and batching
User Defined Type (UDT) support

Data Access API’s
System.Xml
XQuery classes
Integrated SQLXML classes (bulkload, etc)
MDAC 9.0 (ships with Yukon)
Side-by-side install
Yukon feature support
New data type support
UDT support

Management API’s
Windows Management Instrumentation (WMI)
Eventing
SQL Server Engine
DTS, Analysis Services, and Reporting Services (post beta 1)
Configuration API
Non-connected configuration
Management Objects
SQL Server (SMO), Replication (RMO), Analysis Services (AMO)
100% managed code (written in C#)
Performance, scalability
Scripting improvements
According to .NET library design guidelines

Developer Tools Integration
Visual Studio supports a new Yukon Project system
Easy to develop, debug and deploy .NET code for the database
Integrated debugging experience across mid-tier and database tier
Seamlessly step cross-language T-SQL & .NET
Set breakpoints anywhere, inspect anything
Visual Studio project extensions for Business Intelligence projects

Programmability Conclusion
Choice
Where to processes data
How to store data (relational, XML, UDT’s)
Extensibility
User defined data types, functions, procedures,..
Integration
XML
SOAP
Development Tools

Questions?
[email_address]

Thank you for attending. Visit www.mshug.org.

SQL Server "Yukon" and the Developer

by Databaseguys on Aug 11, 2010

Accessibility

Upload Details

Usage Rights

Statistics

SQL Server "Yukon" and the Developer Presentation Transcript