SQL Server 2008 R2 StreamInsight OverviewNameTitleMicrosoft Corporation
Presentation Outline (hidden slide)Technical Level: 200
Intended Audience: ITDMs,DBAs, Database Developers, Database Architects, BI specialists
Objectives (what do you want the audience to take away):
Introduction to Complex Event Processing (CEP) and Microsoft’s StreamInsight solution
Technical overview of CEP architecture and development environment
Presentation Outline:
Overview - Information Platform Vision, SQL Server 2008 Foundation, SQL Server 2008 R2 Value Proposition
Introduction to Complex Event Processing (CEP)
Business Challenges and key CEP benefits
Platform Architecture
CEP and LINQ Queries
CEP Development Environment
Query Binding & Configuration
CEP Platform Summary
Deployment Scenarios
RoadmapInformation Platform VisionPervasive InsightEmpowered ITDynamic DevelopmentMISSION CRITICAL PLATFORMDesktop & MobileCloudServer & Datacenter
Scalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud servicesMPP support for 10s to 100s TB DWHighly scalable appliancesSeamless integration with Microsoft BI A Comprehensive PlatformManaged Self-Service BIMulti-server managementVirtualization & Live Migration
TRUSTED, SCALABLE PLATFORMIT & DEVELOPER EFFICIENCYMANAGED SELF-SERVICE BIEnterprise-level security, scalabilityHigh-scale, complex event processingData consistency across heterogeneous systemsMulti-server managementVirtualization & Live Migration Accelerated development& deploymentSelf-service analyticsSelf-service reportingStreamlined collaboration& managementCOMPREHENSIVE PLATFORM FOR IT VALUEMPP support for 10s-100s TB DWHighly scalable appliancesSeamless BI IntegrationScalable relational database platformConsistent, familiar model & toolsSelf-managed, highly available cloud service
What is CEP?EventComplex Event Processing (CEP) is the continuous and incremental processing of event streams from multiple sources based on declarative query and pattern specifications with near-zero latency. requestoutput streaminput streamresponse6
LatencyScenarios for Event ProcessingRelational Database ApplicationsCEP Target ScenariosOperational Analytics Applications, e.g., Logistics, etc.Data Warehousing ApplicationsWeb Analytics ApplicationsManufacturing Applications        Financial trading ApplicationsMonitoring ApplicationsAggregate Data Rate (Events/sec.)7
Example CEP ScenariosPower, Utilities:Energy consumption
Outages
Smart grids
100,000 events/secManufacturing:Sensor on plant floor
React through device controllers
Aggregated data
10,000 events/secWeb Analytics:Click-stream data
Online customer behavior

Microsoft SQL Server - StreamInsight Overview Presentation

Editor's Notes

  • #4 Now more than ever, organizations have the need to use information management to compete and grow in a difficult market by reducing costs and identifying the highest value opportunities for their organization.  As we engage with customers, you explain the pressures you have to deliver more real-time information through rich applications while also reducing costs in this new economy. The converging IT trends of virtually free storage space, the rapid adoption of virtualization and the increasing capabilities of industry standard hardware, the emergence of the Cloud as a deployment option, and the need for real-time business information for all employees through easy to use tools are driving the data explosion we see today. You need a complete approach to managing, accessing and delivering information across your organization to accelerate and improve business decisions..  We also understand that at the center of delivering on these business needs there are people - IT Professionals, who support the expanding information needs of the business through IT services, Developers who build solutions in time to capture business opportunities in an increasingly competitive market and Business Users, who quickly mine volumes of data for business insights to help increase customer satisfaction and drive business results. Microsoft, along with our worldwide partners, is committed to deliver an Information Platform which enables your people and provides you with a complete set of technologies and tools to help you realize more value from your information at the lowest total cost of ownership. As we invest in the Information Platform we think about what we need to deliver to you in each of these 4 areas:  Mission-Critical Platform Mission-Critical Platform for all your application requirements, delivered with the industry’s best TCOEnsuring your applications and systems are reliable, highly available, secure and deliver superior, predictable performance is top priority for IT and for Microsoft. At our core, we are focused on delivering an information platform which meets the needs for performance, scalability, availability, and security for your most mission critical business applications at a lower cost of ownership, including acquisition costs and the ongoing costs of support, management and maintenance. From the server to the datacenter we offer our customers a reliable information platform that grows with their needs at a third of the cost of our enterprise DB competitor.Secure and available infrastructureWe have seen tremendous growth in our Enterprise business – investing significantly in our datacenter capability on the Windows Server platform, building out the industry’s most widely deployed database platform. The largest enterprises on the planet are now running their top-tier applications on the Microsoft platform and seeing sustained high-performance and uptime that directly benefits their businesses’ bottom line. Scales to all business requirementsWith storage costs declining, and increasing data volumes, IT departments need the ability to scale up seamlessly to process an increasing number of transactions, as well as storing and processing larger volumes of information. Microsoft’s Information Platform provides high scalability and performance for OLTP and BI as well as new Data Warehousing capabilities to scale to hundreds of terabytes to deliver on the most critical business needs. A complete and interoperable platform that empowers IT to be more productive and agile The boundaries of the IT environment continue to be stretched and IT Professionals have increased responsibility to manage application requirements for the datacenter, across mobile devices and the desktop, and now out in the cloud. To successfully manage these resources across the enterprise IT professionals require a consistent, and productive platform, including easy to use and robust tools.  Increased DBA Productivity and ControlSQL Server has long had a focus on DBA productivity – by providing rich management tools that empower administrators to take control of their environment. We continue to invest in tools that enable administrators to manage multiple servers at once via policies and to proactively manage system performance. We’re also investing to provide complementary tools for areas such as data integration and master data management.  Consolidation and VirtualizationConsolidation and virtualization can deliver significant resource and operational benefits in the datacenter, particularly at a time when IT professionals are facing budget pressure along with the need to continue the same level of service. Together, Windows Server, System Center and SQL Server can deliver a virtualized Data Center, providing increased utilization of server resources to reduce costs, greater standardization to reduce administration overhead and greater agility to dynamically scale to support changing and growing business needs.  The Power of Choice - Harnessing the CloudThe cloud offers new ways for IT to reduce the friction of connecting with customers and partners, the ability to quickly provision resources, and a way to reduce operational costs. Microsoft is delivering SQL Azure as part of the Windows Azure Platform to enable IT to manage these resources with a platform and tools that are consistent with their existing SQL Server environment.Dynamic DevelopmentIntegrated tools to help Developers more quickly build rich, intuitive and connected applications Developers are continually asked to deliver richer applications and services while lowering the time-to-solution to adapt to business needs and opportunities. With Visual Studio, the .NET Framework, and SQL Server developers have a highly productive platform to deliver data through their applications and to collaborate more efficiently with IT on deployment needs and requirements. The consistent development experience also gives developers the power to build applications for deployment across devices, desktops, the datacenter, and the cloud.  Tight Integration across the stackSQL Server has deep integration with Visual Studio and .NET to provide developers with a rich, seamless development experience. Developers can use familiar tools and the power of a model-driven approach to vastly improve their productivity, by abstracting away from database specifics and instead focusing on the business logic and outcomes required.  Platform for all DataBeing able to bring unstructured data alongside structured data in a single application gives developers the power to bring the relational model to new types of data. They can extend existing applications and develop new types of applications that incorporate location aware services, real time streaming data – all in a secure, synchronized way.  Rich and embeddable user experiencesDevelopers can embed powerful user experiences into their applications through components such as spatial data for rich mapping scenarios, embeddable BI controls and data synchronization. Looking ahead, developers can integrate value-added cloud services into applications for a differentiated value prop and additional services opportunities.Pervasive InsightA complete Business Intelligence platform that enables users across the organization to derive greater insights through familiar toolsBusiness Intelligence continues to be the #1 priority for CIOs. Even as budgets are cut IT is being asked to do more to deliver information to the business. Getting the right information to the right person at the right time is critical for success now more than ever. This requires providing access through familiar tools to end users while also providing IT the ability to manage and secure access to the information. By enabling access to all types of users through familiar tools, in a secure and well managed way – businesses can get more value from their information than ever before. Microsoft helps companies consolidate information, deliver access and empower users at all levels of the business: strategic, tactical and operational decision makers. Integrate all your data and scale your reporting systemsWith SQL Server, you can integrate the many sources of data in your organization into large scale data warehouses and deliver rich, high-performance reporting to your whole organization.  Enable users to derive insights through familiar toolsIncreased processing power and memory for desktops and laptops are enabling information workers to do more advanced data mining and analysis to improve decision making. We are extending our capabilities to deliver the power of self-service business intelligence to individual users through the familiar tools they use everyday such as Microsoft Excel. Enable collaborative decision making Today organizations have relevant data that lives in the datacenter, on user devices and desktops, and through external services. It is critical for users to be able to draw upon the wealth of information that is distributed throughout the organization and to do analysis and reporting with the data sources that are most relevant. The real value is that individual insight can be easily shared across work groups and across the organization. With Microsoft Office SharePoint, individual information workers can share and publish insights and analysis tools to scale reach and deliver greater value to the organization.ClosingLooking across the Information Platform, we think about how these capabilities can better support our customers’ information needs. For example a national retailer could use technology to track the demographics, volume and location of customers throughout stores across the country.  By processing large volume of data in real-time, they could then evaluate the needs of their customer base at any given moment and make changes to promotions or the store environment like the background music, to better appeal to the audience and drive real-time purchase.  Looking across the Information Platform, the ability to dynamically respond to customer needs could be built by working with your development organization to develop a new application or extending an existing application, partnering with IT to support the application through greater utilization of existing assets, and delivering information to business users through familiar tools. By providing business information pervasively throughout the organization in real-time this organization would be able to much more quickly identify and capture business opportunities.The Information Platform delivers the rich capabilities of SQL Server and SQL Azure to enable IT, developers and end users to deliver on your most critical business needs and maximize the value of your information throughout the organization at a low cost of ownership.
  • #5 The purpose of this slide is to communicate the next wave of SQL innovation and how it should be messaged. There are three key areas of innovation: SQL Server 2008 R2 – the next generation release of the SQL Server database platform, Parallel Data Warehouse, appliances for high scale data warehousing and SQL Azure – scalable relational database platform service in the cloud. When you talk to each of these innovations, you want to emphasize that each is built on the solid foundation of SQL Server 2008.SQL Server 2008 R2 enables businesses to make more timely, better informed decisions by enabling users to access, integrate, analyze and share information using tools they are already familiar with – Microsoft Office. DBAs can more efficiently manage databases and applications at scale with multi-server management. Enhanced support for Virtualization will provide opportunities to further optimize resources through consolidation.SQL Azure – delivers on the Microsoft Data Platform vision of extending the SQL Server capabilities to the cloud as web-based services. SQL Azure provides an internet-facing database and advanced query processing services and is ideal solution for customers building new applications or integrating with existing investments in the cloud. Built on SQL Server technologies, SQL Azure provides the same enterprise-class availability, scalability , and security with the benefits of built-in data protection, self healing and disaster recovery as well as a consistent SQL Server programming model & tools. SQL Azure is scheduled for release later this year.Parallel Data Warehouse is a highly scalable data warehouse appliance. It uses Massively Parallel Processing (MPP) to deliver high performance and scalability on SQL Server 2008, Windows Server 2008 and industry-standard hardware. Parallel Data Warehouse is a separate release/edition but will launch jointly with R2 in the first half of 2010.
  • #6 The “hero” offering that we’ll really sell broadly is SQL Server 2008 R2. You’ll notice that the messaging pillars for R2 are aligned with the Trusted, Productive, Intelligent messaging pillars for SQL Server 2008.To provide a comprehensive view of the R2 release (especially for SA discussions) this slide focuses on the key technology investments for each of the pillars. Trusted, Scalable Platform, it’s important to re-emphasize the enterprise-level security, high availability and scale delivered in SQL 2008 for mission critical applications. What’s new to the R2 release is StreamInsight for Complex Event Processing, Master Data Services for data consistency across heterogeneous systems, SQL Server support for up to 256 Logical Processors – providing greater flexibility in hardware choice, and enhanced data compression including Unicode compression for greater storage efficiency.IT & Developer Efficiency, the release-defining scenarios for R2 are Virtualization and Multi-server Management to increase IT productivity and reduce data management costs. This is enabled by the new manageability enhancements delivered in Management Studio plus R2 support for Windows Server 2008 R2 Hyper-V Virtualization and Live Migration. With R2, we introduce a new concept to the market, a single unit of deployment which will significantly increase the efficiencies around data-tier application deployments and upgrades resulting in dramatically streamlined consolidation and management efforts. Managed Self Service BI – Self-service analytics is delivered with PowerPivot – which is about enabling users to get the data they need without IT having to do a 6-month project to create a new application. PowerPivot gives users the power and flexibility to take internal data, integrate it with other information – and within Excel do all the slicing and dicing you need to get to the view of information you really need for decision making. This is all done “in memory” through really high compression in RAM – which is very powerful. None of the other major BI vendors can do this. User can easily share their application with others by publishing it to SharePoint.Once published, there’s a PowerPivot Operations Dashboard in SharePoint that provides IT Pros with the ability to manage business intelligence through SharePoint like it was just another service they provide. This new dashboard allows IT Pros to look at which reports are being run, who’s running them, how often are they running them, is the server being over utilized, how can I move the app dynamically to another server…BI is basically another managed object for IT. The reports the users publish is the object and we enable IT to understand how it is being used and apply rules and policies to that.
  • #30 Your free PASS membership enables access to 12 Virtual Chapters, 24 Hours of PASS broadcasts, local PASS Chapters, professional development resources, newsletters, events calendar, and much moreMeet up with like-minded professionals throughout the year at face-to-face PASS Chapter meetings, discuss topical SQL Server issues, share tips and tricks, network, enjoy special guest speakers and get access to all things PASSAt PASS Summit,meet top industry experts , learn about best practices, effective troubleshooting, how to prevent issues, save money, and build a better SQL Server environment