SQL Server 2014
Faster Insights from Any Data
(Level 300 Deck)
SQL Server 2014
Faster Insights from
Any Data
(Level 300 Deck)
SQL Server 2014
Faster Insights from
Any Data
(Level 300 Deck)
SQL Server 2014
Faster Insights from
Any Data
(Level 300 Deck)
Easy Access to Data, Big and Small
Microsoft Power BI for Office 365
1 in 4 enterprise customers on Office 3651 Billion Office Users
Analyze Visualize Share ...
Power Query
Power Query
Powerful Self-Service BI with Excel 2013
Power Query
Enable self-service data discovery, query, transformation and mashup experiences for Information
Workers, via ...
Power Query
Discover, combine, and refine Big Data, small data, and any data with Data
Explorer for Excel.
S
Data Sources
Windows Azure
Marketplace
Windows Active
Directory
Azure SQL
Database
Azure HDInsight
PowerPivot
PowerPivot
Powerful Self-Service BI with Excel 2013
Introducing PowerPivot
PowerPivot for SharePoint
Power View
Power View
Powerful Self-Service BI with Excel 2013
Introducing Power View
Power View in Excel
Excel Database
server
SQL AS
(Tabular)
Power View
SQL RS
ADOMD.NET
SQL AS
(PowerPivot)
Power View in SharePoint
Browser SharePoint
web server
Database
server
SharePoint
app server
SQL AS
(PowerPivot)
SQL AS
(T...
Power View for Multidimensional Models
• Power View on Analysis Services via BISM
• Native support for DAX in Analysis Ser...
Architecture
Internet Explorer
Analysis Services
BI Semantic Model
Tabular
SharePoint
(2010 or 2013)
Reporting
Services
Po...
BI Semantic Model: ArchitectureThird-party
applications
Reporting Services
(Power View) Excel PowerPivot
Databases LOB App...
BISM-MD Object Tabular Object
Cube Model
Cube Dimension Table
Attributes (Key(s), Name) Columns
Measure Group Table
Measur...
Query Execution Architecture
Client Application
Analysis Services
Query Parser
Query Processor
s
FE Caches
MDX Formula Eng...
Power Map
Power Map
Powerful Self-Service BI with Excel 2013
Power Map for Microsoft Excel enables information workers to discover and share new insights
from geographical and tempora...
Map Data
• Data in Excel
• Geo-Code
• 3D and 3 Visuals
Discover Insights
• Play over Time
• Annotate points
• Capture scen...
Map Data
•
Discover Insights
•
•
•
•
Share Stories
•
•
•
• Export to Video for Viral!
Power Map
Excel Add-in to Enhance Data Visualization
Power BI Site
Power BI Site
Collaborate and Stay Connected with Office 365
Q&A
Q & A
Q & A
Collaborate and Stay Connected with Office 365
Q&A
Mobile BI
Mobile BI
Collaborate and Stay Connected with Office 365
Q&A
Engage customers with smart,
contextual mobile experiences
Boost agility with real-time access to
apps and data from anywh...
Excite and Engage Users
Deliver Immersive, Connected Customer Experiences
Optimize for
discovery and
reach
Connect with
so...
Stay Productive on the Go
Deliver Familiar, Connected Experiences to a Mobile Workforce
…while ensuring enterprise securit...
Mobile BI Capabilities Available Today
Browser-based corporate
BI solutions on iOS,
Android and Windows:
• SharePoint Mobi...
SharePoint Mobile 2013
Mobile Browser
Support across
different mobile
devices, including
touch for tablets and
phone
Nativ...
Tablet Touch Experience
Office Web Apps
Never be without
the tools you need.
Access and share with
confidence.
Excel Web App
Excel Web App
Quick Explore
Mobile-Friendly Apps for Office
Extend with Hybrid Cloud Solutions
Extend with Hybrid Cloud Solutions
Extend with Hybrid Cloud Solutions
HDInsight
HDInsight
Key Trends
Big Data Analytics
Internet of things
Audio / Video
Log Files
Text/Image
Social Sentiment
Data Market Feeds
eGov Feeds
Weather
Wikis / Blogs
...
Modern Data Warehousing
Hadoop Distributed Architecture
MapReduce: Move Code to the Data
So How Does It Work?
Distributed Storage
(HDFS)
Query
(Hive)
Distributed Processing
(MapReduce)
ODBC
Legend
Red = Core
Hadoop
Blue = Data
proce...
Record
reader
Map Combiner
Partitioner
Shuffle
and sort
Reduce
Output
format
MapReduce: Driver
MapReduce: Mapper
MapReduce: Reducer
MapReduce Summary
77
Programming HDInsight
Hive, Pig, Mahout, Cascading, Scalding, Scoobi, Pegasus…
C#, F# Map/Reduce, LINQ to Hive, Microsoft ...
Authoring Jobs App Integration
Building Developer Experiences
Authoring frameworks and languages
Connectivity
Programmabil...
RDBMS vs. Hadoop
Microsoft Hadoop Vision
Insights to all users by activating new types of data
Polybase
Polybase
Polybase
84
DBHDFS
SQL Server PDW querying HDFS data, in-situ
=
Polybase in PDW V2
85
Hadoop
HDFS DB
(a) PDW query in, results out
Hadoop
HDFS DB
(b) PDW query in, results stored in HDFS
Sensor
& RFID
Web
Apps
Unstructured data Structured data
Traditional schema-
based DW applications
RDBMS
Hadoop
Social
App...
• Querying data in Hadoop from PDW using regular SQL queries, including
• Full SQL query access to data stored in HDFS, re...
Native Query Across Hadoop and PDW
Creating “External Tables”
• Internal representation of data residing in Hadoop/HDFS (d...
Native Query Across Hadoop and PDW
Querying Unstructured Data
1. Querying data in HDFS and displaying results in table for...
Native Query Across Hadoop and PDW
Parallel Data Import from HDFS into PDW
Persistently storing data from HDFS in PDW tabl...
Sensor
& RFID
Web
Apps
Unstructured data
Social
Apps
Mobile
Apps
HDFS data nodes
Native Query Across Hadoop and PDW
Parall...
In-Memory for big data analytics
Interactive Analytics over “Big Data”
92
• SQL Server Analysis Services scaled out to ver...
StreamInsight
StreamInsight
StreamInsight
Managing Streaming Data In-Memory
•
•
•
Customer benefits
•
•
•
•
95
Event
Output
stream
Input
stream
Analyzing Streaming Data in the Cloud
StreamInsight on Windows Azure
96
StreamInsight on Azure is a cloud scale service fo...
Complete and Consistent Data Platform
Call to action
Download SQL Server 2014 CTP2
Stay tuned for availability
www.microsoft.com/sqlserver
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be...
SQL Server 2014 Faster Insights from Any Data -Level 300 Presentation from Atidan
SQL Server 2014 Faster Insights from Any Data -Level 300 Presentation from Atidan
SQL Server 2014 Faster Insights from Any Data -Level 300 Presentation from Atidan
Upcoming SlideShare
Loading in …5
×

SQL Server 2014 Faster Insights from Any Data -Level 300 Presentation from Atidan

490
-1

Published on

updated October 2013

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
490
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
49
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

SQL Server 2014 Faster Insights from Any Data -Level 300 Presentation from Atidan

  1. 1. SQL Server 2014 Faster Insights from Any Data (Level 300 Deck)
  2. 2. SQL Server 2014 Faster Insights from Any Data (Level 300 Deck)
  3. 3. SQL Server 2014 Faster Insights from Any Data (Level 300 Deck)
  4. 4. SQL Server 2014 Faster Insights from Any Data (Level 300 Deck)
  5. 5. Easy Access to Data, Big and Small
  6. 6. Microsoft Power BI for Office 365 1 in 4 enterprise customers on Office 3651 Billion Office Users Analyze Visualize Share Find Q&A MobileDiscover Scalable | Manageable | Trusted
  7. 7. Power Query
  8. 8. Power Query
  9. 9. Powerful Self-Service BI with Excel 2013
  10. 10. Power Query Enable self-service data discovery, query, transformation and mashup experiences for Information Workers, via Excel and PowerPivot Discovery and connectivity to a wide range of data sources, spanning volume as well as variety of data. Highly interactive and intuitive experience for rapidly and iteratively building queries over any data source, any size. Consistency of experience, and parity of query capabilities over all data sources. Joins across different data sources; ability to create custom views over data that can then be shared with team/department.
  11. 11. Power Query Discover, combine, and refine Big Data, small data, and any data with Data Explorer for Excel.
  12. 12. S Data Sources Windows Azure Marketplace Windows Active Directory Azure SQL Database Azure HDInsight
  13. 13. PowerPivot
  14. 14. PowerPivot
  15. 15. Powerful Self-Service BI with Excel 2013
  16. 16. Introducing PowerPivot
  17. 17. PowerPivot for SharePoint
  18. 18. Power View
  19. 19. Power View
  20. 20. Powerful Self-Service BI with Excel 2013
  21. 21. Introducing Power View
  22. 22. Power View in Excel Excel Database server SQL AS (Tabular) Power View SQL RS ADOMD.NET SQL AS (PowerPivot)
  23. 23. Power View in SharePoint Browser SharePoint web server Database server SharePoint app server SQL AS (PowerPivot) SQL AS (Tabular) SQL RS Add-In SQL RS Power View
  24. 24. Power View for Multidimensional Models • Power View on Analysis Services via BISM • Native support for DAX in Analysis Services • Better flexibility: Choice of DAX on Tabular or Multidimensional (cubes)
  25. 25. Architecture Internet Explorer Analysis Services BI Semantic Model Tabular SharePoint (2010 or 2013) Reporting Services Power View Analysis Services BI Semantic Model Multidimensional SQL Server Data Tools SQL Server Data Tools 1 2 35 6 4
  26. 26. BI Semantic Model: ArchitectureThird-party applications Reporting Services (Power View) Excel PowerPivot Databases LOB Applications Files OData Feeds Cloud Services SharePoint Insights
  27. 27. BISM-MD Object Tabular Object Cube Model Cube Dimension Table Attributes (Key(s), Name) Columns Measure Group Table Measure Measure Measure without MeasureGroup Within Table called “Measures” MeasuregroupCube Dimension relationship Relationship Perspective Perspective KPI KPI User/Parent-Child Hierarchies Hierarchies Multidimensional-Tabular Mapping
  28. 28. Query Execution Architecture Client Application Analysis Services Query Parser Query Processor s FE Caches MDX Formula Engine Storage Engine s SE Caches Partition Data Query SE Evaluation Engine Tabular Metadata Metadata LayerDAX Query Processor Multi- dimensional Metadata 1 DISCOVER_CSDL_METADATA 2 3 DAX Query 1 2 45 6 7 9 8 3
  29. 29. Power Map
  30. 30. Power Map
  31. 31. Powerful Self-Service BI with Excel 2013
  32. 32. Power Map for Microsoft Excel enables information workers to discover and share new insights from geographical and temporal data through three-dimensional storytelling. What Is Power Map?
  33. 33. Map Data • Data in Excel • Geo-Code • 3D and 3 Visuals Discover Insights • Play over Time • Annotate points • Capture scenes Share Stories • Cinematic Effects • Interactive Tours • Share Workbook Power Map: Steps to 3D insights
  34. 34. Map Data •
  35. 35. Discover Insights • • • •
  36. 36. Share Stories • • • • Export to Video for Viral!
  37. 37. Power Map Excel Add-in to Enhance Data Visualization
  38. 38. Power BI Site
  39. 39. Power BI Site
  40. 40. Collaborate and Stay Connected with Office 365 Q&A
  41. 41. Q & A
  42. 42. Q & A
  43. 43. Collaborate and Stay Connected with Office 365 Q&A
  44. 44. Mobile BI
  45. 45. Mobile BI
  46. 46. Collaborate and Stay Connected with Office 365 Q&A
  47. 47. Engage customers with smart, contextual mobile experiences Boost agility with real-time access to apps and data from anywhere Enable Deep Business and Customer Connections Virtually Anytime, Anywhere
  48. 48. Excite and Engage Users Deliver Immersive, Connected Customer Experiences Optimize for discovery and reach Connect with social apps and networks Real time content and updates Beautiful experiences + security and performance
  49. 49. Stay Productive on the Go Deliver Familiar, Connected Experiences to a Mobile Workforce …while ensuring enterprise security, manageability, and compliance
  50. 50. Mobile BI Capabilities Available Today Browser-based corporate BI solutions on iOS, Android and Windows: • SharePoint Mobile enhancements • PerformancePoint Services • Excel Services • SQL Server Reporting Services “Ultimately, the new Microsoft mobile BI solution leads to more revenue for Recall and gives us deeper customer insight, helping us stay ahead of our competitors.” Recall Records Management Company Gets Real-Time BI, Boosts Sales with Mobile Solution case study. Full Case study.
  51. 51. SharePoint Mobile 2013 Mobile Browser Support across different mobile devices, including touch for tablets and phone Native Apps Rich native apps experience to business social interactions and collaboration Office Hub A hub to all your doc storage services and Office rich editing experience Learn more: http://blogs.office.com/b/sharepoint/archive/2013/03/06/out-and-about-new-sharepoint-mobile-offerings.aspx
  52. 52. Tablet Touch Experience
  53. 53. Office Web Apps Never be without the tools you need. Access and share with confidence.
  54. 54. Excel Web App
  55. 55. Excel Web App Quick Explore
  56. 56. Mobile-Friendly Apps for Office
  57. 57. Extend with Hybrid Cloud Solutions
  58. 58. Extend with Hybrid Cloud Solutions
  59. 59. Extend with Hybrid Cloud Solutions
  60. 60. HDInsight
  61. 61. HDInsight
  62. 62. Key Trends
  63. 63. Big Data Analytics
  64. 64. Internet of things Audio / Video Log Files Text/Image Social Sentiment Data Market Feeds eGov Feeds Weather Wikis / Blogs Click Stream Sensors / RFID / Devices Spatial & GPS Coordinates WEB 2.0Mobile Advertising CollaborationeCommerce Digital Marketing Search Marketing Web Logs Recommendations ERP / CRM Sales Pipeline Payables Payroll Inventory Contacts Deal Tracking Terabytes (10E12) Gigabytes (10E9) Exabytes (10E18) Petabytes (10E15) Velocity - Variety - variability Volume 1980 190,000$ 2010 0.07$ 1990 9,000$ 2000 15$ Storage/GB ERP / CRM WEB 2.0 Internet of things What Is Big Data?
  65. 65. Modern Data Warehousing
  66. 66. Hadoop Distributed Architecture
  67. 67. MapReduce: Move Code to the Data
  68. 68. So How Does It Work?
  69. 69. Distributed Storage (HDFS) Query (Hive) Distributed Processing (MapReduce) ODBC Legend Red = Core Hadoop Blue = Data processing Gray= Microsoft integration points and value adds Orange = Data Movement Green = Packages HDInsight and Hadoop Ecosystem
  70. 70. Record reader Map Combiner Partitioner Shuffle and sort Reduce Output format
  71. 71. MapReduce: Driver
  72. 72. MapReduce: Mapper
  73. 73. MapReduce: Reducer
  74. 74. MapReduce Summary 77
  75. 75. Programming HDInsight Hive, Pig, Mahout, Cascading, Scalding, Scoobi, Pegasus… C#, F# Map/Reduce, LINQ to Hive, Microsoft .NET management clients JavaScript Map/Reduce, browser hosted console, Node.js management clients PowerShell, cross-platform CLI tools
  76. 76. Authoring Jobs App Integration Building Developer Experiences Authoring frameworks and languages Connectivity Programmability Security Loosely coupled Lightweight Low cost to extend Scenario oriented Innovation flows upward New compute models Performance enhancements Extend breadth & depth Enable new scenarios Integrate with current tool chains
  77. 77. RDBMS vs. Hadoop
  78. 78. Microsoft Hadoop Vision Insights to all users by activating new types of data
  79. 79. Polybase
  80. 80. Polybase
  81. 81. Polybase 84 DBHDFS SQL Server PDW querying HDFS data, in-situ =
  82. 82. Polybase in PDW V2 85 Hadoop HDFS DB (a) PDW query in, results out Hadoop HDFS DB (b) PDW query in, results stored in HDFS
  83. 83. Sensor & RFID Web Apps Unstructured data Structured data Traditional schema- based DW applications RDBMS Hadoop Social Apps Mobile Apps How to overcome the “impedance mismatch” Increasingly massive amounts of unstructured data driven by new sources At the same time, vast amounts of corporate data and data sources, and the bulk of their data analysis Polybase addresses this challenge for advanced data analytics by allowing native query across PDW and Hadoop, integrating structured and unstructured data Native Query Across Hadoop and PDW
  84. 84. • Querying data in Hadoop from PDW using regular SQL queries, including • Full SQL query access to data stored in HDFS, represented as ‘external tables’ in PDW • Basic statistics support for data coming from HDFS • Querying across PDW and Hadoop tables (joining ‘on the fly’) • Fully parallelized, high performance import of data from HDFS files into PDW tables • Fully parallelized, high performance export of data in PDW tables into HDFS files • Integration with various Hadoop distributions: Hadoop on Windows Server, Hortonwork and Cloudera. • Supporting Hadoop 1.0 and 2.0 Native Query Across Hadoop and PDW Polybase Features in SQL Server PDW
  85. 85. Native Query Across Hadoop and PDW Creating “External Tables” • Internal representation of data residing in Hadoop/HDFS (delimited text files only) • High-level permissions required for creating external tables • ADMINISTER BULK OPERATIONS & ALTER SCHEMA • Different than ‘regular SQL tables’: essentially read only (no DML support) CREATE EXTERNAL TABLE table_name ({<column_definition>} [,...n ]) {WITH (LOCATION =‘<URI>’,[FORMAT_OPTIONS = (<VALUES>)])} [;] Indicates “External” Table 1 Required location of Hadoop cluster and file 2 Optional Format Options associated with data import from HDFS 3
  86. 86. Native Query Across Hadoop and PDW Querying Unstructured Data 1. Querying data in HDFS and displaying results in table form (using external tables) 2. Joining data from HDFS with relational PDW data Example – Creating external table ‘ClickStream’: CREATE EXTERNAL TABLE ClickStream(url varchar(50), event_date date, user_IP varchar(50)), WITH (LOCATION =‘hdfs://MyHadoop:5000/tpch1GB/employee.tbl’, FORMAT_OPTIONS (FIELD_TERMINATOR = '|')); Text file in HDFS with | as field delimiter SELECT top 10 (url) FROM ClickStream where user_IP = ‘192.168.0.1’ Filter query against data in HDFS SELECT url.description FROM ClickStream cs, Url_Description url WHERE cs.url = url.name and cs.url=’www.cars.com’; Join data coming from files in HDFS (Url_Description is a second text file in HDFS) Query Examples 1 2 SELECT user_name FROM ClickStream cs, Users u WHERE cs.user_IP = u.user_IP and cs.url=’www.microsoft.com’; 3 Join data from HDFS with relational PDW table (Users is a distributed PDW table)
  87. 87. Native Query Across Hadoop and PDW Parallel Data Import from HDFS into PDW Persistently storing data from HDFS in PDW tables Fully parallelized via CREATE TABLE AS SELECT (CTAS) with external tables as source table and PDW tables (either distributed or replicated) as destination CREATE TABLE ClickStream_PDW WITH DISTRIBUTION = HASH(url) AS SELECT url, event_date, user_IP FROM ClickStream Retrieval of data in HDFS “on-the-fly” Enhanced PDW query engine CTAS Results External Table DMS Reader 1 DMS Reader N … HDFS bridge Parallel HDFS Reads Parallel Importing Sensor & RFID Web Apps Unstructured data Hadoop Social Apps Mobile Apps Structured data Traditional DW applications PDW
  88. 88. Sensor & RFID Web Apps Unstructured data Social Apps Mobile Apps HDFS data nodes Native Query Across Hadoop and PDW Parallel Data Export from PDW into HDFS • Fully parallelized via CREATE EXTERNAL TABLE AS SELECT (CETAS) with external tables as destination table and PDW tables as source • ‘Round-trip of data’ possible with first importing data from HDFS, joining it with relational data, and then exporting results back to HDFS CREATE EXTERNAL TABLE ClickStream (url, event_date, user_IP) WITH (LOCATION =‘hdfs://MyHadoop:5000/users/outputDir’, FORMAT_OPTIONS (FIELD_TERMINATOR = '|')) AS SELECT url, event_date, user_IP FROM ClickStream_PDW Enhanced PDW query engine CETAS Results External Table DMS Writer 1 DMS Writer N … HDFS bridge Parallel HDFS Writes Parallel Reading Structured data Traditional DW applications PDW
  89. 89. In-Memory for big data analytics Interactive Analytics over “Big Data” 92 • SQL Server Analysis Services scaled out to very large data volumes • Sourced from “Big Data” sources, e.g. • Hadoop, Isotope, etc. • Enterprise data sources (SQL Server, Oracle, SAP, etc.) • Built upon the In-Memory Analytics engine • In-memory, column-store, 10x compression • Deployment vehicles: Box, Appliance, Cloud • Customers: • Skype, Klout, Halo 4, UBS, AdCenter, Windows Update XMLAWeb services External Data Sources GW Mgmt Deploy Monitor AS Instance AS Instance AS Instance Reliable Persistent Storage Excel, PV 3rd party apps, tools, etc.
  90. 90. StreamInsight
  91. 91. StreamInsight
  92. 92. StreamInsight Managing Streaming Data In-Memory • • • Customer benefits • • • • 95 Event Output stream Input stream
  93. 93. Analyzing Streaming Data in the Cloud StreamInsight on Windows Azure 96 StreamInsight on Azure is a cloud scale service for complex event-processing Ideal for analyzing streaming data either born on the cloud, or globally distributed Customer benefits • Insights from data in motion • Elastic scale out in the cloud • Simplified management via built-in connectivity • Low TCO of cloud service
  94. 94. Complete and Consistent Data Platform
  95. 95. Call to action Download SQL Server 2014 CTP2 Stay tuned for availability www.microsoft.com/sqlserver
  96. 96. © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×