Dogfood 2012 - Decoding the Business Intelligence Alphabet Soup

  • 1,335 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,335
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
0
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Excel 2007 – PivotTable – Support for hierarchical data
  • Client connects directly : Authentication? Wire sniffing? Parameter manipulation?
  • Any changes WILL be lost when the browser is closed
  • Any changes WILL be lost when the browser is closed
  • Any changes WILL be lost when the browser is closed
  • Excel oriented?
  • Practically speaking, exceptionally large files (4mil rows == 120mb) will take time to transfer, load, and then display to the user

Transcript

  • 1. Decoding the Business IntelligenceAlphabet SoupSSRS, KPI, OLAP, BISM and more!Scott Brickey, SharePoint Practice Managerwww.sds-consulting.com
  • 2. About UsSDS Custom SharePoint SolutionsAgile development and SharePoint coding experience tocreate an optimal solution for your unique SharePointapplication and integration needs.· Workflow & InfoPath Forms for Business Process Automation· SharePoint Reports & BI Integration· Portals & Collaboration· Content ManagementAgile Practices for proven faster delivery, higher quality, & increased business value.
  • 3. A Brief Forward• LOTS of info! – Feel free to ask questions throughout• LOTS of slides (approx 100) – Focus on the concepts and areas of interest• Slides are available online www.sbrickey.com/Tech/Calendar www.sds-consulting.com www.slideshare.net/Scott_Brickey/dogfood-2012-decoding-the-business- intelligence-alphabet-soup – DON’T write everything down
  • 4. Business Intelligence Tools :A brief history 1993 • Excel – Pivot Tables 1998 • SQL Server Analysis Services 2000 • Excel – OLAP support 2004 • SQL Server Reporting Services
  • 5. Business Intelligence Tools :Yesterday, Today, and Tomorrow2007Excel: 2010- PivotTable improvements- Conditional Formatting Excel: 2012- Row limit improvements - Pivot Table Slicers - Spark Lines Excel: 2013SharePoint: - PowerPivot- Excel Services SharePoint: SharePoint: Excel:- PerformancePoint Services - Excel Services - PowerPivot for Excel Svcs - Power View- SSRS Integrated Mode improvements Analysis Services: - Visio Services - Tabular Mode SharePoint: Report Services: - PerformancePoint support - SharePoint Service App for iPad - Power View
  • 6. Agenda• Data Silos and Data Warehouses• Reporting Services• Excel Services• Visio Services• Performance Point• Power Pivot and Power View
  • 7. Data Silos andData Warehouses
  • 8. Data Silos• Where does data live? – Line of business systems (OLTP) • Databases : SQL, Oracle, etc • Data Exports : CSV – Excel files – SharePoint Lists • Also accessible via RSS, OData – Elsewhere • RSS, Atom, OData, etc
  • 9. Data Warehouse Architecture OLTP DW SSAS • Raw Data • ROLAP • MOLAP • TSQL • TSQL • MDX • Normalized • Denormalized • MultiDimensional • Realtime • Realtime - 1 • Realtime - 2
  • 10. SQL Server Reporting Services
  • 11. Why Reporting Services?• Free – Limited to local SQL Express data only • Except when using linked servers – No scheduled/unattended reports• Already in use• Convert Access reports, train report builders• No dependency on SharePoint editions• Reuse your SharePoint portal – Intranet, Extranet, website
  • 12. Reporting Services Native Mode (2005)Minimally Integrated• Install from RSWebParts.cab – C:Program Files (x86)Microsoft SQL Server110ToolsReporting ServicesSharePointRSWebParts.cab• Integration via Web Parts – Report Explorer • Link to Report Builder – Report Viewer • same as the ReportViewer ASP.Net control • Basically an IFrame• Contents stored on SSRS• Client connects directly to SSRS – Firewall and other considerations
  • 13. Reporting Services Integrated Mode(2008 & 2008 R2)Deeply Integrated – Single Dedicated Report Server• SSRS Configuration  SharePoint Mode• Central Admin  General Application Settings• Content stored in SharePoint – Utilize SharePoint’s security model, Versioning, Approvals, Workflows – Logging, AAM’s, Claims based auth• RS Content Types – Report Data Source *.RSDS connection string – Report Builder Model (DataSet) *.RSD query – Report Builder Model (Semantic) *.SMDL – Report Builder Report *.RDL• Remove the Report Explorer web part (unnecessary)• Client connects THROUGH SharePoint (double/triple hop)
  • 14. Reporting Services 2012Completely Integrated – Scalable Dedicated Servers• SSRS Configuration  SharePoint Mode• Central Admin  Service Application – Scalable Architecture• Scheduled Report Jobs – Data Driven subscription – Report snapshots for historical data• Power View – Interactive Designer – Timeline “Play” button – (more on this later)
  • 15. Reporting ServicesData Sources• Microsoft • Extensible / Standards – SQL Server Database – OLE DB – SQL Server Analysis – ODBC – SQL Azure – SharePoint List – XML – SSRS Report Model – BI Semantic Model for Power View• Third Party – Oracle – SAP NetWeaver BI – Hyperion Essbase
  • 16. Reporting ServicesData Sets• Single query (fields, filters)• Single source• Data provider specific language – TSQL, MDX, XMLA• Dataset (file) security
  • 17. Reporting ServicesQuery Designer – SQL – Data Set
  • 18. Reporting ServicesQuery Designer – SQL – Data Set
  • 19. Reporting ServicesQuery Designer – MDX – Data Set
  • 20. Reporting ServicesQuery Designer – MDX – Data Set
  • 21. Reporting ServicesData Models• Data Models are SSRS Data Sources• Describes data and relationships• Automatically generated from SQL Database or OLAP Cube – Exploring the tables, views, fields, relationships• Model Item-level permissions• SQL Express NOT supported• Click Through Reports
  • 22. Reporting ServicesQuery Designer – SQL – Data Model
  • 23. Reporting ServicesQuery Designer – SQL – Data Model
  • 24. Reporting ServicesQuery Designer – MDX – Data Model
  • 25. Reporting ServicesQuery Designer – MDX – Data Model
  • 26. Reporting ServicesQuery Designer – Data Model
  • 27. Reporting ServicesReports• Create with Report Designer (BIDS) or Report Builder• Data Visualizations – Table/Matrix/List – Chart – Gauge – Map – Data Bar – Sparkline – Indicator• Subscriptions – Data Driven Alerts• Options – Data : Live, Cached, Snapshot
  • 28. Reporting ServicesVisualizations : Charts• Column• Line• Shape – Pie, Funnel• Bar• Area• Range – Area, Stock, …• Scatter• Polar
  • 29. Reporting ServicesVisualizations : Gauges• Radial• Linear
  • 30. Reporting ServicesVisualizations : Map
  • 31. Reporting ServicesVisualizations : Spark Lines• Column (bar)• Line• Area• Shape• Range
  • 32. Reporting ServicesVisualizations : Indicators• Directional• Symbols• Shapes• Ratings
  • 33. Reporting ServicesReport Outputs• Export to File – XML, CSV, PDF, Excel (XLSX) – TIFF, Word, MSHTML• Export to Data Feed (.atomsvc) – PowerPivot (default) – SSIS (via HTTP connection) – Outlook (yes, really)
  • 34. Reporting ServicesSubscriptions• Event Driven – On a schedule (Hour, Day, Week, Month) – When snapshots are created Destinations Formats
  • 35. Reporting ServicesData Driven Subscriptions• Data Source : Report Data Source, Report Data Model• Query• Report parameter binding• Delivery – Static Values – Query Fields Destinations Formats
  • 36. Excel and Excel Services
  • 37. Excel : Data Connections• Stored : Embedded or External File• Microsoft : SQL Database, Analysis Services – MS Query : SharePoint Lists• Office Data Connection (*.ODC) files• XML – CSV• Extensible Providers – ODBC : Access, dBase, Excel, Paradox, FoxPro, CSV, Oracle – OLE DB : SQL, Analysis Services, Active Directory
  • 38. Excel : Pivot Tables
  • 39. Excel : Pivot Charts
  • 40. Excel : Indicators
  • 41. Excel : Spark Lines
  • 42. Excel : Usage• Data Connections – Fairly easy to create – Can be centralized in a SharePoint connection library • Permissions, Version History, Content Approval • Good for testing – Designed for single source (table/view, file, etc) • SQL : Relationships are difficult (no GUI) • No way to query ACROSS data sources
  • 43. Excel : Usage• Excel formatting options – Numbers, Currency, Date/Time, etc• Easy and intuitive – On the fly changes (filters, slicers, etc)
  • 44. SharePoint : Excel Services• Web Parts – Render Excel document in web part – Limit access with Named Items – Relate web parts with filters using Web Part Connections• Office Web Applications – View/Edit Excel document in web browser
  • 45. Visio ServicesFeatures of the Forgotten
  • 46. Business Intelligence in Visio• Use shapes to document a process• Data Connections• Map data to shapes• Expose with Visio Services
  • 47. PerformancePointSupercharging your intelligence
  • 48. PerformancePointDashboards• Dashboards are web part pages• Dashboards are composed of Items and Reports – Created using PerformancePoint Data Connections – Stored individually, to be reused
  • 49. PerformancePointDashboard Items• Data Sources• Key Performance Indicators (objectives) – Actual vs Target (goal)• Indicators – Gauges, Progress Bars, Stoplights, etc• Filters• Scorecards – Hierarchical grouping of KPIs
  • 50. PerformancePointDashboard Reports• Analytic Chart• Analytic Grid• Strategy Map• KPI Details• Reporting Services• Other – Excel Services – ProClarity Analytics Server Page – Web Page
  • 51. PerformancePointAnalytic Grid - Designer
  • 52. PerformancePointAnalytic Grid - Viewing
  • 53. PerformancePointAnalytic Grid - Drillthrough
  • 54. PerformancePointAnalytic Grid - Drillthrough
  • 55. PerformancePointAnalytic Grid - Decomposition Tree• Sss
  • 56. PerformancePointDecomposition Tree• ALL the dimensions!
  • 57. PerformancePointDecomposition Tree• View as Analytic Chart or Grid – Bar – Stacked, Stacked (100%) – Line, Line with Markers – Pie
  • 58. PerformancePointAnalytic Grid - On the move!
  • 59. PerformancePointAnalytic Grid - On the move!
  • 60. PerformancePointAnalytic Grid - On the move!
  • 61. PerformancePointAnalytic Grid - On the move!
  • 62. PowerPivot
  • 63. BI : Letting go of the past• Excel – Dominant tool for Agile BI – Known limitations • 2003 65,536 rows x 256 columns • 2007/2010 1,048,576 rows x 16,384 columns• SSAS – MDX and TSQL are very different – Different toolset• Computing resources are underutilized – Multiple Processors, Multiple Cores – Gigabytes of memory
  • 64. PowerPivot : Back to the Future• Vertipaq Engine• Keep ALL the data – Query data ONCE – Utilize compression – Relate data ACROSS data source – Data is cached within the document
  • 65. PowerPivot : Excel 2010, SharePointEnterprise, and SQL Enterprise• NO row limit (technically) – Only limited by available RAM• No cube processing• No penalty for new calculations• Add-in for Excel• Add-in for SharePoint Excel Services, which uses special SQL Analysis instance (‘POWERPIVOT’) – Data caching – Automatic background refreshing of data – New SharePoint list views / visualizations
  • 66. PowerPivot : Data Sources• Databases – SQL Database, Analysis Services, Access – SQL Azure – Oracle, Teradata, Sybase, Informix, DB2 – OLE DB / ODBC• Excel File• SSRS Report• Azure DataMarket – https://datamarket.azure.com/browse• Atom Data Feed• CSV
  • 67. PowerPivot : Adding Data
  • 68. PowerPivot : Adding Data
  • 69. PowerPivot + Pivot Tables
  • 70. PowerPivot Library Views• Gallery View
  • 71. PowerPivot Library Views• Carousel View
  • 72. PowerPivot Library Views• Theater View
  • 73. PowerPivotSoftware Requirements• Excel 2010• SharePoint : Enterprise (Excel Services) – Excel Services Application – PowerPivot Service Application – Secure Store Service – Claims to Windows Token Service• SQL : Dev, Eval, Enterprise, Data Center – RS in SharePoint [Integrated] mode – Analysis Services : SQL Server PowerPivot for SharePoint
  • 74. Analysis ServicesTabular modePowerPivot beyond Excel
  • 75. SQL Analysis Services : OLAP• First appeared in SQL 2005• OLTP  Data Warehouse  Cube – Facts (Measures) and Dimensions – Data Transformations – Cube Processing• MOLAP (MDX) Queries – Known or expected lookups, i.e. Ʃ ($)• ROLAP (TSQL) Queries – Ad-hoc calculations
  • 76. SQL Analysis Services : OLAPLimitations• SSAS was designed for limited resources – SSAS 2005 hardware requirements • HDD: 90 MB, CPU: P3 GHz, RAM: 1 GB – SSAS PowerPivot hardware requirements • HDD: 80 GB, CPU: 16x3 GHz, RAM: 8-128 GB• Outdated resource constraints cause usability constraints today
  • 77. SQL Analysis Services : TabularPowerPivot for ALL• PowerPivot for the Server• Excel File -> Business Intelligence Model file (*.BIM)• Two data query options – Vertipaq / In-Memory mode – DirectQuery mode
  • 78. Building your BIM• SQL Data Tools (formerly BIDS)• Create BIM from scratch – Similar experience as PowerPivot for Excel – Some extra features (permissions, processing mode, etc)• Import Excel PowerPivot file
  • 79. BI Semantic ModelConnection Files to Tabular Data• Office Data Connection (ODC) files – Open with Excel – NOT compatible with tabular data• BI Semantic Mode (BISM) files – Open with Excel and PowerPivot – Connect to SSAS Tabular OR Excel PowerPivot file
  • 80. PowerViewReporting Services meets Power Pivot
  • 81. Power View• Starts with tabular data – Excel PowerPivot – Analysis Services Tabular Mode – BI Semantic Model file (connection file)• In-Browser (Silverlight) editor – RDLX file• Export to PowerPoint
  • 82. Power ViewIn-Browser Editor
  • 83. Power View : Visualizations
  • 84. Power ViewPlaying with Scatter Plots
  • 85. Conclusion
  • 86. Final Thoughts• BI starts with the end user – Connect to the data, wherever it is• BI should be easy to share – Available to the users, wherever they are• BI should be agile – Requirements change, mistakes happen• BI should be promotable – Optimize the use of resources
  • 87. Appendixes
  • 88. Acronyms• BIDS Business Intelligence Development Studio• BIM Business Intelligence Model (Tabular mode)• BISM Business Intelligence Semantic Model• DAX Data Analysis eXpression• DMX Data Mining eXpression (OLAP mode)• KPI Key Performance Indicator• MDX Multi Dimensional eXpression• MOLAP Multidimensional Online Analytical Processing
  • 89. Acronyms• PPS Performance Point Services• OLTP OnLine Transaction Processing• OLAP OnLine Analytical Processing• ROLAP Relational Online Analytical Processing• SSRS Sql Server Reporting Services• SSAS Sql Server Analysis Services• SSIS Sql Server Integration Services• TSQL Transact Structured Query Language• XMLA XML for Analysis -- OR – Multidimensional eXpressions Language
  • 90. Supported Data Sources• Reporting Services – SQL, SSAS, SQL Azure, SharePoint, SSRS Report Model, BI Semantic Model for Power View – Oracle, SAP NetWeaver BI, Hyperion Essbase – OLE DB, ODBC, XML• PowerView – BISM – Excel PowerPivot document
  • 91. Supported Data Sources• Excel – Native : SQL, SSAS, SP List, XML – OLEDB : SQL, SSAS, ODBC DSN, Oracle … – ODBC : Access, DBase, Excel, Oracle, Paradox, TXT/CSV, FoxPro …• PowerPivot – Relational Database: SQL, Azure, Access, Oracle, Teradata, Sybase, Informix, DB2, OLE DB, ODBC – Multidimensional Database: SSAS – Data Feeds: SSRS, Azure DataMarket, Data Feed (Atom) – Files: Excel, TXT/CSV
  • 92. Supported Data Sources• Visio – Excel workbook – Access database – SharePoint list – SQL database – OLE DB, ODBC
  • 93. Supported Data Sources• PerformancePoint – SQL Database – SQL Analysis Services – Excel workbook – SharePoint list
  • 94. Supported Data Sources• SSAS Tabular Mode – Relational Database: SQL, Azure, Access, Oracle, Teradata, Sybase, Informix, DB2, OLE DB, ODBC – Multidimensional Database: SSAS – Data Feeds: SSRS, Azure DataMarket, Data Feed (Atom) – Files: Excel, TXT/CSV• BISM – Excel PowerPivot document – SSAS Tabular Model
  • 95. SharePoint Features, Content Types,and File Extensions• SP Foundation – Office Data Connection (Excel, Visio) ODC – Universal Data Connection (InfoPath) UDCX• SC : Report Server Integration Feature – Report Data Source RSDS – Report Builder Model (Data Set) RSD – Report Builder Model (Semantic Model) SMDL – Report Builder Report RDL• SC : PerformancePoint Services Site Collection Features – PerformancePoint Data Source PPSDC• SC : PowerPivot Feature Integration for Site Collections – BI Semantic Model Connection BISM – Data Service Document ATOMSVC• SC : Power View Integration Feature – Power View Report RDLX
  • 96. File Types and ExtensionsBy authoring tool• SQL Server Analysis Services / Data Tools – Business Intelligence Model BIM• Power View – Power View Report RDLX
  • 97. References• Requirements for SSRS (2008 R2) in Integrated Mode http://msdn.microsoft.com/en-us/library/bb283190.aspx• Requirements for SQL 2012 (PowerPivot and SSRS) in Integrated Mode http://msdn.microsoft.com/en-us/library/ee210640.aspx• Installing SSRS Integrated Mode for SharePoint 2013 http://msdn.microsoft.com/en-us/library/jj219068.aspx• Hardware Requirements for PowerPivot http://msdn.microsoft.com/en-us/library/ee210640.aspx• System Requirements for Power View http://technet.microsoft.com/en-us/library/hh560549.aspx• PowerPivot BI Semantic Model Connection http://technet.microsoft.com/en-us/library/gg471575.aspx• SSRS Subscriptions and Delivery http://msdn.microsoft.com/en-us/library/ms159762.aspx
  • 98. Questions & Evals
  • 99. MORE INFORMATIONSDS SharePoint Webcasts:• Managing Content and Maximizing Search, 11/2• Sharing Business Insights – Integrating with Business Intelligence Reports, 11/30• Visit http://sds-consulting.com to register• SharePoint Library for various components. http://SDSSharepointLibrary.codeplex.com/SharePoint Lunch and LearnsPublications on the SDS website and bloghttp://sds-consulting.comhttp://www.sbrickey.com
  • 100. Thanks To Our Sponsors