Getting to Know the BI Semantic Model

  • 2,120 views
Uploaded on

Getting to Know the BI Semantic Model - Visual Studio Live! March 2013

Getting to Know the BI Semantic Model - Visual Studio Live! March 2013

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
2,120
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
43
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Getting to Know the BISemantic ModelLevel: IntermediateMarch 28, 2013Andrew BrustCEO and FounderBlue Badge Insights
  • 2. • CEO and Founder, Blue Badge Insights• Big Data blogger for ZDNet• Microsoft Regional Director, MVP• Co-chair VSLive! and 17 years as a speaker• Founder, Microsoft BI User Group of NYC– http://www.msbinyc.com• Co-moderator, NYC .NET Developers Group– http://www.nycdotnetdev.com• “Redmond Review” columnist forVisual Studio Magazine and Redmond DeveloperNews• brustblog.com, Twitter: @andrewbrustMeet Andrew
  • 3. Andrew’s New Blog (bit.ly/bigondata)
  • 4. Read all about it!
  • 5. What is the BI Semantic Model• It’s a relational model for analytical data• Similar to an OLAP cube– Because it facilitates dimensional/drill-down analysis– (Some people would even consider BISM a cube)• Similar to a data warehouse– Because it accommodates a star schema– Because it uses columnar technology used in many datawarehouse appliances• But it’s different– Data is not stored dimensionally– Star schema not required– Can function as a model layer only, storing no physical data
  • 6. Agenda• BISM Overview• BISM in Excel 2013• PowerPivot• SSAS Tabular• Power View
  • 7. BISM OVERVIEW
  • 8. GenesisBISMCompetingproducts(BO, TM1)ReportBuilder 1.0reportmodelsAnalysisServicescubes
  • 9. BISM Companions• Manifested in storage engines for PowerPivot and SSASTabular modexVelocity in-memory technologies• Analytical function library with Excel-like syntax• Successor to MultiDimensional Expressions (MDX)Data Access eXpressions (DAX)• For designing, storing and querying modelsPowerPivot• For reporting on and visualizing BISM dataPower View• Which creates BISM models implictlyExcel 2013
  • 10. Motivations• Self Service• In-memory performance• Agility• More business-friendly• More relational-friendly
  • 11. Column-Oriented Stores• Imagine, instead of:• You have:• Perf: values you wish to aggregate are adjacent• Efficiency: great compression from identical or nearly-identical values in proximity• Fast aggregation and high compression means huge volumesof data can be stored and processed, in RAMEmployee ID Age Income1 43 900002 38 1000003 35 100000Employee ID 1 2 3Age 43 38 35Income 90000 100000 100000
  • 12. BISM IN EXCEL 2013
  • 13. BISM Embedded in Excel 2013• Importation of data into a sheet implicitlyadds it to a columnar, in-memory BISMmodel– The model can then be queried via PivotTabes, chartsand Power View– “Import millions of rows from multiple data sources”– “Create relationships between data from differentsources, and between multiple tables in a PivotTable”– “Create implicit calculated fields”– “Manage data connections”• This means most “spreadmarts” are nowBISM models. This is huge.
  • 14. Rules for Model Building• Sometimes data is not immediately added– But building a PivotTable or Power View report on itwill cause it to be added• Even a manually created Excel table maybe added• “Add to Data Model” button in PowerPivottab of ribbon allows adding explicitly• Using PowerPivot window unnecessary,but still required for more advancedmodeling.– As long as you have Office ProPlus
  • 15. Data Explorer• Beta Excel add-in for importation ofstructured and unstructured data– Facebook– Hadoop/HDFS– Active Directory– SharePoint– Files in folder, XML– Improved Web/HTML• Because of implicit model and linkedtables, Data Explorer effectively opens upnew data sources for the BISM
  • 16. Embedded Models
  • 17. POWERPIVOT
  • 18. What is PowerPivot?• Excel + Analysis Services + SharePoint• Mitigates many spreadmart pitfalls:– Use Analysis Services (AS) as a hidden engineInstead of no engine– Share via SharePoint, accessible by all AS clientsInstead of “deploying” via email– Formal data refresh on serverSo data doesn’t get stale, and users don’t have tomake effort at updating– Allow IT to monitorSo it’s not all rogue– Provide path to more rigorous implementationsCan be upsized to Analysis Services
  • 19. How do you get PowerPivot?• For Excel 2010:– Download the add-in from www.powerpivot.com– Get 32-bit or 64-bit version, depending on yourversion of Office (not Windows)– Run the installer• For Excel 2013:– Included in product, but only with:Office Pro Plus retail product (under volume licensing)Office 365 Pro Plus or Enterprise E3/E4 subscriptions– It’s still an add-in, installed but not activated by defaultSame goes for Excel version of Power View
  • 20. Data Import• Relational databases– SQL Server (including SQL Azure!), Access– Oracle, DB2, Sybase, Informix– Teradata– “Others” (OLE DB, including OLE DB provider for ODBC)• OData feeds, incl. R2/2012 Reporting Services,Azure DataMarket, WCF Data Services (Astoria),SharePoint 2010+ lists, Visual Studio LightSwitch• Excel via clipboard, linked tables• Filter, preview, friendly names fortables/columns
  • 21. Calculated Columns and DAX• Formula-based columns may be created• Formula syntax is called DAX (Data AnalysiseXpressions).– Not to be confused with MDX or DMX. Or DACs.• DAX expressions are similar to Excel formulas– Work with tables and columns; similar to, but distinct from,worksheets and their columns (and rows)• =FUNC(table name[column name])• =FUNCX(table name, <filter expression>)• FILTER(Resellers,[ProductLine] = "Mountain")• RELATED(Products[EnglishProductName])• DAX expressions can be heavily nested
  • 22. PowerPivot GuidebookTable tabsView datain ExcelDAX formula barRelationshipindicatorImport data fromalmost anywhereSort and filterCalculatedcolumnentry
  • 23. Modeling the Data KPIsCalculationsData andDiagram viewsCalculationareaCalculationformulaSort one columnby another
  • 24. Diagram ViewDefault Aggregations Special Advanced ModeReportingpropertiesHierarchiesHide specificcolumns andtablesCreaterelationshipsvisuallyKPIsPerspectivesCalculations
  • 25. PowerPivot Client
  • 26. Excel Services• A component of SharePoint Server 2007+;requires Enterprise CAL• Allows export of workbook, worksheet, orindividual items to SharePoint report library– Works great for PivotTables and Charts!– Also for sheets with CUBExxx formulas or conditionalformatting-driven “scorecards”• Content can be viewed in browser– Excel client not required– Drilldown interactivity maintained– Rendered in pure HTML and JavaScript– Parameterization supported
  • 27. PowerPivot Server• Publish to Excel Services• Viewing and interacting• Data Refresh• Treating as SSAS cube– 2008 R2 version: URL to .xlsx as server name– 2012 version: use POWERPIVOT named instance and treatjust like SSASDb name is GUID-based; best to discover it– Use Excel, Reporting Services as clientsAnd now Power View too…more later
  • 28. The IT DashboardIncrease IT efficiency:Familiar Technologiesfor Authoring, Sharing,Security, andComplianceCustomizable ITDashboardVisualize usage withanimated chartsSimplify management of SSBI content usingIT Operations Dashboard for SharePoint
  • 29. PowerPivot Server
  • 30. SSAS Tabular
  • 31. Analysis Services Tabular Mode• SSAS Tabular Mode is theenterprise/server implementation ofPowerPivot• You must have a dedicated Tabular modeSSAS instance• Tabular SSAS projects: Anlaysis Servicesproject tools gone PowerPivot– Implements equivalent tooling to PowerPivot Window– Can create an SSAS Tabular database project byimporting an Excel workbook with PowerPivot model• SSAS Tabular models support partitionsand roles
  • 32. SSAS Tabular Project in SSDT-BI(i.e. Visual Studio)SSAS Tabular projectmenus and toolbarCalculations areaand formula barReporting propertiesin Properties window
  • 33. DirectQuery Mode• In DQ mode, modeldefines schema,but is not used fordata• Queries issueddirectly againstsource• Similar to ROLAPstorage forconventional cubes• Combine withxVelocityColumnstoreindexes for fast,real-time querying
  • 34. SSAS Tabular Mode
  • 35. POWER VIEW
  • 36. What is Power View?• Ad hoc reporting. Really!• Analysis, data exploration• Data Visualization• In Silverlight, in the browser, in SharePoint• And now in Excel 2013, too– ProPlus edition required– Still Silverlight• Is actually based on SSRS– Power View makes a special RDL file• Competitive response– To QlikView, Tableau, Tibco Spotfire
  • 37. Power View Data Sources• Power View works only against BISM• DirectQuery mode supported, however• Support for SSAS Multidimensional cubescoming• Gist is this: Power View emits DAXexpressions– PowerPivot and SSAS Tabular support DAX– SSAS Multidimensional will support DAX soon
  • 38. Create a Power View Report• In Excel 2013, click Power View button onInsert tab of ribbon– Make sure add-in is activated• In SharePoint, click “Create Power ViewReport” button or option on workbook inPowerPivot Gallery• For SSAS tabular model, create BISM datasource, then click its “Create Power ViewReport” button or option– BISM data sources can point to PowerPivotworkbooks too, if you want.• Can export to PowerPoint and view there
  • 39. Power View!Variety ofvisualizationsand data formatsField list, aswith PivotTablesData regions pane,as with PivotTables
  • 40. Maximize, FilterMaximize chartFilter area
  • 41. Power View Basics
  • 42. Scatter/Bubble Charts• Allow for several measures• Features a “play” axis which can bemanipulated through a slider or animated• Excellent way to visualize trends over time
  • 43. Advanced Properties• Setting the representative column andimage tells Power View how to summarizeyour data, and show stored images• Other properties tell it about keyattributes, default aggregations and more• These are all BISM features; they aremerely being exposed by PowerPivot andSSAS Tabular– They are the justification for the term “semantic”
  • 44. Advanced Power View
  • 45. Vocabulary--Multidimensional--• Multidimensional OLAPMOLAP• Unified Dimensional ModelUDM• Unit of schema in a multidimensional databaseCube--BISM--• Excel/PowerPivot/SSAS’ column store enginexVelocity ColumnstoreTechnology• Old name for xVelocity in-memory analytics engineVertiPaq• BI Semantic ModelBISM• In-Memory BI EngineIMBI• A column store-based model• Because it uses tables, not cubesTabular
  • 46. Thank You!• Email• andrew.brust@bluebadgeinsights.com• Blog:• http://www.zdnet.com/blog/big-data• Twitter• @andrewbrust on twitter