The first step is often the most difficult because you have to clean up the data before you can use it effectively. This is particularly difficult in finance where results are often restated.
The most important tool in organizing data is OLAP cubes. BIDS, which installs with SQL Server, has wizards to help you create cubes. This work is usuallydone by a business analyst or information architect because it requires an in-depth knowledge of the data.
This is the hardest step and you won’t be able to do it alone. At the very least you will need a business analyst or project manager with a comprehensive knowledge of the data and what it means. Creating analysis cubes especially is difficult because it requires a thorough understanding of how the business works and what Measures would be significant for the business users.
Used to be a lot of smaller independent copies but now only one is left as a major player. Most of these products provide a set of targeted applications that can not be added extended with custom programming.
The “Insights” slice of the Microsoft “pie”
I know of company that has written a powerful risk analysis product for SharePoint 2010 – get name from my email
This is the Functional view
Plan your data connections and place them in data connection libraries--test them from all BI application: Excel spreadsheets, PowerPivot spreadsheets, Dashboard Designer, Reporting Services, etc.
In SharePoint 2007, a separate web site was used to manage the Shared Service Provider (SSP). In SharePoint Server 2010 and hence Project Server 2010, all Service Applications can be managed directly in Central Admin (CA) – doesn’t require a separate site for management purposes.In the SSP model you traditionally consumed all available services from an SSP or none at all (Excel Services sometimes being an exception). In Project Server 2010 there is more flexibility, so you can pick and choose which Service Applications you want to consume within an individual web app.
WFE = Web Front EndWhen you create a service application, a proxy for the service application is created at the same time. A proxy is a virtual entity that connects Web applications to service applications.Proxies for services in the local farm are not created by the administrator, but these appear along with the list of service applications in Central Administration. Some proxies might include settings that can be modified. For example, if a Web application is connected to multiple instances of the Managed Metadata service, you must indicate which of the proxies is connected to the primary service application which hosts the corporate taxonomy.Proxy groups are explained in more detail in the next slide.
SA = Service ApplicationIn MOSS 2007 Web apps were tied to bundled services via SSPsIn Windows SharePoint Services (WSS) 4.0 it is a looser association, a web application is able to select from just the service application it needs to fulfill its user requirements – i.e. “a la carte” The Service Application Proxy Groups is what makes this possible.Web applications group multiple service application proxies into Service Application Proxy GroupsEnables a Web application to be tied to one or more sets of services, or a mix of multiple farm services.Note that some types of SharePoint 2010 services are capable of sharing their capabilities across server farms. But the project service application for Project Server 2010 does not.By default, all service applications are included in the default proxy group. You may remove service applications from the default proxy group if needed.When you create a Web application, you can select the default proxy group, or you can create a custom proxy group by selecting only the service applications that you want the Web application to use.Custom proxy groups are not reusable across multiple Web applications. Each time you select “custom” when creating a Web application, you are selecting services only for the Web application you are creating.
This slide, which I took from one of the MSDN SharePoint 2010 BI video, might give you the idea that all you have to install is the Service Application and the Excel Calculation Service instance. Unfortunately, there’s a lot more to it.
Installing Excel without adding SPNs for
You will probably never use Claims unless you need Form Authentication and you will need Kerberos because you will be in a multi-server farm environment.
Much easier if you deploy and test Excel services first!
I’ve been trying to figure out what this ”1 hour later” in this diagram refers to. Does that mean how long it takes to create this diagram in Visio? I don’t think so!
Let’s take a look at this
Bringing it All Together SharePoint 2010 Business Intelligence Kathryn Birstein, SharePoint Architect SharePoint Salvation http://www.sharepointsalvation.com
What is Business Intelligence? Any information that pertains to the history, current status or future projections of a business organization Systems that provide directed background data and reporting tools to support and improvethe decision-making process
The Three Stages of Business Intelligence Organizing, cleansing and collecting data Delivering the data in a consistent and appropriate, meaningful and easy-to-use format Using the data to make effective decisions
Stage 1: Organizing Data OLAP (Online Analytical Processing)Precalculates and stores aggregates in SSAS databases Use Business Intelligence Studio (BIDS) to create SSAS databases Cubes: The basic unit of storage and analysis in Analysis Services Dimensions: a category for analyzing business data, ex: States,Cities Measures: column in a table that you'd like to analyze, ex: sales
Stage 2: Delivering Data A team effort – need at least business analyst with a good knowledge of data warehouse Establish governance rules upfront – only stored procedures, all connections in libraries, etc. Enlist business power users to manage rights of BI objects Test user acceptance at draft stage
The Business Intelligence Market By 2014 the total sales of BI products is expected to hit $12bn
Microsoft SharePoint 2010The business collaboration platform for the Enterprise and the Web Sites Connect and Empower People Communities Composites Cut Costs with a Unified Infrastructure Content Insights Rapidly Respond to Business Needs Search
SharePoint 2010 BI Pros Less expensive than other solutions—free with Enterprise version of SharePoint 2010 Completely customizable and extensible with .NET and Silverlight Good support from Microsoft premier support Brings together your entire environment Offers users more “self-service” options Is “embedded” with SharePoint rather than separate
SharePoint 2010 BI Cons More work to get started—have to build or purchase a risk analysis application (like ProViz XL IRM), for instance, while other products offer this OTB SharePoint 2010 setup and admin requires senior IT support Requires SharePoint Enterprise license Need to be a entirely Microsoft shop to reap the full benefits New kid on the block
When to Use SharePoint BI? When your organization is looking for a long term solution When you are an all-Microsoft shop When flexibility and extensibility are paramount concerns When your users make extensive use of Excel for modeling critical data When delivering data worldwide is important
What Comprises SharePoint BI? The following services are the primary SharePoint Business Intelligence services Excel Services PowerPivot for Excel 2010 Performance Point SQL Server Reporting Services Office Web Apps Visio Graphic Services Business Connectivity Services
Supporting BI Services The following services play a supporting role in SharePoint Business Intelligence services Enterprise Search Secure Store Service Metadata Service Usage Data Collection Web Analytics State Service
Other SharePoint BI Elements SQL Server 2008 R2 Analysis Services – for OLAP cubes Business Intelligence Studio – for report and cube creation Report Builder – for report creation by business users Dashboard Designer – the client part of Performance Point SharePoint Designer 2010 – for Business Connectivity connections, etc.
SharePoint BI Brings it All Together Functional ViewPoint
SharePoint BI Brings It All Together Structural Viewpoint
SharePoint 2010 BI Deployment Many interdependent services Must use Kerberos authentication for full, secure, data access Read and use 177-page white paper “Configuring Kerberos Authentication for Microsoft SharePoint 2010 Products” Must TEST connections to external data – make sure you can refresh successfully SQL databases SQL Server OLAP cubes Other data sources
Service Applications Benefits No longer a separate SSP website SAs managed via Central Administration Pick and choose the services you use If you don’t need a service, don’t add it Web applications can consume services on an individual basis Each Web application can use any combination of all available SAs Service Applications may be organized into groups called Proxy Groups Deploy multiple instances of the same SA Just give each one a unique name Reuse SA instances across multiple Web applications in farm
Service Model – Architectural View Service: Actual program (binaries) deployed to servers in farm Service Machine Instance: Actual instance of the running service binaries on a server Service Application Service Application:Configuration of the service in a farm Service Proxy Service Proxy Service Application Proxy:Reference to the Service Application Service Consumer:Bits that utilize the service’s logic Web Part, Pages (Service Consumer) *.SVC’s, PowerShell Cmdlets (Service Consumer)
What is a Service Application? Service Application: A configured logical instance of a Service Provides data or computing resources Exposes administrative interfaces Uses resources Service Database Application Pool Service Instances: Running physical instance of a service Contains the configured user accounts the server will run as Contains connection details for the configured databases utilized by the service Could be non-SharePoint schema databases … ie: custom DBs
How is a Service Application Used? Features, such as web parts, on a Web App use Service Applications Web application SA Proxy Service Application A Service Application Proxy connects a Web App to a Service app Associations determined by administrators, can be changed any time Connections can be managed individually or in groups (‘Service Application Proxy Group’)
Service Application Proxy A proxy is a virtual entity that connects Web applications to service applications Consumers interact with the service via proxies Installed on the WFE servers Associated with a service application Knows how to connect to the service on the app servers via WCF services Talks to a round-robin load balancer when the service is installed on multiple app servers
Service Application Proxy Groups A proxy group is a group of Service Application proxies that are selected for a web application By default, all SA proxies are included in the default proxy group You can remove them from the default group When you create a web app you can: select the default proxy group create a custom proxy group by selecting which SA proxies should be included
Excel Services Architecture W E B F R O N T E N D REST API Excel Web Services Excel Web Access JSON Excel Proxy (connector-part of Excel Service Application) A P P L I C A T I O N S E R V E R User-Defined Functions Excel Calculation Service SharePoint Content Database External Data Sources XLSX / b / m Oracle OLAP
Excel Deployment: Let's Get Real Web applications must use Kerberos authentication, add SPN on app pool account http/WFE and http/WFE.mydomain.com Create Excel Calculation Services SPN on Application Pool identity account HTTP/appservername Start Excel Calculation Services on APP server Add and configure Excel Service Application
Excel Deployment (continued) Start Claims to Windows Token Service on APP server Check to make sure its running as “Local System” in Central Admin/Security Install SSAS on SQL Server Create SPN for SSAS service account, MSOLAPSvc.3/sqlservername Configure constrained delegation On APP server, add SSAS service account On Excel service account, add SSAS service account
Excel Services Limitations Supported and Unsupported Featureshttp://msdn.microsoft.com/en-us/library/ff595319.aspx Differences between using a workbook in Excel and Excel Serviceshttp://office.microsoft.com/en-us/excel-help/differences-between-using-a-workbook-in-excel-and-excel-services-HA010021716.aspx
PowerPivot Deployement http://msdn.microsoft.com/en-us/library/ee210616.aspx Install PowerPivot for “existing” farm from SQL Server 2008 DVD on APP server Deploy powerpivotwebapp.wsp solution to each web application that will run PowerPivot Create a PowerPivot service application Install Secure Store and configure unattended service account (you really should use Kerberos) Activate PowerPivot feature on site collections
Diagrams containing data graphics are refreshable
Diagrams give data context and improve insights into the state of a system
FAST BI Indexing Connector Add-in to FAST Search Server for SharePoint Query and Crawl XLSX/XSLM and RDL reports Dedicated Reports tab Use filters to refine and narrow results BI Search identifies Table, Pivot Tables, and Chart Data Crawls data not visible in report using data connection
Detailed Report Information Location of Search Term Find Similar Reports Report Preview
Watch Videos Microsoft BI Resource Centerhttp://technet.microsoft.com/en-us/sharepoint/ee692578.aspx Two important Twenty-Six New York videos: http://www.26ny.com/content/5.1_articles.html#articles_webcasts 1. How does the Microsoft BI Stack . . .Stack UP? An excellent review of all the BI software products out there and how they compare to Microsoft BI. 2. Rapid BI Dashboard Development A great demo of Performance Point Dashboard Designer showing the full power of this tool
Do Some Tutorials Excel Services Tutorial – Is It Working?http://www.sharepointmonitor.com/2010/02/getting-started-with-the-sharepoint-2010-excel-services/
PowerPivot Tutorial for Excel 2010http://technet.microsoft.com/en-us/library/ee835510.aspx
Reporting Services Tutorialshttp://msdn.microsoft.com/en-us/library/bb522859.aspx SQL Server Analysis Services Tutorialhttp://technet.microsoft.com/en-us/library/ms170208.aspx
Create a Sales Dashboard in PPS http://technet.microsoft.com/en-us/bi/ff643005.aspx
SharePoint 2010 BI Resources Choosing a Business Intelligence Tool http://technet.microsoft.com/en-us/library/ff394320(office.14).aspx Excel Services 2010 Overview http://technet.microsoft.com/en-us/library/ee424405(office.14).aspx Office Web Apps http://technet.microsoft.com/en-us/library/ee855124(office.14).aspx PowerPivot for SharePoint http://technet.microsoft.com/en-us/library/ee210682(SQL.105).aspx PerformancePoint Services Planning http://technet.microsoft.com/en-us/library/ee681486(office.14).aspx Reporting Services & SharePoint Integration http://technet.microsoft.com/en-us/library/ee210649(SQL.105).aspx Visio Services Planning http://technet.microsoft.com/en-us/library/ee663482(office.14).aspx
2 ASUS Netbooks Also Some Books 1 Typemock Isolator License A 2-5 Day Course from SetFocus on SharePoint Telerik RAD Controls Set 1 DeliverPointWFE 2010 license (Worth $1500) 1 BCS Meta Man license (Worth $1200) 1 Lightning Conductor 2010 WFE license (Worth $800) 1 Lightning Storm Forums license. (Worth $600)