The first step is often the most difficult because you have to clean up the data before you can use it effectively. This is particularly difficult in finance where results are often restated.
The most important tool in organizing data is OLAP cubes. BIDS, which installs with SQL Server, has wizards to help you create cubes. This work is usuallydone by a business analyst or information architect because it requires an in-depth knowledge of the data.
This is the hardest step and you won’t be able to do it alone. At the very least you will need a business analyst or project manager with a comprehensive knowledge of the data and what it means. Creating analysis cubes especially is difficult because it requires a thorough understanding of how the business works and what Measures would be significant for the business users.
Used to be a lot of smaller independent copies but now only one is left as a major player. Most of these products provide a set of targeted applications that can not be added extended with custom programming.
The “Insights” slice of the Microsoft “pie”
I know of company that has written a powerful risk analysis product for SharePoint 2010 – get name from my email
This is the Functional view
Plan your data connections and place them in data connection libraries--test them from all BI application: Excel spreadsheets, PowerPivot spreadsheets, Dashboard Designer, Reporting Services, etc.
In SharePoint 2007, a separate web site was used to manage the Shared Service Provider (SSP). In SharePoint Server 2010 and hence Project Server 2010, all Service Applications can be managed directly in Central Admin (CA) – doesn’t require a separate site for management purposes.In the SSP model you traditionally consumed all available services from an SSP or none at all (Excel Services sometimes being an exception). In Project Server 2010 there is more flexibility, so you can pick and choose which Service Applications you want to consume within an individual web app.
WFE = Web Front EndWhen you create a service application, a proxy for the service application is created at the same time. A proxy is a virtual entity that connects Web applications to service applications.Proxies for services in the local farm are not created by the administrator, but these appear along with the list of service applications in Central Administration. Some proxies might include settings that can be modified. For example, if a Web application is connected to multiple instances of the Managed Metadata service, you must indicate which of the proxies is connected to the primary service application which hosts the corporate taxonomy.Proxy groups are explained in more detail in the next slide.
SA = Service ApplicationIn MOSS 2007 Web apps were tied to bundled services via SSPsIn Windows SharePoint Services (WSS) 4.0 it is a looser association, a web application is able to select from just the service application it needs to fulfill its user requirements – i.e. “a la carte” The Service Application Proxy Groups is what makes this possible.Web applications group multiple service application proxies into Service Application Proxy GroupsEnables a Web application to be tied to one or more sets of services, or a mix of multiple farm services.Note that some types of SharePoint 2010 services are capable of sharing their capabilities across server farms. But the project service application for Project Server 2010 does not.By default, all service applications are included in the default proxy group. You may remove service applications from the default proxy group if needed.When you create a Web application, you can select the default proxy group, or you can create a custom proxy group by selecting only the service applications that you want the Web application to use.Custom proxy groups are not reusable across multiple Web applications. Each time you select “custom” when creating a Web application, you are selecting services only for the Web application you are creating.
This slide, which I took from one of the MSDN SharePoint 2010 BI video, might give you the idea that all you have to install is the Service Application and the Excel Calculation Service instance. Unfortunately, there’s a lot more to it.
Installing Excel without adding SPNs for
You will probably never use Claims unless you need Form Authentication and you will need Kerberos because you will be in a multi-server farm environment.
Much easier if you deploy and test Excel services first!
I’ve been trying to figure out what this ”1 hour later” in this diagram refers to. Does that mean how long it takes to create this diagram in Visio? I don’t think so!
Let’s take a look at this
Kathryn Birstein: SharePoint 2010 Business Intelligence-Bringing it All Together
Bringing it All Together<br />SharePoint 2010 Business Intelligence<br />Kathryn Birstein, SharePoint Architect<br />SharePoint Salvation<br />http://www.sharepointsalvation.com<br />
What is Business Intelligence?<br />Any information that pertains to the history, current status or future projections of a business organization<br />Systems that provide directed background data and reporting tools to support and improvethe decision-making process<br />
The Three Stages of Business Intelligence<br />Organizing, cleansing and collecting data<br />Delivering the data in a consistent and appropriate, meaningful and easy-to-use format<br />Using the data to make effective decisions<br />
Stage 1: Organizing Data<br />OLAP (Online Analytical Processing)Precalculates and stores aggregates in SSAS databases<br />Use Business Intelligence Studio (BIDS) to create SSAS databases<br />Cubes: The basic unit of storage and analysis in Analysis Services <br />Dimensions: a category for analyzing business data, ex: States,Cities<br />Measures: column in a table that you'd like to analyze, ex: sales<br />
Stage 2: Delivering Data<br />A team effort – need at least business analyst with a good knowledge of data warehouse<br />Establish governance rules upfront – only stored procedures, all connections in libraries, etc.<br />Enlist business power users to manage rights of BI objects<br />Test user acceptance at draft stage<br />
The Business Intelligence Market<br />By 2014 the total sales of BI products is expected to hit $12bn<br />
Microsoft SharePoint 2010The business collaboration platform for the Enterprise and the Web<br />Sites<br />Connect and Empower People<br />Communities<br />Composites<br />Cut Costs with a Unified Infrastructure<br />Content<br />Insights<br />Rapidly Respond to Business Needs<br />Search<br />
SharePoint 2010 BI Pros<br />Less expensive than other solutions—free with Enterprise version of SharePoint 2010<br />Completely customizable and extensible with .NET and Silverlight<br />Good support from Microsoft premier support<br />Brings together your entire environment<br />Offers users more “self-service” options<br />Is “embedded” with SharePoint rather than separate<br />
SharePoint 2010 BI Cons<br />More work to get started—have to build or purchase a risk analysis application (like ProViz XL IRM), for instance, while other products offer this OTB<br />SharePoint 2010 setup and admin requires senior IT support<br />Requires SharePoint Enterprise license<br />Need to be a entirely Microsoft shop to reap the full benefits<br />New kid on the block<br />
When to Use SharePoint BI?<br />When your organization is looking for a long term solution<br />When you are an all-Microsoft shop<br />When flexibility and extensibility are paramount concerns<br />When your users make extensive use of Excel for modeling critical data<br />When delivering data worldwide is important<br />
What Comprises SharePoint BI?<br />The following services are the primary SharePoint Business Intelligence services<br />Excel Services<br />PowerPivot for Excel 2010<br />Performance Point <br />SQL Server Reporting Services<br />Office Web Apps<br />Visio Graphic Services<br />Business Connectivity Services<br />
Supporting BI Services<br />The following services play a supporting role in SharePoint Business Intelligence services<br />Enterprise Search<br />Secure Store Service<br />Metadata Service<br />Usage Data Collection<br />Web Analytics<br />State Service<br />
Other SharePoint BI Elements<br />SQL Server 2008 R2 Analysis Services – for OLAP cubes<br />Business Intelligence Studio – for report and cube creation<br />Report Builder – for report creation by business users<br />Dashboard Designer – the client part of Performance Point <br />SharePoint Designer 2010 – for Business Connectivity connections, etc.<br />
SharePoint BI Brings it All Together<br />Functional ViewPoint<br />
SharePoint BI Brings It All Together<br />Structural Viewpoint<br />
SharePoint 2010 BI Deployment<br />Many interdependent services<br />Must use Kerberos authentication for full, secure, data access<br />Read and use 177-page white paper “Configuring Kerberos Authentication for Microsoft SharePoint 2010 Products”<br />Must TEST connections to external data – make sure you can refresh successfully<br />SQL databases<br />SQL Server OLAP cubes<br />Other data sources<br />
Service Applications Benefits<br />No longer a separate SSP website<br />SAs managed via Central Administration<br />Pick and choose the services you use<br />If you don’t need a service, don’t add it<br />Web applications can consume services on an individual basis<br />Each Web application can use any combination of all available SAs<br />Service Applications may be organized into groups called Proxy Groups<br />Deploy multiple instances of the same SA<br />Just give each one a unique name<br />Reuse SA instances across multiple Web applications in farm<br />
Service Model – Architectural View<br />Service: Actual program (binaries) deployed to servers in farm<br />Service Machine Instance: Actual instance of the running service binaries on a server<br />Service Application<br />Service Application:Configuration of the service in a farm<br />Service Proxy<br />Service Proxy<br />Service Application Proxy:Reference to the Service Application<br />Service Consumer:Bits that utilize the service’s logic<br />Web Part, Pages<br />(Service Consumer)<br />*.SVC’s, PowerShell Cmdlets<br />(Service Consumer)<br />
What is a Service Application?<br />Service Application: A configured logical instance of a Service<br />Provides data or computing resources<br />Exposes administrative interfaces<br />Uses resources<br />Service Database<br />Application Pool<br />Service Instances: Running physical instance of a service<br />Contains the configured user accounts the server will run as<br />Contains connection details for the configured databases utilized by the service<br />Could be non-SharePoint schema databases … ie: custom DBs<br />
How is a Service Application Used?<br />Features, such as web parts, on a Web App use Service Applications<br />Web application SA Proxy Service Application<br />A Service Application Proxy connects a Web App to a Service app<br />Associations determined by administrators, can be changed any time<br />Connections can be managed individually or in groups (‘Service Application Proxy Group’)<br />
Service Application Proxy<br />A proxy is a virtual entity that connects Web applications to service applications<br />Consumers interact with the service via proxies<br />Installed on the WFE servers<br />Associated with a service application<br />Knows how to connect to the service on the app servers via WCF services<br />Talks to a round-robin load balancer when the service is installed on multiple app servers<br />
Service Application Proxy Groups<br />A proxy group is a group of Service Application proxies that are selected for a web application<br />By default, all SA proxies are included in the default proxy group<br />You can remove them from the default group<br />When you create a web app you can:<br />select the default proxy group<br />create a custom proxy group by selecting which SA proxies should be included<br />
Excel Services Architecture<br />W E B F R O N T E N D<br />REST API<br />Excel Web Services<br />Excel Web Access <br />JSON<br />Excel Proxy (connector-part of Excel Service Application)<br />A P P L I C A T I O N S E R V E R<br />User-Defined Functions<br />Excel Calculation Service<br />SharePoint Content Database<br />External Data Sources<br />XLSX / b / m<br />Oracle<br />OLAP<br />
Excel Deployment: Let's Get Real<br />Web applications must use Kerberos authentication, add SPN on app pool account<br />http/WFE and http/WFE.mydomain.com<br />Create Excel Calculation Services SPN on Application Pool identity account<br />HTTP/appservername<br />Start Excel Calculation Services on APP server<br />Add and configure Excel Service Application<br />
Excel Deployment (continued)<br />Start Claims to Windows Token Service on APP server<br />Check to make sure its running as “Local System” in Central Admin/Security<br />Install SSAS on SQL Server<br />Create SPN for SSAS service account, MSOLAPSvc.3/sqlservername<br />Configure constrained delegation<br />On APP server, add SSAS service account<br />On Excel service account, add SSAS service account<br />
Excel Services Limitations<br />Supported and Unsupported Featureshttp://msdn.microsoft.com/en-us/library/ff595319.aspx<br />Differences between using a workbook in Excel and Excel Serviceshttp://office.microsoft.com/en-us/excel-help/differences-between-using-a-workbook-in-excel-and-excel-services-HA010021716.aspx<br />
PowerPivot Deployement<br />http://msdn.microsoft.com/en-us/library/ee210616.aspx<br />Install PowerPivot for “existing” farm from SQL Server 2008 DVD on APP server<br />Deploy powerpivotwebapp.wsp solution to each web application that will run PowerPivot<br />Create a PowerPivot service application<br />Install Secure Store and configure unattended service account (you really should use Kerberos)<br />Activate PowerPivot feature on site collections<br />
Diagrams containing data graphics are refreshable
Diagrams give data context and improve insights into the state of a system</li></ul>Data Source<br />
FAST BI Indexing Connector<br />Add-in to FAST Search Server for SharePoint<br />Query and Crawl XLSX/XSLM and RDL reports<br />Dedicated Reports tab<br />Use filters to refine and narrow results<br />BI Search identifies Table, Pivot Tables, and Chart Data<br />Crawls data not visible in report using data connection<br />
Detailed Report Information<br />Location of Search Term<br />Find Similar Reports<br />Report Preview<br />
Watch Videos<br />Microsoft BI Resource Centerhttp://technet.microsoft.com/en-us/sharepoint/ee692578.aspx<br />Two important Twenty-Six New York videos:<br />http://www.26ny.com/content/5.1_articles.html#articles_webcasts<br />1. How does the Microsoft BI Stack . . .Stack UP?<br /> An excellent review of all the BI software products out there and how they compare to Microsoft BI. <br />2. Rapid BI Dashboard Development<br /> A great demo of Performance Point Dashboard Designer showing the full power of this tool<br />
Do Some Tutorials<br />Excel Services Tutorial – Is It Working?http://www.sharepointmonitor.com/2010/02/getting-started-with-the-sharepoint-2010-excel-services/ <br /><ul><li>PowerPivot Tutorial for Excel 2010http://technet.microsoft.com/en-us/library/ee835510.aspx</li></ul>Reporting Services Tutorialshttp://msdn.microsoft.com/en-us/library/bb522859.aspx<br />SQL Server Analysis Services Tutorialhttp://technet.microsoft.com/en-us/library/ms170208.aspx<br />
Create a Sales Dashboard in PPS<br />http://technet.microsoft.com/en-us/bi/ff643005.aspx<br />
SharePoint 2010 BI Resources<br />Choosing a Business Intelligence Tool<br />http://technet.microsoft.com/en-us/library/ff394320(office.14).aspx<br />Excel Services 2010 Overview<br />http://technet.microsoft.com/en-us/library/ee424405(office.14).aspx<br />Office Web Apps<br />http://technet.microsoft.com/en-us/library/ee855124(office.14).aspx<br />PowerPivot for SharePoint<br />http://technet.microsoft.com/en-us/library/ee210682(SQL.105).aspx<br />PerformancePoint Services Planning<br />http://technet.microsoft.com/en-us/library/ee681486(office.14).aspx<br />Reporting Services & SharePoint Integration<br />http://technet.microsoft.com/en-us/library/ee210649(SQL.105).aspx<br />Visio Services Planning<br />http://technet.microsoft.com/en-us/library/ee663482(office.14).aspx<br />