SPS NY talk on analytics in SharePoint and the options OOTB, build-your-own, and buying add-ons

1. SEARCHING FOR SHAREPOINT ANALYTICS
HOW TO GET INSIGHT ON YOUR INTRANET
Jeff Fried
CTO, BA Insight
SharePoint Saturday NYC
July 2016

3. THANK YOU
EVENT SPONSORS
We appreciated you supporting the
New York SharePoint Community!
• Diamond, Platinum, Gold, & Silver have
tables scattered throughout
• Please visit them and inquire about their
products & services
• To be eligible for prizes make sure to get
your bingo card stamped by ALL sponsors
• Raffle at the end of the day and you must
be present to win!

4. Focused on Search and
SharePoint since 2004
Longtime
Search Nerd
• CTO, BA Insight
• Senior PM, Microsoft
• VP, FAST
• SVP, LingoMotors
About Jeff Fried
Passionate About
• Search
• SharePoint
• Search-driven
applications
• Information Strategy
Blog:
BAinsight.com/blog
Technet Column
“A View from the
Crawlspace”
jeff.fried@bainsight.com

5. About BA Insight


– Connectivity
– Applications -
– Classification -
– Analytics


6.  Analytics Out-of-the-Box
 Build your own Analytics
 What else is out there?
 What’s coming next?
Outline

7. The Value of Analytics
• Continually improve performance and satisfaction
– Improve infrastructural performance
– improve your search centre's performance
• Increase user engagement
• Validate that SharePoint is delivering results
• Use today's analytics to help drive tomorrows experiences

8. Layers of Analytics
Infrastructure
Application
Behaviour
Website SharePoint/Intranet
Web services
Page load
People happy?
Servers, Farm
Health checks
How are people
using SharePoint

9.  Analytics Out-of-the-Box
 Build your own Analytics
 What else is out there?
 What’s next?
Outline

10. SharePoint Evolution

11. SharePoint 2010 Analytics
 Web Analytics Reports
 Traffic reports
 Search reports
 Inventory reports
 These reports aggregated at the following levels:
 Per web application in the farm
 Per site collection
 Per site
 Per search service application
 OoTB these reports are visible to Administrators at each level
 ‘View Web Analytics Data’ Permission Level

12. SP 2010 – Report Summary

13. SP 2010 - Traffic Reports
How much traffic your site gets
(Number of Page Views);
Who visits your sites
(Top Visitors);
How visitors arrive at your site
(Top Referrers);
Daily Unique Visitors
Top Destinations
Top Browsers

14. SP 2010 - Search Reports
How many times users searched
(Number of Queries)
What were the most used search
terms (Top Queries)
What queries have high failure
rates (Failed Queries)
Best Bet Usage, Search keywords

15. SP 2010 - Inventory Reports
What is the total disk drive space
user (Storage Usage)
How many sites exist
(Number of Sites)
Top Site Product Versions
Top Site Languages

16. SP 2010 – Schedule & Export

17. SharePoint 2013 Analytics
Popularity Trends shows usage
event statistics for a site
collection, a site, or an individual
item in a library or list.

18. SharePoint 2013 Analytics
Most Popular Items shows
usage event statistics for all
items in a library or list.

19. SharePoint 2013 Analytics

20. SharePoint 2013 Audit Reports

21. SharePoint 2013 Audit Reports

22. SharePoint 2016 Analytics

23. SP 2016

24.  Better statistics on how SharePoint is being used, and how things may fail
 Real time telemetry (latency, 404’s, document usage stats)
 SLAPI (SharePoint Logging API)
 Enhanced usage database (improves *significantly* upon existing usage
database)
 Generates updated report data in real time
 Stats / Reports on usage, health, storage, performance, and much more
 There’s a lot of useful data in there
Advanced Data Analysis & Reporting

25.  SharePoint Online Reports: Very much like on premises
 New usage reports for SharePoint, OneDrive, Yammer and Skype now
available
 Providing a complete picture across all Office 365 services
 Activity Dashboard
 Email
 Office Activations
 SharePoint
 OneDrive
 Skype for Business
 Yammer
SharePoint Online Analytics

26. SharePoint Online Analytics

27. SharePoint Online Analytics

28.  Analytics Out-of-the-Box
 Build your own Analytics
 What else is out there?
 What’s coming next?
Outline

29. SharePoint Analytics – Lacking!
• Reports – not Real time
• Require Site Admin Access
• Lack of Breakdown e.g. by Hour
• No OoTB Dash boarding
• Custom means Custom

30. SharePoint Search Analytics
DB´s
Properties
Analytics
IndexTimer Jobs
Crawler Logs
Events
Configuration
PowerShell analysisenginepssnapin
Thank you to Nicki Borrell 
Analytics Timer Job for Search
Service Application Search Service
Application
Microsoft SharePoint Foundation
Usage Data Import
Microsoft SharePoint Foundation
Usage Data Processing
Usage Analytics Timer Job for
Search Application Search Service
Application

31. Analytics Beyond OoTB: SSRS

32. Analytics Beyond OoTB: SSRS

33. Analytics Beyond OoTB: Power BI

34. Custom Solutions with PowerPivot
Thank you to Nicki Borrell 

35. Custom Solutions with PowerPivot

36. PowerShell & Custom Code
Thank you to Nicki Borrell 
PowerShell:
• Get Usage Report:
– $searchApp.GetRollupAnalyticsItemData …
• Get Search Report:
– $searchApp.GetSearchReport …

37. PowerShell & Custom Code
Thank you to Radu Tut 
$searchApp = Get-SPEnterpriseSearchServiceApplication
$site = Get-SPSite "{SiteUrl}"
$result =
$searchApp.GetRollupAnalyticsItemData(1,[System.Guid]::Empty,$site.ID,[System.Guid]::Empty)
$result
#for a specific date or for a specific month
$date = Get-Date "2013-01-18"
$result.GetHitCountForDay($date)
$result.GetHitCountForMonth($date)

38. PowerShell & Custom Code
Thank you to Nicki Borrell 
PowerShell:
• Get Usage Report:
– $searchApp.GetRollupAnalyticsItemData …
• Get Search Report:
– $searchApp.GetSearchReport …
Custom Code:

39. PowerShell & Custom Code
SPSecurity.RunWithElevatedPrivileges(delegate
{
// You can use SPContext.Current.Site.ID if you have HttpContext
using (var site = new SPSite(siteId))
{
var context = SPServiceContext.GetContext(site);
var searchProxy = context.GetDefaultProxy(typeof(SearchServiceApplicationProxy)) as
SearchServiceApplicationProxy;
var usageData=
searchProxy.GetRollupAnalyticsItemData(1,Guid.Empty,site.ID,Guid.Empty);
// process it
}
}); Thank you to Radu Tut 

40.  Analytics Out-of-the-Box
 Build your own Analytics
 What else is out there?
 What’s coming next?
Outline

41. Demo
41

42.  Analytics Out-of-the-Box
 Build your own Analytics
 What else is out there?
 What’s coming next?
Outline

43. How does Delve Analytics differ?
Infrastructure
Application
Behaviour
User

44. Delve Analytics

45. Delve Analytics

46. Delve Analytics

47. Delve Analytics

48. Session Summary
 Analytics Out of the Box
 How analytics have changed through the versions of SharePoint 2010, 2013 and SharePoint
2016 - sometimes not for the better
 Build your own Analytics
 What options are available beyond out-of-the-box reports - building your own, and add-on
dashboards and reports
 Analytics – What else is out there?
 Analytics in the Real World
 The Value of Analytics
 Analytics – What’s next?

50. www.BAinsight.com
Jeff.Fried@BAinsight.com
@jefffried

51. CONFERENCE MATERIALS
• Slides / Demo will be posted on Lanyrd.com
• http://lanyrd.com/2016/spsnyc
• Photos posted to our Facebook page
• https://www.facebook.com/sharepointsaturdaynyc
• Tweet Us - @SPSNYC or #SPSNYC
• Sign Up for our NO SPAM mailing list for all conference
news & announcements
• http://goo.gl/7WzmPW
• Problems / Questions / Complaints / Suggestions
• Info@SPSNYMetro.com

52. • Visit ExtaCloud’s booth for wrist bands!
Scallywag's Irish Pub
508 9th Ave, between 38th & 39th.
[6 minutes walk]
Scallywags also serves food.
http://www.scallywagsnyc.com/

53. References
 Discontinued features and modified functionality in Microsoft SharePoint 2013
 Introducing Delve Analytics in Office 365
 Introducing Web Analytics in SharePoint 2010
 New Analytics in SharePoint 2013
 New usage reports for SharePoint, OneDrive, Yammer and Skype now
available

56. Searching for SharePoint Analytics
How to get insight on your Intranet
Jeff Fried
CTO, BA Insight
SharePoint Saturday NYC
July 2016

57. For More Information
• Check out our resources on: www.BAinsight.com
• Reach me via email at: Jeff.Fried@BAinsight.com
• Follow me on Twitter at: @jefffried