This document summarizes Brian Culver's presentation on unlocking big data with analytics and business intelligence on Office365. The presentation agenda includes an introduction to big data, understanding sentiment analysis, connecting big data and BI, creating an Azure HDInsight cluster, loading and validating data, Hadoop and C#, and visualizing results with PowerView. Culver then shares closing comments on understanding customers through big data and ensuring projects have a clear ROI.

1. Unlock your Big Data with Analytics
and BI on Office365
Brian Culver ● SPS Utah ● SPT 104 ● March 1-3, 2016

2. About Brian Culver, MCM
 SharePoint Solutions Architect for Expert Point Solutions in
Houston, Texas.
 Microsoft Certified Master (MCM) in SharePoint
 Microsoft Certified Professional Developer (MCPD).
 Brian has worked in the Information Technology industry for
since 1998 and he has been working with SharePoint since
2005. His deep expertise includes Azure, Office365,
SharePoint, ASP.Net, SQL Server and Project Server. He has
been involved in many large SharePoint implementations
including Internet and Intranet sites, Partner Portals,
Enterprise Content Management and Governance, and much
custom application integration and development.
 Author, Speaker and Blogger
Email : brian.culver(at)expertpointsolutions.com
Twitter : @spbrianculver
LinkedIn : https://www.linkedin.com/in/bculver
Blog : http://blog.expertpointsolutions.com

3. Session Agenda
What is Big Data?
Understanding Sentiment Analysis
Connecting Big Data and Business Intelligence
 Create an Azure HDInsight Cluster
 Load data into Blob Storage
 Validate data via HDInsight
 Hadoop and C#
 Visualizing Results via PowerView
Closing comments

4. What is Big Data?
 Big Data is about personalization and knowledge.
Understanding our customers and relationships to the
world.
• 27% of customers have seen Personalization online
• 86% of those say Personalization influenced what they purchased to
some extent
• 31% want a more Personalized experience
• 59% of customers who have experienced Personalization believe it has
a noticeable influence on purchasing
• 58% prefer product recommendations from previous purchases over
other forms of personalization

5. What is Big Data?

6. What is Big Data?

7. What is Big Data?

8. What is Big Data?
Big Data is data that is “too” complex, large, and/or fast.
Big Data offers a new set of approaches for analyzing data sets that
were not previously accessible which posed challenges across one
or more of the “3 V’s”:
 Volume - too big and large - Terabytes (and more) of credit card
transactions, web usage data, system logs, etc.
 Variety - too Complex - Unstructured data such as social media,
customer reviews, call center records, etc.
 Velocity - too Fast - Sensor data, live web traffic, mobile phone usage,
GPS data, etc.

9. Data Complexity: Variety and Velocity
Terabytes
Gigabytes
Megabytes
Petabytes
What is Big Data?

10. What is Big Data?
Web app
optimization
Smart meter
monitoring
Advertising
analysis
Fraud
detection
Healthcare
outcomes
Weather
forecasting
Natural resource
exploration
Social network
analysis
Traffic flow
optimization
IT infrastructure
optimization
Legal
discovery
COMMON BIG DATA CUSTOMER SCENARIOS
GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST
AND FAST IN YOUR INDUSTRY
Internet of
Things (IoT)

11. What is Big Data?
How are customers using HDInsight?
Azure HDInsight + Machine Learning
How Pier 1 uses HDInsight to improve and customize
customer experience:
http://www.youtube.com/watch?v=fN8Cixcc5yg

12. What is Big Data?
Ambari - Cluster provisioning, management, and monitoring.
Avro (Microsoft .NET Library for Avro) - Data serialization for the
Microsoft .NET environment.
Hive - Structured Query Language (SQL)-like querying.
Mahout - Machine learning.
MapReduce and YARN - Distributed processing and resource
management.
Oozie - Workflow management.
Pig - Simpler scripting for MapReduce transformations.
Sqoop - Data import and export.
ZooKeeper - Coordination of processes in distributed systems.

13. REDUCEMAP
Map + Reduce = Extract, Load + Transform
Raw
Data
Raw
Data
Raw
Data
Raw
Data
Mapper Mapper Mapper Mapper
Data Data Data Data
Reducer
Output
What is Big Data?

14. Understanding Sentiment Analysis
 Sentiment Analysis is the process of understanding the
emotional content of text.

15. Understanding Sentiment Analysis
I had a fantastic time on holiday at your resort. The service was
excellent and awesome. My family really enjoyed themselves.
We look forward to next year. One thing though, the pool was
closed which sucked.
Hotel Feedback

16. Understanding Sentiment Analysis
Take a list of positive and negative words
Positive
Good
Great
Fantastic
Excellent
Friendly
Awesome
Enjoyed
Negative
Bad
Worse
Rubbish
Sucked
Awful
Terrible
Bogus

17. Understanding Sentiment Analysis
I had a fantastic time on holiday at your resort. The
service was excellent and awesome. My family really
enjoyed themselves. We look forward to next year.
One thing though, the pool was closed which
sucked.
Hotel Feedback

18. Understanding Sentiment Analysis
Positive
Fantastic
Excellent
Awesome
Enjoyed
Negative
Sucked
4 1

19. Understanding Sentiment Analysis
4 1- = 3
Overall sentiment  Positive

20. Understanding Sentiment Analysis
Sentiment Analysis gets a lot more complicated…

21. Big Data & Business Intelligence
In the following demo, we will cover the following:
1. [If you don’t have one] Create an Azure Account
2. Go to https://portal.azure.com/
3. Create Storage
4. Create HDInsight Cluster
5. Load data into Blob Storage
6. Validate data via HDInsight
7. Hadoop and C#
8. Visualizing Results via Excel PowerView

22. Connecting Big Data
and Business Intelligence
Demo

23. Closing Comments
 Big Data is about understanding what your customers are saying and
thinking.
 Anything can be understood and processed but it requires time to analyze
and understand.
 Any device that creates data can produce valuable information.
 Try different things and let the patterns emerge.
 But Where Is Big Data’s ROI?
 Collecting data - the kind of data that provides valuable insights into
customer preferences, cost savings and revenue generation.
 Roughly 40% of companies are unsure whether they’ll receive any
return—and that includes 38% of companies that have already made
some investment in big data, according to Gartner data (437 large
companies surveyed in June 2015).
 “Gartner has also warned that the majority of big data projects in the
short term are likely to fail.”

24. Thank you
Brian Culver, MCM
Twitter:
@spbrianculver
E-mail:
brian.culver(at)expertpointsolutions.com
Blog:
http://blog.expertpointsolutions.com/
Slides:
http://www.slideshare.net/bculver

25. Questions
??
?
?

26. Constructive Feedback Is Appreciated
Great information,
but would like to
have learned
more about [Insert
Topic]
Brian – Your
presentation
was …
Good
Demos!
Thanks!

27. Thank you!
Brian Culver, MCM
Twitter:
@spbrianculver
E-mail:
brian.culver(at)expertpointsolutions.com
Blog:
http://blog.expertpointsolutions.com/
Slides:
http://www.slideshare.net/bculver

28. Resources
Twitter Sentiment Processing
 http://tweetsentiment.azurewebsites.net/
 http://azure.microsoft.com/en-us/documentation/articles/hdinsight-hbase-analyze-twitter-
sentiment/
 https://azure.microsoft.com/en-us/documentation/articles/hdinsight-connect-excel-hive-
odbc-driver/
 https://support.office.com/en-us/article/Power-View-Explore-visualize-and-present-your-
data-98268d31-97e2-42aa-a52b-a68cf460472e
 https://support.office.com/en-ca/article/Power-View-in-Excel-on-Office-365-or-in-
SharePoint-Server-99127d68-d7b7-42d0-a4ee-20e2d9897472?ui=en-US&rs=en-
CA&ad=CA
 https://support.office.com/en-ca/article/Power-View-in-HTML5-c71dc902-2a2c-482e-b5a5-
e9c884650a26?ui=en-US&rs=en-CA&ad=CA
 https://apps.twitter.com/
 https://manage.windowsazure.com
 https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hbase-tutorial-get-
started/
 https://www.gartner.com/doc/3123817?ref=QuickSearch&sthkw=heudecker%20AND%20k
art&refval=155652106&qid=2aa81339616939553482e7aae26523f4
 http://www.datacenterjournal.com/big-datas-roi/