Learn more at: https://www.experfy.com/training/courses/gain-competitive-advantage-using-microsoft-azure-data-platform-and-cortana-analytics#sthash.VXCvEaud.dpuf Get up to speed on latest Azure technologies through a series of easy to digest lectures and demos to optimize your impact through the use of data. Find out how to use Microsoft Azure to increase profiits, reduce costs and streamline processes while maximizing your data assets. The instructor has over 25 years of BI and datawarehousing experience working for companies like Bank of America and Kronos. See more at: https://www.experfy.com/training/courses/gain-competitive-advantage-using-microsoft-azure-data-platform-and-cortana-analytics#sthash.VXCvEaud.dpuf

1. EXPERFY
Microsoft Azure Data Platform TRACK
Gain Competitive Advantage using
Microsoft Azure Data Platform and
Cortana Analytics
By Jon Bloom

2. 01
Data Professional, Bloom Consulting
Jonathan Bloom
Jon has been in the Data Science space since 1995.
Based in Safety Harbor, Florida, he specializes in
the Financial Services, Education, Hi-Tech, and
Insurance industries. Microsoft Certified Solutions
Expert (MCSE).
https://www.experfy.com/blog/author/jonathan-
bloom
• 1983 IBM PC / TRS-80
• 1986 High School
• 1988 Fortan
• 1994 Paradox/QuatroPro
• 1996 c++, VB, Oracle, Crystal
Reports
• 1999 ASP, Actuate
• 2004 .net
• 2006 Java, Web Services
• 2011 Microsoft BI
• 2011 Microsoft Azure
• 2012 Hadoop
• 2014 Azure ML Machine Learning
• 2015 PowerBI

3. 01
Data Professional, Bloom Consulting
Jonathan Bloom
Jon has been in the Data Science space since 1995.
Based in Safety Harbor, Florida, he specializes in
the Financial Services, Education, Hi-Tech, and
Insurance industries. Microsoft Certified Solutions
Expert (MCSE).
https://www.experfy.com/blog/author/jonathan-
bloom
• 1991 Retail
• 1994 Banking
• 1998 Medical Reporting Software
• 1999 Utilities Energy Company
• 2000 Credit Card Processing
• 2001 Telecommunications
• 2003 Insurance
• 2005 Consulting
• 2007 County Government
• 2011 County School Board
• 2012 Software Company
• 2013 Consulting

4. 01
Data Professional, Bloom Consulting
Jonathan Bloom
Jon has been in the Data Science space since 1995.
Based in Safety Harbor, Florida, he specializes in
the Financial Services, Education, Hi-Tech, and
Insurance industries. Microsoft Certified Solutions
Expert (MCSE).
https://www.experfy.com/blog/author/jonathan-
bloom
• 2012 Microsoft Certified Professional
(MCP)
• 2012 Microsoft Certified Solutions
Associate (MCSA)
• 2014 Microsoft Certified Solutions Expert
(MCSE Business Intelligence)
• 2012 SQL BI User Group Speaker
• 2012-2015 SQL Saturday Speaker
– Enterprise Data Warehousing
– PowerBI / Power Pivot / Power Query
– Reporting for DBAs
– Big Data / Hadoop
• 2013 – 2015 IT Pro Camp Speaker
– SSIS
– Business Intelligence
– Big Data / Hadoop
• 2013 Architectural Concepts Podcast

5. Table of Contents
① Rise of Data Culture
② Cortana Analytics Suite
③ Azure SQL Databases
④ Azure HDInsight Hadoop
⑤ Azure Machine Learning
⑥ Azure Data Lake Analytics
⑦ Azure Stream Analytics
⑧ Azure Data Factory
⑨ Azure Data Catalog
⑩ Azure Event Hubs
⑪ Power BI
⑫ Artificial Intelligence

6. • Data is the new Oil
o We've been collecting Data for half a century
o Data is now an “asset” to each organization
o “Monetize” data
Rise of Data Culture
Rise of Data Culture 6

7. • Provide Insights
o Data-Driven Decisions
» Manage the business
» Increase profits
» Decrease costs
» Streamline processes
Rise of Data Culture
Rise of Data Culture 7

8. • Data Explosion
o Exponential growth
o Both Structured and Unstructured
Rise of Data Culture
Rise of Data Culture 8

9. • New Data Sources
o Variety of data sources
» Open Data Sources for specific industries
» Social Media data
» "Home Grown" data
Rise of Data Culture
Rise of Data Culture 9

10. • Size of Data
o Traditional databases could not handle huge data
o New open source tools like Hadoop solve this problem
Rise of Data Culture
Rise of Data Culture 10

11. • Technology Advances
o Lower costs:
» Hardware
» Software
» Memory
» Processing power
o Software in the hands of Developers
Rise of Data Culture
Rise of Data Culture 11

12. • Data Integration
o Mashing desperate data sets
o Derive new insights from existing data sets
o Complete picture of data ecosystem
Rise of Data Culture
Rise of Data Culture 12

13. • Agile Methodology
o Shorter time to insight
o Iterative cycles
o Release final product every sprint
o Better project scoping
o Better project control
Rise of Data Culture
Rise of Data Culture 13

14. • Data Scientist
o Sexiest position
» Statistics
» Math
» Programming
» Domain Knowledge
» Curiosity
» Visualizations
» Storytelling
Rise of Data Culture
Rise of Data Culture 14

15. • Chief Data Officer
o Reports to Senior Executives/CIO
o Responsible for all Data
o Data Driven Organization
o Document Ecosystem
» Servers
» Applications
» Databases
» Diagrams
Rise of Data Culture
Rise of Data Culture 15
o Data Governance
o Allocate resources
» Hire Consultants
» Matrix Internal Employees
o Consolidate Technologies

16. • What is Cortana Analytics Suite?
o “Cortana Analytics is a fully managed big data and advanced analytics
suite that enables you to transform your data into intelligent action.”
Cortana Analytics Suite
Cortana Analytics Suite 16

17. • Cortana Analytics
o Azure Portal
o Gather Data
o Predict
o Automate
Cortana Analytics Suite
Cortana Analytics Suite 17

18. • IaaS - Infrastructure as a Service
o “a form of cloud computing that provides virtualized computing
resources over the Internet”
SQL Server in Azure VM
Azure SQL Databases 18

19. • PaaS - Platform as a Service
o “A cloud computing model that delivers applications over the Internet”
o SQL Server Database runs in Azure Public Cloud
Azure SQL Server Database
Azure SQL Databases 19

20. • PaaS - Platform as a Service
o “a cloud computing model that delivers applications over the Internet”
o SQL Server Data Warehouse runs in Azure Public Cloud
Azure SQL Data Warehouse
Azure SQL Databases 20

21. • Apache Hadoop
o Hadoop is a free, Java-based programming framework that supports the
processing of large data sets in a distributed computing environment. It
is part of the Apache project sponsored by the Apache Software
Foundation.
Azure HDInsight Hadoop
Azure HDInsight Hadoop 21

22. • Apache Hadoop
o Yahoo
• Doug Cutting
• A better search engine
• HDFS built to support Apache Nutch web search engine project
• Crawl hundreds of millions of web pages
• HDFS is now an Apache Hadoop sub-project
Azure HDInsight Hadoop
Azure HDInsight Hadoop 22

23. • Apache MapReduce
o A Programming model for large scale data processing
• Written in Java
• Send computation to the data
• Parallel distributed algorithm within cluster
Azure HDInsight Hadoop
Azure HDInsight Hadoop 23

24. • Apache Hadoop NextGen MapReduce (YARN)
o Splits Job Tracker into 2 pieces
» Resource Manager
• Scheduler
• Application Manager
» Node Manager
• Agent running on each Node machine
Azure HDInsight Hadoop
Azure HDInsight Hadoop 24

25. • Apache HIVE
o A Data Warehousing infrastructure built into Hadoop
o HiveQL – simple SQL like language
» Ad Hoc Query Analysis
» Aggregations
o No “row-level” updates or “real time” queries
o Mount data: specify delimiters, file location, table name
Azure HDInsight Hadoop
Azure HDInsight Hadoop 25

26. • Apache PIG
o Platform to analyze large data sets
o High Level language
o Parallelization
o Compiler creates series of Map/Reduce jobs
Azure HDInsight Hadoop
Azure HDInsight Hadoop 26

27. • Apache SQOOP
o Apache Sqoop is a tool designed for efficiently transferring bulk data
between Apache Hadoop and structured data stores such as relational
databases.
o From EDW to Hadoop
o From Hadoop to Relational Databases
Azure HDInsight Hadoop
Azure HDInsight Hadoop 27

28. • Spark
o Fast and general engine for large scale data processing
o Open Source Cluster computing Framework
o Originally developed AMPLap, University of California Berkley
o Now part of Apache Software Foundation
o Not based on MapReduce paradigm (uses In Memory)
» Up to 100x faster than MapReduce
Azure HDInsight Hadoop
Azure HDInsight Hadoop 28

29. • What is Azure Machine Learning?
o “Machine learning uses computers to run predictive models that learn
from existing data in order to forecast future behaviors, outcomes, and
trends.”
Azure Machine Learning
Azure Machine Learning 29

30. • What is Azure Data Lake Analytics?
o “Azure Data Lake includes all the capabilities required to make it easy for
developers, data scientists, and analysts to store data of any size, shape
and speed, and do all types of processing and analytics across platforms
and languages.”
Azure Data Lake Analytics
Azure Data Lake Analytics 30

31. • What is Azure Stream Analytics?
o Azure Stream Analytics allows you to leverage cloud technologies to find
insights in real time from devices and sensors, typically know as the
“Internet of Things”.
Azure Stream Analytics
Azure Stream Analytics 31

32. • What is Azure Data Factory?
o “Data Factory is a cloud-based data integration service that orchestrates
and automates the movement and transformation of data.”
o Best of breed analytical pipelines
Azure Data Factory
Azure Data Factory 32

33. • What is Azure Data Catalog?
o Azure Data Catalog is an enterprise-wide metadata catalog which stores,
describes and indexes information on data sources.
Azure Data Catalog
Azure Data Catalog 33

34. • What is Azure Event Hubs?
o “Event Hubs is a highly scalable publish-subscribe event ingestor. It can
collect millions of events per second, so that you can process and
analyze the massive amounts of data produced by your connected
devices and applications. Once collected into Event Hubs, you can
transform and store the data by using any real-time analytics provider or
with batching/storage adapters.”
Azure Event Hubs
Azure Event Hubs 34

35. • Suite of Products
o Individual Add-Ins for Excel
» Power Pivot
» Power Query Formula Language (“M”)
» Power View
» Power Map
» Natural Query Language
Power BI
Power BI 35

36. • Definition
o “The ability of a computer or other machine to perform actions thought
to require intelligence. Among these actions are logical deduction and
inference, creativity, the ability to make decisions based on past
experience or insufficient or conflicting information, and the ability to
understand spoken language. ”
» http://dictionary.reference.com/browse/artificial-intelligence
Artificial Intelligence
Artificial Intelligence 36

37. • Azure Data Platform and Cortana Analytics
o To get more insight and depth into each of the topics listed, please sign
up and purchase this course at:
o https://www.experfy.com/training/courses/gain-competitive-
advantage-using-microsoft-azure-data-platform-and-cortana-analytics
o Thanks for watching~!
Experfy Course
Artificial Intelligence 37