This document discusses deploying Hadoop in the cloud using Microsoft's Azure HDInsight solution. It provides an overview of why organizations deploy Hadoop to the cloud, citing advantages like speed, scale, lower costs and easier maintenance. It then introduces Azure HDInsight, Microsoft's Hadoop distribution for the cloud, which supports various Hadoop projects like Hive, HBase, Mahout and Storm. It also discusses how Azure HDInsight allows organizations to run Hadoop across more global data centers than other vendors and ensures high availability, security and performance. Finally, it provides information on how readers can get started with Azure HDInsight.

1. Microsoft
さとうなおき (@satonaoki)

2. Why Deploy To the Cloud?
Microsoft’s Solution
How Do I Get Started?

3. Breaking points of traditional approach

4. Breaking points of traditional approach

5. Breaking points of traditional approach

6. Breaking points of traditional approach

7. What if you could handle big data?

8. Introducing Apache Hadoop

9. Data volume

10. Data variety

11. Data velocity

12. Hadoop is a platform with portfolio of projects

13. A Hadoop distribution is a package of projects

14. With many contributors

15. Business applications of Hadoop

16. New analytic applications from new data

17. What Is Hadoop?
Microsoft’s Solution
How Do I Get Started?

18. Challenges with implementing Hadoop

19. Why Cloud + Big Data?
Speed Scale Economics
Always Up,
Always On
Open and flexibleTime to value
Data of all Volume,
Variety, Velocity
Massive Compute
and Storage
Deployment
expertise

20. Why Hadoop in the Cloud?

21. Scenarios For Deploying Hadoop As Hybrid

22. What Is Hadoop?
Why Deploy To the Cloud?
Microsoft’s Solution

23. Introducing Azure HDInsight

24. Microsoft contributions to Hadoop

25. Microsoft + Hortonworks

26. HDInsight Built for Windows or Linux

27. HDInsight Supports Hive

28. HDInsight Supports HBase
Data Node Data Node Data Node Data Node
Task Tracker Task Tracker Task Tracker Task Tracker
Name Node
Job Tracker
HMaster
Coordination
Region Server Region Server Region Server Region Server

29. HDInsight Supports Mahout

30. HDInsight Supports Storm
Stream
processin
g
Search and query
Data analytics (Excel)
Web/thick client
dashboards
Devices to take action
RabbitMQ /
ActiveMQ

31. Spark for Azure HDInsight
In Memory Processing on Multiple Workloads
Azure
HDInsight
In Memory
Spark
• Single execution model for multiple
tasks
• Processing up to 100x faster
performance
• Developer friendly (Java, Python, Scala)
• BI tool of choice (Power BI, Tabelau,
Qlik, SAP)
• Notebook experience (Jupyter/iPython,
Zeppelin)

32. R Server for HDInsight
• Familiarity of R (most popular language for data
scientists)
• Scalability of Hadoop and Spark
• Up to 7x faster using Spark engine
• Train and run ML models on datasets of any size
• Cloud managed solution (easy setup, elastic,
SLA)

33. HDInsight Allows You To Add Hadoop Projects

34. Microsoft Makes Hadoop Easier
Deep Visual Studio Integration
• Debug Hive jobs through Yarn logs or troubleshoot Storm topologies
• Visualize Hadoop clusters, tables, and storage
• Submit Hive queries, Storm topologies (C# or Java spouts/bolts)
• IntelliSense

35. Introducing Azure HDInsight

36. Big Opportunities in the Cloud
Source:
1: http://www.idc.com/getdoc.jsp?containerId=prUS25329114
2: Gartner Market Guide For Hadoop. December, 2015
3X
Spending on cloud-
based Big Data and
analytics solutions will
grow 3 times faster than
on-premises solutions1
52%
52% of surveyed
organizations plan to
use or continue to
deploy Hadoop in the
cloud (IaaS and PaaS)2
128% 18
Microsoft is the only
company with cloud
revenue at large scale
that grew triple digits in
its fifth consecutive
quarter
Microsoft Azure
running Hadoop in
more datacenters
around the world than
anyone else

37. Operational
Central US
Iowa
West US
California
East US
Virginia
North Central US
Illinois
US Gov
Iowa
South Central US
Texas
Brazil South
Sao Paulo State
West Europe
Netherlands Sovereign
Cloud: China
North *
Beijing
Sovereign
Cloud: China
South *
Shanghai
Japan East
Tokyo, Saitama
Japan West
Osaka
India South
Chennai
East Asia
Hong Kong
SE Asia
Singapore
Australia South East
Victoria
Australia East
New South Wales
India Central
Pune
India West
Mumbai
North Europe
Ireland
East US 2
Virginia
Hadoop is being run everywhere
More Datacenters than any other vendor

38. Why Microsoft Azure?
Azure Storage

39. No hardware challenges

40. Deployed in minutes

41. Mission Critical, Enterprise Ready

42. Maintenance done for you

43. Low Cost
$£€¥
*IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”

44. Introducing Azure HDInsight

45. Bringing Hadoop to a billion people

46. Making advanced analytics accessible to Hadoop
Cloud

49. What Is Hadoop?
Why Deploy To the Cloud?
Microsoft’s Solution

50. Get Started
http://azure.microsoft.com/en-us/documentation/services/hdinsight/
http://azure.microsoft.com/en-us/documentation/articles/hdinsight-learn-map/
http://www.microsoftvirtualacademy.com/training-courses/getting-started-with-microsoft-big-data
http://channel9.msdn.com/Shows/Data-Exposed
http://azure.microsoft.com/en-us/pricing/free-trial/

51. © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.