Download to read offline
Uploaded bySimon Elliston Ball
Getting your Big Data on with HDInsight
The document discusses getting started with big data using HDInsight, a cloud-based Hadoop service on Azure, and its various functionalities like data warehousing, machine learning, and batch analytics. It includes references to tools such as PowerShell, Sqoop for data import/export, and the Hive SQL-like interface for querying data. Additionally, it covers integration with .NET and machine learning libraries like Mahout, along with links to resources and tools for managing big data on Azure.
More Related Content
Similar to Getting your Big Data on with HDInsight
![[Azureビッグデータ関連サービスとHortonworks勉強会] Azure HDInsight](https://cdn.slidesharecdn.com/ss_thumbnails/20160719hortonworksmeetuphdinsight-160721074805-thumbnail.jpg?width=640&height=640&fit=bounds)
Getting your Big Data on with HDInsight
- 1. Simon Elliston Ball Headof Big Data @sireb Getting your Big Data on with HDInsight http://bit.ly/GettingHDInsight #gettingHDInsight
- 2. HDInsight: Hadoop onAzure.
- 3.
- 4.
- 5.
- 6.
- 7. Big Data What canI do with it? Data warehousing Machine Learning Batch Analytics ETL
- 8.
- 9.
- 10.
- 11.
- 12. Import Export toolfor RDBMS Sqoop up that SQL Command line based Generates Map Reduce jobs Doing it with PowerShell
- 13.
- 14. SELECT * FROMhivesampletable Hive: like SQL Support for window functions Rollups, aggregates
- 15. Limited support forsome SQL features Hive: like SQL, but… Works on arbitrary data Schema on Read
- 16.
- 17. Java based MapReduce Simple algorithm key:value a:1 a:1 b:1 c:1 a:1,1 b:1 c:1 Map Sort / Shuffle Reduce a:2 b:1 c:1 key: value key: value
- 18. Streaming Interface MapReduce .NET http://hadoopsdk.codeplex.com/ PM>Install-Package Microsoft.Hadoop.MapReduce
- 19.
- 20. Machine learning libraryfor Hadoop Mahout Just another Hadoop Job All packaged in a jar
- 22.
- 23. High performance Key-Valuestore HBase Different cluster type in the portal Can link to MapReduce and Hive
- 24.
- 25.