Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
• WHERE
• WHAT
• WHY
• HOW
asv[s]://<container>@<account>.blob.core.windows.net/<path>
<property>
<name>fs.azure.account.key.accountname</name>
<valu...
Container Blob Name
mycontainer a.txt
mycontainer b.txt
mycontainer dir1c.txt
mycontainer dir1dir2d.txt
Target Destination Tool / Library Requires Active HDInsight
Cluster
SQL Server,
Azure SQL DB
Sqoop (Hadoop ecosystem proje...
mvaWindows
Azure
http://microsoft.com/msdn
www.microsoft.com/learninghttp://channel9.msdn.com/Events/TechEd
http://microsoft.com/technet
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Data Management in Microsoft HDInsight: How to Move and Store Your Data
Upcoming SlideShare
Loading in …5
×

Data Management in Microsoft HDInsight: How to Move and Store Your Data

238 views

Published on

Big Data processing requires a lot of data movement and the ability to efficiently store and manage the data. In this presentation, we show what storage options HDInsight provides you, and how you can load data into HDInsight using different data movement approaches, including Sqoop and Oozie to coordinate the workflows.

Published in: Technology
  • Login to see the comments

  • Be the first to like this

Data Management in Microsoft HDInsight: How to Move and Store Your Data

  1. 1. • WHERE • WHAT • WHY • HOW
  2. 2. asv[s]://<container>@<account>.blob.core.windows.net/<path> <property> <name>fs.azure.account.key.accountname</name> <value>enterthekeyvaluehere</value> </property>
  3. 3. Container Blob Name mycontainer a.txt mycontainer b.txt mycontainer dir1c.txt mycontainer dir1dir2d.txt
  4. 4. Target Destination Tool / Library Requires Active HDInsight Cluster SQL Server, Azure SQL DB Sqoop (Hadoop ecosystem project) Yes Excel Codename “Data Explorer” No Another Blob Storage Account Azure Blob Storage REST APIs (Copy Blob, etc) No SQL Server Analysis Services Hive ODBC Driver Yes Existing BI Apps Hive ODBC Driver (assumes app supports ODBC connections to data sources) Yes
  5. 5. mvaWindows Azure
  6. 6. http://microsoft.com/msdn www.microsoft.com/learninghttp://channel9.msdn.com/Events/TechEd http://microsoft.com/technet

×