Your SlideShare is downloading. ×
Hadoop on Azure
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Hadoop on Azure

1,659
views

Published on


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,659
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. HUG France #1 - 15 Mars 2012 Hadoop sur Azure JavascriptBenjamin GUINEBERTIÈREbengui@microsoft.com@benjguin
  • 2. Hadoop sur Windows Azure● www.hadooponazure.com● Création automatisée d’un cluster Hadoop sur le public PaaS de Microsoft: Windows Azure● Hadoop sur Windows Azure et Windows Server (sans Cygwin)● Hadoop classique (jobs Java, PIG, HIVE, HDFS, …)● Parmi les contributions proposées par Microsoft: Javascript
  • 3. Javascript sur Hadoop On Azure● Dans la JVM (Rhino)● Jobs map/reduce en Javascript● Console interactive ● HDFS #ls ● RunJS runJs("bin/iisLogsAnalysis.js", "iislogs", "out-HD") ● HIVE hive.exec("SELECT * FROM hiveresult LIMIT 50") ● Syntaxe à la LINQ pour générer du PIG pig.from("out-H", "dummy, sessionID, username, startDateTime, endDateTime, nbHits:long").select("username, sessionID, nbHits").orderBy("nbHits DESC").take(5).to("demo-iislogs-out-H-top5") ● Graphiques simples graph.bar(data, { x: "user", y: "hits", orientation: "90" })
  • 4. Map Reduce, en Java, C#, Javascript 6
  • 5. Scénario démo : Analyse de Logs Serveur Web IIS SQL Server HIVE ODBC Driver Excel HIVE ODBC Driver Graph.bar(data) Hive Blob Map Reduce Logs IIS Storage distcp HDFS iislogsAnalysis.js 7
  • 6. DÉMO
  • 7. Pour en savoir plus● Après-midi du dév le 24 mai 2012 ● http://aka.ms/amdev-hadoop
  • 8. HUG France #1 - 15 Mars 2012 Hadoop sur Azure - Javascript Merci pour votre attentionBenjamin GUINEBERTIÈREbengui@microsoft.com@benjguin