2012-06-25 - MapReduce auf Azure

2,575 views
2,426 views

Published on

Der Map-Reduce Algorithmus begegnet uns bei vielen NoSQL Datenbanken. Wann immer große Datenmengen aggregiert werden, ist er das Mittel der Wahl. In einem Crashkurs wird die Theorie erläutert und gezeigt, wie in Dokumenten bei MongoDB, RavenDB und Hadoop gesucht wird. Mithilfe des MapReduce Modells von Hadoop werden Probleme wie das Durchzählen von Daten, Logfile-Analysen und Graphenanalysen demonstriert. Als Programmiersprache wird C# eingesetzt.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,575
On SlideShare
0
From Embeds
0
Number of Embeds
1,899
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

2012-06-25 - MapReduce auf Azure

  1. 1. 0067011990999991950051507004...9999999N9+00001+99999999999...0043011990999991950051512004...9999999N9+00221+99999999999...0043011990999991950051518004...9999999N9-00111+99999999999...0043012650999991949032412004...0500001N9+01111+99999999999...0043012650999991949032418004...0500001N9+00781+99999999999...(1950, 0)(1950, 22)(1950, -11)(1949, 111)(1949, 78)(key, value)
  2. 2. (1950, 0)(1950, 22)(1950, -11)(1949, 111)(1949, 78)(1949, [111, 78]) .(1950, [0, 22, -11])
  3. 3. (1949, 111)(1950, 22)(1949, [111, 78]) .(1950, [0, 22, -11])
  4. 4. (1949, 111)(1949, 78)(1950, 0)(1950, 20)(1950, 10)(1950, 25)(1950, 15)(1950, 0)(1949, 111)(1950, 20)(1950, 25)(1949, [111]) .(1950, [20, 25])
  5. 5. js> runJar(apps/hadoop-streaming.jar,-files "asv://server/Mapper.exe,asv://server/Reducer.exe"-mapper "Mapper.exe"-reducer "Reducer.exe"-input "inputFile"-output "outputFile")
  6. 6. 141.8.147.14 - - [22/Jun/2013:00:00:35 +0200] ↓"GET /catalog/images/footbag_freaks08freestyle2_medium.jpg ↓HTTP/1.1" 200 4379 "-" ↓"Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)"IP Address, Date, Request, Code, Size, Country, Referer, UserAgent141.8.147.14, […] , Mozilla/5.0{"IP Address" : "141.8.147.14","Date" : "[22/Jun/2013:00:00:35 +0200]","Request" : "GET /catalog/images/footbag_freaks08freestyle2_medium.jpg HTT"Code" : 200,"Size" : 4379,"Country" : "Germany","Referer" : "-",
  7. 7. http://highlyscalable.wordpress.com/2012/02/01/mapreduce-patterns/

×