Downloaded 189 times
Uploaded byJeff Hammerbacher
1,134 views
Mapreduce Pact06 Keynote
The document discusses MapReduce, a programming model developed at Google for processing and generating large datasets in parallel across clusters of machines. It describes Google's computing environment involving thousands of machines, challenges of programming for such distributed systems, and how MapReduce addresses these challenges by providing an abstraction that handles parallelization, fault tolerance, and distribution details. MapReduce involves a map step that processes input key-value pairs, and a reduce step that combines all intermediate values associated with the same key. Examples demonstrate how MapReduce can be used for tasks like word count, language modeling, and joining distributed data.
