SlideShare a Scribd company logo
MCS 7101: Cloud Technologies and Architectures
A. Simon Alex
MapReduce
A. Simon Alex MCS 7101 September 30, 2019 1 / 8
Overview
1 MapReduce
What is MapReduce?
MapReduce Programming Model
How MapReduce Works?
MapReduce Example
A. Simon Alex MCS 7101 September 30, 2019 2 / 8
MapReduce What is MapReduce?
What is MapReduce?
Programming model and implementation developed at Google for pro-
cessing and generating large datasets across a cluster of computers.
MapReduce is used in Nutch (open source web search) and Apache
Hadoop (developed to index rich textual and structural information).
A. Simon Alex MCS 7101 September 30, 2019 3 / 8
MapReduce MapReduce Programming Model
MapReduce Programming Model
This programming model is inspired∗ by the map and reduce primitives
of functional programming languages such as Lisp.
map: takes as input a procedure and a sequence of values and applies
the procedure to each value in the sequence.
reduce: takes as input a sequence of values and combines all values
using binary operator.
∗
but not equivalent!
A. Simon Alex MCS 7101 September 30, 2019 4 / 8
MapReduce How MapReduce Works?
How MapReduce Works?
MapReduce works by breaking the processing into two phases: the map
phase and the reduce phase.
Each phase has key-value pairs as input and output, the types of which
may be chosen by the programmer.The programmer also specifies two
functions: the map function and the reduce function.
A. Simon Alex MCS 7101 September 30, 2019 5 / 8
MapReduce MapReduce Example
MapReduce Example
Challenge
What’s the highest ever recorded Makerere’s CGPA for each year in
their dataset?
A. Simon Alex MCS 7101 September 30, 2019 6 / 8
MapReduce MapReduce Example
MapReduce Example
Figure: MapReduce logical data flow
A. Simon Alex MCS 7101 September 30, 2019 7 / 8
MapReduce Conclusion
Questions?
A. Simon Alex MCS 7101 September 30, 2019 8 / 8

More Related Content

What's hot

Computer Architecture
Computer ArchitectureComputer Architecture
Computer Architecture
Sonal Patil
 
Presentation_JeepCar
Presentation_JeepCarPresentation_JeepCar
Presentation_JeepCar
Georgia Chatzi
 
Geodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and AzureGeodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and Azure
André Zehnder
 
Cucinella open week social business
Cucinella open week social businessCucinella open week social business
Cucinella open week social business
symbola
 
geo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourggeo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourg
geoportal of the federal authorities of the Swiss Confederation
 
Crop identification using geo spatial technologies
Crop identification using geo spatial technologiesCrop identification using geo spatial technologies
Crop identification using geo spatial technologies
GodiSaiKiran
 
City of Houston Storm Water Section
City of Houston Storm Water SectionCity of Houston Storm Water Section
City of Houston Storm Water Section
Esri
 
Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissions
niket_narang
 
Nov.2016Res_V2linkedin
Nov.2016Res_V2linkedinNov.2016Res_V2linkedin
Nov.2016Res_V2linkedin
Christopher Mimilis
 
Data visualization using r pt 20140316
Data visualization using r pt 20140316Data visualization using r pt 20140316
Data visualization using r pt 20140316
Myung-Hoe Huh
 
Colla, Gregory Resume 2015
Colla, Gregory Resume 2015Colla, Gregory Resume 2015
Colla, Gregory Resume 2015
Gregory Colla
 
How Rough Is Your Runway?
How Rough Is Your Runway? How Rough Is Your Runway?
How Rough Is Your Runway?
Safe Software
 
FME and the BGS in 2016/2017
FME and the BGS in 2016/2017FME and the BGS in 2016/2017
FME and the BGS in 2016/2017
Sterling Geo
 
capital bikeshare
capital bikesharecapital bikeshare
capital bikeshare
Su Jung(Sue) Lee
 
The Analogues R-Package - Ramirez-Villegas
The Analogues R-Package - Ramirez-VillegasThe Analogues R-Package - Ramirez-Villegas
INTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISINTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GIS
nandugagarin
 
Satellite Image Processing Projects Research Help
Satellite Image Processing Projects Research HelpSatellite Image Processing Projects Research Help
Satellite Image Processing Projects Research Help
Matlab Simulation
 
Supporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME ServerSupporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME Server
Safe Software
 
Street Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means ClusteringStreet Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means Clustering
M. Ilhan Akbas
 
Examples of My Recent Work
Examples of My Recent WorkExamples of My Recent Work
Examples of My Recent Work
guestf2807f
 

What's hot (20)

Computer Architecture
Computer ArchitectureComputer Architecture
Computer Architecture
 
Presentation_JeepCar
Presentation_JeepCarPresentation_JeepCar
Presentation_JeepCar
 
Geodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and AzureGeodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and Azure
 
Cucinella open week social business
Cucinella open week social businessCucinella open week social business
Cucinella open week social business
 
geo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourggeo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourg
 
Crop identification using geo spatial technologies
Crop identification using geo spatial technologiesCrop identification using geo spatial technologies
Crop identification using geo spatial technologies
 
City of Houston Storm Water Section
City of Houston Storm Water SectionCity of Houston Storm Water Section
City of Houston Storm Water Section
 
Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissions
 
Nov.2016Res_V2linkedin
Nov.2016Res_V2linkedinNov.2016Res_V2linkedin
Nov.2016Res_V2linkedin
 
Data visualization using r pt 20140316
Data visualization using r pt 20140316Data visualization using r pt 20140316
Data visualization using r pt 20140316
 
Colla, Gregory Resume 2015
Colla, Gregory Resume 2015Colla, Gregory Resume 2015
Colla, Gregory Resume 2015
 
How Rough Is Your Runway?
How Rough Is Your Runway? How Rough Is Your Runway?
How Rough Is Your Runway?
 
FME and the BGS in 2016/2017
FME and the BGS in 2016/2017FME and the BGS in 2016/2017
FME and the BGS in 2016/2017
 
capital bikeshare
capital bikesharecapital bikeshare
capital bikeshare
 
The Analogues R-Package - Ramirez-Villegas
The Analogues R-Package - Ramirez-VillegasThe Analogues R-Package - Ramirez-Villegas
The Analogues R-Package - Ramirez-Villegas
 
INTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISINTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GIS
 
Satellite Image Processing Projects Research Help
Satellite Image Processing Projects Research HelpSatellite Image Processing Projects Research Help
Satellite Image Processing Projects Research Help
 
Supporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME ServerSupporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME Server
 
Street Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means ClusteringStreet Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means Clustering
 
Examples of My Recent Work
Examples of My Recent WorkExamples of My Recent Work
Examples of My Recent Work
 

Similar to Map Reduce Presentation

IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET Journal
 
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduceA simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
IRJET Journal
 
Main map reduce
Main map reduceMain map reduce
Main map reduce
Masoumeh Rezaei Jam
 
Ijciet 10 01_183
Ijciet 10 01_183Ijciet 10 01_183
Ijciet 10 01_183
IAEME Publication
 
Mapreduce Osdi04
Mapreduce Osdi04Mapreduce Osdi04
Mapreduce Osdi04
Jyotirmoy Dey
 
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Richard Müller
 
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docxGIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
shericehewat
 
Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019
Mohammed Awad
 
Project on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environmentProject on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environment
Siddharth Chaudhary
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
lmphuong06
 
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
OpenACC and Open Hackathons Monthly Highlights May  2023.pdfOpenACC and Open Hackathons Monthly Highlights May  2023.pdf
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
OpenACC
 
Mapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large ClustersMapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large Clusters
Abhishek Singh
 
estimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptxestimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptx
ubaidullah75790
 
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
TELKOMNIKA JOURNAL
 
Serving GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution AnalysisServing GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution Analysis
pdituri
 
T180304125129
T180304125129T180304125129
T180304125129
IOSR Journals
 
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Richard Müller
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
VLSICS Design
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
VLSICS Design
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
VLSICS Design
 

Similar to Map Reduce Presentation (20)

IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
 
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduceA simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
 
Main map reduce
Main map reduceMain map reduce
Main map reduce
 
Ijciet 10 01_183
Ijciet 10 01_183Ijciet 10 01_183
Ijciet 10 01_183
 
Mapreduce Osdi04
Mapreduce Osdi04Mapreduce Osdi04
Mapreduce Osdi04
 
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
 
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docxGIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
 
Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019
 
Project on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environmentProject on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environment
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
 
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
OpenACC and Open Hackathons Monthly Highlights May  2023.pdfOpenACC and Open Hackathons Monthly Highlights May  2023.pdf
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
 
Mapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large ClustersMapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large Clusters
 
estimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptxestimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptx
 
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
 
Serving GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution AnalysisServing GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution Analysis
 
T180304125129
T180304125129T180304125129
T180304125129
 
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 

Recently uploaded

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
Claudio Di Ciccio
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 

Recently uploaded (20)

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on BlockchainCAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 

Map Reduce Presentation

  • 1. MCS 7101: Cloud Technologies and Architectures A. Simon Alex MapReduce A. Simon Alex MCS 7101 September 30, 2019 1 / 8
  • 2. Overview 1 MapReduce What is MapReduce? MapReduce Programming Model How MapReduce Works? MapReduce Example A. Simon Alex MCS 7101 September 30, 2019 2 / 8
  • 3. MapReduce What is MapReduce? What is MapReduce? Programming model and implementation developed at Google for pro- cessing and generating large datasets across a cluster of computers. MapReduce is used in Nutch (open source web search) and Apache Hadoop (developed to index rich textual and structural information). A. Simon Alex MCS 7101 September 30, 2019 3 / 8
  • 4. MapReduce MapReduce Programming Model MapReduce Programming Model This programming model is inspired∗ by the map and reduce primitives of functional programming languages such as Lisp. map: takes as input a procedure and a sequence of values and applies the procedure to each value in the sequence. reduce: takes as input a sequence of values and combines all values using binary operator. ∗ but not equivalent! A. Simon Alex MCS 7101 September 30, 2019 4 / 8
  • 5. MapReduce How MapReduce Works? How MapReduce Works? MapReduce works by breaking the processing into two phases: the map phase and the reduce phase. Each phase has key-value pairs as input and output, the types of which may be chosen by the programmer.The programmer also specifies two functions: the map function and the reduce function. A. Simon Alex MCS 7101 September 30, 2019 5 / 8
  • 6. MapReduce MapReduce Example MapReduce Example Challenge What’s the highest ever recorded Makerere’s CGPA for each year in their dataset? A. Simon Alex MCS 7101 September 30, 2019 6 / 8
  • 7. MapReduce MapReduce Example MapReduce Example Figure: MapReduce logical data flow A. Simon Alex MCS 7101 September 30, 2019 7 / 8
  • 8. MapReduce Conclusion Questions? A. Simon Alex MCS 7101 September 30, 2019 8 / 8