SlideShare a Scribd company logo
1 of 8
Download to read offline
MCS 7101: Cloud Technologies and Architectures
A. Simon Alex
MapReduce
A. Simon Alex MCS 7101 September 30, 2019 1 / 8
Overview
1 MapReduce
What is MapReduce?
MapReduce Programming Model
How MapReduce Works?
MapReduce Example
A. Simon Alex MCS 7101 September 30, 2019 2 / 8
MapReduce What is MapReduce?
What is MapReduce?
Programming model and implementation developed at Google for pro-
cessing and generating large datasets across a cluster of computers.
MapReduce is used in Nutch (open source web search) and Apache
Hadoop (developed to index rich textual and structural information).
A. Simon Alex MCS 7101 September 30, 2019 3 / 8
MapReduce MapReduce Programming Model
MapReduce Programming Model
This programming model is inspired∗ by the map and reduce primitives
of functional programming languages such as Lisp.
map: takes as input a procedure and a sequence of values and applies
the procedure to each value in the sequence.
reduce: takes as input a sequence of values and combines all values
using binary operator.
∗
but not equivalent!
A. Simon Alex MCS 7101 September 30, 2019 4 / 8
MapReduce How MapReduce Works?
How MapReduce Works?
MapReduce works by breaking the processing into two phases: the map
phase and the reduce phase.
Each phase has key-value pairs as input and output, the types of which
may be chosen by the programmer.The programmer also specifies two
functions: the map function and the reduce function.
A. Simon Alex MCS 7101 September 30, 2019 5 / 8
MapReduce MapReduce Example
MapReduce Example
Challenge
What’s the highest ever recorded Makerere’s CGPA for each year in
their dataset?
A. Simon Alex MCS 7101 September 30, 2019 6 / 8
MapReduce MapReduce Example
MapReduce Example
Figure: MapReduce logical data flow
A. Simon Alex MCS 7101 September 30, 2019 7 / 8
MapReduce Conclusion
Questions?
A. Simon Alex MCS 7101 September 30, 2019 8 / 8

More Related Content

What's hot

Computer Architecture
Computer ArchitectureComputer Architecture
Computer ArchitectureSonal Patil
 
Geodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and AzureGeodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and AzureAndré Zehnder
 
Cucinella open week social business
Cucinella open week social businessCucinella open week social business
Cucinella open week social businesssymbola
 
Crop identification using geo spatial technologies
Crop identification using geo spatial technologiesCrop identification using geo spatial technologies
Crop identification using geo spatial technologiesGodiSaiKiran
 
City of Houston Storm Water Section
City of Houston Storm Water SectionCity of Houston Storm Water Section
City of Houston Storm Water SectionEsri
 
Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsniket_narang
 
Data visualization using r pt 20140316
Data visualization using r pt 20140316Data visualization using r pt 20140316
Data visualization using r pt 20140316Myung-Hoe Huh
 
Colla, Gregory Resume 2015
Colla, Gregory Resume 2015Colla, Gregory Resume 2015
Colla, Gregory Resume 2015Gregory Colla
 
How Rough Is Your Runway?
How Rough Is Your Runway? How Rough Is Your Runway?
How Rough Is Your Runway? Safe Software
 
FME and the BGS in 2016/2017
FME and the BGS in 2016/2017FME and the BGS in 2016/2017
FME and the BGS in 2016/2017Sterling Geo
 
INTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISINTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISnandugagarin
 
Satellite Image Processing Projects Research Help
Satellite Image Processing Projects Research HelpSatellite Image Processing Projects Research Help
Satellite Image Processing Projects Research HelpMatlab Simulation
 
Supporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME ServerSupporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME ServerSafe Software
 
Street Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means ClusteringStreet Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means ClusteringM. Ilhan Akbas
 
Examples of My Recent Work
Examples of My Recent WorkExamples of My Recent Work
Examples of My Recent Workguestf2807f
 

What's hot (20)

Computer Architecture
Computer ArchitectureComputer Architecture
Computer Architecture
 
Presentation_JeepCar
Presentation_JeepCarPresentation_JeepCar
Presentation_JeepCar
 
Geodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and AzureGeodata Processing and Webservices with Python and Azure
Geodata Processing and Webservices with Python and Azure
 
Cucinella open week social business
Cucinella open week social businessCucinella open week social business
Cucinella open week social business
 
geo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourggeo.admin.ch at the EuroCloud Congress in Luxembourg
geo.admin.ch at the EuroCloud Congress in Luxembourg
 
Crop identification using geo spatial technologies
Crop identification using geo spatial technologiesCrop identification using geo spatial technologies
Crop identification using geo spatial technologies
 
City of Houston Storm Water Section
City of Houston Storm Water SectionCity of Houston Storm Water Section
City of Houston Storm Water Section
 
Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissions
 
Nov.2016Res_V2linkedin
Nov.2016Res_V2linkedinNov.2016Res_V2linkedin
Nov.2016Res_V2linkedin
 
Data visualization using r pt 20140316
Data visualization using r pt 20140316Data visualization using r pt 20140316
Data visualization using r pt 20140316
 
Colla, Gregory Resume 2015
Colla, Gregory Resume 2015Colla, Gregory Resume 2015
Colla, Gregory Resume 2015
 
How Rough Is Your Runway?
How Rough Is Your Runway? How Rough Is Your Runway?
How Rough Is Your Runway?
 
FME and the BGS in 2016/2017
FME and the BGS in 2016/2017FME and the BGS in 2016/2017
FME and the BGS in 2016/2017
 
capital bikeshare
capital bikesharecapital bikeshare
capital bikeshare
 
The Analogues R-Package - Ramirez-Villegas
The Analogues R-Package - Ramirez-VillegasThe Analogues R-Package - Ramirez-Villegas
The Analogues R-Package - Ramirez-Villegas
 
INTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GISINTEGRATION OF BIM AND GIS
INTEGRATION OF BIM AND GIS
 
Satellite Image Processing Projects Research Help
Satellite Image Processing Projects Research HelpSatellite Image Processing Projects Research Help
Satellite Image Processing Projects Research Help
 
Supporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME ServerSupporting Situational Awareness at LAX using FME Server
Supporting Situational Awareness at LAX using FME Server
 
Street Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means ClusteringStreet Network Generation with Adjustable Complexity Using k-Means Clustering
Street Network Generation with Adjustable Complexity Using k-Means Clustering
 
Examples of My Recent Work
Examples of My Recent WorkExamples of My Recent Work
Examples of My Recent Work
 

Similar to Map Reduce Presentation

IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...IRJET Journal
 
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduceA simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduceIRJET Journal
 
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]Richard Müller
 
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docxGIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docxshericehewat
 
Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019Mohammed Awad
 
Project on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environmentProject on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environmentSiddharth Chaudhary
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacmlmphuong06
 
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
OpenACC and Open Hackathons Monthly Highlights May  2023.pdfOpenACC and Open Hackathons Monthly Highlights May  2023.pdf
OpenACC and Open Hackathons Monthly Highlights May 2023.pdfOpenACC
 
Mapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large ClustersMapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large ClustersAbhishek Singh
 
estimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptxestimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptxubaidullah75790
 
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...TELKOMNIKA JOURNAL
 
Serving GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution AnalysisServing GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution Analysispdituri
 
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]Richard Müller
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSVLSICS Design
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSVLSICS Design
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSVLSICS Design
 

Similar to Map Reduce Presentation (20)

IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...IRJET-  	  A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing wit...
 
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduceA simulation-based approach for straggler tasks detection in Hadoop MapReduce
A simulation-based approach for straggler tasks detection in Hadoop MapReduce
 
Main map reduce
Main map reduceMain map reduce
Main map reduce
 
Ijciet 10 01_183
Ijciet 10 01_183Ijciet 10 01_183
Ijciet 10 01_183
 
Mapreduce Osdi04
Mapreduce Osdi04Mapreduce Osdi04
Mapreduce Osdi04
 
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
Graph-Based Performance Analysis at System- and Application-Level [SSP 2020]
 
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docxGIS 5103 – Fundamentals of GISLecture 83D GIS.docx
GIS 5103 – Fundamentals of GISLecture 83D GIS.docx
 
Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019Predicting Aviation Industry Performance (L/F) - 2019
Predicting Aviation Industry Performance (L/F) - 2019
 
Project on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environmentProject on nypd accident analysis using hadoop environment
Project on nypd accident analysis using hadoop environment
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
 
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
OpenACC and Open Hackathons Monthly Highlights May  2023.pdfOpenACC and Open Hackathons Monthly Highlights May  2023.pdf
OpenACC and Open Hackathons Monthly Highlights May 2023.pdf
 
Mapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large ClustersMapreduce - Simplified Data Processing on Large Clusters
Mapreduce - Simplified Data Processing on Large Clusters
 
estimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptxestimation-for-software-projects-chapter-26-ppt.pptx
estimation-for-software-projects-chapter-26-ppt.pptx
 
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
Application Profiling and Mapping on NoC-based MPSoC Emulation Platform on Re...
 
Serving GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution AnalysisServing GIS Data To Electrical Distribution Analysis
Serving GIS Data To Electrical Distribution Analysis
 
T180304125129
T180304125129T180304125129
T180304125129
 
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
Graph-Based Analysis and Visualization of Software Traces [SSP 2019]
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONSA METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
A METHODOLOGY FOR IMPROVEMENT OF ROBA MULTIPLIER FOR ELECTRONIC APPLICATIONS
 

Recently uploaded

Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Mark Simos
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentMahmoud Rabie
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Memoori
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Jeffrey Haguewood
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceOpsTree solutions
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 

Recently uploaded (20)

Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career Development
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
 
Deliver Latency Free Customer Experience
Deliver Latency Free Customer ExperienceDeliver Latency Free Customer Experience
Deliver Latency Free Customer Experience
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDF
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 

Map Reduce Presentation

  • 1. MCS 7101: Cloud Technologies and Architectures A. Simon Alex MapReduce A. Simon Alex MCS 7101 September 30, 2019 1 / 8
  • 2. Overview 1 MapReduce What is MapReduce? MapReduce Programming Model How MapReduce Works? MapReduce Example A. Simon Alex MCS 7101 September 30, 2019 2 / 8
  • 3. MapReduce What is MapReduce? What is MapReduce? Programming model and implementation developed at Google for pro- cessing and generating large datasets across a cluster of computers. MapReduce is used in Nutch (open source web search) and Apache Hadoop (developed to index rich textual and structural information). A. Simon Alex MCS 7101 September 30, 2019 3 / 8
  • 4. MapReduce MapReduce Programming Model MapReduce Programming Model This programming model is inspired∗ by the map and reduce primitives of functional programming languages such as Lisp. map: takes as input a procedure and a sequence of values and applies the procedure to each value in the sequence. reduce: takes as input a sequence of values and combines all values using binary operator. ∗ but not equivalent! A. Simon Alex MCS 7101 September 30, 2019 4 / 8
  • 5. MapReduce How MapReduce Works? How MapReduce Works? MapReduce works by breaking the processing into two phases: the map phase and the reduce phase. Each phase has key-value pairs as input and output, the types of which may be chosen by the programmer.The programmer also specifies two functions: the map function and the reduce function. A. Simon Alex MCS 7101 September 30, 2019 5 / 8
  • 6. MapReduce MapReduce Example MapReduce Example Challenge What’s the highest ever recorded Makerere’s CGPA for each year in their dataset? A. Simon Alex MCS 7101 September 30, 2019 6 / 8
  • 7. MapReduce MapReduce Example MapReduce Example Figure: MapReduce logical data flow A. Simon Alex MCS 7101 September 30, 2019 7 / 8
  • 8. MapReduce Conclusion Questions? A. Simon Alex MCS 7101 September 30, 2019 8 / 8