SlideShare a Scribd company logo
International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017
ISSN: 2395-1303 http://www.ijetjournal.org Page 141
Energy Efficient algorithm of Map Reduce for Big Data
Applications
D.Revathi
Dept. of computer science & Engineering
AVN institute of technology,
Hyderabad.
Vijendar amgothu
Dept. of computer science & Engineering
University College of Engineering
Osmania University,Hyderabad
I. Introduction
Now days waste quantity of digital data is being
accumulated in several important areas, including e-
commerce, social network, finance,banking, health care,
education, and environment. It's become progressively
popular to mine such massive data so as to achieve
insights to assist business selections or to produce higher
customized, higher quality services. In recent years, a
large variety of computing frameworks [1], [2], [3], [5]
are established for large data analysis. Among these
frameworks, map reduce [1] (with its ASCII text file
implementations, like Hadoop) is that the most generally
utilized in production because of its simplicity, gnerality
and maturity. We proposed be likely to focus on map
reduce during in big data applications.It is now
implemented with the bigdata applications. Big data is
constantly evolving. Due to the advent of new
technologies, devices, and communication means like
social networking sites, the amount of data produced
bymankind is growing rapidly every year. Though all
this information produced is meaningful and can be
useful when processed, it is being neglected Big data
means it is a collection of large datasets that cannot be
processed using traditional computing techniques. Big
data is not merely a data, rather it has become a
complete subject, which involves various tools,
techniques and frameworks. As new data and updates
are being collected, the input data of a big data mining
algorithm will gradually change, and the computed
results will become stale and obsolete over time.
Incremental processing is a promising approach to
refreshing mining results. It utilizes previously saved
states to avoid the expense of re-computation from
scratch. In this paper, we propose Energy Map Reduce
Scheduling Algorithm, a novel incremental processing
extension to Map Reduce, the most widely used
framework for mining big data. Map Reduce to support
incremental processing. However, it has two main
limitations. First, Incoop method supports only task-
RESEARCH ARTICLE OPEN ACCESS
Abstract:
In recent years the data mining applications become musty and outmoded over time. Energy wastage is the major
problem more in big data analytics and applications. More workload and more computational time will increase high energy
cost and decrease efficiency. The Incremental computational time processing is a promising approach to refreshing mining
results. It utilizes previously saved states to avoid the expense of re-computation from scratch. In this paper, we propose
Energy efficiency Map Reduce Scheduling Algorithm, a novel incremental processing extension to reduce the Map, the most
widely used framework for mining big data. Map reduce is a programming model for processing and generating large amount
of data in parallel processing time. In this paper, Energy Efficiency reduce Map (EEMP) is algorithm provide more energy
and less maps in big data. Priority based scheduling is a task will allocate the schedules based on necessary and utilization of
the Jobs. For reducing the maps, it will reduce the system computational time so easily energy has improved in terms of big
data applications.. Final results show the experimental comparison of the different algorithms involved in the paper.
Index Terms— Big Data, EEM, Map Reduce, incremental processing, svm.
International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017
ISSN: 2395-1303 http://www.ijetjournal.org Page 142
level incremental processing. . That is, it saves and
reuses states at the coarseness of individual Map and
reduce tasks. Every task generally processes an
oversized number of key-valuepairs (kvpairs). If Incoop
detects any data changes within the input of a task, it'll
rerun the whole task. Whereas this approach simply
leverages existing Map Reduce options for state savings,
it should incur a large quantity of redundant computation
if solely a small fraction of kv-pairs have modified
during a task. Second, Incoop supports solely one-step
computation, whereas important mining algorithms, like
PageRank, need iterative computation. Incoop would
treat every iteration as a separate MapReduce job.
However, a small number of input data changes could
gradually propagate to affect a large portion of
intermediate states when variety of iterations, leading to
expensive global re-computation after. We tend to
propose i2MapReduce, an extension to Map Reduce that
supports fine-grain incremental processing for each one
step and iterative computation.
II. Proposed method
Main aim of proposed method is to reduce the
minimum energy cost from efficient Map reducing
concepts in big data applications. To optimize the
mining results, we evaluate Map Reduce using a one-
step algorithm and three iterative algorithms with
diverse computation characteristics for efficient
mining also improve the energy. In this paper we also
include the algorithm for incremental processing
approach named as Energy map reduce scheduling
method (EEMP) is provide more energy and
minimum maps. Priority based scheduling is a task
will allocate the schedules based on necessary and
utilization of the Jobs. For reducing the maps, it will
reduce the system work so easily energy has
improved. Final we shows the experimental
comaprison of the different This paper involves the
input files with the .arff extension, that is, artributte
relation file format. An ARFF (Attribute-Relation File
Format) file is an ASCII text file that describes a list
of instances sharing a set of attributes. ARFF files
have two distinct sections. The first section is the
Header information, which is followed the Data
information.The Header of the ARFF file contains the
name of the relation, a list of the attributes (the
columns in the data), and their types. Hadoop plugin
is implemented in the eclipse environment. Hadoop is
the flexible and available architecture for large scale
computation on data processing on a netwrk of
commodity hardware. Eclipse is an integrated
development environment (IDE). It contains a base
workspace and an extensible plug-in system for
customizing the environment. Here in this paper we
are implementing hadoop plugin by including tha jar
files in eclipse and which creates a virtual memory of
1GB. existing algorithms involved in the paper.
Fig.1.screen shot
II.1. Related Work
In related work we presented the proposed algorithm for
enery efficiency map
reduce.
International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017
ISSN: 2395-1303 http://www.ijetjournal.org Page 143

In this paper involves the input files with the .arff
extension, that is, artributte relation file format. An
Attribute-Relation File Format file is an ASCII text
file that describes a list of instances sharing a set of
attributes. ARFF files have two distinct sections. The
first section is the Header information, which is
followed the Data information. The Header of the
ARFF file contains the name of the relation, a list of
the attributes (the columns in the data), and their
types. Hadoop is implemented in the eclipse
environment. Hadoop is the flexible and available
architecture for large scale computation on data
processing on a netwrk of commodity hardware.
Eclipse is an integrated development environment
(IDE). It contains a base workspace and an extensible
plug-in system for customizing the environment. Here
in this paper we are implementing hadoop plugin by
including the .jar files in eclipse and which creates a
virtual memory of 2GB.
In this proposed paper we show the efficient methods of
classifying the evaluvated results by using the two
classification methods: one is Support Vector
Machine(SVM) and Naive Bayesian.
A support vector machine is a Classification method..it
is a Supervised algorithm used for Classification and
Regression (binary and multi-class problem) and
anomalie detection (one class problem) .An SVM
training algorithm builds a model that assigns new data
into one category or the other category, making it is a
non-probabilistic binary linear classifier. An SVM
model is a representation of the data as points in space,
mapped so that the examples of the separate categories
are divided by a clear gap that is as wide as possible.
The support vector machine has been developed as
robust tool for classification and regression in noisy,
complex domains. The two key features of support
vector machines are generalization theory, which leads
to a principled way to choose an hypothesis; and, kernel
functions, which introduce non-linearity in the
hypothesis space without explicitly requiring a non-
linear algorithm
Fig.2. shows the svm classifier
The black line indicates that separate the two classes of
svm. . Mathematically, the separation can be found by
taking the two critical members, one for each class. This
points are called support vectors. These are the critical
points (members) that define the channel.The separation
is then the perpendicular bisector of the line joining
these two support vectors .That's the idea of support
vector machine.
The second classifier method is The Naive Bayesian
classifier is based on Bayes‟ theorem with independence
assumptions between predictors. A Naive Bayesian
model is easy to build, with no complicated iterative
parameter estimation which makes it particularly useful
for very large datasets. Despite its simplicity, the Naive
Bayesian classifier often does surprisingly well and is
widely used because it often outperforms more
sophisticated classification methods. Bayes theorem
provides a way of calculating the posterior probability.
Naive Bayes classifier assumes that the effect of the
value of a predictor (x) on a given class (c) is
independent of the values of other predictors. This type
of assumption is called class conditional independence.
The posterior probability can be calculated first, then
constructing a frequency table for each attribute against
the target value . Then, transforming the frequency
tables to likelihood tables and finally uses the Naive
Bayesian equation to calculate the posterior probability
for each class. The class with the highest posterior
probability is the outcome of prediction.
II.2. Map reduce process
In the above block diagram is the map reduce processing
in the big data applications. In this diagram three factors
are considered one is map tasks, and second is reduce
tasks ,final factor is reduced tasks.
International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017
ISSN: 2395-1303 http://www.ijetjournal.org Page 144
Fig.3.Map reduce processing
MapReduce is a programming model and an
associated implementation for processing and generating
large data sets with a parallel, distributed algorithm on a
cluster. It is this programming paradigm that allows for
massive scalability across hundreds or thousands of
servers in a Hadoop cluster. The first is the map job,
which takes a set of data and converts it into another set
of data, where individual elements are broken down into
tuples (key/value pairs). The reduce job takes the output
from a map as input and combines those data tuples into
a smaller set of tuples. As the sequence of the name
MapReduce implies, the reduce job is always performed
after the map job. Process of scheduling is an essential
part of a Multiprogramming operating system. Such
operating systems allow more than one process to be
loaded into the executable memory at a time and loaded
process shares the CPU using time multiplexing. Priority
Scheduling. The basic idea is straightforward: each
process is assigned a priority, and priority is allowed to
run. Equal-Priority processes are scheduled in FCFS
order. The shortest-Job-First (SJF) algorithm is a special
case of general priority scheduling algorithm.
The probability density function for the normal
distribution is defined by two parameters (mean and
standard deviation)
III. Conclusion
We have described support vector machine and naïve
Bayesian classification methods for effective data
analysis results and a set of efficient techniques for
incremental iterative processing computation. Real time
experiments will show that EEMP and the described
classification methods significantly reduce the run time
for refreshing big data mining results compared to re-
computation on both plain and iterative Map Reduce
thereby reduces the workload of the system which results
in the efficient and reliable energy usage. We are also
classify the data by using svm and The Naive Bayesian
methods.
References
[1] S. Lloyd, “Least squares quantization in PCM,”
IEEE Trans. Inform. Theory., vol. 28, no. 2, pp.
129–137, Mar. 1982. J. Clerk Maxwell, A Treatise
on Electricity and Magnetism, 3rd ed., vol. 2.
Oxford: Clarendon, 1892, pp.68–73.
[2] I. S R. Agrawal and R. Srikant, “Fast algorithms for
mining association rules in large databases,” in Proc.
20th Int. Conf. Very Large Data Bases, 1994, pp.
487–499.
[3] S. Brin, and L. Page, “The anatomy of a large-scale
hypertextual web search engine,” Comput. Netw.
ISDN Syst., vol. 30, no. 1–7, pp. 107–117, Apr.
1998..
[4] R. Power and J. Li, “Piccolo: Building fast,
distributed programs with partitioned tables,” in
Proc. 9th USENIX Conf. Oper. Syst. Des.
Implementation, 2010, pp. 1–14
[5] Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa,
“Electron spectroscopy studies on magneto-optical
media and plastic substrate interface,” IEEE Transl.
[6] J. Magn. Japan, vol. 2, pp. 740–741, August 1987
[Digests 9th Annual Conf. Magnetics Japan, p. 301,
1982.
[7] J. Dean and S. Ghemawat, “Mapreduce: Simplified
data processing on large clusters,” in Proc. 6th Conf.
Symp. Opear. Syst. Des. Implementation,2004.
[8] T. J€org, R. Parvizi, H. Yong, and S. Dessloch,
“Incremental recomputations in mapreduce,” in
Proc. 3rd Int. Workshop Cloud Data
Manage.,2011,pp.7–14.
[9] Y. Zhang, Q. Gao, L. Gao, and C. Wang,
“imapreduce: A distributed computing framework
for iterative computation,” J. Grid Comput., vol.
10,no.1,pp.47–68,2012.
[10] D. G. Murray, F. McSherry, R. Isaacs, M. Isard, P.
Barham, and M. Abadi, “Naiad: A timely dataflow
system,” in Proc. 24th ACM Symp.
Oper.Syst.Principles,2013,pp.439–455.
International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017
ISSN: 2395-1303 http://www.ijetjournal.org Page 145

More Related Content

What's hot

Implementation of p pic algorithm in map reduce to handle big data
Implementation of p pic algorithm in map reduce to handle big dataImplementation of p pic algorithm in map reduce to handle big data
Implementation of p pic algorithm in map reduce to handle big data
eSAT Publishing House
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET Journal
 
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
IRJET Journal
 
Parallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive IndexingParallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive Indexing
IRJET Journal
 
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
IJERA Editor
 
Hadoop Mapreduce Performance Enhancement Using In-Node Combiners
Hadoop Mapreduce Performance Enhancement Using In-Node CombinersHadoop Mapreduce Performance Enhancement Using In-Node Combiners
Hadoop Mapreduce Performance Enhancement Using In-Node Combiners
ijcsit
 
A data aware caching 2415
A data aware caching 2415A data aware caching 2415
A data aware caching 2415
SANTOSH WAYAL
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
IRJET Journal
 
E031201032036
E031201032036E031201032036
E031201032036
ijceronline
 
Distributed Feature Selection for Efficient Economic Big Data Analysis
Distributed Feature Selection for Efficient Economic Big Data AnalysisDistributed Feature Selection for Efficient Economic Big Data Analysis
Distributed Feature Selection for Efficient Economic Big Data Analysis
IRJET Journal
 
High Dimensionality Structures Selection for Efficient Economic Big data usin...
High Dimensionality Structures Selection for Efficient Economic Big data usin...High Dimensionality Structures Selection for Efficient Economic Big data usin...
High Dimensionality Structures Selection for Efficient Economic Big data usin...
IRJET Journal
 
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
IRJET Journal
 
Coarse Grain Reconfigurable Floating Point Unit
Coarse Grain Reconfigurable Floating Point UnitCoarse Grain Reconfigurable Floating Point Unit
Coarse Grain Reconfigurable Floating Point Unit
AM Publications,India
 
Jovian DATA: A multidimensional database for the cloud
Jovian DATA: A multidimensional database for the cloudJovian DATA: A multidimensional database for the cloud
Jovian DATA: A multidimensional database for the cloud
Bharat Rane
 
Finalprojectpresentation
FinalprojectpresentationFinalprojectpresentation
Finalprojectpresentation
SANTOSH WAYAL
 
CMPE275-Project1Report
CMPE275-Project1ReportCMPE275-Project1Report
CMPE275-Project1Report
Sandyarathi Das
 
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEYDYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
ijccsa
 
Final Report_798 Project_Nithin_Sharmila
Final Report_798 Project_Nithin_SharmilaFinal Report_798 Project_Nithin_Sharmila
Final Report_798 Project_Nithin_Sharmila
Nithin Kakkireni
 
IRJET- Hadoop based Frequent Closed Item-Sets for Association Rules form ...
IRJET-  	  Hadoop based Frequent Closed Item-Sets for Association Rules form ...IRJET-  	  Hadoop based Frequent Closed Item-Sets for Association Rules form ...
IRJET- Hadoop based Frequent Closed Item-Sets for Association Rules form ...
IRJET Journal
 
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
ijccsa
 

What's hot (20)

Implementation of p pic algorithm in map reduce to handle big data
Implementation of p pic algorithm in map reduce to handle big dataImplementation of p pic algorithm in map reduce to handle big data
Implementation of p pic algorithm in map reduce to handle big data
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
 
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
IRJET - Evaluating and Comparing the Two Variation with Current Scheduling Al...
 
Parallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive IndexingParallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive Indexing
 
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
Implementing Workload Postponing In Cloudsim to Maximize Renewable Energy Uti...
 
Hadoop Mapreduce Performance Enhancement Using In-Node Combiners
Hadoop Mapreduce Performance Enhancement Using In-Node CombinersHadoop Mapreduce Performance Enhancement Using In-Node Combiners
Hadoop Mapreduce Performance Enhancement Using In-Node Combiners
 
A data aware caching 2415
A data aware caching 2415A data aware caching 2415
A data aware caching 2415
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
 
E031201032036
E031201032036E031201032036
E031201032036
 
Distributed Feature Selection for Efficient Economic Big Data Analysis
Distributed Feature Selection for Efficient Economic Big Data AnalysisDistributed Feature Selection for Efficient Economic Big Data Analysis
Distributed Feature Selection for Efficient Economic Big Data Analysis
 
High Dimensionality Structures Selection for Efficient Economic Big data usin...
High Dimensionality Structures Selection for Efficient Economic Big data usin...High Dimensionality Structures Selection for Efficient Economic Big data usin...
High Dimensionality Structures Selection for Efficient Economic Big data usin...
 
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
Novel Scheduling Algorithms for Efficient Deployment of Map Reduce Applicatio...
 
Coarse Grain Reconfigurable Floating Point Unit
Coarse Grain Reconfigurable Floating Point UnitCoarse Grain Reconfigurable Floating Point Unit
Coarse Grain Reconfigurable Floating Point Unit
 
Jovian DATA: A multidimensional database for the cloud
Jovian DATA: A multidimensional database for the cloudJovian DATA: A multidimensional database for the cloud
Jovian DATA: A multidimensional database for the cloud
 
Finalprojectpresentation
FinalprojectpresentationFinalprojectpresentation
Finalprojectpresentation
 
CMPE275-Project1Report
CMPE275-Project1ReportCMPE275-Project1Report
CMPE275-Project1Report
 
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEYDYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
DYNAMIC ENERGY MANAGEMENT IN CLOUD DATA CENTERS: A SURVEY
 
Final Report_798 Project_Nithin_Sharmila
Final Report_798 Project_Nithin_SharmilaFinal Report_798 Project_Nithin_Sharmila
Final Report_798 Project_Nithin_Sharmila
 
IRJET- Hadoop based Frequent Closed Item-Sets for Association Rules form ...
IRJET-  	  Hadoop based Frequent Closed Item-Sets for Association Rules form ...IRJET-  	  Hadoop based Frequent Closed Item-Sets for Association Rules form ...
IRJET- Hadoop based Frequent Closed Item-Sets for Association Rules form ...
 
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...
 

Similar to IJET-V3I1P27

Big Data on Implementation of Many to Many Clustering
Big Data on Implementation of Many to Many ClusteringBig Data on Implementation of Many to Many Clustering
Big Data on Implementation of Many to Many Clustering
paperpublications3
 
Data Dimensional Reduction by Order Prediction in Heterogeneous Environment
Data Dimensional Reduction by Order Prediction in Heterogeneous EnvironmentData Dimensional Reduction by Order Prediction in Heterogeneous Environment
Data Dimensional Reduction by Order Prediction in Heterogeneous Environment
Association of Scientists, Developers and Faculties
 
Generating Frequent Itemsets by RElim on Hadoop Clusters
Generating Frequent Itemsets by RElim on Hadoop ClustersGenerating Frequent Itemsets by RElim on Hadoop Clusters
Generating Frequent Itemsets by RElim on Hadoop Clusters
BRNSSPublicationHubI
 
Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...
Rusif Eyvazli
 
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
IJECEIAES
 
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
dbpublications
 
Web Oriented FIM for large scale dataset using Hadoop
Web Oriented FIM for large scale dataset using HadoopWeb Oriented FIM for large scale dataset using Hadoop
Web Oriented FIM for large scale dataset using Hadoop
dbpublications
 
2004 map reduce simplied data processing on large clusters (mapreduce)
2004 map reduce simplied data processing on large clusters (mapreduce)2004 map reduce simplied data processing on large clusters (mapreduce)
2004 map reduce simplied data processing on large clusters (mapreduce)
anh tuan
 
Map reduce
Map reduceMap reduce
Map reduce
Shahbaz Sidhu
 
A Survey on Data Mapping Strategy for data stored in the storage cloud 111
A Survey on Data Mapping Strategy for data stored in the storage cloud  111A Survey on Data Mapping Strategy for data stored in the storage cloud  111
A Survey on Data Mapping Strategy for data stored in the storage cloud 111
NavNeet KuMar
 
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
IJET - International Journal of Engineering and Techniques
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
lmphuong06
 
Dynamically Partitioning Big Data Using Virtual Machine Mapping
Dynamically Partitioning Big Data Using Virtual Machine MappingDynamically Partitioning Big Data Using Virtual Machine Mapping
Dynamically Partitioning Big Data Using Virtual Machine Mapping
AM Publications
 
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
paperpublications3
 
Algorithm selection for sorting in embedded and mobile systems
Algorithm selection for sorting in embedded and mobile systemsAlgorithm selection for sorting in embedded and mobile systems
Algorithm selection for sorting in embedded and mobile systems
Jigisha Aryya
 
Fast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data AnalysisFast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data Analysis
IRJET Journal
 
Lecture 1 mapreduce
Lecture 1  mapreduceLecture 1  mapreduce
Lecture 1 mapreduce
Shubham Bansal
 
Ijetcas14 316
Ijetcas14 316Ijetcas14 316
Ijetcas14 316
Iasir Journals
 
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
IRJET Journal
 
High Performance Computing for Satellite Image Processing and Analyzing – A ...
High Performance Computing for Satellite Image  Processing and Analyzing – A ...High Performance Computing for Satellite Image  Processing and Analyzing – A ...
High Performance Computing for Satellite Image Processing and Analyzing – A ...
Editor IJCATR
 

Similar to IJET-V3I1P27 (20)

Big Data on Implementation of Many to Many Clustering
Big Data on Implementation of Many to Many ClusteringBig Data on Implementation of Many to Many Clustering
Big Data on Implementation of Many to Many Clustering
 
Data Dimensional Reduction by Order Prediction in Heterogeneous Environment
Data Dimensional Reduction by Order Prediction in Heterogeneous EnvironmentData Dimensional Reduction by Order Prediction in Heterogeneous Environment
Data Dimensional Reduction by Order Prediction in Heterogeneous Environment
 
Generating Frequent Itemsets by RElim on Hadoop Clusters
Generating Frequent Itemsets by RElim on Hadoop ClustersGenerating Frequent Itemsets by RElim on Hadoop Clusters
Generating Frequent Itemsets by RElim on Hadoop Clusters
 
Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...
 
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
 
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
 
Web Oriented FIM for large scale dataset using Hadoop
Web Oriented FIM for large scale dataset using HadoopWeb Oriented FIM for large scale dataset using Hadoop
Web Oriented FIM for large scale dataset using Hadoop
 
2004 map reduce simplied data processing on large clusters (mapreduce)
2004 map reduce simplied data processing on large clusters (mapreduce)2004 map reduce simplied data processing on large clusters (mapreduce)
2004 map reduce simplied data processing on large clusters (mapreduce)
 
Map reduce
Map reduceMap reduce
Map reduce
 
A Survey on Data Mapping Strategy for data stored in the storage cloud 111
A Survey on Data Mapping Strategy for data stored in the storage cloud  111A Survey on Data Mapping Strategy for data stored in the storage cloud  111
A Survey on Data Mapping Strategy for data stored in the storage cloud 111
 
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
[IJET V2I2P18] Authors: Roopa G Yeklaspur, Dr.Yerriswamy.T
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
 
Dynamically Partitioning Big Data Using Virtual Machine Mapping
Dynamically Partitioning Big Data Using Virtual Machine MappingDynamically Partitioning Big Data Using Virtual Machine Mapping
Dynamically Partitioning Big Data Using Virtual Machine Mapping
 
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
Implementing Map Reduce Based Edmonds-Karp Algorithm to Determine Maximum Flo...
 
Algorithm selection for sorting in embedded and mobile systems
Algorithm selection for sorting in embedded and mobile systemsAlgorithm selection for sorting in embedded and mobile systems
Algorithm selection for sorting in embedded and mobile systems
 
Fast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data AnalysisFast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data Analysis
 
Lecture 1 mapreduce
Lecture 1  mapreduceLecture 1  mapreduce
Lecture 1 mapreduce
 
Ijetcas14 316
Ijetcas14 316Ijetcas14 316
Ijetcas14 316
 
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
 
High Performance Computing for Satellite Image Processing and Analyzing – A ...
High Performance Computing for Satellite Image  Processing and Analyzing – A ...High Performance Computing for Satellite Image  Processing and Analyzing – A ...
High Performance Computing for Satellite Image Processing and Analyzing – A ...
 

More from IJET - International Journal of Engineering and Techniques

healthcare supervising system to monitor heart rate to diagonize and alert he...
healthcare supervising system to monitor heart rate to diagonize and alert he...healthcare supervising system to monitor heart rate to diagonize and alert he...
healthcare supervising system to monitor heart rate to diagonize and alert he...
IJET - International Journal of Engineering and Techniques
 
verifiable and multi-keyword searchable attribute-based encryption scheme for...
verifiable and multi-keyword searchable attribute-based encryption scheme for...verifiable and multi-keyword searchable attribute-based encryption scheme for...
verifiable and multi-keyword searchable attribute-based encryption scheme for...
IJET - International Journal of Engineering and Techniques
 
Ijet v5 i6p18
Ijet v5 i6p18Ijet v5 i6p18
Ijet v5 i6p17
Ijet v5 i6p17Ijet v5 i6p17
Ijet v5 i6p16
Ijet v5 i6p16Ijet v5 i6p16
Ijet v5 i6p15
Ijet v5 i6p15Ijet v5 i6p15
Ijet v5 i6p14
Ijet v5 i6p14Ijet v5 i6p14
Ijet v5 i6p13
Ijet v5 i6p13Ijet v5 i6p13
Ijet v5 i6p12
Ijet v5 i6p12Ijet v5 i6p12
Ijet v5 i6p11
Ijet v5 i6p11Ijet v5 i6p11
Ijet v5 i6p10
Ijet v5 i6p10Ijet v5 i6p10
Ijet v5 i6p2
Ijet v5 i6p2Ijet v5 i6p2
IJET-V3I2P23
IJET-V3I2P23IJET-V3I2P23
IJET-V3I2P22
IJET-V3I2P22IJET-V3I2P22
IJET-V3I2P21
IJET-V3I2P21IJET-V3I2P21
IJET-V3I2P20
IJET-V3I2P20IJET-V3I2P20
IJET-V3I2P19
IJET-V3I2P19IJET-V3I2P19
IJET-V3I2P18
IJET-V3I2P18IJET-V3I2P18
IJET-V3I2P17
IJET-V3I2P17IJET-V3I2P17
IJET-V3I2P16
IJET-V3I2P16IJET-V3I2P16

More from IJET - International Journal of Engineering and Techniques (20)

healthcare supervising system to monitor heart rate to diagonize and alert he...
healthcare supervising system to monitor heart rate to diagonize and alert he...healthcare supervising system to monitor heart rate to diagonize and alert he...
healthcare supervising system to monitor heart rate to diagonize and alert he...
 
verifiable and multi-keyword searchable attribute-based encryption scheme for...
verifiable and multi-keyword searchable attribute-based encryption scheme for...verifiable and multi-keyword searchable attribute-based encryption scheme for...
verifiable and multi-keyword searchable attribute-based encryption scheme for...
 
Ijet v5 i6p18
Ijet v5 i6p18Ijet v5 i6p18
Ijet v5 i6p18
 
Ijet v5 i6p17
Ijet v5 i6p17Ijet v5 i6p17
Ijet v5 i6p17
 
Ijet v5 i6p16
Ijet v5 i6p16Ijet v5 i6p16
Ijet v5 i6p16
 
Ijet v5 i6p15
Ijet v5 i6p15Ijet v5 i6p15
Ijet v5 i6p15
 
Ijet v5 i6p14
Ijet v5 i6p14Ijet v5 i6p14
Ijet v5 i6p14
 
Ijet v5 i6p13
Ijet v5 i6p13Ijet v5 i6p13
Ijet v5 i6p13
 
Ijet v5 i6p12
Ijet v5 i6p12Ijet v5 i6p12
Ijet v5 i6p12
 
Ijet v5 i6p11
Ijet v5 i6p11Ijet v5 i6p11
Ijet v5 i6p11
 
Ijet v5 i6p10
Ijet v5 i6p10Ijet v5 i6p10
Ijet v5 i6p10
 
Ijet v5 i6p2
Ijet v5 i6p2Ijet v5 i6p2
Ijet v5 i6p2
 
IJET-V3I2P23
IJET-V3I2P23IJET-V3I2P23
IJET-V3I2P23
 
IJET-V3I2P22
IJET-V3I2P22IJET-V3I2P22
IJET-V3I2P22
 
IJET-V3I2P21
IJET-V3I2P21IJET-V3I2P21
IJET-V3I2P21
 
IJET-V3I2P20
IJET-V3I2P20IJET-V3I2P20
IJET-V3I2P20
 
IJET-V3I2P19
IJET-V3I2P19IJET-V3I2P19
IJET-V3I2P19
 
IJET-V3I2P18
IJET-V3I2P18IJET-V3I2P18
IJET-V3I2P18
 
IJET-V3I2P17
IJET-V3I2P17IJET-V3I2P17
IJET-V3I2P17
 
IJET-V3I2P16
IJET-V3I2P16IJET-V3I2P16
IJET-V3I2P16
 

Recently uploaded

Mechatronics material . Mechanical engineering
Mechatronics material . Mechanical engineeringMechatronics material . Mechanical engineering
Mechatronics material . Mechanical engineering
sachin chaurasia
 
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
MadhavJungKarki
 
Height and depth gauge linear metrology.pdf
Height and depth gauge linear metrology.pdfHeight and depth gauge linear metrology.pdf
Height and depth gauge linear metrology.pdf
q30122000
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
PreethaV16
 
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
Transcat
 
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
PriyankaKilaniya
 
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
Anant Corporation
 
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODELDEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
ijaia
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
Gino153088
 
P5 Working Drawings.pdf floor plan, civil
P5 Working Drawings.pdf floor plan, civilP5 Working Drawings.pdf floor plan, civil
P5 Working Drawings.pdf floor plan, civil
AnasAhmadNoor
 
SENTIMENT ANALYSIS ON PPT AND Project template_.pptx
SENTIMENT ANALYSIS ON PPT AND Project template_.pptxSENTIMENT ANALYSIS ON PPT AND Project template_.pptx
SENTIMENT ANALYSIS ON PPT AND Project template_.pptx
b0754201
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
ecqow
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
mahaffeycheryld
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
ElakkiaU
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
aryanpankaj78
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Sinan KOZAK
 
Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...
Prakhyath Rai
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
CVCSOfficial
 
Accident detection system project report.pdf
Accident detection system project report.pdfAccident detection system project report.pdf
Accident detection system project report.pdf
Kamal Acharya
 
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
upoux
 

Recently uploaded (20)

Mechatronics material . Mechanical engineering
Mechatronics material . Mechanical engineeringMechatronics material . Mechanical engineering
Mechatronics material . Mechanical engineering
 
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
1FIDIC-CONSTRUCTION-CONTRACT-2ND-ED-2017-RED-BOOK.pdf
 
Height and depth gauge linear metrology.pdf
Height and depth gauge linear metrology.pdfHeight and depth gauge linear metrology.pdf
Height and depth gauge linear metrology.pdf
 
Object Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOADObject Oriented Analysis and Design - OOAD
Object Oriented Analysis and Design - OOAD
 
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
Tools & Techniques for Commissioning and Maintaining PV Systems W-Animations ...
 
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
Prediction of Electrical Energy Efficiency Using Information on Consumer's Ac...
 
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by AnantLLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
LLM Fine Tuning with QLoRA Cassandra Lunch 4, presented by Anant
 
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODELDEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
DEEP LEARNING FOR SMART GRID INTRUSION DETECTION: A HYBRID CNN-LSTM-BASED MODEL
 
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
4. Mosca vol I -Fisica-Tipler-5ta-Edicion-Vol-1.pdf
 
P5 Working Drawings.pdf floor plan, civil
P5 Working Drawings.pdf floor plan, civilP5 Working Drawings.pdf floor plan, civil
P5 Working Drawings.pdf floor plan, civil
 
SENTIMENT ANALYSIS ON PPT AND Project template_.pptx
SENTIMENT ANALYSIS ON PPT AND Project template_.pptxSENTIMENT ANALYSIS ON PPT AND Project template_.pptx
SENTIMENT ANALYSIS ON PPT AND Project template_.pptx
 
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
一比一原版(CalArts毕业证)加利福尼亚艺术学院毕业证如何办理
 
Generative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdfGenerative AI Use cases applications solutions and implementation.pdf
Generative AI Use cases applications solutions and implementation.pdf
 
An Introduction to the Compiler Designss
An Introduction to the Compiler DesignssAn Introduction to the Compiler Designss
An Introduction to the Compiler Designss
 
Digital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptxDigital Twins Computer Networking Paper Presentation.pptx
Digital Twins Computer Networking Paper Presentation.pptx
 
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
Optimizing Gradle Builds - Gradle DPE Tour Berlin 2024
 
Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...Software Engineering and Project Management - Software Testing + Agile Method...
Software Engineering and Project Management - Software Testing + Agile Method...
 
TIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptxTIME TABLE MANAGEMENT SYSTEM testing.pptx
TIME TABLE MANAGEMENT SYSTEM testing.pptx
 
Accident detection system project report.pdf
Accident detection system project report.pdfAccident detection system project report.pdf
Accident detection system project report.pdf
 
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
一比一原版(uofo毕业证书)美国俄勒冈大学毕业证如何办理
 

IJET-V3I1P27

  • 1. International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017 ISSN: 2395-1303 http://www.ijetjournal.org Page 141 Energy Efficient algorithm of Map Reduce for Big Data Applications D.Revathi Dept. of computer science & Engineering AVN institute of technology, Hyderabad. Vijendar amgothu Dept. of computer science & Engineering University College of Engineering Osmania University,Hyderabad I. Introduction Now days waste quantity of digital data is being accumulated in several important areas, including e- commerce, social network, finance,banking, health care, education, and environment. It's become progressively popular to mine such massive data so as to achieve insights to assist business selections or to produce higher customized, higher quality services. In recent years, a large variety of computing frameworks [1], [2], [3], [5] are established for large data analysis. Among these frameworks, map reduce [1] (with its ASCII text file implementations, like Hadoop) is that the most generally utilized in production because of its simplicity, gnerality and maturity. We proposed be likely to focus on map reduce during in big data applications.It is now implemented with the bigdata applications. Big data is constantly evolving. Due to the advent of new technologies, devices, and communication means like social networking sites, the amount of data produced bymankind is growing rapidly every year. Though all this information produced is meaningful and can be useful when processed, it is being neglected Big data means it is a collection of large datasets that cannot be processed using traditional computing techniques. Big data is not merely a data, rather it has become a complete subject, which involves various tools, techniques and frameworks. As new data and updates are being collected, the input data of a big data mining algorithm will gradually change, and the computed results will become stale and obsolete over time. Incremental processing is a promising approach to refreshing mining results. It utilizes previously saved states to avoid the expense of re-computation from scratch. In this paper, we propose Energy Map Reduce Scheduling Algorithm, a novel incremental processing extension to Map Reduce, the most widely used framework for mining big data. Map Reduce to support incremental processing. However, it has two main limitations. First, Incoop method supports only task- RESEARCH ARTICLE OPEN ACCESS Abstract: In recent years the data mining applications become musty and outmoded over time. Energy wastage is the major problem more in big data analytics and applications. More workload and more computational time will increase high energy cost and decrease efficiency. The Incremental computational time processing is a promising approach to refreshing mining results. It utilizes previously saved states to avoid the expense of re-computation from scratch. In this paper, we propose Energy efficiency Map Reduce Scheduling Algorithm, a novel incremental processing extension to reduce the Map, the most widely used framework for mining big data. Map reduce is a programming model for processing and generating large amount of data in parallel processing time. In this paper, Energy Efficiency reduce Map (EEMP) is algorithm provide more energy and less maps in big data. Priority based scheduling is a task will allocate the schedules based on necessary and utilization of the Jobs. For reducing the maps, it will reduce the system computational time so easily energy has improved in terms of big data applications.. Final results show the experimental comparison of the different algorithms involved in the paper. Index Terms— Big Data, EEM, Map Reduce, incremental processing, svm.
  • 2. International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017 ISSN: 2395-1303 http://www.ijetjournal.org Page 142 level incremental processing. . That is, it saves and reuses states at the coarseness of individual Map and reduce tasks. Every task generally processes an oversized number of key-valuepairs (kvpairs). If Incoop detects any data changes within the input of a task, it'll rerun the whole task. Whereas this approach simply leverages existing Map Reduce options for state savings, it should incur a large quantity of redundant computation if solely a small fraction of kv-pairs have modified during a task. Second, Incoop supports solely one-step computation, whereas important mining algorithms, like PageRank, need iterative computation. Incoop would treat every iteration as a separate MapReduce job. However, a small number of input data changes could gradually propagate to affect a large portion of intermediate states when variety of iterations, leading to expensive global re-computation after. We tend to propose i2MapReduce, an extension to Map Reduce that supports fine-grain incremental processing for each one step and iterative computation. II. Proposed method Main aim of proposed method is to reduce the minimum energy cost from efficient Map reducing concepts in big data applications. To optimize the mining results, we evaluate Map Reduce using a one- step algorithm and three iterative algorithms with diverse computation characteristics for efficient mining also improve the energy. In this paper we also include the algorithm for incremental processing approach named as Energy map reduce scheduling method (EEMP) is provide more energy and minimum maps. Priority based scheduling is a task will allocate the schedules based on necessary and utilization of the Jobs. For reducing the maps, it will reduce the system work so easily energy has improved. Final we shows the experimental comaprison of the different This paper involves the input files with the .arff extension, that is, artributte relation file format. An ARFF (Attribute-Relation File Format) file is an ASCII text file that describes a list of instances sharing a set of attributes. ARFF files have two distinct sections. The first section is the Header information, which is followed the Data information.The Header of the ARFF file contains the name of the relation, a list of the attributes (the columns in the data), and their types. Hadoop plugin is implemented in the eclipse environment. Hadoop is the flexible and available architecture for large scale computation on data processing on a netwrk of commodity hardware. Eclipse is an integrated development environment (IDE). It contains a base workspace and an extensible plug-in system for customizing the environment. Here in this paper we are implementing hadoop plugin by including tha jar files in eclipse and which creates a virtual memory of 1GB. existing algorithms involved in the paper. Fig.1.screen shot II.1. Related Work In related work we presented the proposed algorithm for enery efficiency map reduce.
  • 3. International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017 ISSN: 2395-1303 http://www.ijetjournal.org Page 143 In this paper involves the input files with the .arff extension, that is, artributte relation file format. An Attribute-Relation File Format file is an ASCII text file that describes a list of instances sharing a set of attributes. ARFF files have two distinct sections. The first section is the Header information, which is followed the Data information. The Header of the ARFF file contains the name of the relation, a list of the attributes (the columns in the data), and their types. Hadoop is implemented in the eclipse environment. Hadoop is the flexible and available architecture for large scale computation on data processing on a netwrk of commodity hardware. Eclipse is an integrated development environment (IDE). It contains a base workspace and an extensible plug-in system for customizing the environment. Here in this paper we are implementing hadoop plugin by including the .jar files in eclipse and which creates a virtual memory of 2GB. In this proposed paper we show the efficient methods of classifying the evaluvated results by using the two classification methods: one is Support Vector Machine(SVM) and Naive Bayesian. A support vector machine is a Classification method..it is a Supervised algorithm used for Classification and Regression (binary and multi-class problem) and anomalie detection (one class problem) .An SVM training algorithm builds a model that assigns new data into one category or the other category, making it is a non-probabilistic binary linear classifier. An SVM model is a representation of the data as points in space, mapped so that the examples of the separate categories are divided by a clear gap that is as wide as possible. The support vector machine has been developed as robust tool for classification and regression in noisy, complex domains. The two key features of support vector machines are generalization theory, which leads to a principled way to choose an hypothesis; and, kernel functions, which introduce non-linearity in the hypothesis space without explicitly requiring a non- linear algorithm Fig.2. shows the svm classifier The black line indicates that separate the two classes of svm. . Mathematically, the separation can be found by taking the two critical members, one for each class. This points are called support vectors. These are the critical points (members) that define the channel.The separation is then the perpendicular bisector of the line joining these two support vectors .That's the idea of support vector machine. The second classifier method is The Naive Bayesian classifier is based on Bayes‟ theorem with independence assumptions between predictors. A Naive Bayesian model is easy to build, with no complicated iterative parameter estimation which makes it particularly useful for very large datasets. Despite its simplicity, the Naive Bayesian classifier often does surprisingly well and is widely used because it often outperforms more sophisticated classification methods. Bayes theorem provides a way of calculating the posterior probability. Naive Bayes classifier assumes that the effect of the value of a predictor (x) on a given class (c) is independent of the values of other predictors. This type of assumption is called class conditional independence. The posterior probability can be calculated first, then constructing a frequency table for each attribute against the target value . Then, transforming the frequency tables to likelihood tables and finally uses the Naive Bayesian equation to calculate the posterior probability for each class. The class with the highest posterior probability is the outcome of prediction. II.2. Map reduce process In the above block diagram is the map reduce processing in the big data applications. In this diagram three factors are considered one is map tasks, and second is reduce tasks ,final factor is reduced tasks.
  • 4. International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017 ISSN: 2395-1303 http://www.ijetjournal.org Page 144 Fig.3.Map reduce processing MapReduce is a programming model and an associated implementation for processing and generating large data sets with a parallel, distributed algorithm on a cluster. It is this programming paradigm that allows for massive scalability across hundreds or thousands of servers in a Hadoop cluster. The first is the map job, which takes a set of data and converts it into another set of data, where individual elements are broken down into tuples (key/value pairs). The reduce job takes the output from a map as input and combines those data tuples into a smaller set of tuples. As the sequence of the name MapReduce implies, the reduce job is always performed after the map job. Process of scheduling is an essential part of a Multiprogramming operating system. Such operating systems allow more than one process to be loaded into the executable memory at a time and loaded process shares the CPU using time multiplexing. Priority Scheduling. The basic idea is straightforward: each process is assigned a priority, and priority is allowed to run. Equal-Priority processes are scheduled in FCFS order. The shortest-Job-First (SJF) algorithm is a special case of general priority scheduling algorithm. The probability density function for the normal distribution is defined by two parameters (mean and standard deviation) III. Conclusion We have described support vector machine and naïve Bayesian classification methods for effective data analysis results and a set of efficient techniques for incremental iterative processing computation. Real time experiments will show that EEMP and the described classification methods significantly reduce the run time for refreshing big data mining results compared to re- computation on both plain and iterative Map Reduce thereby reduces the workload of the system which results in the efficient and reliable energy usage. We are also classify the data by using svm and The Naive Bayesian methods. References [1] S. Lloyd, “Least squares quantization in PCM,” IEEE Trans. Inform. Theory., vol. 28, no. 2, pp. 129–137, Mar. 1982. J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed., vol. 2. Oxford: Clarendon, 1892, pp.68–73. [2] I. S R. Agrawal and R. Srikant, “Fast algorithms for mining association rules in large databases,” in Proc. 20th Int. Conf. Very Large Data Bases, 1994, pp. 487–499. [3] S. Brin, and L. Page, “The anatomy of a large-scale hypertextual web search engine,” Comput. Netw. ISDN Syst., vol. 30, no. 1–7, pp. 107–117, Apr. 1998.. [4] R. Power and J. Li, “Piccolo: Building fast, distributed programs with partitioned tables,” in Proc. 9th USENIX Conf. Oper. Syst. Des. Implementation, 2010, pp. 1–14 [5] Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa, “Electron spectroscopy studies on magneto-optical media and plastic substrate interface,” IEEE Transl. [6] J. Magn. Japan, vol. 2, pp. 740–741, August 1987 [Digests 9th Annual Conf. Magnetics Japan, p. 301, 1982. [7] J. Dean and S. Ghemawat, “Mapreduce: Simplified data processing on large clusters,” in Proc. 6th Conf. Symp. Opear. Syst. Des. Implementation,2004. [8] T. J€org, R. Parvizi, H. Yong, and S. Dessloch, “Incremental recomputations in mapreduce,” in Proc. 3rd Int. Workshop Cloud Data Manage.,2011,pp.7–14. [9] Y. Zhang, Q. Gao, L. Gao, and C. Wang, “imapreduce: A distributed computing framework for iterative computation,” J. Grid Comput., vol. 10,no.1,pp.47–68,2012. [10] D. G. Murray, F. McSherry, R. Isaacs, M. Isard, P. Barham, and M. Abadi, “Naiad: A timely dataflow system,” in Proc. 24th ACM Symp. Oper.Syst.Principles,2013,pp.439–455.
  • 5. International Journal of Engineering and Techniques - Volume 3 Issue 1, Jan- Feb 2017 ISSN: 2395-1303 http://www.ijetjournal.org Page 145