Submit Search
Upload
Efficient Cost Minimization for Big Data Processing
•
0 likes
•
20 views
IRJET Journal
Follow
https://irjet.net/archives/V3/i2/IRJET-V3I2172.pdf
Read less
Read more
Engineering
Report
Share
Report
Share
1 of 3
Download now
Download to read offline
Recommended
Cross Domain Data Fusion
Cross Domain Data Fusion
IRJET Journal
Mining Stream Data using k-Means clustering Algorithm
Mining Stream Data using k-Means clustering Algorithm
Manishankar Medi
Elimination of data redundancy before persisting into dbms using svm classifi...
Elimination of data redundancy before persisting into dbms using svm classifi...
nalini manogaran
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET Journal
Towards a low cost etl system
Towards a low cost etl system
ijdms
Data mining
Data mining
sweetysweety8
IRJET- Recommendation System based on Graph Database Techniques
IRJET- Recommendation System based on Graph Database Techniques
IRJET Journal
New proximity estimate for incremental update of non uniformly distributed cl...
New proximity estimate for incremental update of non uniformly distributed cl...
IJDKP
Recommended
Cross Domain Data Fusion
Cross Domain Data Fusion
IRJET Journal
Mining Stream Data using k-Means clustering Algorithm
Mining Stream Data using k-Means clustering Algorithm
Manishankar Medi
Elimination of data redundancy before persisting into dbms using svm classifi...
Elimination of data redundancy before persisting into dbms using svm classifi...
nalini manogaran
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET- A Data Stream Mining Technique Dynamically Updating a Model with Dynam...
IRJET Journal
Towards a low cost etl system
Towards a low cost etl system
ijdms
Data mining
Data mining
sweetysweety8
IRJET- Recommendation System based on Graph Database Techniques
IRJET- Recommendation System based on Graph Database Techniques
IRJET Journal
New proximity estimate for incremental update of non uniformly distributed cl...
New proximity estimate for incremental update of non uniformly distributed cl...
IJDKP
D01 etl
D01 etl
Prince Jain
Welcome to International Journal of Engineering Research and Development (IJERD)
Welcome to International Journal of Engineering Research and Development (IJERD)
IJERD Editor
GCUBE INDEXING
GCUBE INDEXING
IJDKP
A unified approach for spatial data query
A unified approach for spatial data query
IJDKP
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
acijjournal
Ijcatr04071003
Ijcatr04071003
Editor IJCATR
Partitioning of Query Processing in Distributed Database System to Improve Th...
Partitioning of Query Processing in Distributed Database System to Improve Th...
IRJET Journal
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
IJDKP
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
IJDKP
Data Distribution Handling on Cloud for Deployment of Big Data
Data Distribution Handling on Cloud for Deployment of Big Data
ijccsa
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
ijcsit
Literature review of attribute level and
Literature review of attribute level and
IJDKP
Mca titles
Mca titles
tema_solution
Cloak-Reduce Load Balancing Strategy for Mapreduce
Cloak-Reduce Load Balancing Strategy for Mapreduce
AIRCC Publishing Corporation
Enhancing the labelling technique of
Enhancing the labelling technique of
IJDKP
Fast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data Analysis
IRJET Journal
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
IRJET Journal
Comparing and analyzing various method of data integration in big data
Comparing and analyzing various method of data integration in big data
IRJET Journal
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET Journal
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET Journal
Managing Big data using Hadoop Map Reduce in Telecom Domain
Managing Big data using Hadoop Map Reduce in Telecom Domain
AM Publications
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET Journal
More Related Content
What's hot
D01 etl
D01 etl
Prince Jain
Welcome to International Journal of Engineering Research and Development (IJERD)
Welcome to International Journal of Engineering Research and Development (IJERD)
IJERD Editor
GCUBE INDEXING
GCUBE INDEXING
IJDKP
A unified approach for spatial data query
A unified approach for spatial data query
IJDKP
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
acijjournal
Ijcatr04071003
Ijcatr04071003
Editor IJCATR
Partitioning of Query Processing in Distributed Database System to Improve Th...
Partitioning of Query Processing in Distributed Database System to Improve Th...
IRJET Journal
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
IJDKP
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
IJDKP
Data Distribution Handling on Cloud for Deployment of Big Data
Data Distribution Handling on Cloud for Deployment of Big Data
ijccsa
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
ijcsit
Literature review of attribute level and
Literature review of attribute level and
IJDKP
Mca titles
Mca titles
tema_solution
Cloak-Reduce Load Balancing Strategy for Mapreduce
Cloak-Reduce Load Balancing Strategy for Mapreduce
AIRCC Publishing Corporation
Enhancing the labelling technique of
Enhancing the labelling technique of
IJDKP
What's hot
(15)
D01 etl
D01 etl
Welcome to International Journal of Engineering Research and Development (IJERD)
Welcome to International Journal of Engineering Research and Development (IJERD)
GCUBE INDEXING
GCUBE INDEXING
A unified approach for spatial data query
A unified approach for spatial data query
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
MAP/REDUCE DESIGN AND IMPLEMENTATION OF APRIORIALGORITHM FOR HANDLING VOLUMIN...
Ijcatr04071003
Ijcatr04071003
Partitioning of Query Processing in Distributed Database System to Improve Th...
Partitioning of Query Processing in Distributed Database System to Improve Th...
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
SOURCE CODE RETRIEVAL USING SEQUENCE BASED SIMILARITY
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
Data Distribution Handling on Cloud for Deployment of Big Data
Data Distribution Handling on Cloud for Deployment of Big Data
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
AN ENTROPIC OPTIMIZATION TECHNIQUE IN HETEROGENEOUS GRID COMPUTING USING BION...
Literature review of attribute level and
Literature review of attribute level and
Mca titles
Mca titles
Cloak-Reduce Load Balancing Strategy for Mapreduce
Cloak-Reduce Load Balancing Strategy for Mapreduce
Enhancing the labelling technique of
Enhancing the labelling technique of
Similar to Efficient Cost Minimization for Big Data Processing
Fast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data Analysis
IRJET Journal
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
IRJET Journal
Comparing and analyzing various method of data integration in big data
Comparing and analyzing various method of data integration in big data
IRJET Journal
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET Journal
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET Journal
Managing Big data using Hadoop Map Reduce in Telecom Domain
Managing Big data using Hadoop Map Reduce in Telecom Domain
AM Publications
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET Journal
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
IRJET Journal
710201931
710201931
IJRAT
Literature Survey on Buliding Confidential and Efficient Query Processing Usi...
Literature Survey on Buliding Confidential and Efficient Query Processing Usi...
paperpublications3
GREEN WSN- OPTIMIZATION OF ENERGY USE THROUGH REDUCTION IN COMMUNICATION WORK...
GREEN WSN- OPTIMIZATION OF ENERGY USE THROUGH REDUCTION IN COMMUNICATION WORK...
ijfcstjournal
Green wsn optimization of energy use
Green wsn optimization of energy use
ijfcstjournal
An optimized cost-based data allocation model for heterogeneous distributed ...
An optimized cost-based data allocation model for heterogeneous distributed ...
IJECEIAES
Dynamic Resource Provisioning with Authentication in Distributed Database
Dynamic Resource Provisioning with Authentication in Distributed Database
Editor IJCATR
A Survey and Comparison of SDN Based Traffic Management Techniques
A Survey and Comparison of SDN Based Traffic Management Techniques
Associate Professor in VSB Coimbatore
Efficient multicast delivery for data redundancy minimization over wireless d...
Efficient multicast delivery for data redundancy minimization over wireless d...
redpel dot com
Heterogeneous data transfer and loader
Heterogeneous data transfer and loader
eSAT Publishing House
Heterogeneous data transfer and loader
Heterogeneous data transfer and loader
eSAT Journals
An Robust Outsourcing of Multi Party Dataset by Utilizing Super-Modularity an...
An Robust Outsourcing of Multi Party Dataset by Utilizing Super-Modularity an...
IRJET Journal
IRJET- A Comprehensive Review on Query Optimization for Distributed Databases
IRJET- A Comprehensive Review on Query Optimization for Distributed Databases
IRJET Journal
Similar to Efficient Cost Minimization for Big Data Processing
(20)
Fast Range Aggregate Queries for Big Data Analysis
Fast Range Aggregate Queries for Big Data Analysis
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
Svm Classifier Algorithm for Data Stream Mining Using Hive and R
Comparing and analyzing various method of data integration in big data
Comparing and analyzing various method of data integration in big data
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET- Providing In-Database Analytic Functionalities to Mysql : A Proposed S...
IRJET- Big Data Processes and Analysis using Hadoop Framework
IRJET- Big Data Processes and Analysis using Hadoop Framework
Managing Big data using Hadoop Map Reduce in Telecom Domain
Managing Big data using Hadoop Map Reduce in Telecom Domain
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
IRJET - A Research on Eloquent Salvation and Productive Outsourcing of Massiv...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
An Energy Efficient Data Transmission and Aggregation of WSN using Data Proce...
710201931
710201931
Literature Survey on Buliding Confidential and Efficient Query Processing Usi...
Literature Survey on Buliding Confidential and Efficient Query Processing Usi...
GREEN WSN- OPTIMIZATION OF ENERGY USE THROUGH REDUCTION IN COMMUNICATION WORK...
GREEN WSN- OPTIMIZATION OF ENERGY USE THROUGH REDUCTION IN COMMUNICATION WORK...
Green wsn optimization of energy use
Green wsn optimization of energy use
An optimized cost-based data allocation model for heterogeneous distributed ...
An optimized cost-based data allocation model for heterogeneous distributed ...
Dynamic Resource Provisioning with Authentication in Distributed Database
Dynamic Resource Provisioning with Authentication in Distributed Database
A Survey and Comparison of SDN Based Traffic Management Techniques
A Survey and Comparison of SDN Based Traffic Management Techniques
Efficient multicast delivery for data redundancy minimization over wireless d...
Efficient multicast delivery for data redundancy minimization over wireless d...
Heterogeneous data transfer and loader
Heterogeneous data transfer and loader
Heterogeneous data transfer and loader
Heterogeneous data transfer and loader
An Robust Outsourcing of Multi Party Dataset by Utilizing Super-Modularity an...
An Robust Outsourcing of Multi Party Dataset by Utilizing Super-Modularity an...
IRJET- A Comprehensive Review on Query Optimization for Distributed Databases
IRJET- A Comprehensive Review on Query Optimization for Distributed Databases
More from IRJET Journal
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
IRJET Journal
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
IRJET Journal
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
IRJET Journal
Effect of Camber and Angles of Attack on Airfoil Characteristics
Effect of Camber and Angles of Attack on Airfoil Characteristics
IRJET Journal
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
IRJET Journal
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
IRJET Journal
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
IRJET Journal
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
IRJET Journal
A REVIEW ON MACHINE LEARNING IN ADAS
A REVIEW ON MACHINE LEARNING IN ADAS
IRJET Journal
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
IRJET Journal
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
IRJET Journal
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
IRJET Journal
Survey Paper on Cloud-Based Secured Healthcare System
Survey Paper on Cloud-Based Secured Healthcare System
IRJET Journal
Review on studies and research on widening of existing concrete bridges
Review on studies and research on widening of existing concrete bridges
IRJET Journal
React based fullstack edtech web application
React based fullstack edtech web application
IRJET Journal
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
IRJET Journal
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
IRJET Journal
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
IRJET Journal
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
IRJET Journal
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
IRJET Journal
More from IRJET Journal
(20)
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
Effect of Camber and Angles of Attack on Airfoil Characteristics
Effect of Camber and Angles of Attack on Airfoil Characteristics
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
A REVIEW ON MACHINE LEARNING IN ADAS
A REVIEW ON MACHINE LEARNING IN ADAS
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
Survey Paper on Cloud-Based Secured Healthcare System
Survey Paper on Cloud-Based Secured Healthcare System
Review on studies and research on widening of existing concrete bridges
Review on studies and research on widening of existing concrete bridges
React based fullstack edtech web application
React based fullstack edtech web application
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
Recently uploaded
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
misbanausheenparvam
power system scada applications and uses
power system scada applications and uses
DevarapalliHaritha
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
Tsuyoshi Horigome
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
Call Girls in Nagpur High Profile
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
Asst.prof M.Gokilavani
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
GDSCAESB
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
srsj9000
Past, Present and Future of Generative AI
Past, Present and Future of Generative AI
abhishek36461
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfid
NikhilNagaraju
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur High Profile
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
Asst.prof M.Gokilavani
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
RajaP95
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
João Esperancinha
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptx
wendy cai
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
null - The Open Security Community
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
hassan khalil
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.
eptoze12
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Dr.Costas Sachpazis
microprocessor 8085 and its interfacing
microprocessor 8085 and its interfacing
jaychoudhary37
Recently uploaded
(20)
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
power system scada applications and uses
power system scada applications and uses
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Past, Present and Future of Generative AI
Past, Present and Future of Generative AI
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfid
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
microprocessor 8085 and its interfacing
microprocessor 8085 and its interfacing
Efficient Cost Minimization for Big Data Processing
1.
International Research Journal
of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 03 Issue: 02 | Feb-2016 www.irjet.net p-ISSN: 2395-0072 © 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal | Page 973 Efficient Cost Minimization for Big Data Processing Pooja Gawale1, Rutuja Jadhav2, Shubhangi Kumavat3, Pooja4 1234 Student, Department of Computer Engineering, MET’s Bhujbal Knowledge City, Maharashtra, India ------------------------------------------------------------------***-------------------------------------------------------------------- Abstract - Big data is a collection of data sets which are large and complex and difficult to process by conventional tools. The growth in big data is found to be at a very high pace each day. As the rising trend of big data, it brings new challenge to the infrastructure and service providers because of its volume, velocity and variety. This heavy importunity to meet the restraints like storage, computation and communication in the data centers incurs high expenses in order to meet their needs. Hence, cost reduction is extremely necessary and major fact in this period of big data. The operational expense of the data centers is profoundly driven by three main factors, i.e., data loading, task assignment and data migration. In this paper, big data processing is characterized using two-dimensional Markov chain and the expected completion time is evaluated and further we formulate the problem as mixed non- linear programming (MNLP) based on closed-form expression to deal with high operational complexity. To reduce communication traffic and search effective solution we present solution which is based on weighted bloom filter (WBF), known as Distributed incomplete pattern matching (DI-matching). A bloom filter is a simple randomized organization of data that answers membership question with no false negative and small false positive probability Traditional bloom filter is generalized to weighted bloom filter incorporates the information on query frequencies and membership likelihood of elements into its most effective design. Key Words: Big data, Data center, Cost minimization, WBF, Data movement, Communication cost 1. INTRODUCTION The continuous increase in volume and detail of data captured by organization, for instance growth of social media, Internet of Things, as well as multimedia, has created an uncontrollable wave of data in either structured or unstructured format and it is referred as Big data. Big are characterized by three aspects: (a) data are existing in large numbers, (b) data cannot be classified into regular relational data bases and (c) data are produced, captured and processed rapidly. Big data is a term that refers to data sets or combinations of data sets whose size (volume), complexity (variation) and process of expanding (velocity) make them hard to confine, conduct, analyze by usual technology and tools. Therefore efficient management of processing and transmitting ids needed to avoid overwhelming data centers and networks with large volumes of data. Data centers are spread at different locations. The oversized amount of data transmission leads to high communication cost. The main objective is to place the data chunks in the server, to distribute task onto servers, to move data between data centers. Two dimensional Markov chain model is used to process in the first data center and the output is passed as an input to the next data center. Likewise all the data chunks are processed in differently located distributed data center [3]. In this paper we present a solution to find target patterns over distributed environment which is based on well design weighted bloom filter (WBF) called, Distributed Incomplete pattern matching (DI-matching). Specifically, to reduce communication cost and ensure pattern matching in distributed incomplete patterns, use of WBF is done to encode query pattern and disseminate the encoded data to each data center [7]. We study the cost minimization problem of big data computation through combine optimization of data assignment, data placement and data migration in distributed data centers. To deal with high computational complexity of solving mixed non- linear programming (MNLP), linearize it [1]. 2. RELATED WORK To assume the challenges of successfully handling big data, many opinions have been suggested to recover the repository and processing cost. The advantage in manipulating big data is to secure and efficient data loading. It is reported that use of flexibility in data loading policy to increase efficiency in data centers[6]. Data center resizing and data placement are those techniques that have catch lots of attention. From then there has been considerable amount of work being carried on to minimize energy expenditure in the server. As per Rao, investigation on how to reduce the cost by routing user request to data centers located at different places with updated sizes that matched the user requests [5]. Big data service frameworks, comprises a distributed file system, which
2.
International Research Journal
of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 03 Issue: 02 | Feb-2016 www.irjet.net p-ISSN: 2395-0072 © 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal | Page 974 distributes data chunks and their replica across the data centers for fine grained load balancing and very similar data access efficiency. To reduce the communication expenditure, few current studies shows to get better data locality by placing jobs on the servers where input data reside to avoid remote data loading . As per Jin, the transmission expenditure is directly proportional to the number of network connection is used. The additional connection used, the higher cost will liable [4]. 2.1 Conventional System In Existing scenario, general focus is on operation and repository suppression, while ignoring the suppression of transmission expenditure. The existing routing strategy between distributed data centers fails to exploit the join diversity of data center networks. Due to storage and computation cost minimization for Big data processing in data centers capacity constraints, all tasks cannot be resides onto the identical server, on which there correspondent data reside. Drawbacks of conventional system are wastage of resources due to data locality, does not support flexibility and operational task, communication cost optimization has not been achieved and data center resizing difficulty. 2.2 Data center resizing Cost minimization Data center resizing has been proposed to optimize cost by adjusting the numerous active servers through placing jobs [5]. Data center resizing and data placement are usually jointly consider to match the computing requirement. Existing data center resizing methods only focus on the control of switching on or off servers. The critical problem is non linear relationship between the processing speed and the energy consumption. 2.3 Big data processing management In recent years, there is big demand for obtaining knowledge from big data to create business values or make society efficient. Among big data processing, streams are becoming conventional and expands, e.g., extroverted medial streams, sensor data streams, lock streams and stock exchanges streams. 3. SYSTEM OVERVIEW We have considered the reduction of cost problem of big data processing with together consideration of data loading, task assignment and data migration. To elaborate the rate constraint computation and transmission in big data processing we put forward a two dimensional Markov chain and derive the expected task completion time in closed form. Based on the generated closed form expression, we describe the cost minimization problem in a structure of mixed integer nonlinear programming (MINLP) to satisfy the following queries: 1) how to place data modules in the server 2) how to circulate task onto the server without resource constraint violation and 3) how to resize data centers to achieve a goal of operation cost reduction 3.1 Network Model The distributed data centers is a system that spans many data centers at many locations generally considered for storage. For storing and managing and retrieving data in data center, every data center has many servers. Each data center contains and support task assignment, data loading and data migration. The data centers A, B and C in the figure are connected with each other. DC A DC B DC C Fig -1: Data Center Network Model 3.2 Markov Chain A Markov chain is a process that consist finite number of states and some known probabilities having the property that, given the present, the future is conditionally independent of the past. A simple random walk is an example of Markov chain. A series of independent events satisfies the definition of Markov chain. To describe the rate constrained figures and transmission in big data process, a two-dimensional Markov chain is applied and expected task completion time is calculated. The total cost can be calculated by summing up the cost on each server across all distributed data centers and this can be formulated as mixed integer non-linear programming problem and further it is linearized to deal with high operational complexity.
3.
International Research Journal
of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 03 Issue: 02 | Feb-2016 www.irjet.net p-ISSN: 2395-0072 © 2016, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal | Page 975 3.3 Data Center Formation A promising and prominent way is to adjust number of active servers in different data centers to adapt to the user request is known as data center resizing. In this following problem should be studied: how to distribute workload or user request in available data centers. The Quality of Service may not be guaranteed due to the congestion, the data center resizing and request scheduling using weighted bloom filter algorithm is together considered. The measures on the data loading include data flow from source data centers to target data center, where data modules is required. In order to reduce data migration inside the data center and also to save communication expense task assignment is used. It includes assigning tasks on that number of servers, which are enough to serve the recent request and turn off remaining servers [2] . Fig -2: Data Center Formation 3.4 Weighted Bloom Filter A bloom filter is a compact randomized organization of data for representing a set in order to support membership. Bloom filter is space efficient and hence is very appealing in network application. Weighted bloom filter is conceptualized as: the given pattern is represented and encoded by weighted bloom filter (WBF), where the weight encodes the relation of local patterns and a corresponding global pattern along the time. Then the represented patterns stored in data center could be sampled and hashed into WBF to check whether it is the pattern of interest. Matched patterns together with the corresponding weights are submitted to data center. Finally, the data center aggregates the weights of the patterns and ranks them by weight values. To study the pattern matching in terms of incomplete, dynamic and distributed data incomplete pattern matching is used. To create communication efficient and search effective framework, DI matching is used to address incomplete pattern matching. 3. CONCLUSIONS In this paper, we reviewed important aspects of big data handling in distributed data center. We study how to minimize the cost that occurs during the big data handling by combine consideration of three main factors i.e., data loading, task assignment and data migration by two dimensional Markov chain and formulating problem as MINLP. We proposed weighted bloom filter to reduce communication cost and search effective mechanism. It reduces processing time and increases performance and to ensure pattern matching DI-matching concept is used. REFERENCES [1] Lin Gu, Deze Zeng, Peng Li and song Guo, “Cost Minimization for Big Data processing in Geo- Distributed Data Centers,”, 2014. [2] S. A. Yazad, S. Venkatesan, and N. Mittal, “Boosting energy Efficiency with Mirrored data block replication policy and energy Schedular,” SIGOPSOper.Syst.Rev.,Vol.47,no.2,pp.33-40,2013. [3] S.Agarwal,J. Dunagan,N.Jaim,S.Saroju,A.Wolman,and H.Bhogan “Volley:Automated Data Placement for Geo-Distributed Cloud Services,”in the 7th USENIX Symposium on Networked Systems Design and Implementation(NSDI),2010,pp.17-32 [4] H.Jin,T.Cheocherngngam,D.Levy,A.Smith,D.pan,J.Liu,a nd N.Pissinou,” Joint Host-Network Optimization for Energy-Efficient Data Center Networking,” in Proceedings of the 27th International Symposium on Parallel Distributed Processing(IPDPS),2013,pp.623- 634. [5] L.Rao, X.Liu, L.Xie and W.Liu, “Minimizing Electricity cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment,” in Proceedings of the 29th International Conference on Computer Communications (INFOCOM), IEEE, 2010, pp.1-9 [6] J. Cohen, B. Dolan, M. Dunlap, J. M. Hellerstein, and C. Welton, “Mad skills: new analysis practices for Big data, ” Proc. VLDB Endow., vol.2, no.2,pp. 1481-1492, 2009. [7] Siyaun Liu, Lei Kang, Lei Chen, Lionel M. Ni, fellow, “How to Conduct Distributed Incomplete Pattern Matching, ” vol. 25, no.4, April 2014. Task Assignmen t Data MigrationData Loading
Download now