The document discusses a methodology for evaluating the impact of databases and cloud patterns on the energy efficiency of cloud applications. It aims to measure the energy consumption and response time of applications implemented with MySQL, PostgreSQL, and MongoDB databases, both individually and combined with cloud patterns like Local Database Proxy, Local Sharding-Based Router, and Priority Message Queue. The methodology defines research questions, hypotheses, independent variables like choice of database/pattern, dependent variables like energy usage and response time. It also describes the data extraction process and analysis methods that will be used. The overall goal is to understand how databases and patterns affect energy efficiency and response time to help developers make informed design choices.
This document provides a review of evolutionary algorithms that have been used to optimize wireless sensor networks (WSNs). It begins with background on WSNs and discusses common issues like energy efficiency. It then reviews heuristic and metaheuristic approaches that have been used for clustering and routing in WSNs. The main part of the document focuses on four commonly used evolutionary algorithms - genetic algorithms, particle swarm optimization, harmony search algorithm, and flower pollination algorithm. For each algorithm, it provides an overview and details on how the algorithm works and pseudo-code. It concludes that these nature-inspired metaheuristic techniques can help optimize challenges in WSNs like cluster formation and energy consumption better than classical algorithms.
To Get any Project for CSE, IT ECE, EEE Contact Me @ 09849539085, 09966235788 or mail us - ieeefinalsemprojects@gmail.co¬m-Visit Our Website: www.finalyearprojects.org
This document proposes an ant colony optimization-based unequal clustering approach for wireless sensor networks to minimize energy consumption. It initializes nodes near the base station as relay nodes to reduce the number of participating relay nodes and increase performance. The approach selects optimal cluster heads using ant colony meta-heuristic optimization and selects optimal paths between nodes. It performs data fusion to reduce the number of transmissions from cluster heads to other nodes, lowering energy usage. The paper claims this approach reduces energy consumption more effectively than existing unequal clustering approaches based on evaluation of performance metrics.
Recently with the increasing development of distributed computer systems (DCSs) in networked
industrial and manufacturing applications on the World Wide Web (WWW) platform, including service-oriented
architecture and Web of Things QoS-aware systems, it has become important to predict the Web performance.
In this paper, we present Web performance prediction in time by making a forecast of a Web resource
downloading using the Efficient Turning Bands (TB) geostatistical simulation method. Real-life data for the
research were obtained from our own website named "Distributed forecasting system". Generation of log file
form website and performing monitoring of a group of Web clients from connected LAN. For better web
prediction we used spatio temporal prediction method with time utility for downloading particular file from
website and calculate forecasting result using Turning bands method but improving more forecasting
accuracy use the efficient turning band method basically efficient turning band use Naive bays algorithm and
calculate efficient result and that result is compared with Turning band and efficient turning band method.
The efficient turning band method result show good forecasting quality of Web performance prediction and
forecasting.
2009 HEP Science Network Requirements Workshop Final Reportbutest
The document summarizes the proceedings of a workshop organized by the Energy Sciences Network (ESnet) and the Office of High Energy Physics (HEP) to characterize the networking requirements of HEP science programs over the next 10 years. Key points discussed include:
- The HEP community has large, distributed data needs that will continue growing with projects like the LHC. More LHC Tier-3 sites and Tier-2 to Tier-2 traffic are anticipated.
- The two LHC Tier-1 sites in the US predict needing 40-50Gbps capacity in 2-5 years and 100-200Gbps in 5-10 years to support HEP traffic.
- There are
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
This document provides a review of evolutionary algorithms that have been used to optimize wireless sensor networks (WSNs). It begins with background on WSNs and discusses common issues like energy efficiency. It then reviews heuristic and metaheuristic approaches that have been used for clustering and routing in WSNs. The main part of the document focuses on four commonly used evolutionary algorithms - genetic algorithms, particle swarm optimization, harmony search algorithm, and flower pollination algorithm. For each algorithm, it provides an overview and details on how the algorithm works and pseudo-code. It concludes that these nature-inspired metaheuristic techniques can help optimize challenges in WSNs like cluster formation and energy consumption better than classical algorithms.
To Get any Project for CSE, IT ECE, EEE Contact Me @ 09849539085, 09966235788 or mail us - ieeefinalsemprojects@gmail.co¬m-Visit Our Website: www.finalyearprojects.org
This document proposes an ant colony optimization-based unequal clustering approach for wireless sensor networks to minimize energy consumption. It initializes nodes near the base station as relay nodes to reduce the number of participating relay nodes and increase performance. The approach selects optimal cluster heads using ant colony meta-heuristic optimization and selects optimal paths between nodes. It performs data fusion to reduce the number of transmissions from cluster heads to other nodes, lowering energy usage. The paper claims this approach reduces energy consumption more effectively than existing unequal clustering approaches based on evaluation of performance metrics.
Recently with the increasing development of distributed computer systems (DCSs) in networked
industrial and manufacturing applications on the World Wide Web (WWW) platform, including service-oriented
architecture and Web of Things QoS-aware systems, it has become important to predict the Web performance.
In this paper, we present Web performance prediction in time by making a forecast of a Web resource
downloading using the Efficient Turning Bands (TB) geostatistical simulation method. Real-life data for the
research were obtained from our own website named "Distributed forecasting system". Generation of log file
form website and performing monitoring of a group of Web clients from connected LAN. For better web
prediction we used spatio temporal prediction method with time utility for downloading particular file from
website and calculate forecasting result using Turning bands method but improving more forecasting
accuracy use the efficient turning band method basically efficient turning band use Naive bays algorithm and
calculate efficient result and that result is compared with Turning band and efficient turning band method.
The efficient turning band method result show good forecasting quality of Web performance prediction and
forecasting.
2009 HEP Science Network Requirements Workshop Final Reportbutest
The document summarizes the proceedings of a workshop organized by the Energy Sciences Network (ESnet) and the Office of High Energy Physics (HEP) to characterize the networking requirements of HEP science programs over the next 10 years. Key points discussed include:
- The HEP community has large, distributed data needs that will continue growing with projects like the LHC. More LHC Tier-3 sites and Tier-2 to Tier-2 traffic are anticipated.
- The two LHC Tier-1 sites in the US predict needing 40-50Gbps capacity in 2-5 years and 100-200Gbps in 5-10 years to support HEP traffic.
- There are
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...ijccsa
Fast development of knowledge and communication has established a new computational style which is
known as cloud computing. One of the main issues considered by the cloud infrastructure providers, is to
minimize the costs and maximize the profitability. Energy management in the cloud data centers is very
important to achieve such goal. Energy consumption can be reduced either by releasing idle nodes or by
reducing the virtual machines migrations. To do the latter, one of the challenges is to select the placement
approach of the migrated virtual machines on the appropriate node. In this paper, an approach to reduce
the energy consumption in cloud data centers is proposed. This approach adapts harmony search
algorithm to migrate the virtual machines. It performs the placement by sorting the nodes and virtual
machines based on their priority in descending order. The priority is calculated based on the workload.
The proposed approach is simulated. The evaluation results show the reduction in the virtual machine
migrations, the increase of efficiency and the reduction of energy consumption.
KEYWORDS
Energy Consumption, Virtual Machine Placement, Harmony Search Algorithm, Server Consolidati
Energy efficient reverse skyline query processing over wireless sensor networksFinalyear Projects
This document discusses energy efficient processing of reverse skyline queries in wireless sensor networks. It proposes using a full skyband approach to minimize communication costs among sensor nodes when evaluating range reverse skyline queries. It also discusses optimization mechanisms for improving the performance of multiple reverse skyline queries, including vertical and horizontal optimizations. Extensive experiments on real and synthetic data demonstrate the efficiency and effectiveness of the proposed approaches.
Reinforcement Learning for Building Energy Optimization Through Controlling o...Power System Operation
This paper presents a novel methodology to control HVAC system and minimize energy cost
on the premise of satisfying power system constraints. A multi-agent architecture based on game theory and
reinforcement learning is developed so as to reduce the cost and computational complexity of the microgrid.
The multi-agent architecture comprising agents, state variables, action variables, reward function and cost
game is formulated. The paper lls the gap between multi-agent HVAC systems control and power system
optimization and planning. The results and analysis indicate that the proposed algorithm is benecial to deal
with the problem of ``curse of dimensionality'' for multi-agent microgrid HVAC system control and speed
up learning of unknown power system conditions.
A Baye's Theorem Based Node Selection for Load Balancing in Cloud Environmentneirew J
Cloud computing is a popular computing model as it renders service to large number of users request on
the fly and has lead to the proliferation of large number of cloud users. This has lead to the overloaded
nodes in the cloud environment along with the problem of load imbalance among the cloud servers and
thereby impacts the performance. Hence, in this paper a heuristic Baye's theorem approach is considered
along with clustering to identify the optimal node for load balancing. Experiments using the proposed
approach are carried out on cloudsim simulator and are compared with the existing approach. Results
demonstrates that task deployment performed using this approach has improved performance in terms of
utilization and throughput when compared to the existing approaches.
A BAYE'S THEOREM BASED NODE SELECTION FOR LOAD BALANCING IN CLOUD ENVIRONMENThiij
Cloud computing is a popular computing model as it renders service to large number of users request on
the fly and has lead to the proliferation of large number of cloud users. This has lead to the overloaded
nodes in the cloud environment along with the problem of load imbalance among the cloud servers and
thereby impacts the performance. Hence, in this paper a heuristic Baye's theorem approach is considered
along with clustering to identify the optimal node for load balancing. Experiments using the proposed
approach are carried out on cloudsim simulator and are compared with the existing approach. Results
demonstrates that task deployment performed using this approach has improved performance in terms of
utilization and throughput when compared to the existing approaches
Scheduling Algorithm Based Simulator for Resource Allocation Task in Cloud Co...IRJET Journal
This document proposes a scheduling algorithm for allocating resources in cloud computing based on the Project Evaluation and Review Technique (PERT). It aims to address issues like starvation of lower priority tasks. The algorithm models task allocation as a directed acyclic graph and uses PERT to schedule critical and non-critical tasks, prioritizing higher priority tasks. The algorithm is evaluated against other scheduling methods and shows improvements in reducing completion time and optimizing resource allocation for all tasks.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is given on reviewing rainfall and hydrometric networks.
Energy Efficient Techniques for Data aggregation and collection in WSNIJCSEA Journal
A multidisciplinary research area such as wireless sensor networks (WSN) have been invoked the monitoring of remote physical environment and are used for a wide range of applications ranging from defense personnel to many scientific research, statistical application, disaster area and War Zone. These networks are constraint with energy, memory and computing power enhance efficient techniques are needed for data aggregation, data collection, query processing, decision making and routing in sensor networks. The problem encountered in the recent past was of the more battery power consumption as activity increases, need more efficient data aggregation and collection techniques with right decision making capabilities. Therefore, this paper proposed the efficient and effective architecture and mechanism of energy efficient techniques for data aggregation and collection in WSN using principles like global weight calculation of nodes, data collection for cluster head and data aggregation techniques using data cube aggregation.
- The document describes a flexible distributed energy management system (DEMS) designed and implemented by Roy Emmerich to investigate grid integration of distributed energy resources.
- The DEMS uses a hierarchical, agent-based model to aggregate and control distributed generators, loads, and storage units in a laboratory environment.
- The goal is to enable distributed energy resources to provide grid services like secondary frequency control currently provided by large centralized power plants.
Time Efficient VM Allocation using KD-Tree Approach in Cloud Server Environmentrahulmonikasharma
This document summarizes a research paper that proposes a new algorithm called KD-Tree approach for efficient virtual machine (VM) allocation in cloud computing environments. The algorithm aims to minimize the response time for allocating VMs to user requests. It does this by adopting a KD-Tree data structure to index physical host machines, allowing the scheduler to quickly find the host that can accommodate a new VM request with the minimum latency in O(Log n) time. The proposed approach is evaluated through simulations using the CloudSim toolkit and is shown to outperform an existing linear scheduling strategy (LSTR) algorithm in terms of reducing VM allocation times.
Webinar: Post-combusion carbon capture - Thermodynamic modellingGlobal CCS Institute
Vladimir Vaysman from WorleyParsons gave a Global CCS Institute webinar on 12 March 2013 to present a generic methodology developed to provide independent verification of the impact on a coal–fired power station of installing and operating a post-combustion capture plant.
Vladimir illustrated the methodology using Loy Yang A power station in Australia in five different scenarios that cover carbon capture, air cooling, coal drying and plant optimisation.
The methodology offers a sound approach to provide performance data and protect technology vendor IP while also providing confidence to the wider CCS community to evaluate a project.
Vladimir is a Project Manager with more than 31 years of engineering experience, including 14 years with WorleyParsons. He has undertaken an array of design and analysis studies and developed significant expertise across a range of technologies, from pulverised coal and circulating fluidised bed, to integrated gasification combined cycle and carbon capture. Vladimir has participated in projects in Australia, Bulgaria, Canada, China, Kazakhstan, Korea, Malaysia, Moldova, New Zealand, Poland, Romania, Russia and Ukraine.
Dr Dev Kambhampati | DOE NETL Report- Cost & Performance Baseline for Fossil ...Dr Dev Kambhampati
This document provides a summary of cost and performance baselines for fossil energy power plants, including integrated gasification combined cycle (IGCC), pulverized coal (PC), and natural gas combined cycle (NGCC) configurations. Key findings include:
- IGCC, PC, and NGCC plants without carbon capture can achieve efficiencies of 39%, 39%, and 58% respectively. With capture, efficiencies drop to 32-35%, 30-33%, and 45-48%.
- Total overnight capital costs for non-capture plants are $718/kW for NGCC, $2,010/kW for PC, and $2,505/kW for IGCC on average. Capture increases
Challenges in Dynamic Resource Allocation and Task Scheduling in Heterogeneou...rahulmonikasharma
This document discusses the challenges of dynamic resource allocation and task scheduling in heterogeneous cloud environments. It outlines that resource allocation involves deciding how to allocate resources to tasks to maximize utilization, while task scheduling assigns tasks to processors to minimize execution time. The major challenges are optimizing allocated resources to minimize costs while meeting customer demands and application requirements. Allocating resources dynamically in heterogeneous cloud environments is difficult due to issues like resource contention, scarcity, and fragmentation. The document also discusses approaches to resource modeling, allocation, offering, discovery and monitoring that algorithms must address to effectively allocate resources on demand.
An efficient approach on spatial big data related to wireless networks and it...eSAT Journals
Abstract
Spatial big data acts as a important key role in wireless networks applications. In that spatial and spatio temporal problems contains the distinct role in big data and it’s compared to common relational problems. If we are solving those problems means describing the three applications for spatial big data. In each applications imposing the specific design and we are developing our work on highly scalable parallel processing for spatial big data in Hadoop frameworks by using map reduce computational model. Our results show that enables highly scalable implementations of algorithms using Hadoop for the purpose of spatial data processing problems. Inspite of developing these implementations requires specialized knowledge and user friendly.
Keywords: Spatial Big Data, Hadoop, Wireless Networks, Map reduce
This document proposes using a novel dynamic fuzzy c-means (dFCM) clustering technique combined with an artificial neural network (ANN) approach to reconfigure power distribution networks and minimize active power loss. The dFCM clustering is used to preprocess the input data for the ANN by transforming the input space into kernels, reducing the size of the ANN needed. The proposed framework combines dFCM clustering and ANN and is tested on two power networks, showing benefits like very short processing time, high accuracy, and a simple ANN structure with few neurons compared to other traditional reconfiguration methods.
Sankalp Nimbhorkar is pursuing a Master's in Computer Science at North Carolina State University graduating in 2011. His master's thesis involves combining software defined radios, USRP2 devices, and channel width adaptation based on bit error rate measurements to improve network throughput. He has worked on several systems programming, network programming, Android, and embedded systems projects involving operating systems, networking, and wireless communication.
Available technologies: algorithm for flexible bandwidth reservations for dat...balmanme
Scientists at Berkeley Lab developed a flexible reservation algorithm that finds communication paths in time-dependent networks with bandwidth constraints. The algorithm offers reservation options that meet the user's specified requirements for start time, transit time, and bandwidth. It was tested in network simulations and can produce reservation options in under a second for networks with 1000 nodes. The algorithm provides more flexibility than existing reservation systems and allows users to optimize their choices for large-scale data transfers.
This document describes a study on the energy consumption of databases and cloud patterns. It aims to evaluate the impact of three databases (MySQL, PostgreSQL, MongoDB) and three cloud patterns (Local Database Proxy, Local Sharding-Based Router, Priority Message Queue) on the energy consumption and response time of cloud applications. The methodology section outlines the experimental setup, including the applications tested, databases used, cloud patterns implemented, and tools for measuring energy consumption and response time. Preliminary results are presented comparing the energy use and performance of the databases without cloud patterns and with different cloud pattern implementations.
This document describes a study on the energy consumption of databases and cloud patterns. It aims to evaluate the impact of three databases (MySQL, PostgreSQL, MongoDB) and three cloud patterns (Local Database Proxy, Local Sharding-Based Router, Priority Message Queue) on the energy consumption and response time of cloud applications. The methodology section outlines the experimental setup, including the applications tested, databases used, cloud patterns implemented, and tools for measuring energy consumption and response time. Preliminary results are presented comparing the energy use and performance of the databases without any cloud patterns, and then with each of the three cloud patterns.
Energy Efficient Technologies for Virtualized Cloud Data Center: A Systematic...IRJET Journal
This document summarizes a systematic mapping study and literature review of 74 peer-reviewed articles on energy efficient technologies for virtualized cloud data centers. The study aims to evaluate approaches that optimize power consumption in virtualized data centers. A characterization framework was proposed to classify the studies based on generic attributes, contribution type and evaluation method, technological attributes, and quality management. The results showed that virtualization, consolidation, and workload scheduling are widely used techniques. Around 60% of studies contributed solutions and validation methods through experiments or theoretical models. Dynamic voltage and frequency scaling-enabled scheduling and dynamic server consolidation were identified as important methods for saving energy. The study also identified a need for standardized benchmarking to help research progress and bridge industry-academia gaps
Dr. Fariba Fahroo presents an overview of her program, Computational Mathematics, at the AFOSR 2013 Spring Review. At this review, Program Officers from AFOSR Technical Divisions will present briefings that highlight basic research programs beneficial to the Air Force.
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...ijccsa
Fast development of knowledge and communication has established a new computational style which is
known as cloud computing. One of the main issues considered by the cloud infrastructure providers, is to
minimize the costs and maximize the profitability. Energy management in the cloud data centers is very
important to achieve such goal. Energy consumption can be reduced either by releasing idle nodes or by
reducing the virtual machines migrations. To do the latter, one of the challenges is to select the placement
approach of the migrated virtual machines on the appropriate node. In this paper, an approach to reduce
the energy consumption in cloud data centers is proposed. This approach adapts harmony search
algorithm to migrate the virtual machines. It performs the placement by sorting the nodes and virtual
machines based on their priority in descending order. The priority is calculated based on the workload.
The proposed approach is simulated. The evaluation results show the reduction in the virtual machine
migrations, the increase of efficiency and the reduction of energy consumption.
KEYWORDS
Energy Consumption, Virtual Machine Placement, Harmony Search Algorithm, Server Consolidati
Energy efficient reverse skyline query processing over wireless sensor networksFinalyear Projects
This document discusses energy efficient processing of reverse skyline queries in wireless sensor networks. It proposes using a full skyband approach to minimize communication costs among sensor nodes when evaluating range reverse skyline queries. It also discusses optimization mechanisms for improving the performance of multiple reverse skyline queries, including vertical and horizontal optimizations. Extensive experiments on real and synthetic data demonstrate the efficiency and effectiveness of the proposed approaches.
Reinforcement Learning for Building Energy Optimization Through Controlling o...Power System Operation
This paper presents a novel methodology to control HVAC system and minimize energy cost
on the premise of satisfying power system constraints. A multi-agent architecture based on game theory and
reinforcement learning is developed so as to reduce the cost and computational complexity of the microgrid.
The multi-agent architecture comprising agents, state variables, action variables, reward function and cost
game is formulated. The paper lls the gap between multi-agent HVAC systems control and power system
optimization and planning. The results and analysis indicate that the proposed algorithm is benecial to deal
with the problem of ``curse of dimensionality'' for multi-agent microgrid HVAC system control and speed
up learning of unknown power system conditions.
A Baye's Theorem Based Node Selection for Load Balancing in Cloud Environmentneirew J
Cloud computing is a popular computing model as it renders service to large number of users request on
the fly and has lead to the proliferation of large number of cloud users. This has lead to the overloaded
nodes in the cloud environment along with the problem of load imbalance among the cloud servers and
thereby impacts the performance. Hence, in this paper a heuristic Baye's theorem approach is considered
along with clustering to identify the optimal node for load balancing. Experiments using the proposed
approach are carried out on cloudsim simulator and are compared with the existing approach. Results
demonstrates that task deployment performed using this approach has improved performance in terms of
utilization and throughput when compared to the existing approaches.
A BAYE'S THEOREM BASED NODE SELECTION FOR LOAD BALANCING IN CLOUD ENVIRONMENThiij
Cloud computing is a popular computing model as it renders service to large number of users request on
the fly and has lead to the proliferation of large number of cloud users. This has lead to the overloaded
nodes in the cloud environment along with the problem of load imbalance among the cloud servers and
thereby impacts the performance. Hence, in this paper a heuristic Baye's theorem approach is considered
along with clustering to identify the optimal node for load balancing. Experiments using the proposed
approach are carried out on cloudsim simulator and are compared with the existing approach. Results
demonstrates that task deployment performed using this approach has improved performance in terms of
utilization and throughput when compared to the existing approaches
Scheduling Algorithm Based Simulator for Resource Allocation Task in Cloud Co...IRJET Journal
This document proposes a scheduling algorithm for allocating resources in cloud computing based on the Project Evaluation and Review Technique (PERT). It aims to address issues like starvation of lower priority tasks. The algorithm models task allocation as a directed acyclic graph and uses PERT to schedule critical and non-critical tasks, prioritizing higher priority tasks. The algorithm is evaluated against other scheduling methods and shows improvements in reducing completion time and optimizing resource allocation for all tasks.
This document provides guidance on how to review monitoring networks. It begins with an introduction on the objectives and physical characteristics that networks are based on. It then discusses the types of networks, including basic, secondary, dedicated, and representative networks. The document outlines the steps in network design, which include assessing data needs, setting objectives, determining required network density, reviewing the existing network, and conducting a cost-effectiveness analysis. Specific guidance is given on reviewing rainfall and hydrometric networks.
Energy Efficient Techniques for Data aggregation and collection in WSNIJCSEA Journal
A multidisciplinary research area such as wireless sensor networks (WSN) have been invoked the monitoring of remote physical environment and are used for a wide range of applications ranging from defense personnel to many scientific research, statistical application, disaster area and War Zone. These networks are constraint with energy, memory and computing power enhance efficient techniques are needed for data aggregation, data collection, query processing, decision making and routing in sensor networks. The problem encountered in the recent past was of the more battery power consumption as activity increases, need more efficient data aggregation and collection techniques with right decision making capabilities. Therefore, this paper proposed the efficient and effective architecture and mechanism of energy efficient techniques for data aggregation and collection in WSN using principles like global weight calculation of nodes, data collection for cluster head and data aggregation techniques using data cube aggregation.
- The document describes a flexible distributed energy management system (DEMS) designed and implemented by Roy Emmerich to investigate grid integration of distributed energy resources.
- The DEMS uses a hierarchical, agent-based model to aggregate and control distributed generators, loads, and storage units in a laboratory environment.
- The goal is to enable distributed energy resources to provide grid services like secondary frequency control currently provided by large centralized power plants.
Time Efficient VM Allocation using KD-Tree Approach in Cloud Server Environmentrahulmonikasharma
This document summarizes a research paper that proposes a new algorithm called KD-Tree approach for efficient virtual machine (VM) allocation in cloud computing environments. The algorithm aims to minimize the response time for allocating VMs to user requests. It does this by adopting a KD-Tree data structure to index physical host machines, allowing the scheduler to quickly find the host that can accommodate a new VM request with the minimum latency in O(Log n) time. The proposed approach is evaluated through simulations using the CloudSim toolkit and is shown to outperform an existing linear scheduling strategy (LSTR) algorithm in terms of reducing VM allocation times.
Webinar: Post-combusion carbon capture - Thermodynamic modellingGlobal CCS Institute
Vladimir Vaysman from WorleyParsons gave a Global CCS Institute webinar on 12 March 2013 to present a generic methodology developed to provide independent verification of the impact on a coal–fired power station of installing and operating a post-combustion capture plant.
Vladimir illustrated the methodology using Loy Yang A power station in Australia in five different scenarios that cover carbon capture, air cooling, coal drying and plant optimisation.
The methodology offers a sound approach to provide performance data and protect technology vendor IP while also providing confidence to the wider CCS community to evaluate a project.
Vladimir is a Project Manager with more than 31 years of engineering experience, including 14 years with WorleyParsons. He has undertaken an array of design and analysis studies and developed significant expertise across a range of technologies, from pulverised coal and circulating fluidised bed, to integrated gasification combined cycle and carbon capture. Vladimir has participated in projects in Australia, Bulgaria, Canada, China, Kazakhstan, Korea, Malaysia, Moldova, New Zealand, Poland, Romania, Russia and Ukraine.
Dr Dev Kambhampati | DOE NETL Report- Cost & Performance Baseline for Fossil ...Dr Dev Kambhampati
This document provides a summary of cost and performance baselines for fossil energy power plants, including integrated gasification combined cycle (IGCC), pulverized coal (PC), and natural gas combined cycle (NGCC) configurations. Key findings include:
- IGCC, PC, and NGCC plants without carbon capture can achieve efficiencies of 39%, 39%, and 58% respectively. With capture, efficiencies drop to 32-35%, 30-33%, and 45-48%.
- Total overnight capital costs for non-capture plants are $718/kW for NGCC, $2,010/kW for PC, and $2,505/kW for IGCC on average. Capture increases
Challenges in Dynamic Resource Allocation and Task Scheduling in Heterogeneou...rahulmonikasharma
This document discusses the challenges of dynamic resource allocation and task scheduling in heterogeneous cloud environments. It outlines that resource allocation involves deciding how to allocate resources to tasks to maximize utilization, while task scheduling assigns tasks to processors to minimize execution time. The major challenges are optimizing allocated resources to minimize costs while meeting customer demands and application requirements. Allocating resources dynamically in heterogeneous cloud environments is difficult due to issues like resource contention, scarcity, and fragmentation. The document also discusses approaches to resource modeling, allocation, offering, discovery and monitoring that algorithms must address to effectively allocate resources on demand.
An efficient approach on spatial big data related to wireless networks and it...eSAT Journals
Abstract
Spatial big data acts as a important key role in wireless networks applications. In that spatial and spatio temporal problems contains the distinct role in big data and it’s compared to common relational problems. If we are solving those problems means describing the three applications for spatial big data. In each applications imposing the specific design and we are developing our work on highly scalable parallel processing for spatial big data in Hadoop frameworks by using map reduce computational model. Our results show that enables highly scalable implementations of algorithms using Hadoop for the purpose of spatial data processing problems. Inspite of developing these implementations requires specialized knowledge and user friendly.
Keywords: Spatial Big Data, Hadoop, Wireless Networks, Map reduce
This document proposes using a novel dynamic fuzzy c-means (dFCM) clustering technique combined with an artificial neural network (ANN) approach to reconfigure power distribution networks and minimize active power loss. The dFCM clustering is used to preprocess the input data for the ANN by transforming the input space into kernels, reducing the size of the ANN needed. The proposed framework combines dFCM clustering and ANN and is tested on two power networks, showing benefits like very short processing time, high accuracy, and a simple ANN structure with few neurons compared to other traditional reconfiguration methods.
Sankalp Nimbhorkar is pursuing a Master's in Computer Science at North Carolina State University graduating in 2011. His master's thesis involves combining software defined radios, USRP2 devices, and channel width adaptation based on bit error rate measurements to improve network throughput. He has worked on several systems programming, network programming, Android, and embedded systems projects involving operating systems, networking, and wireless communication.
Available technologies: algorithm for flexible bandwidth reservations for dat...balmanme
Scientists at Berkeley Lab developed a flexible reservation algorithm that finds communication paths in time-dependent networks with bandwidth constraints. The algorithm offers reservation options that meet the user's specified requirements for start time, transit time, and bandwidth. It was tested in network simulations and can produce reservation options in under a second for networks with 1000 nodes. The algorithm provides more flexibility than existing reservation systems and allows users to optimize their choices for large-scale data transfers.
This document describes a study on the energy consumption of databases and cloud patterns. It aims to evaluate the impact of three databases (MySQL, PostgreSQL, MongoDB) and three cloud patterns (Local Database Proxy, Local Sharding-Based Router, Priority Message Queue) on the energy consumption and response time of cloud applications. The methodology section outlines the experimental setup, including the applications tested, databases used, cloud patterns implemented, and tools for measuring energy consumption and response time. Preliminary results are presented comparing the energy use and performance of the databases without cloud patterns and with different cloud pattern implementations.
This document describes a study on the energy consumption of databases and cloud patterns. It aims to evaluate the impact of three databases (MySQL, PostgreSQL, MongoDB) and three cloud patterns (Local Database Proxy, Local Sharding-Based Router, Priority Message Queue) on the energy consumption and response time of cloud applications. The methodology section outlines the experimental setup, including the applications tested, databases used, cloud patterns implemented, and tools for measuring energy consumption and response time. Preliminary results are presented comparing the energy use and performance of the databases without any cloud patterns, and then with each of the three cloud patterns.
Energy Efficient Technologies for Virtualized Cloud Data Center: A Systematic...IRJET Journal
This document summarizes a systematic mapping study and literature review of 74 peer-reviewed articles on energy efficient technologies for virtualized cloud data centers. The study aims to evaluate approaches that optimize power consumption in virtualized data centers. A characterization framework was proposed to classify the studies based on generic attributes, contribution type and evaluation method, technological attributes, and quality management. The results showed that virtualization, consolidation, and workload scheduling are widely used techniques. Around 60% of studies contributed solutions and validation methods through experiments or theoretical models. Dynamic voltage and frequency scaling-enabled scheduling and dynamic server consolidation were identified as important methods for saving energy. The study also identified a need for standardized benchmarking to help research progress and bridge industry-academia gaps
Dr. Fariba Fahroo presents an overview of her program, Computational Mathematics, at the AFOSR 2013 Spring Review. At this review, Program Officers from AFOSR Technical Divisions will present briefings that highlight basic research programs beneficial to the Air Force.
e-Research & the art of linking Astrophysics to DeforestationDavid Wallom
Keynote at HPCS 2016 on e-Research, talking about the e-Research methodology linking work on Astrophysics with finally Deforestation via Smartening Energy Systems and Detecting Energy Theft
Residual Energy Based Cluster head Selection in WSNs for IoT ApplicationIRJET Journal
This document proposes a new cluster head selection method for wireless sensor networks using a modified firefly algorithm called synchronous firefly algorithm. The goal is to improve energy efficiency and network lifetime compared to existing methods like LEACH. It discusses how cluster-based approaches help organize wireless sensor networks for efficient data aggregation and transmission. However, existing methods don't optimally select cluster heads, resulting in uneven energy drain. The proposed method uses a firefly algorithm inspired by fireflies' flashing behavior to select high-energy nodes as cluster heads in a way that prevents local optima and achieves faster convergence. Simulation results show the new method outperforms LEACH and other existing hierarchical clustering algorithms.
Show and Tell - Data and Digitalisation, Digital Twins.pdfSIFOfgem
The document summarizes several projects presented at a webinar on the Strategic Innovation Fund's "Data & Digitalisation" challenge.
- The EN-twin-e project aims to develop a digital twin of the electricity distribution network to provide greater visibility of distributed energy resources. This will help the ESO make more effective balancing decisions.
- The Digi-GIFT project seeks to build an integrated cybersecurity system and shared data infrastructure. This will help manage data quality, integrity and security while supporting applications like digital twins.
- Cost-benefit analyses were conducted for a shared data infrastructure, an integrated cyber intrusion defense system, and quantifying flexibility services. The analyses found savings from data sharing and
IRJET- A Statistical Approach Towards Energy Saving in Cloud ComputingIRJET Journal
This document proposes a statistical approach to save energy in cloud computing through predictive monitoring and optimization techniques. It discusses using Gaussian process regression to predict infrastructure workload and then applying convex optimization to determine the optimal subset of physical machines needed. Virtual machines would be migrated to this subset and idle physical machines could then be powered off to reduce energy consumption while maintaining system performance. An evaluation using 29 days of Google trace data showed the potential for significant power savings without affecting quality of service.
An Approach to Reduce Energy Consumption in Cloud data centers using Harmony ...neirew J
Fast development of knowledge and communication has established a new computational style which is
known as cloud computing. One of the main issues considered by the cloud infrastructure providers, is to
minimize the costs and maximize the profitability. Energy management in the cloud data centers is very
important to achieve such goal. Energy consumption can be reduced either by releasing idle nodes or by
reducing the virtual machines migrations. To do the latter, one of the challenges is to select the placement
approach of the migrated virtual machines on the appropriate node. In this paper, an approach to reduce
the energy consumption in cloud data centers is proposed. This approach adapts harmony search
algorithm to migrate the virtual machines. It performs the placement by sorting the nodes and virtual
machines based on their priority in descending order. The priority is calculated based on the workload.
The proposed approach is simulated. The evaluation results show the reduction in the virtual machine
migrations, the increase of efficiency and the reduction of energy consumption.
Preparing for Zero Net Energy BuildingsEnercare Inc.
Enercare’s 3rd annual Thought Leadership event series, Energy Management: What’s New and What’s Next, explores energy conservation opportunities, the latest technologies and regulations shaping the multi-residential and commercial building management space.
Commissioned by the Continental Automated Buildings Association (CABA), the Zero Net Energy Buildings research project examined strategies and technologies applied in large commercial and multi-unit buildings, to identify zero net energy (ZNE) best practices. Building automation systems and energy information systems in ZNE buildings were characterized and building occupants and owners were surveyed on the functionality and utilization of these systems. The results of this research can be used to value the system in relation to a ZNE outcome.
Presented by: Greg Walker, Research Director, Continental Automated Buildings Association (CABA)
In this deck from the HPC User Forum at Argonne, Doug Kothe from the Exascale Computing Project presents an ECP update.
"The Exascale Computing Project (ECP) is focused on accelerating the delivery of a capable exascale computing ecosystem that delivers 50 times more computational science and data analytic application power than possible with DOE HPC systems such as Titan (ORNL) and Sequoia (LLNL). With the goal to launch a US exascale ecosystem by 2021, the ECP will have profound effects on the American people and the world."
Watch the video: https://wp.me/p3RLHQ-kPG
Learn more: https://exascaleproject.org
and
http://hpcuserforum.com
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
The document proposes techniques to build green broadband access networks called Wireless-Optical Broadband Access Networks (WOBAN) that reduce energy consumption. It develops energy-aware design techniques and routing protocols for WOBAN. A Mixed Integer Linear Program model is used to analyze the impact of energy-aware design on WOBAN's performance. Results show large potential power savings from incorporating energy-aware design and routing in access networks.
Call for Papers- Special Issue: Recent Trends, Innovations and Sustainable So...Christo Ananth
Energy Systems Modelling is growing in relevance on providing insights and strategies to plan a carbon-neutral future. The implementation of an effective energy transition plan faces multiple challenges, spanning from the integration of the operations of different energy carriers and sectors to the consideration of multiple spatial and temporal resolutions. Demand-side management has to be applied to multi-carrier energy system models lacks; prosumers is explored only in a limited manner; In General, multi-scale modelling frameworks should be established and considered both in the dimensions of time, space, technology and energy carrier; long term energy system models tend to address uncertainty scarcely; there is a lack of studies modelling uncertainties related to emerging technologies and; modelling of energy consumer behaviour is one of the major aspect of future research. The increased pressure in decarbonizing the energy system has renewed the interest in energy system modelling, with several reviews trying to convey a comprehensive description of the utilized methodologies as well as providing new insights on how they can be used to answer new questions
Call for Papers- Special Issue: Recent Trends, Innovations and Sustainable So...Christo Ananth
Christo Ananth, Special Issue on Recent Trends, “Innovations and Sustainable Solutions for Next Gen Renewable Energy Systems”, International Journal of Electrical and Electronic Engineering & Telecommunications, ISSN: 2319-2518 (Online), indexed in Scopus
Dr Callum Rae - A New Approach to Energy Centre Design
http://www.ktpscotland.org.uk/ViewArticle/tabid/4421/articleType/ArticleView/articleId/10338/Callum-Rae--Hurley-Palmer-Flatt.aspx
The Exascale Computing Project (ECP) aims to develop capable exascale computing systems, applications, and software to address national priorities. The ECP draws expertise from six national laboratories and addresses four key challenges of exascale computing related to parallelism, memory and storage, reliability, and energy consumption. It utilizes a holistic co-design approach across applications, software, hardware, and workforce development over its seven-year timeline.
The document discusses the history and current state of software engineering and its application to IoT systems. It notes that 50 years after the earliest software projects, issues still include cost overruns, property damage, risks to life and death, and challenges ensuring quality. For IoT, fragmentation across hardware, software, APIs and standards poses significant problems. The document proposes that research into IoT software engineering could help address these issues through approaches like developing software to run across diverse IoT platforms, and automatically miniaturizing software through techniques like multi-objective optimization to suit different IoT device capabilities.
1) Issue trackers are often used to track more than just bugs, including features, enhancements, and refactoring work.
2) A manual analysis found that nearly half of issues labeled as "bugs" in issue trackers were actually not bugs.
3) Relying on issue tracker labels alone can introduce significant errors into datasets used for tasks like bug prediction and severity estimation. More work is needed to clean noisy and unreliable data.
The document discusses how to derive dependency structures for legacy J2EE applications. It proposes analyzing all application tiers together using a language-independent model and parsing various artifacts. Configuration files and limited data flow analysis are used to understand dependencies. Container dependencies are explicitly codified by studying technology specifications and codifying dependency rules to apply when certain code patterns are detected in applications. This allows completing an application's dependency graph.
The document discusses the state of practices of service identification in the industry for migrating legacy systems to service-oriented architectures (SOA). It finds that while service identification is seen as important, it remains primarily a manual process focused on identifying coarse-grained business services from source code and business processes. Wrapping and clustering functionalities are common techniques. Fully automating service identification is still challenging due to the need to understand complex legacy system dependencies. The document recommends service identification be business-driven and follow proven methodologies.
This document discusses techniques for testing advanced driver assistance systems (ADAS) through physics-based simulation. It faces challenges due to the large, complex, and multidimensional test input space as well as the computational expense of simulation. The document proposes using a genetic algorithm guided by decision trees to more efficiently search for critical test cases. Classification trees are built to partition the input space into homogeneous regions in order to better guide the selection and generation of test inputs toward more critical areas.
The document reports on the findings of a survey of 45 industrial practitioners on their experiences with legacy-to-SOA migrations. The key findings include: 1) Practitioners migrate legacy systems implemented in Cobol and Java to reduce maintenance costs and improve flexibility/interoperability; 2) Identifying services is an important step but is mostly manual and business-driven; 3) The most used techniques are functionality clustering and wrapping; 4) Desired service qualities are reusability, granularity and loose coupling; 5) Identified services prioritize domain-specific over technical services; 6) RESTful services are most targeted technology.
The document investigates the impact of linguistic anti-patterns (LAs) on program comprehension. It defines LAs as bad naming, documentation, and implementation practices. A study was conducted involving 92 students assessing programs with and without LAs. The study found that LAs negatively impact understandability by increasing time and reducing correctness. Certain LAs like A2, B4, and D1 had a stronger negative effect than others like E1. The study also found that providing knowledge about LAs can help mitigate their impact by making programs easier and faster to comprehend.
The document discusses research on identifying and analyzing the impact of patterns on the quality of multi-language systems. The objectives are to collect and categorize sets of programming languages used together, detect patterns in multi-language programs to track bugs and provide best practices, and study how patterns impact quality. The contributions will be a catalog of multi-language patterns and defects, a detection tool, and analysis of patterns' effects on quality attributes. Current work includes reviewing literature on language combinations and patterns to provide recommendations for high-quality multi-language development.
This document discusses research on change impact analysis in multi-language systems. It begins by outlining recommendations for best practices when using JNI, such as passing primitive types, minimizing calls between native and Java code, and properly handling strings. It then describes a qualitative analysis of JNI usage that identified common practices and issues. Finally, it proposes future work to survey developers on applying recommendations to facilitate change impact analysis in multi-language systems.
The document summarizes a recommendation system that suggests software processes for video game projects based on similarities to past projects. The system analyzes over 100 postmortems from previous games to build a database of development processes and project contexts. It uses principal component analysis to identify similar past projects and recommends a process by combining elements from similar projects' processes. The system was evaluated both quantitatively based on correctness and coverage metrics and qualitatively through surveys and a case study with a developer team.
Will io t trigger the next software crisisPtidej Team
This document discusses how the rise of the Internet of Things (IoT) could trigger a new software crisis due to issues like fragmentation, complexity, and lack of standards. It provides a brief history of software engineering challenges over the past 50 years such as cost overruns, safety issues, and prioritizing productivity over quality. The document then examines how these same problems are emerging in the IoT context today. It argues that IoT software engineering practices need to address issues like device software, cloud/app development, and privacy in order to avoid a major crisis.
This document discusses theories related to software design patterns. It notes that while design patterns are commonly used, there is a need for more research on how they impact software quality. The document proposes several areas for developing theories, including systematically categorizing existing patterns based on underlying principles, combining principles to identify new patterns, and developing theories of patterns from developer behavior and for building software systems. Formalizing patterns and identifying their relationships could help teaching and understanding of patterns.
Laleh M. Eshkevari defended her Ph.D dissertation on developing techniques for the automatic detection and classification of identifier renamings in software projects. Her dissertation outlined a taxonomy of renamings, described approaches for renaming detection based on line mapping, entity mapping and data flow analysis, and discussed methods for classifying renamings based on their form and semantic changes. Evaluation of the approaches on several open source projects showed high precision and recall for renaming detection and identified trends in how renamings are used in practice.
1) The document analyzes the co-occurrence of code smells like anti-patterns and clones in software systems and their impact on fault-proneness.
2) It finds that over 50% of classes with anti-patterns also have clones, and 59-78% of classes with clones also participate in anti-patterns.
3) Classes with both anti-patterns and clones are significantly more fault-prone than other classes, with the risk of faults being at least 7 times higher in one system studied.
Trustrace is an approach that uses software repository links like SVN commits to improve the trust in automatically recovered traceability links between requirements and code. It calculates an initial trust value for links based on IR techniques like VSM, and then reweights the links based on additional information from the software repository. An evaluation on two case studies found Trustrace improved precision over VSM alone and showed no significant difference in recall, supporting the hypothesis that Trustrace can improve link recovery accuracy over IR-only approaches.
The document presents a taxonomy called ProMeTA for classifying program metamodels used in program reverse engineering. ProMeTA defines characteristics such as target language, abstraction level, meta-language, and more to classify popular metamodels like AST, KDM, FAMIX. The taxonomy aims to provide a comprehensive guide for researchers and practitioners to select, design, and communicate metamodels. The paper also analyzes existing metamodels according to the ProMeTA taxonomy and identifies gaps to guide future metamodel development.
This document describes a controlled, multiple case study of software evolution and defects from industrial projects. It details the data sources used, including source code repositories, issue tracking databases, and interviews. Metrics such as code smells, size, effort, and defects were collected. Programming skills of developers were also measured. Code smell detection tools and custom scripts to analyze code changes were used to extract metrics on a variety of code issues and evolution over time. The data is available online for further analysis.
The document describes a study on detecting linguistic (anti)patterns in RESTful APIs. It presents an approach called DOLAR (Detection Of Linguistic Antipatterns in REST) that analyzes REST API URIs and detects antipatterns using heuristics-based algorithms. Experiments were conducted on 309 methods from 15 public REST APIs to test DOLAR's accuracy, the extensibility of the underlying SOFA framework, and the performance of detection algorithms. The results showed that 42% of methods exhibited contextualized resource names (a pattern) while 14% had contextless resource names (an antipattern), with detection taking under a second on average.
Microservice Teams - How the cloud changes the way we workSven Peters
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
When it is all about ERP solutions, companies typically meet their needs with common ERP solutions like SAP, Oracle, and Microsoft Dynamics. These big players have demonstrated that ERP systems can be either simple or highly comprehensive. This remains true today, but there are new factors to consider, including a promising new contender in the market that’s Odoo. This blog compares Odoo ERP with traditional ERP systems and explains why many companies now see Odoo ERP as the best choice.
What are ERP Systems?
An ERP, or Enterprise Resource Planning, system provides your company with valuable information to help you make better decisions and boost your ROI. You should choose an ERP system based on your company’s specific needs. For instance, if you run a manufacturing or retail business, you will need an ERP system that efficiently manages inventory. A consulting firm, on the other hand, would benefit from an ERP system that enhances daily operations. Similarly, eCommerce stores would select an ERP system tailored to their needs.
Because different businesses have different requirements, ERP system functionalities can vary. Among the various ERP systems available, Odoo ERP is considered one of the best in the ERp market with more than 12 million global users today.
Odoo is an open-source ERP system initially designed for small to medium-sized businesses but now suitable for a wide range of companies. Odoo offers a scalable and configurable point-of-sale management solution and allows you to create customised modules for specific industries. Odoo is gaining more popularity because it is built in a way that allows easy customisation, has a user-friendly interface, and is affordable. Here, you will cover the main differences and get to know why Odoo is gaining attention despite the many other ERP systems available in the market.
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Using Query Store in Azure PostgreSQL to Understand Query PerformanceGrant Fritchey
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Łukasz Chruściel
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
UI5con 2024 - Bring Your Own Design SystemPeter Muessig
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
Atelier - Innover avec l’IA Générative et les graphes de connaissancesNeo4j
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement.
Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdfVALiNTRY360
Salesforce Healthcare CRM, implemented by VALiNTRY360, revolutionizes patient management by enhancing patient engagement, streamlining administrative processes, and improving care coordination. Its advanced analytics, robust security, and seamless integration with telehealth services ensure that healthcare providers can deliver personalized, efficient, and secure patient care. By automating routine tasks and providing actionable insights, Salesforce Healthcare CRM enables healthcare providers to focus on delivering high-quality care, leading to better patient outcomes and higher satisfaction. VALiNTRY360's expertise ensures a tailored solution that meets the unique needs of any healthcare practice, from small clinics to large hospital systems.
For more info visit us https://valintry360.com/solutions/health-life-sciences
Transform Your Communication with Cloud-Based IVR SolutionsTheSMSPoint
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
SOCRadar's Aviation Industry Q1 Incident Report is out now!
The aviation industry has always been a prime target for cybercriminals due to its critical infrastructure and high stakes. In the first quarter of 2024, the sector faced an alarming surge in cybersecurity threats, revealing its vulnerabilities and the relentless sophistication of cyber attackers.
SOCRadar’s Aviation Industry, Quarterly Incident Report, provides an in-depth analysis of these threats, detected and examined through our extensive monitoring of hacker forums, Telegram channels, and dark web platforms.
E-commerce Development Services- Hornet DynamicsHornet Dynamics
For any business hoping to succeed in the digital age, having a strong online presence is crucial. We offer Ecommerce Development Services that are customized according to your business requirements and client preferences, enabling you to create a dynamic, safe, and user-friendly online store.
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
1. Understanding the Impact of Databases on the
Energy Efficiency of Cloud Applications
Defense for obtaining the master’s degree in applied
sciences
B´echir Bani
´Ecole Polytechnique de Montr´eal
Ptidej Team / SWAT Lab
2. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Table of contents
1 Introduction
2 Literature Review
3 Methodology
4 Results
5 Conclusion
The Impact of Databases on the Energy Efficiency – B´echir Bani 2/53 – www.polymtl.ca
3. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Motivations
The Impact of Databases on the Energy Efficiency – B´echir Bani 3/53 – www.polymtl.ca
4. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Motivations
The Impact of Databases on the Energy Efficiency – B´echir Bani 4/53 – www.polymtl.ca
5. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Motivations
• Little is still known about the energy footprint of these
applications and, in particular, of their databases
• Databases are the backbone of cloud-based applications
The Impact of Databases on the Energy Efficiency – B´echir Bani 5/53 – www.polymtl.ca
6. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Motivations
Cloud Application = Databases + Cloud Patterns
The Impact of Databases on the Energy Efficiency – B´echir Bani 6/53 – www.polymtl.ca
7. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Motivations
• None of previous works investigated the combined impact of
databases and cloud patterns on the energy consumption of
cloud-based applications
• The benefits and trade-offs of different databases and
combinations of cloud patterns are mostly intuitive and not
validated
The Impact of Databases on the Energy Efficiency – B´echir Bani 7/53 – www.polymtl.ca
8. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Objectives
1 Propose an approach to collect energy measures of
cloud-based applications implemented with cloud patterns in
conjunction with databases in a cloud environment
2 Evaluate the impact on energy consumption of three cloud
patterns: Local Database Proxy, Local Sharding-Based
Router, and Priority Message Queue, individually, and also
their combination, with three databases: MySQL,
PostgreSQL, and MongoDB
3 Highlight the contrast response time with energy efficiency of
databases so that developers are aware of the trade-offs
between these two quality indicators when selecting a
database for their application
The Impact of Databases on the Energy Efficiency – B´echir Bani 8/53 – www.polymtl.ca
9. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Relevant Literature Review
1 Energy Consumption and Applications Design
2 Performance of Relational and NoSQL Databases
3 Impact of Cloud Patterns on Applications Performance
The Impact of Databases on the Energy Efficiency – B´echir Bani 9/53 – www.polymtl.ca
10. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Relevant Literature Review
1 Energy Consumption and Applications Design
2 Performance of Relational and NoSQL Databases
3 Impact of Cloud Patterns on Applications Performance
The Impact of Databases on the Energy Efficiency – B´echir Bani 9/53 – www.polymtl.ca
11. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Energy Consumption and Applications Design
1 How Green Are Cloud Patterns? (Abtahizadeh et al.)
• Compared the energy efficiency of three cloud patterns
• Showed that cloud patterns can effectively reduce the energy
consumption of a cloud application
• Only considered MySQL database and a RESTful application
2 Investigating the impacts of web servers on web
application energy usage (Manotas et al.)
• Investigated the impact of four Web servers on the energy
consumption of a Web application
• Showed that the energy consumption of a Web application
depends on the Web server used to handle requests
The Impact of Databases on the Energy Efficiency – B´echir Bani 10/53 – www.polymtl.ca
12. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Energy Consumption and Applications Design
1 Initial explorations on design pattern energy usage
(Sahin et al.)
• Investigated the energy efficiency of design patterns
• Showed that design patterns have a significant impact on
energy consumption
2 How do code refactorings affect energy usage? (Sahin et
al.)
• Showed that code refactorings affect the energy consumption
of applications
The Impact of Databases on the Energy Efficiency – B´echir Bani 11/53 – www.polymtl.ca
13. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Relevant Literature Review
1 Energy Consumption and Applications Design
2 Performance of Relational and NoSQL Databases
3 Impact of Cloud Patterns on Applications Performance
The Impact of Databases on the Energy Efficiency – B´echir Bani 12/53 – www.polymtl.ca
14. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Performance of Relational and NoSQL Databases
1 Comparison of NoSQL and SQL Databases in the Cloud
(Hammes et al.)
• Highlighted the performance of both PostgreSQL database and
MongoDB database
• Observed that PostgreSQL databases perform better than
MongoDB databases in cloud environments
2 A comprehensive comparison of SQL and MongoDB
Databases (Aghi et al.)
• Highlighted the performance of MySQL and MongoDB
Databases
• Showed that MongoDB database performs better than MySQL
for complex queries
• Showed that MySQL databases perform better than MongoDB
databases for small datasets
The Impact of Databases on the Energy Efficiency – B´echir Bani 13/53 – www.polymtl.ca
15. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Relevant Literature Review
1 Energy Consumption and Applications Design
2 Performance of Relational and NoSQL Databases
3 Impact of Cloud Patterns on Applications Performance
The Impact of Databases on the Energy Efficiency – B´echir Bani 14/53 – www.polymtl.ca
16. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Impact of Cloud Patterns on Applications Performance
1 An empirical Study of the impact of cloud patterns on
Quality of Service (QoS) (Hecht et al.)
• Studied the impact of three cloud patterns on QoS
• Reported that the implementation of the Local Database
Proxy pattern can significantly impact the QoS
2 Scalability patterns for platform-as-a-service (Ardagna et
al.)
• Evaluated the impact of five scalability patterns on the
performance of a Platform as a Service (PaaS)
• Showed that each pattern can affect the way virtual machine
resources are added and removed
The Impact of Databases on the Energy Efficiency – B´echir Bani 15/53 – www.polymtl.ca
17. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects and Design
3 Research variables
• Independent Variables
• Dependent Variables
4 Data Extraction Process
5 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 16/53 – www.polymtl.ca
18. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects and Design
3 Research variables
• Independent Variables
• Dependent Variables
4 Data Extraction Process
5 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 16/53 – www.polymtl.ca
19. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Research Questions and Hypothesis
RQ1: Does the choice of MySQL, PostgreSQL, and
MongoDB databases affect the energy consumption of cloud
applications (when no cloud patterns are implemented)?
• H1
0yz: There is no difference between the average amount of
energy consumed by applications implementing databases Dy
and Dz (without any cloud pattern)
• H2
0yz: There is no difference between the average response
time of databases Dy and Dz (without any cloud pattern)
The Impact of Databases on the Energy Efficiency – B´echir Bani 17/53 – www.polymtl.ca
20. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Research Questions and Hypothesis
RQ2: Does the implementation of Local Database Proxy,
Local Sharding Based Router, and Priority Message Queue
patterns affect the energy consumption of cloud applications
using MySQL, PostgreSQL, and MongoDB Databases?
• H1
xyz: There is no difference between the average amount of
energy consumed by applications implementing databases Dy
and Dz in conjunction with patterns Px
• H2
xyz: There is no difference between the average response
time of databases Dy and Dz by applying the design Px
The Impact of Databases on the Energy Efficiency – B´echir Bani 18/53 – www.polymtl.ca
21. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Research Questions and Hypothesis
RQ3: Do the interactions between Local Database Proxy,
Local Sharding Based Router, and Priority Message Queue
patterns affect the energy consumption of cloud applications
using MySQL, PostgreSQL, and MongoDB databases?
• H1
xyz7: There is no difference between the average amount of
energy consumed by applications implementing databases Dy
and Dz in conjunction with the combination of patterns Px
and P7
• H2
xyz7: There is no difference between the average response
time of databases Dy and Dz by applying the combination of
designs Px and P7
The Impact of Databases on the Energy Efficiency – B´echir Bani 19/53 – www.polymtl.ca
22. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects and Design
3 Research variables
• Independent Variables
• Dependent Variables
4 Data Extraction Process
5 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 20/53 – www.polymtl.ca
23. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Objects and Design
RESTful multi-threaded application
• Communicates through REST calls
• Use Sakila sample database (provided by MySQL)
• Adapt the schema of Sakila sample database to PostgreSQL
and MongoDB databases
• Implemented with different patterns and strategies
• Clients are simulated using a multi-threaded architecture (100;
250; 500; 1,000; 1,500)
The Impact of Databases on the Energy Efficiency – B´echir Bani 21/53 – www.polymtl.ca
24. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Objects and Design
DVD Store application
• Standard cloud-based application
• Open source simulation of an e-commerce web site
• We refactor the code of DVD Store to allow it to connect to a
MongoDB database
• Clients are simulated using a multi-threaded architecture (100,
250; 500; 1,000; 1,500)
The Impact of Databases on the Energy Efficiency – B´echir Bani 22/53 – www.polymtl.ca
25. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Objects and Design
JPetStore application
• Standard cloud-based application
• Open source simulation of an e-commerce web application
• We refactor the code of JPetStore to allow it to connect to a
PostgreSQL and MongoDB databases
• Clients are simulated using a multi-threaded architecture (100;
250; 500; 1,000; 1,500)
The Impact of Databases on the Energy Efficiency – B´echir Bani 23/53 – www.polymtl.ca
26. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Objects and Design
Power-API
• Provides power information (in watts converted to joules to
measure the energy) per PID for each system component
(CPU, memory, etc.)
• Uses sensors and analytical models for its energy estimation
• Allows to estimate the amount of power required by the CPU
to execute a process (at the corresponding PID)
• Does not introduce noise in its measurements
The Impact of Databases on the Energy Efficiency – B´echir Bani 24/53 – www.polymtl.ca
27. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects and Design
3 Research variables
• Independent Variables
• Dependent Variables
4 Data Extraction Process
5 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 25/53 – www.polymtl.ca
28. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Research Variables
1 Independent Variables
• Databases: MySQL, PostgreSQL, MongoDB
• Cloud Patterns: Local Database Proxy, Local Sharding-Based
Router, Priority Message Queue
2 Dependent Variables
• Response Time: Corresponding to Select and Insert requests
(milliseconds)
• Energy Consumption: Using Power-API profiler (Joules)
The Impact of Databases on the Energy Efficiency – B´echir Bani 26/53 – www.polymtl.ca
29. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects
3 Design
4 Research variables
• Independent Variables
• Dependent Variables
5 Data Extraction Process
6 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 27/53 – www.polymtl.ca
30. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Data Extraction Process
Energy Consumption Data Extraction Process
The Impact of Databases on the Energy Efficiency – B´echir Bani 28/53 – www.polymtl.ca
31. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Data Extraction Process
Energy Data Collection Procedure
1: CollectData(VMs, CloudApp, Profiler)
2: Begin
3: StartCloudApp()
4: ExecuteCloudApp(x) // Seconds
5: for all VM ∈ VMs do
6: StartProfiler()
7: ExecuteProfiler(x) // Seconds
8: FinishExecProfiler()
9: end for
10: FinishExecCloudApp()
11: End
The Impact of Databases on the Energy Efficiency – B´echir Bani 29/53 – www.polymtl.ca
32. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Methodology
1 Research Questions and Hypothesis
2 Objects
3 Design
4 Research variables
• Independent Variables
• Dependent Variables
5 Data Extraction Process
6 Analysis Method
The Impact of Databases on the Energy Efficiency – B´echir Bani 30/53 – www.polymtl.ca
33. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Analysis Method
• Mann-Whitney U test
• A non-parametric statistical test whose relevance is reflected in
the assessment of two independent distributions
• The null hypothesis is rejected (there is a significant difference
between the the two distributions) when its p-value < 0.05
• Cliff’s δ effect size
• Represents the degree of interlock between two sample
distributions
• Its value ranges from -1 to +1: negligeable (δ < 0.147),
small (0.147< δ <0.33), medium (0.33< δ <0.474) and
large (δ > 0.474)
The Impact of Databases on the Energy Efficiency – B´echir Bani 31/53 – www.polymtl.ca
34. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
RQ1:
Does the choice of MySQL, PostgreSQL, and
MongoDB databases affect the energy consumption
of cloud applications (when no cloud patterns are
implemented)?
The Impact of Databases on the Energy Efficiency – B´echir Bani 32/53 – www.polymtl.ca
35. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Without Cloud Patterns
100 250 500 1000 1500
0
500
1,000
1,500
2,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(a) RESTful (Energy)
100 250 500 1000 1500
0
500
1,000
1,500
2,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(b) DVDStore (Energy)
100 250 500 1000 1500
0
500
1,000
1,500
2,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(c) JPetStore (Energy)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(d) RESTful (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(e) DVDStore (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of ClientsAverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(f) JPetStore (Time)
The Impact of Databases on the Energy Efficiency – B´echir Bani 33/53 – www.polymtl.ca
36. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Without Cloud Patterns
Energy Consumption p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P0 262.5 568.2 0.01 medium 262.5 354.7 0.24 small 568.2 354.7 0.09 small
Response Time p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P0 36018.6 28615.7 0.09 small 36018.6 4253.8 < 10e−6 large 28615.7 4253.8 < 10e−6 large
The Impact of Databases on the Energy Efficiency – B´echir Bani 34/53 – www.polymtl.ca
37. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
RQ2:
Does the implementation of Local Database Proxy,
Local Sharding Based Router, and Priority Message
Queue patterns affect the energy consumption of
cloud applications using MySQL, PostgreSQL, and
MongoDB Databases?
The Impact of Databases on the Energy Efficiency – B´echir Bani 35/53 – www.polymtl.ca
38. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Local Database Proxy Pattern
Energy Consumption p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P1 490.2 1391.1 < 10e−6 large 490.2 890.0 < 10e−6 large 1391.1 890.0 0.09 small
P2 495.2 1529.9 < 10e−6 large 495.2 915.9 < 10e−6 large 1529.9 915.9 0.04 medium
P3 495.0 1476.5 < 10e−6 large 495.0 904.5 < 10e−6 large 1476.5 904.5 0.04 medium
Response Time p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P1 30430.0 27867.8 0.23 small 30430.0 3639.8 < 10e−6 large 27867.8 3639.8 < 10e−6 large
P2 29504.1 27036.5 0.23 small 29504.1 3214.2 < 10e−6 large 27036.5 3214.2 < 10e−6 large
P3 29825.2 26129.6 0.23 small 29825.2 3275.0 < 10e−6 large 26129.6 3275.0 < 10e−6 large
The Impact of Databases on the Energy Efficiency – B´echir Bani 36/53 – www.polymtl.ca
39. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Local Sharding-Based Router
Energy Consumption p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P4 1331.9 6330.2 < 10e−6 large 1331.9 5826.4 < 10e−6 large 6330.2 5826.4 0.23 small
P5 611.6 4245.1 < 10e−6 large 611.6 3821.8 < 10e−6 large 4245.1 3821.8 0.23 small
P6 824.1 4929.4 < 10e−6 large 824.1 4194.4 < 10e−6 large 4929.4 4194.4 0.23 small
Response Time p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P4 170693.1 138026.6 0.09 small 170693.1 26259.5 < 10e−6 large 138026.6 26259.5 < 10e−6 large
P5 165250.7 145382.6 0.09 small 165250.7 27897.8 < 10e−6 large 145382.6 27897.8 < 10e−6 large
P6 168786.5 130585.0 0.09 small 168786.5 24680.3 < 10e−6 large 130585.0 24680.3 < 10e−6 large
The Impact of Databases on the Energy Efficiency – B´echir Bani 37/53 – www.polymtl.ca
40. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
RQ3:
Do the interactions between Local Database Proxy,
Local Sharding Based Router, and Priority Message
Queue patterns affect the energy consumption of
cloud applications using MySQL, PostgreSQL, and
MongoDB databases?
The Impact of Databases on the Energy Efficiency – B´echir Bani 38/53 – www.polymtl.ca
41. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Combination Proxy Pattern and Message Queue Pattern
Energy Consumption p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P1+P7 442.7 1379.8 < 10e−6 large 442.7 814.3 < 10e−6 large 1379.8 814.3 0.03 medium
P2+P7 468.8 1482.5 < 10e−6 large 468.8 891.9 < 10e−6 large 1482.5 891.9 0.03 medium
P3+P7 490.2 1391.1 < 10e−6 large 490.2 890.0 < 10e−6 large 1391.1 890.0 0.09 small
Response Time p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P1+P7 27826.2 22299.8 0.48 negligible 27826.2 3747.1 < 10e−6 large 22299.8 3747.1 < 10e−6 large
P2+P7 26703.4 25706.8 0.48 negligible 26703.4 3127.5 < 10e−6 large 25706.8 3127.5 < 10e−6 large
P3+P7 29339.7 23153.6 0.23 small 29339.7 4210.2 < 10e−6 large 23153.6 4210.2 < 10e−6 large
The Impact of Databases on the Energy Efficiency – B´echir Bani 39/53 – www.polymtl.ca
42. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Combination Sharding and Message Queue Patterns
Energy Consumption p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P4+P7 1255.5 5777.4 < 10e−6 large 1255.5 5622.9 < 10e−6 large 5777.4 5622.9 0.82 negligible
P5+P7 492.2 3884.5 < 10e−6 large 492.2 3386.6 < 10e−6 large 3884.5 3386.6 0.23 small
P6+P7 775.9 4526.8 < 10e−6 large 775.9 4127.4 < 10e−6 large 4526.8 4127.4 0.23 small
Response Time p-value and Cliff’s δ
Pattern MySQL PostgreSQL p-value Cliff’s δ MySQL MongoDB p-value Cliff’s δ PostgreSQL MongoDB p-value Cliff’s δ
P4+P7 37584.7 29287.7 0.23 small 37584.7 2716.3 < 10e−6 large 29287.7 2716.3 < 10e−6 large
P5+P7 38153.7 26445.6 0.09 small 38153.7 2869.7 < 10e−6 large 26445.6 2869.7 < 10e−6 large
P6+P7 34183.0 27507.3 0.23 small 34183.0 20609.3 0.03 medium 27507.3 20609.3 0.09 small
The Impact of Databases on the Energy Efficiency – B´echir Bani 40/53 – www.polymtl.ca
43. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Important Results
• MySQL database is the least energy consuming but is the
slowest among the three databases
• PostgreSQL database is the most energy consuming among
the three databases, but is faster than MySQL but slower
than MongoDB
• MongoDB database consumes more energy than MySQL
but less than PostgreSQL and is the fastest among the three
databases
The Impact of Databases on the Energy Efficiency – B´echir Bani 41/53 – www.polymtl.ca
44. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Discussions
• PostgreSQL database generates multiple parallel processes to
run the requests sent by the RESTful cloud-based application
• MySQL and MongoDB generate only one process at a time to
handle requests sent by the cloud-based application
The Impact of Databases on the Energy Efficiency – B´echir Bani 42/53 – www.polymtl.ca
45. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Discussions
• MySQL and PostgreSQL follow the ACID model
• MongoDB database follow the BASE model
⇒ MongoDB is faster than the other two relational
databases
⇒ requests processed by relational databases must be
executed one by one and cannot be executed in a
Simultaneous way
The Impact of Databases on the Energy Efficiency – B´echir Bani 43/53 – www.polymtl.ca
46. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Summary
• We carried on a series of experiments on different versions of
three cloud applications
• We contrasted the performance of various combinations of
databases and cloud patterns in terms of energy consumption
and response time of the cloud-based applications
• Databases can reduce the energy consumption of cloud-based
applications
• Cloud patterns do not impact the behavior of the databases
The Impact of Databases on the Energy Efficiency – B´echir Bani 44/53 – www.polymtl.ca
47. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Limitations of the proposed approach
• Energy measurements are subject to perturbations depending
of hardware and network
• More studies should be conducted with possibly more accurate
tools to verify our findings
• Our findings may still be specific to our studied applications,
which were designed specifically for the experiments: future
works should replicate this study on other cloud-based
applications
The Impact of Databases on the Energy Efficiency – B´echir Bani 45/53 – www.polymtl.ca
48. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Future work
• Expand our study to different NoSQL databases like HBase,
Cassandra and HANA
• Investigate the energy impact of data modeling strategies like
denormalization and data duplication
• Examine how a match/mismatch between the selected
database and the workload characteristic affects energy
efficiency
The Impact of Databases on the Energy Efficiency – B´echir Bani 46/53 – www.polymtl.ca
49. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Publication
Earlier study in the thesis is published as follows:
• A Study of the Energy Consumption of Databases and Cloud
Patterns
B´echir Bani, Foutse Khomh and Yann-Ga¨el Gu´eh´eneuc, in
Proceedings of the 14th International Conference On Service
Oriented Computing (ICSOC), Banff, Alberta, Canada, 10-13
October, 2016.
My contribution: Methodology, analysis and paper writing.
The Impact of Databases on the Energy Efficiency – B´echir Bani 47/53 – www.polymtl.ca
50. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
• We carried on a series of experiments on different versions of
three cloud applications
• We contrasted the performance of various combinations of
databases and cloud patterns in terms of energy consumption
and response time of the cloud-based applications
• Databases can reduce the energy consumption of cloud-based
applications
• Cloud patterns do not impact the behavior of the databases
The Impact of Databases on the Energy Efficiency – B´echir Bani 48/53 – www.polymtl.ca
51. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
The Impact of Databases on the Energy Efficiency – B´echir Bani 49/53 – www.polymtl.ca
52. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Local Database Proxy Pattern
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(a) Random (Energy)
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of ClientsCPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(b) R-R (Energy)
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(c) Custom (Energy)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(d) Random (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(e) R-R (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(f) Custom (Time)
The Impact of Databases on the Energy Efficiency – B´echir Bani 50/53 – www.polymtl.ca
53. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Local Sharding-Based Router Pattern
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(a) Modulo (Energy)
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of ClientsCPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(b) LookUp (Energy)
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(c) Consistent (Energy)
100 250 500 1000 1500
0
1
2
3
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(d) Modulo (Time)
100 250 500 1000 1500
0
1
2
3
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(e) LookUp (Time)
100 250 500 1000 1500
0
1
2
3
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(f) Consistent (Time)
The Impact of Databases on the Energy Efficiency – B´echir Bani 51/53 – www.polymtl.ca
54. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Combination Proxy Pattern and Message Queue Pattern
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(a) Random* (Energy)
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of ClientsCPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(b) R-R* (Energy)
100 250 500 1000 1500
0
1,000
2,000
3,000
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(c) Custom* (Energy)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(d) Random* (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(e) R-R* (Time)
100 250 500 1000 1500
0
2
4
6
8
·104
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(f) Custom* (Time)
The Impact of Databases on the Energy Efficiency – B´echir Bani 52/53 – www.polymtl.ca
55. POLYTECHNIQUE MONTR´EAL Introduction Literature Review Methodology Results Conclusion
Combination Sharding and Message Queue Patterns
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(a) Modulo* (Energy)
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of ClientsCPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(b) LookUp* (Energy)
100 250 500 1000 1500
0
0.5
1
1.5
·104
Number of Clients
CPU+MemoryEnergyConsumption(J)
MySQL
PostgreSQL
MongoDB
(c) Consistent*(Energy)
100 250 500 1000 1500
0
0.2
0.4
0.6
0.8
1
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(d) Modulo* (Time)
100 250 500 1000 1500
0
0.2
0.4
0.6
0.8
1
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(e) LookUp* (Time)
100 250 500 1000 1500
0
0.2
0.4
0.6
0.8
1
·105
Number of Clients
AverageResponseTime(ms)
MySQL
PostgreSQL
MongoDB
(f) Consistent*(Time)
The Impact of Databases on the Energy Efficiency – B´echir Bani 53/53 – www.polymtl.ca