SlideShare a Scribd company logo
1 of 15
EEDC
Execution
                        34330
                                 Intelligent Placement of
                                 Datacenters for Internet
Environments for                          Services
Distributed
Computing
European Master In Distributed
Computing (EMDC)
                                      Homework number: 6
                                    Paper Presentation, EEDC



                                       Ioanna Tsalouchidou –
                                   ioannatsalouchidou@gmail.com
Contents

•   Datacenters
•   The Problem
•   Framework
•   The placement tool
•   Evaluation
•   Tradeoffs
•   Conclusions




                         2
Datacenters

•   Where Google, Yahoo, Microsoft etc host services
•   Geographically distributed
•   Enormous cost of provisioning
•   Locations selected intelligently




                            3
The Problem

Selecting the location
●




    ●
        Optimization problem
    ●
        Solutions

Efficiency and accuracy
●




Characterization of the areas
●




Quantification and tradeoffs
●




                                4
Framework

Parameters:
●




                  CAPEX (CAP_ind, CAP_max, CAP_act)
    ●
        Costs
                  OPEX (OP_alt, OP_utl)

    ●
        Response Time
    ●
        Consistency delay
    ●
        Availability
    ●
        CO2 emissions




                             5
Framework

Formulating the problem:
●

  ●
    Input
         ●
           Max number of servers
         ●
           Utilization of servers
         ●
           Number of users
         ●
           Redundancy
         ●
           Network latency
  ●
    Output
         ●
           Optimal cost
         ●
           Max number of servers/location
         ●
           Number of servers/population center
  ●
    Existing datacenters



                           6
Framework

Solution approaches
●

  ●
    Simple linear programming, LP0
  ●
    Pre-Set linear programming, LP1
  ●
    Brute force
  ●
    Heuristic based on LP
  ●
    Simulated annealing plus, SA+LP1
  ●
    Optimized SA+LP1, OSA+LP1




                          7
The Tool

Location Dependent Data
●

  ●
    Network backbones
  ●
    Power plants, transmission lines, CO2 emissions
  ●
    Electricity, land, water, temperature
  ●
    Missing data




                           8
The Tool

Characteristics
●

  ●
    Datacenter size, cooling, PUEs
  ●
    Connection costs
  ●
    Building costs
  ●
    Land costs
  ●
    Water costs
  ●
    Servers, internal networking costs
  ●
    Staff costs




                            9
Evaluation
Cost achieved
●

  ●
    Comparison with Brute force
  ●
    3 days execution
  ●
    5 datacenters




                          10
Evaluation




             11
Placement Tradeoffs
 Questions:
   ●
     Latency cost
   ●
     Availability cost
   ●
     Consistency cost
   ●
     Green datacenter network cost:
      ●
        huge CO2 emission
   ●
     Chiller-less datacenter network cost increase:
      ●
        20% energy consumption, 30% building cost




                          12
Placement Tradeoffs




                  13
Conclusion

Automatic placement of Datacenters
●




Optimization framework
●




Solution approaches
●




Tradeoffs
●




Future: more fine grained input data automatically
●




                            14
EEDC
Execution
                        34330
                                 Intelligent Placement of
                                 Datacenters for Internet
Environments for                          Services
Distributed
Computing
European Master In Distributed
Computing (EMDC)
                                      Homework number: 6
                                    Paper Presentation, EEDC



                                       Ioanna Tsalouchidou –
                                   ioannatsalouchidou@gmail.com

More Related Content

Similar to Intelligent Placement of Datacenters for Internet Services

Intelligent Placement of Datacenters for Internet Services
Intelligent Placement of Datacenters for Internet ServicesIntelligent Placement of Datacenters for Internet Services
Intelligent Placement of Datacenters for Internet ServicesMaria Stylianou
 
Intelligent Placement of Datacenter for Internet Services
Intelligent Placement of Datacenter for Internet Services Intelligent Placement of Datacenter for Internet Services
Intelligent Placement of Datacenter for Internet Services Arinto Murdopo
 
EEDC Intelligent Placement of Datacenters
EEDC Intelligent Placement of DatacentersEEDC Intelligent Placement of Datacenters
EEDC Intelligent Placement of DatacentersRoger Rafanell Mas
 
Deploying Pretrained Model In Edge IoT Devices.pdf
Deploying Pretrained Model In Edge IoT Devices.pdfDeploying Pretrained Model In Edge IoT Devices.pdf
Deploying Pretrained Model In Edge IoT Devices.pdfObject Automation
 
IBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERIBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERinside-BigData.com
 
Everything as a Service
Everything as a ServiceEverything as a Service
Everything as a Servicejavicid
 
DATE 2020: Design, Automation and Test in Europe Conference
DATE 2020: Design, Automation and Test in Europe ConferenceDATE 2020: Design, Automation and Test in Europe Conference
DATE 2020: Design, Automation and Test in Europe ConferenceLEGATO project
 
6 intelligent-placement-of-datacenters
6 intelligent-placement-of-datacenters6 intelligent-placement-of-datacenters
6 intelligent-placement-of-datacenterszafargilani
 
Optical Switching in the Datacenter
Optical Switching in the DatacenterOptical Switching in the Datacenter
Optical Switching in the DatacenterKostas Katrinis
 
Expectations for optical network from the viewpoint of system software research
Expectations for optical network from the viewpoint of system software researchExpectations for optical network from the viewpoint of system software research
Expectations for optical network from the viewpoint of system software researchRyousei Takano
 
Edge-Fog Cloud: Scaling IoT computations on the edge
Edge-Fog Cloud: Scaling IoT computations on the edgeEdge-Fog Cloud: Scaling IoT computations on the edge
Edge-Fog Cloud: Scaling IoT computations on the edgeNitinder Mohan
 
数据中心网络研究:机遇与挑战
数据中心网络研究:机遇与挑战数据中心网络研究:机遇与挑战
数据中心网络研究:机遇与挑战Weiwei Fang
 
Networking Challenges for the Next Decade
Networking Challenges for the Next DecadeNetworking Challenges for the Next Decade
Networking Challenges for the Next DecadeOpen Networking Summit
 
APSys Presentation Final copy2
APSys Presentation Final copy2APSys Presentation Final copy2
APSys Presentation Final copy2Junli Gu
 
HP - Jerome Rolia - Hadoop World 2010
HP - Jerome Rolia - Hadoop World 2010HP - Jerome Rolia - Hadoop World 2010
HP - Jerome Rolia - Hadoop World 2010Cloudera, Inc.
 
The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017Jian-Hong Pan
 
Performance Characterization and Optimization of In-Memory Data Analytics on ...
Performance Characterization and Optimization of In-Memory Data Analytics on ...Performance Characterization and Optimization of In-Memory Data Analytics on ...
Performance Characterization and Optimization of In-Memory Data Analytics on ...Ahsan Javed Awan
 
RECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP Project
 

Similar to Intelligent Placement of Datacenters for Internet Services (20)

Intelligent Placement of Datacenters for Internet Services
Intelligent Placement of Datacenters for Internet ServicesIntelligent Placement of Datacenters for Internet Services
Intelligent Placement of Datacenters for Internet Services
 
Umit hw6
Umit hw6Umit hw6
Umit hw6
 
Intelligent Placement of Datacenter for Internet Services
Intelligent Placement of Datacenter for Internet Services Intelligent Placement of Datacenter for Internet Services
Intelligent Placement of Datacenter for Internet Services
 
EEDC Intelligent Placement of Datacenters
EEDC Intelligent Placement of DatacentersEEDC Intelligent Placement of Datacenters
EEDC Intelligent Placement of Datacenters
 
Deploying Pretrained Model In Edge IoT Devices.pdf
Deploying Pretrained Model In Edge IoT Devices.pdfDeploying Pretrained Model In Edge IoT Devices.pdf
Deploying Pretrained Model In Edge IoT Devices.pdf
 
IBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWERIBM Data Centric Systems & OpenPOWER
IBM Data Centric Systems & OpenPOWER
 
Everything as a Service
Everything as a ServiceEverything as a Service
Everything as a Service
 
DATE 2020: Design, Automation and Test in Europe Conference
DATE 2020: Design, Automation and Test in Europe ConferenceDATE 2020: Design, Automation and Test in Europe Conference
DATE 2020: Design, Automation and Test in Europe Conference
 
6 intelligent-placement-of-datacenters
6 intelligent-placement-of-datacenters6 intelligent-placement-of-datacenters
6 intelligent-placement-of-datacenters
 
Optical Switching in the Datacenter
Optical Switching in the DatacenterOptical Switching in the Datacenter
Optical Switching in the Datacenter
 
Expectations for optical network from the viewpoint of system software research
Expectations for optical network from the viewpoint of system software researchExpectations for optical network from the viewpoint of system software research
Expectations for optical network from the viewpoint of system software research
 
Edge-Fog Cloud: Scaling IoT computations on the edge
Edge-Fog Cloud: Scaling IoT computations on the edgeEdge-Fog Cloud: Scaling IoT computations on the edge
Edge-Fog Cloud: Scaling IoT computations on the edge
 
数据中心网络研究:机遇与挑战
数据中心网络研究:机遇与挑战数据中心网络研究:机遇与挑战
数据中心网络研究:机遇与挑战
 
Networking Challenges for the Next Decade
Networking Challenges for the Next DecadeNetworking Challenges for the Next Decade
Networking Challenges for the Next Decade
 
APSys Presentation Final copy2
APSys Presentation Final copy2APSys Presentation Final copy2
APSys Presentation Final copy2
 
HP - Jerome Rolia - Hadoop World 2010
HP - Jerome Rolia - Hadoop World 2010HP - Jerome Rolia - Hadoop World 2010
HP - Jerome Rolia - Hadoop World 2010
 
EEDC Everthing as a Service
EEDC Everthing as a ServiceEEDC Everthing as a Service
EEDC Everthing as a Service
 
The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017
 
Performance Characterization and Optimization of In-Memory Data Analytics on ...
Performance Characterization and Optimization of In-Memory Data Analytics on ...Performance Characterization and Optimization of In-Memory Data Analytics on ...
Performance Characterization and Optimization of In-Memory Data Analytics on ...
 
RECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP: The Simulation Approach
RECAP: The Simulation Approach
 

More from Ioanna Tsalouchidou

Scalable Dynamic Graph Summarization
Scalable Dynamic Graph SummarizationScalable Dynamic Graph Summarization
Scalable Dynamic Graph SummarizationIoanna Tsalouchidou
 
A Distributed Self-management Service
A Distributed Self-management ServiceA Distributed Self-management Service
A Distributed Self-management ServiceIoanna Tsalouchidou
 
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...Ioanna Tsalouchidou
 
The Chubby lock service for loosely- coupled distributed systems
The Chubby lock service for loosely- coupled distributed systems The Chubby lock service for loosely- coupled distributed systems
The Chubby lock service for loosely- coupled distributed systems Ioanna Tsalouchidou
 
7.howcompanieslearnyoursecrets 120318193259-phpapp01
7.howcompanieslearnyoursecrets 120318193259-phpapp017.howcompanieslearnyoursecrets 120318193259-phpapp01
7.howcompanieslearnyoursecrets 120318193259-phpapp01Ioanna Tsalouchidou
 

More from Ioanna Tsalouchidou (7)

Scalable Dynamic Graph Summarization
Scalable Dynamic Graph SummarizationScalable Dynamic Graph Summarization
Scalable Dynamic Graph Summarization
 
A Distributed Self-management Service
A Distributed Self-management ServiceA Distributed Self-management Service
A Distributed Self-management Service
 
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...
Observation, Experiment, Conclusion: the Three Princes of Serendip_essay_Phil...
 
The Chubby lock service for loosely- coupled distributed systems
The Chubby lock service for loosely- coupled distributed systems The Chubby lock service for loosely- coupled distributed systems
The Chubby lock service for loosely- coupled distributed systems
 
7.howcompanieslearnyoursecrets 120318193259-phpapp01
7.howcompanieslearnyoursecrets 120318193259-phpapp017.howcompanieslearnyoursecrets 120318193259-phpapp01
7.howcompanieslearnyoursecrets 120318193259-phpapp01
 
Cap in depth
Cap in depthCap in depth
Cap in depth
 
Rest vs soap
Rest vs soapRest vs soap
Rest vs soap
 

Intelligent Placement of Datacenters for Internet Services

  • 1. EEDC Execution 34330 Intelligent Placement of Datacenters for Internet Environments for Services Distributed Computing European Master In Distributed Computing (EMDC) Homework number: 6 Paper Presentation, EEDC Ioanna Tsalouchidou – ioannatsalouchidou@gmail.com
  • 2. Contents • Datacenters • The Problem • Framework • The placement tool • Evaluation • Tradeoffs • Conclusions 2
  • 3. Datacenters • Where Google, Yahoo, Microsoft etc host services • Geographically distributed • Enormous cost of provisioning • Locations selected intelligently 3
  • 4. The Problem Selecting the location ● ● Optimization problem ● Solutions Efficiency and accuracy ● Characterization of the areas ● Quantification and tradeoffs ● 4
  • 5. Framework Parameters: ● CAPEX (CAP_ind, CAP_max, CAP_act) ● Costs OPEX (OP_alt, OP_utl) ● Response Time ● Consistency delay ● Availability ● CO2 emissions 5
  • 6. Framework Formulating the problem: ● ● Input ● Max number of servers ● Utilization of servers ● Number of users ● Redundancy ● Network latency ● Output ● Optimal cost ● Max number of servers/location ● Number of servers/population center ● Existing datacenters 6
  • 7. Framework Solution approaches ● ● Simple linear programming, LP0 ● Pre-Set linear programming, LP1 ● Brute force ● Heuristic based on LP ● Simulated annealing plus, SA+LP1 ● Optimized SA+LP1, OSA+LP1 7
  • 8. The Tool Location Dependent Data ● ● Network backbones ● Power plants, transmission lines, CO2 emissions ● Electricity, land, water, temperature ● Missing data 8
  • 9. The Tool Characteristics ● ● Datacenter size, cooling, PUEs ● Connection costs ● Building costs ● Land costs ● Water costs ● Servers, internal networking costs ● Staff costs 9
  • 10. Evaluation Cost achieved ● ● Comparison with Brute force ● 3 days execution ● 5 datacenters 10
  • 12. Placement Tradeoffs Questions: ● Latency cost ● Availability cost ● Consistency cost ● Green datacenter network cost: ● huge CO2 emission ● Chiller-less datacenter network cost increase: ● 20% energy consumption, 30% building cost 12
  • 14. Conclusion Automatic placement of Datacenters ● Optimization framework ● Solution approaches ● Tradeoffs ● Future: more fine grained input data automatically ● 14
  • 15. EEDC Execution 34330 Intelligent Placement of Datacenters for Internet Environments for Services Distributed Computing European Master In Distributed Computing (EMDC) Homework number: 6 Paper Presentation, EEDC Ioanna Tsalouchidou – ioannatsalouchidou@gmail.com