A presentation I gave at IEEE Cloud 2012 – one of the premier conferences on Cloud Computing for a paper by Ali Khajeh-Hoessini and myself. The paper is entitled “CloudMonitor: Profiling Power Usage” and discusses the CloudMonitor software and how it could be used to create an energy tariff for Cloud providers. I’m very grateful to my supervisor Prof Ian Sommerville for encouraging me to go to the conference, to LSCITS for funding the trip and for Google for giving me the time off! More information on CloudMonitor can be found here: http://jws7.net/cloudmonitor

1. University of St Andrews
School of Computer Science
Profiling Power
at Cloud scale
James Smith
Ali Khajeh-Hosseini
Jonathan Ward @jws7
Ian Sommerville
or can we charge for Energy?
1

2. University of St Andrews
School of Computer Science
Profiling Power
at Cloud scale
C loudMon itor
James Smith
Ali Khajeh-Hosseini
Jonathan Ward @jws7
Ian Sommerville
or can we charge for Energy?
2

3. University of St Andrews
School of Computer Science
Operational costs exceeding purchase costs
3

4. University of St Andrews
School of Computer Science
Operational costs exceeding purchase costs
Even over a relatively short
lifespan (3-5 years). Mainly driven
by energy costs
4

5. University of St Andrews
School of Computer Science
Operational costs exceeding purchase costs
Even over a relatively short
lifespan (3-5 years). Mainly driven
by energy costs
We need realistic Energy estimations 5

6. University of St Andrews
School of Computer Science
Operational costs exceeding purchase costs
Even over a relatively short
lifespan (3-5 years). Mainly driven
by energy costs
We need realistic Energy estimations 6
not just included in “infrastructure”

7. University of St Andrews
School of Computer Science
Monitoring
If you cannot measure something
“then you cannot improve it...” - Lord Kelvin
7

8. University of St Andrews
School of Computer Science
Monitoring
If you cannot measure something
“then you cannot improve it...” - Lord Kelvin
13.4% of organisations monitor
their energy consumption!
8

9. University of St Andrews
School of Computer Science
Datacentres
9

10. University of St Andrews
School of Computer Science
Datacentres
10

11. University of St Andrews
School of Computer Science
Datacentres
11

12. University of St Andrews
School of Computer Science
Datacentres
Monitoring at Scale is hard
especially when you
need additional
hardware!
12

13. University of St Andrews
School of Computer Science
CloudMonitor
13

14. University of St Andrews
School of Computer Science
CloudMonitor
Use SIGAR
library to gather
resource usage
14

15. University of St Andrews
School of Computer Science
CloudMonitor
Use SIGAR
library to gather
resource usage
Correlate with
Power Meter
readings
15

16. University of St Andrews
School of Computer Science
CloudMonitor
Use SIGAR
library to gather
resource usage
Correlate with
Power Meter
readings
Generate Power 16
Model

17. University of St Andrews
School of Computer Science
So what?
17

18. University of St Andrews
School of Computer Science
So what?
Generate power model
on one machine. Roll
out to 1,000
18

19. University of St Andrews
School of Computer Science
So what?
Generate power model
on one machine. Roll
out to 1,000
of the same configuration
19

20. University of St Andrews
School of Computer Science
Previous work
• by Bohra, Ata & Chaundary - VMeter
• linear power model is workload-specific
• our work is workload-independent
• calculate once - valid for all machines of
the same configuration
*Husain Bohra, Ata E, and Vipin Chaudhary. “VMeter: power modelling for virtualized clouds.” 2010 IEEE International Symposium on Parallel &
Distributed Processing, Workshops and Phd Forum (IPDPSW) (April 2010): 1-8. 20

21. University of St Andrews
School of Computer Science
21

22. University of St Andrews
School of Computer Science
22

23. University of St Andrews
School of Computer Science
Not perfect
23

24. University of St Andrews
School of Computer Science
Not perfect
but pretty close...
24

25. University of St Andrews
School of Computer Science
The lesson?
Experiments show 96%
accuracy of Software
Predictions against
PDU Measurements
25

26. University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
26

27. University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
Energy rates are
rising at 15% pa
27

28. University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
Energy rates are
rising at 15% pa
36 month cost
of test system:
28

29. University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
Energy rates are
rising at 15% pa
36 month cost $2,767
of test system:
29

30. University of St Andrews
School of Computer Science
Shop for Cloud
30

31. University of St Andrews
School of Computer Science
Amazon AWS EU Cloud
Category Cost
Data Transfer $58,084
VM hours $40,568
Storage $2,325
Storage I/O $2,293
Total $103, 270
31

32. University of St Andrews
School of Computer Science
Hypothetical Cloud that
charges for Energy
Category Cost
Data Transfer $58,084
VM hours $40,568
Energy $2,767
Storage $2,325
Storage I/O $2,293
Total $106, 037
32

33. University of St Andrews
School of Computer Science
The lesson?
Energy would account
for 2.6% of the total
costs
33

34. University of St Andrews
School of Computer Science
The lesson?
Energy would account
for 2.6% of the total
costs
and is likely to
rise in the future
34

35. University of St Andrews
School of Computer Science
Summary
Power
Models
Distributed
CloudMonitor Monitoring
Platform
Resource
Usage
35

36. University of St Andrews
School of Computer Science
36

37. University of St Andrews
School of Computer Science
Everybody benefits! 37

38. University of St Andrews
School of Computer Science
Thanks for listening
@jws7
jws7.net/cloudmonitor
38