Can we hack open source #cloud platforms to help reduce emissions?

Can we hack opensource #cloud platforms to help reduce emissions? Tom Raftery #Monktoberfest 2012, Portland Maine 1

Tom Raftery • Lead analyst, energy and sustainability practice, RedMonk • CIX, Chip & Zenith • GreenMonk.net • twitter.com/tomraftery • tom@redmonk.com • +34 677 695 468 • SlideShare.net/TomRaftery 2CIX, Chip & Zenith - involvement with Cloud, going back to late 90’s

Garret FitzGerald 1926-2011 3Unlikely politician - highly intelligent academic, unimpeachable integrity, head in the clouds(!)

Garret FitzGerald Photo http://www.flickr.com/photos/caribb/5391899550/ 4Before he became a politician -In 1949 analyzed the earliest published Aeroflot timetables, and produced one of the first accurateestimations of the size of Russias airliner fleet - previously a closely guarded secret

Garret FitzGerald Photo http://www.flickr.com/photos/steve_brace/2568478072/ 5KGB thought he was a spy!And look an image with KGB logo - and a sleeping cat!Proving there’s no such thing as security by obscurity & the internet rocks!

Cloud problemNo transparency 6

Problem http://greenmonk.net/2011/07/21/carbon-disclosure-projects-emissions-reduction-claims-for-cloud-computing-are-ﬂawed/ 7Something I have been blogging about for quite a while

Problem http://greenmonk.net/2012/01/09/is-cloud-computing-green/ 8And giving conference talks about it as well

Problem http://www.nytimes.com/2012/09/23/technology/data-centers-waste-vast-amounts-of-energy-belying-industry-image.html 9Data centers use vast amounts of electricityTypically only 6-12% of the electricity powering their servers goes to perform computations - McKinsey &Co.Rest used to keep servers idling and ready in case of a surge in activity - dynamic provisioning - i.e. theelastic in ec2!

Energy ≠ Emissions 10NYT article was good but concentrated on energyBear in mind that energy use and emissions are not necessarily relatedEnergy is not a proxy for emissions

Facebook Photo http://www.facebook.com/album.php?id=193287527693&aid=183026 11A practical example of this is...Prineville siteOpen Compute - open sourced the design of DC & hardware!

Energy“As of the end of Q3 2011, the Prineville data centerhad a power usage effectiveness (PUE) of 1.08...much lower than the industry standard of 1.5.Facebook’s energy consumption per unit of computingpower has declined by 38%” http://opencompute.org/about/energy-efficiency/ 12

Emissions http://www.pacificorp.com/es/mining.html 1358% of its energy from coal12% from gas=> over 70% from fossil fuel directly.22.5% is purchased from other suppliers so could also be fossil fuel.

Dublin http://www.datacenterknowledge.com/archives/2011/08/07/lightning-in-dublin-knocks-amazon-microsoft-data-centers-offline/ 14MicrosoftAmazonGoogleIBMSunGardDigital Realty TrustAll have signiﬁcant DC’s in Dublin

EmissionsIreland sources 84% of electricity from fossil fuels http://www.eirgrid.com/operations/systemperformancedata/electricitystatistics/ 15

Emissions UK sources >90% of its electricity from fossil fuels https://restats.decc.gov.uk/cms/national-renewables-statistics/ 16“Renewables contribution to UK electricity generation was 9.4% in 2011”

Emissions http://www.pacificorp.com/es/mining.html 17The carbon intensity of a data center’s electricity is more important than it’s efficiency!

Cloud providers 18Partial list of cloud companies

Clean cloud providers 19Rackspace’s UK data center runs on 100% renewable powerGoogle have large renewable investments and their operations are carbon neutral

Clean cloud providers 20Greenqloud are based in Iceland where elec is 100% renewable

Clean cloud providers http://aws.amazon.com/about-aws/sustainable-energy/ 21Amazon claim 0 carbon for two of their regions

Clean cloud providers https://twitter.com/jeffbarr/status/251306461836222464 22but demur when asked to back up the claimHow can we verify it is true?*Sound of crickets chirping*

Problem Data? 23

Cloud emissions data 24Partial list of cloud companies

Cloud emissions data providers http://www.sapsustainabilityreport.com/greenhouse-gas-footprint 25This is as granular as the data gets!

Cloud emissions data providers http://www.salesforce.com/company/sustainability/impact.jsp 26Reports 2 weeks lateGives data for carbon saved, not carbon emitted

Cloud emissions data providers http://www.salesforce.com/company/sustainability/savings.jsp 27Completely inaccurate depending on where in EU on premise is being hostedIf hosted in France or Spain with low carbon intensity - move to Salesforce could increase emissionsWothout Salesforce emissions data, how do we know?

Why don’t they? Photo http://www.ﬂickr.com/photos/pahudson/7742561802/ 28Competitive intelligence

Why don’t they? Photo http://www.ﬂickr.com/photos/nathanmarciniak/2207977707/ 29Hide their emissions

Why don’t they? Photo http://www.ﬂickr.com/photos/thomasﬁsherlibrary/6887173879/ 30Lack of reporting standardsThis being Monktoberfest, I had to get in a gratuitous beer shot

Outcome “If you can’t measure it, you can’t manage it” 31Lack of focus on emissions => increased emissions

ReminderA quick recap of 2012 so far... 32

Recap 33In the third quarter alone, crop produc2on dropped $12 billion “due to this summer’s severe heat and drought.” Drop in US farm inventories was so sharp in the last quarter that it wiped 0.2% oﬀ of U.S. GDP in the latest revision.In Texas, the drought has killed more than 300 million trees. Nearly 98% of Nebraska is in extreme to excep2onal drought — 3 months ago, none of it was!hSp://thinkprogress.org/climate/2012/09/30/929381/epic-‐dust-‐bowl-‐of-‐2012-‐con2nues/

Recap http://www.reuters.com/article/2012/06/27/us-usa-wildfires-idUSBRE85L1DD20120627 http://www.bbc.co.uk/news/world-europe-19433715 34One of the worst wildfire seasons on recordWildfires in US and EU

Recap http://edition.cnn.com/2012/09/29/world/asia/pakistan-ﬂoods/index.html http://www.bbc.co.uk/news/world-europe-19767627 35Serious ﬂoods

Recap http://www.reuters.com/article/2012/07/02/us-usa-weather-records-idUSBRE8611EL20120702 36From June 25th - July 1st 2012 in US 2,171 US records broken or matchedIn June 2012 that number is 3,215

Recap http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/ 37Huge issues of ice loss in the arctic

Recap http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/ 38Lack of focus on emissions => increased emissions

Recap http://nsidc.org/arcticseaicenews/2012/09/arctic-sea-ice-extent-settles-at-record-seasonal-minimum/ 39Minimum was 760,000 square kilometers (293,000 square miles) below previous record minimum extentin the satellite record, which occurred on September 18, 2007. This is an area about the size of the stateof Texas.3.29 million square kilometers (1.27 million square miles) below the 1979 to 2000 average minimum,representing an area nearly twice the size of the state of Alaska18% below 2007 and 49% below the 1979 to 2000 average

Recap http://www.youtube.com/watch?v=YegdEOSQotE 40That’s not to mention the issue of arctic methane - what its effects will be are, as yet, unknown (but theywon’t be good!)

Cloud?Cloud computing’s emissions don’t directly cause all these issues. But they do play a significant part. 41

Solution? Open Source 42Here’s where we can help

Solution? 43

Solution? http://www.ﬂickr.com/photos/viamoi/3465644425/ 44Why not fork open source cloud platforms?

Solution? http://www.ﬂickr.com/photos/traftery/5369447689/ 45Add in emissions metrics & reporting tools

Solution? http://www.amee.com/products/ 46Companies like AMEE already provide API’s for this kind of info

Solution? http://www.ﬂickr.com/photos/dixieroadrash/3769522479/ 47Get the update accepted back into the core

Solution? http://www.eucalyptus.com/about/customers 48And thus distributed with next update

Solution? http://www.cloudstack.org/users.html 49And thus distributed with next update

Solution? http://www.openstack.org/foundation/companies/ 50And thus distributed with next update

btw https://www.mastodonc.com/dashboard 51The Mastodon C dashboard gives stats on emissions from various cloud providers - in case you’reinterested in keeping your cloud emissions down.Lot of it is guestimated data - need real data.

Conclusion Adding emissions metrics & reporting tocloud computing will help reduce emissions. Question is - is anyone up for it? 52

Thanks! Contact information: Tom RafteryPrincipal Analyst, Energy & Sustainability, RedMonk Tom@redmonk.com, GreenMonk.net, Twitter.com/tomraftery +34 677 695 468 53

http://greenmonk.net	2032
https://twitter.com	30
http://localhost.dev	28
http://lanyrd.com	16
http://www.udemy.com	10
http://blogs.staging.spectator.co.uk	5
http://demo.local.dev	4
http://www.onlydoo.com	4
http://experiment.localhost.dev	4
http://abtasty.com	3
http://redmonk.com	3
http://experiment.local.dev	3
http://www.enterpriseirregulars.com	2
http://tweetminster.co.uk	2
http://demo.localhost.dev	2
http://translate.googleusercontent.com	2
http://local.dev	1
http://ftga.local.dev	1
http://thisninja	1
http://www.ranksit.com	1
http://webcache.googleusercontent.com	1
http://kred.com	1
http://feeds.feedburner.com	1
http://www.tweetminster.co.uk	1
http://presentationdocs.playableitems.demobo.com	1
http://ranksit.com	1
http://www.kred.com	1
https://si0.twimg.com	1

Can we hack open source #cloud platforms to help reduce emissions?

by Tom Raftery on Oct 04, 2012

Accessibility

Categories

Upload Details

Usage Rights

28 Embeds 2,162

Statistics

Can we hack open source #cloud platforms to help reduce emissions? Presentation Transcript