SlideShare a Scribd company logo
Code for the Earth
OCP APAC Engineering Workshop Tokyo
Day2 (2013-5-28)
• Application Framework (eco PHP)
• Measurement of Runtime Efficiency
Cloud Business Alliance
Tetsu Saburi, Hideyuki Fukuhara
Session Positioning
Application Framework
designing “eco PHP” and promote “code for earth”
Measurement of
Runtime Efficiency
This Topic
OCP Project
100 Google searches = 30Wh
How much energy do you use when you type in a Google search or watch a
YouTube video?
Google said that
100 searches are equal to a 60-watt light bulb burning for 28 minutes.
"Specifically, we currently use about 0.0003 kWh of energy to answer the
average search query," Google said. "This translates into roughly 0.2g of
carbon dioxide."
2011 PC Magazine
60W
28min
x 100 =
We ICT user should care about energy consumption of the service that we use.
APPLICATION FRAMEWORK
new programming culture (eco PHP) for electric-power-efficiency
Eco Application Framework
Eco Programming
Eco Platform
Software
x
efficiency =
work served
by program
Energy
consumption
Measurement of
Runtime Efficiency
Hardware
(Application Framework)
(CPU, …, Shipho)
Programmer
PHP
engine
Eco Programming
Only using eco platform
is not enough
eco platform + good program = efficient
Eco car
Only using eco car
is not enough
eco car + bad driving = wasting energy
eco car + eco driving = efficient
eco platform + bad program = not efficient
Programming Convention
Driving Manner
Eco
Platform
Eco
Platform
Eco
Platform
Eco Platform
OS
Library
Language
Server Cluster
CPUs
print “Hello World”
programmer
Framework
Current framework and
language is designed
only for programmer
Eco Platform is designed for the
earth and programmer.
= flexible, scalable, and efficient
across the entire stack
and easy to maintain
PHP, Ruby, Python,
Java, Javascript, C#, …,
Django, RoR, …,
OpenMPI, …
programmer
language Application
framework
H/W
(CPU)
library
e.g.
- eco PHP platform
- eco Ruby platform
Application
- Web Application
- High Performance Computing (CFD, bio, …)
Distributed Computing Platform for Cluster
……
App
App
App
App
App
App
App App AppApp App AppApp
App
IaaS/Hardware Distributed Platform
OS
VM distributed application platform
server server
Distributed Platform consists of
- distributed execute engine: load management and execution fault tolerance
- distributed storage: fault tolerance for persistent data
- distributed memory: fault tolerance for runtime data (temporary data)
- easy to maintain
Flavor
- Web: small and frequent application (affinity and cache consideration)
- HPC: big and long life application (runtime robust, <-homomorphic coding)
For cluster (many servers), high efficient and easy-to-use platform is needed.
Astimegoon
-Complex
-Heavy
-Expensive
Web Application Framework for Cluster
HTTP + Cookie + CGI
HTTP + Application Server + Session
HTTP + Heavy Application Server + Heavy Object Session
Load Balancer
Heavy Load Balancer
memchache
Web App Framework History
- simple server framework for cluster
- minimum session, minimum server persistence
- reconsideration of cookie and client (instead of session & load balancer model)
- not only request/response model but also publish/subscribe model or …
Reconsideration of Web App Framework for efficiency
e.g.
HTTP + Cookie + CGI/wsgi/rack/… or PHP
(no session or minimum session framework)
Light Load Balance
(low cost and loose relation of
user & server, DNS RR, SDN, …)
+
+ +
RDB+
RDB
NoSQL+ +cache+
Rails, Django, …
NoSQL
time
Eco PHP Platform
•Eco PHP language= subset of PHP
(optimized for Compiler and CPU like http://asmjs.org/ in JS world)
•Eco programming convention and Eco Programmer
•Eco library
•Eco language engine
•HipHop compiler
•HipHop machine (VM, Processor, SoC)
•Eco framework for cluster
•Application framework with distributed computing
technology
•Disaggregated Rack
Eco Programming Culture
new programming culture
Eco programming is more electric-power-efficient
programming. Eco language, eco platform, eco
programming convention, and eco programmer makes
the world better.
eco PHP
is cool!
Like Eco Wordpress
Goal
Create new programming culture
• Build eco application framework (eco PHP and middleware)
• Foster eco programmer (eco programming conventions)
Key technology
• Building eco platform to maximize runtime efficiency on OCP
physical system
• Measurement of runtime efficiency
MEASUREMENT OF RUNTIME
EFFICIENCY
for the most efficient computing infrastructures
Measuring efficiency
Hacking Conventional Computing Infrastructure
We started a project at Facebook almost two years ago with a
pretty big goal: to build one of the most efficient computing
infrastructures at the lowest possible cost. We decided to honor
our hacker roots and challenge convention by custom designing
and building our software, servers and data centers from the
ground up – and then share these technologies as they evolve.
Measure the runtime efficiency
Runtime energy efficiency
calls of Function A
Energy
consumption of
CPU (Wh)
user operations of Application A
Energy
consumption of
server (Wh)
Work served
Energy
consumption
e.g.
Example of efficiency
Facebook
users
Power
Plants
Blog
views & updates
/ sec
Racks
CPUs
convert(),
edit(),
…
Library calls
/ sec
energy measurement scope
work granularity
CPU CPU
+ memory
CPU
+ memory + IO
… Server … Servers …
Code snippet
Function 
Application 
work served
energy consumption
Choice of numerator and denominator
Work granularity
•Code snippet: e.g. for(){…}, …
•Function: e.g. regex, image
processing, …
•Application: e.g. wordpress
•Service: facebook
Energy consumption
measurement scope
•CPU
•CPU + memory
…
•Server
…
•+ Network + Client
Type of measurement application / server
work load eco Wordpress 201x
Load scenario A
- user behavior A
- 1000 user
- 10 min
energy measurement scope Server (OCP1.0 H/W) x 1
Example 1: Application/Server
Application (wordpress)
A Server
Energy
consumption
Work(Load)
Eco wordpress
2014
Eco wordpress
2015
Eco wordpress
2016
Year
Test pattern (work load) is contributed by facebook/linaro results?
Example2: CFD Benchmark/A Disaggregated Rack
Fluid Calculation (CFD Benchmark)
A Disaggregated Rack for HPC
Relations with other OCP Project
• HipHop Project (PHP Compiler, PHP VM)
• Processor or SoC Project? (Intel, AMD, ARM, …)
• Disaggregated Rack
• Japan chapter: “eco Ruby” sub project
2015 document
1 . Application Framework
1.1 Eco PHP 2015
1.1.1 language spec
1.1.2 programming convention
2. Measurement
2.1 wordpress/rack
2.2 2014 vs 2015
…
Documents in future
2014 document
1. Application Framework
1.1 Eco PHP 2014
1.1.1 language spec
1.1.2 programming convention
2. Measurement
2.1 wordpress/server
3. Future vision
Application Framework
And
Measurement of Runtime Efficiency
2014
2016 document
1. Application Framework
1.1 Eco PHP 2016
1.1.1 language spec
1.1.2 programming convention
1.2. Eco Ruby 2016
…
2. Measurement
2.1 wordpress/rack
2.2 eco library/CPU
…
Energy
Work(Load)
Eco wordpress
2014
Eco wordpress
2015
Eco wordpress
2016

More Related Content

What's hot

Cloud data center and openstack
Cloud data center and openstackCloud data center and openstack
Cloud data center and openstack
Andrew Yongjoon Kong
 
Seastar @ NYCC++UG
Seastar @ NYCC++UGSeastar @ NYCC++UG
Seastar @ NYCC++UG
Avi Kivity
 
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
OPNFV
 
Open stack china_201109_sjtu_jinyh
Open stack china_201109_sjtu_jinyhOpen stack china_201109_sjtu_jinyh
Open stack china_201109_sjtu_jinyhOpenCity Community
 
Cloud Foundry on OpenStack - An Experience Report | anynines
Cloud Foundry on OpenStack - An Experience Report | anynines Cloud Foundry on OpenStack - An Experience Report | anynines
Cloud Foundry on OpenStack - An Experience Report | anynines anynines GmbH
 
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
Vietnam Open Infrastructure User Group
 
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Cloud Native Day Tel Aviv
 
One-click Hadoop Cluster Deployment on OpenPOWER Systems
One-click Hadoop Cluster Deployment on OpenPOWER SystemsOne-click Hadoop Cluster Deployment on OpenPOWER Systems
One-click Hadoop Cluster Deployment on OpenPOWER Systems
Pradeep Kumar
 
GPU cloud with Job scheduler and Container
GPU cloud with Job scheduler and ContainerGPU cloud with Job scheduler and Container
GPU cloud with Job scheduler and Container
Andrew Yongjoon Kong
 
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
Altoros
 
Glance Updates - Kilo Edition
Glance Updates - Kilo EditionGlance Updates - Kilo Edition
Glance Updates - Kilo Edition
OpenStack Foundation
 
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
OpenStack Korea Community
 
Seastar at Linux Foundation Collaboration Summit
Seastar at Linux Foundation Collaboration SummitSeastar at Linux Foundation Collaboration Summit
Seastar at Linux Foundation Collaboration Summit
Don Marti
 
Cloud: From Unmanned Data Center to Algorithmic Economy using Openstack
Cloud: From Unmanned Data Center to Algorithmic Economy using OpenstackCloud: From Unmanned Data Center to Algorithmic Economy using Openstack
Cloud: From Unmanned Data Center to Algorithmic Economy using Openstack
Andrew Yongjoon Kong
 
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatHyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
OpenStack
 
Supercomputing by API: Connecting Modern Web Apps to HPC
Supercomputing by API: Connecting Modern Web Apps to HPCSupercomputing by API: Connecting Modern Web Apps to HPC
Supercomputing by API: Connecting Modern Web Apps to HPC
OpenStack
 
My Sql Performance In A Cloud
My Sql Performance In A CloudMy Sql Performance In A Cloud
My Sql Performance In A Cloud
Sky Jian
 
A fun cup of joe with open liberty
A fun cup of joe with open libertyA fun cup of joe with open liberty
A fun cup of joe with open liberty
Andy Mauer
 
Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara
Making Ceph awesome on Kubernetes with Rook - Bassam TabbaraMaking Ceph awesome on Kubernetes with Rook - Bassam Tabbara
Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara
Ceph Community
 
OpenStack and private cloud
OpenStack and private cloudOpenStack and private cloud
OpenStack and private cloud
SK Telecom
 

What's hot (20)

Cloud data center and openstack
Cloud data center and openstackCloud data center and openstack
Cloud data center and openstack
 
Seastar @ NYCC++UG
Seastar @ NYCC++UGSeastar @ NYCC++UG
Seastar @ NYCC++UG
 
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
 
Open stack china_201109_sjtu_jinyh
Open stack china_201109_sjtu_jinyhOpen stack china_201109_sjtu_jinyh
Open stack china_201109_sjtu_jinyh
 
Cloud Foundry on OpenStack - An Experience Report | anynines
Cloud Foundry on OpenStack - An Experience Report | anynines Cloud Foundry on OpenStack - An Experience Report | anynines
Cloud Foundry on OpenStack - An Experience Report | anynines
 
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
Meetup 23 - 01 - The things I wish I would have known before doing OpenStack ...
 
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
Running Neutron at Scale - Gal Sagie & Eran Gampel - OpenStack Day Israel 2016
 
One-click Hadoop Cluster Deployment on OpenPOWER Systems
One-click Hadoop Cluster Deployment on OpenPOWER SystemsOne-click Hadoop Cluster Deployment on OpenPOWER Systems
One-click Hadoop Cluster Deployment on OpenPOWER Systems
 
GPU cloud with Job scheduler and Container
GPU cloud with Job scheduler and ContainerGPU cloud with Job scheduler and Container
GPU cloud with Job scheduler and Container
 
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
Taking Cloud to Extremes: Scaled-down, Highly Available, and Mission-critical...
 
Glance Updates - Kilo Edition
Glance Updates - Kilo EditionGlance Updates - Kilo Edition
Glance Updates - Kilo Edition
 
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...
 
Seastar at Linux Foundation Collaboration Summit
Seastar at Linux Foundation Collaboration SummitSeastar at Linux Foundation Collaboration Summit
Seastar at Linux Foundation Collaboration Summit
 
Cloud: From Unmanned Data Center to Algorithmic Economy using Openstack
Cloud: From Unmanned Data Center to Algorithmic Economy using OpenstackCloud: From Unmanned Data Center to Algorithmic Economy using Openstack
Cloud: From Unmanned Data Center to Algorithmic Economy using Openstack
 
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red HatHyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
Hyperconverged Cloud, Not just a toy anymore - Andrew Hatfield, Red Hat
 
Supercomputing by API: Connecting Modern Web Apps to HPC
Supercomputing by API: Connecting Modern Web Apps to HPCSupercomputing by API: Connecting Modern Web Apps to HPC
Supercomputing by API: Connecting Modern Web Apps to HPC
 
My Sql Performance In A Cloud
My Sql Performance In A CloudMy Sql Performance In A Cloud
My Sql Performance In A Cloud
 
A fun cup of joe with open liberty
A fun cup of joe with open libertyA fun cup of joe with open liberty
A fun cup of joe with open liberty
 
Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara
Making Ceph awesome on Kubernetes with Rook - Bassam TabbaraMaking Ceph awesome on Kubernetes with Rook - Bassam Tabbara
Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara
 
OpenStack and private cloud
OpenStack and private cloudOpenStack and private cloud
OpenStack and private cloud
 

Similar to Code for the earth OCP APAC Tokyo 2013-05

How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
Joseph K. Ziegler
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
Amazon Web Services
 
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
IEEEGLOBALSOFTSTUDENTPROJECTS
 
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
IEEEFINALSEMSTUDENTPROJECTS
 
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
IEEEMEMTECHSTUDENTPROJECTS
 
Parallel Computing - Lec 6
Parallel Computing - Lec 6Parallel Computing - Lec 6
Parallel Computing - Lec 6
Shah Zaib
 
Cloud Computing ...changes everything
Cloud Computing ...changes everythingCloud Computing ...changes everything
Cloud Computing ...changes everything
Lew Tucker
 
Leveraging The Cloud In 2009
Leveraging The Cloud In 2009Leveraging The Cloud In 2009
Leveraging The Cloud In 2009
Ed Laczynski
 
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
Amazon Web Services
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
The UberCloud
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
Wolfgang Gentzsch
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2jeperkins4
 
Apache Beam: A unified model for batch and stream processing data
Apache Beam: A unified model for batch and stream processing dataApache Beam: A unified model for batch and stream processing data
Apache Beam: A unified model for batch and stream processing data
DataWorks Summit/Hadoop Summit
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
Biswajit Pratihari
 
Workshop: Deploy a Deep Learning Framework on Amazon ECS
Workshop: Deploy a Deep Learning Framework on Amazon ECSWorkshop: Deploy a Deep Learning Framework on Amazon ECS
Workshop: Deploy a Deep Learning Framework on Amazon ECS
Amazon Web Services
 
Introduction to requirement of microservices
Introduction to requirement of microservicesIntroduction to requirement of microservices
Introduction to requirement of microservices
Avik Das
 
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
Amazon Web Services Korea
 
OS for AI: Elastic Microservices & the Next Gen of ML
OS for AI: Elastic Microservices & the Next Gen of MLOS for AI: Elastic Microservices & the Next Gen of ML
OS for AI: Elastic Microservices & the Next Gen of ML
Nordic APIs
 
Performance eng prakash.sahu
Performance eng prakash.sahuPerformance eng prakash.sahu
Performance eng prakash.sahu
Dr. Prakash Sahu
 
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SCGIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SCJim Tochterman
 

Similar to Code for the earth OCP APAC Tokyo 2013-05 (20)

How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Automatic scaling of internet applica...
 
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
2014 IEEE DOTNET CLOUD COMPUTING PROJECT Automatic scaling of internet applic...
 
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
IEEE 2014 DOTNET CLOUD COMPUTING PROJECTS Automatic scaling of internet appli...
 
Parallel Computing - Lec 6
Parallel Computing - Lec 6Parallel Computing - Lec 6
Parallel Computing - Lec 6
 
Cloud Computing ...changes everything
Cloud Computing ...changes everythingCloud Computing ...changes everything
Cloud Computing ...changes everything
 
Leveraging The Cloud In 2009
Leveraging The Cloud In 2009Leveraging The Cloud In 2009
Leveraging The Cloud In 2009
 
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
AWS re:Invent 2016: Hardware-Accelerating Graphics Desktop Workloads with Ama...
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the CloudHigh Performance Computing (HPC) and Engineering Simulations in the Cloud
High Performance Computing (HPC) and Engineering Simulations in the Cloud
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2
 
Apache Beam: A unified model for batch and stream processing data
Apache Beam: A unified model for batch and stream processing dataApache Beam: A unified model for batch and stream processing data
Apache Beam: A unified model for batch and stream processing data
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Workshop: Deploy a Deep Learning Framework on Amazon ECS
Workshop: Deploy a Deep Learning Framework on Amazon ECSWorkshop: Deploy a Deep Learning Framework on Amazon ECS
Workshop: Deploy a Deep Learning Framework on Amazon ECS
 
Introduction to requirement of microservices
Introduction to requirement of microservicesIntroduction to requirement of microservices
Introduction to requirement of microservices
 
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
스마트 엔지니어링: 제조사를 위한 품질 예측 시뮬레이션 및 인공지능 모델 적용 사례 소개 – 권신중 AWS 솔루션즈 아키텍트, 천준홍 두산...
 
OS for AI: Elastic Microservices & the Next Gen of ML
OS for AI: Elastic Microservices & the Next Gen of MLOS for AI: Elastic Microservices & the Next Gen of ML
OS for AI: Elastic Microservices & the Next Gen of ML
 
Performance eng prakash.sahu
Performance eng prakash.sahuPerformance eng prakash.sahu
Performance eng prakash.sahu
 
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SCGIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC
GIS & Cloud Computing - GAASC 2010 Fall Summit - Florence, SC
 

Recently uploaded

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 

Recently uploaded (20)

Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 

Code for the earth OCP APAC Tokyo 2013-05

  • 1. Code for the Earth OCP APAC Engineering Workshop Tokyo Day2 (2013-5-28) • Application Framework (eco PHP) • Measurement of Runtime Efficiency Cloud Business Alliance Tetsu Saburi, Hideyuki Fukuhara
  • 2. Session Positioning Application Framework designing “eco PHP” and promote “code for earth” Measurement of Runtime Efficiency This Topic OCP Project
  • 3. 100 Google searches = 30Wh How much energy do you use when you type in a Google search or watch a YouTube video? Google said that 100 searches are equal to a 60-watt light bulb burning for 28 minutes. "Specifically, we currently use about 0.0003 kWh of energy to answer the average search query," Google said. "This translates into roughly 0.2g of carbon dioxide." 2011 PC Magazine 60W 28min x 100 = We ICT user should care about energy consumption of the service that we use.
  • 4. APPLICATION FRAMEWORK new programming culture (eco PHP) for electric-power-efficiency
  • 5. Eco Application Framework Eco Programming Eco Platform Software x efficiency = work served by program Energy consumption Measurement of Runtime Efficiency Hardware (Application Framework) (CPU, …, Shipho) Programmer PHP engine
  • 6. Eco Programming Only using eco platform is not enough eco platform + good program = efficient Eco car Only using eco car is not enough eco car + bad driving = wasting energy eco car + eco driving = efficient eco platform + bad program = not efficient Programming Convention Driving Manner Eco Platform Eco Platform Eco Platform
  • 7. Eco Platform OS Library Language Server Cluster CPUs print “Hello World” programmer Framework Current framework and language is designed only for programmer Eco Platform is designed for the earth and programmer. = flexible, scalable, and efficient across the entire stack and easy to maintain PHP, Ruby, Python, Java, Javascript, C#, …, Django, RoR, …, OpenMPI, … programmer language Application framework H/W (CPU) library e.g. - eco PHP platform - eco Ruby platform Application - Web Application - High Performance Computing (CFD, bio, …)
  • 8. Distributed Computing Platform for Cluster …… App App App App App App App App AppApp App AppApp App IaaS/Hardware Distributed Platform OS VM distributed application platform server server Distributed Platform consists of - distributed execute engine: load management and execution fault tolerance - distributed storage: fault tolerance for persistent data - distributed memory: fault tolerance for runtime data (temporary data) - easy to maintain Flavor - Web: small and frequent application (affinity and cache consideration) - HPC: big and long life application (runtime robust, <-homomorphic coding) For cluster (many servers), high efficient and easy-to-use platform is needed.
  • 9. Astimegoon -Complex -Heavy -Expensive Web Application Framework for Cluster HTTP + Cookie + CGI HTTP + Application Server + Session HTTP + Heavy Application Server + Heavy Object Session Load Balancer Heavy Load Balancer memchache Web App Framework History - simple server framework for cluster - minimum session, minimum server persistence - reconsideration of cookie and client (instead of session & load balancer model) - not only request/response model but also publish/subscribe model or … Reconsideration of Web App Framework for efficiency e.g. HTTP + Cookie + CGI/wsgi/rack/… or PHP (no session or minimum session framework) Light Load Balance (low cost and loose relation of user & server, DNS RR, SDN, …) + + + RDB+ RDB NoSQL+ +cache+ Rails, Django, … NoSQL time
  • 10. Eco PHP Platform •Eco PHP language= subset of PHP (optimized for Compiler and CPU like http://asmjs.org/ in JS world) •Eco programming convention and Eco Programmer •Eco library •Eco language engine •HipHop compiler •HipHop machine (VM, Processor, SoC) •Eco framework for cluster •Application framework with distributed computing technology •Disaggregated Rack
  • 11. Eco Programming Culture new programming culture Eco programming is more electric-power-efficient programming. Eco language, eco platform, eco programming convention, and eco programmer makes the world better. eco PHP is cool! Like Eco Wordpress
  • 12. Goal Create new programming culture • Build eco application framework (eco PHP and middleware) • Foster eco programmer (eco programming conventions) Key technology • Building eco platform to maximize runtime efficiency on OCP physical system • Measurement of runtime efficiency
  • 13. MEASUREMENT OF RUNTIME EFFICIENCY for the most efficient computing infrastructures
  • 14. Measuring efficiency Hacking Conventional Computing Infrastructure We started a project at Facebook almost two years ago with a pretty big goal: to build one of the most efficient computing infrastructures at the lowest possible cost. We decided to honor our hacker roots and challenge convention by custom designing and building our software, servers and data centers from the ground up – and then share these technologies as they evolve. Measure the runtime efficiency
  • 15. Runtime energy efficiency calls of Function A Energy consumption of CPU (Wh) user operations of Application A Energy consumption of server (Wh) Work served Energy consumption e.g.
  • 16. Example of efficiency Facebook users Power Plants Blog views & updates / sec Racks CPUs convert(), edit(), … Library calls / sec
  • 17. energy measurement scope work granularity CPU CPU + memory CPU + memory + IO … Server … Servers … Code snippet Function  Application  work served energy consumption Choice of numerator and denominator Work granularity •Code snippet: e.g. for(){…}, … •Function: e.g. regex, image processing, … •Application: e.g. wordpress •Service: facebook Energy consumption measurement scope •CPU •CPU + memory … •Server … •+ Network + Client
  • 18. Type of measurement application / server work load eco Wordpress 201x Load scenario A - user behavior A - 1000 user - 10 min energy measurement scope Server (OCP1.0 H/W) x 1 Example 1: Application/Server Application (wordpress) A Server Energy consumption Work(Load) Eco wordpress 2014 Eco wordpress 2015 Eco wordpress 2016 Year Test pattern (work load) is contributed by facebook/linaro results?
  • 19. Example2: CFD Benchmark/A Disaggregated Rack Fluid Calculation (CFD Benchmark) A Disaggregated Rack for HPC
  • 20. Relations with other OCP Project • HipHop Project (PHP Compiler, PHP VM) • Processor or SoC Project? (Intel, AMD, ARM, …) • Disaggregated Rack • Japan chapter: “eco Ruby” sub project
  • 21. 2015 document 1 . Application Framework 1.1 Eco PHP 2015 1.1.1 language spec 1.1.2 programming convention 2. Measurement 2.1 wordpress/rack 2.2 2014 vs 2015 … Documents in future 2014 document 1. Application Framework 1.1 Eco PHP 2014 1.1.1 language spec 1.1.2 programming convention 2. Measurement 2.1 wordpress/server 3. Future vision Application Framework And Measurement of Runtime Efficiency 2014 2016 document 1. Application Framework 1.1 Eco PHP 2016 1.1.1 language spec 1.1.2 programming convention 1.2. Eco Ruby 2016 … 2. Measurement 2.1 wordpress/rack 2.2 eco library/CPU … Energy Work(Load) Eco wordpress 2014 Eco wordpress 2015 Eco wordpress 2016