A	
  Scalable	
  and	
  Distributed	
  	
  
Electrical	
  Power	
  Monitoring	
  System	
  
	
  U:lizing	
  Cloud	
  Compu...
Outline	
  
•  Background	
  
•  System	
  overview	
  
•  Design	
  of	
  hardware	
  and	
  soKware	
  
•  Deployment	
 ...
Background	
  
•  The	
  power	
  consumpPon	
  of	
  data	
  
centers	
  and	
  networks	
  becomes	
  
an	
  issue	
  of...
Mo:va:on	
  
•  VisualizaPon	
  is	
  key	
  to	
  plan	
  power	
  savings.	
  
•  The	
  total	
  system	
  cost	
  and	...
System	
  overview	
  
Data collecting
unit Data collecting
unit

2 Data collecting unit	

…	
…	

Update power usage
using...
Small	
  start	
  Go	
  big	
  
Google	
  App	
  Engine	
  
Data	
  store	
  

4	
  sensors	
  

32	
  ports	
  

=	
  128...
Low-­‐cost	
  power	
  measuring	
  unit	
  	
  
•  Send	
  data	
  to	
  data	
  collecPng	
  unit	
  every	
  second.	
 ...
Data	
  collec:ng	
  unit	
  (1/2)	
  
•  Gather	
  data	
  from	
  up	
  to	
  32	
  power	
  measuring	
  unit	
  
•  Pu...
Data	
  collec:ng	
  unit	
  (2/2)	
  
Power
Measuring Unit	

data store	
RJ-45 ports x 32	

CPU board (T-SH7706LSR)
-  SH...
Data	
  store	
  and	
  REST	
  protocol	
  
data store	

config
DB	

Configuration	

power
logging DB	

Data collecting
u...
Google	
  App	
  Engine	
  
•  PaaS	
  cloud	
  service	
  for	
  web	
  applicaPons	
  
–  Java,	
  Python,	
  and	
  Go	...
REST	
  API	
  
path	
  

method	
  

descrip:on	
  

/update	
  

POST	
  

Upload	
  data	
  

/latest	
  

GET	
  

Get...
Update	
  from	
  Data	
  collec:ng	
  unit	
  
Each	
  data	
  collecPon	
  unit	
  sends	
  
data	
  every	
  20	
  seco...
Data	
  retrieval	
  
An	
  applicaPon	
  periodically	
  (e.g.,	
  1	
  
min)	
  gets	
  data	
  from	
  GAE	
  

GAE	
  ...
Deployment	
  at	
  AIST	
  campus	
  
Server	
  room	
  

10	
  data	
  collecPng	
  units	
  
177	
  power	
  measuring	...
Installa:on	
  in	
  AIST	
  server	
  room	
  

Data collecting unit
in free access floor	

Clamp-on
current sensor	

Pow...
Summary	
  
•  Our	
  proposed	
  system	
  helps	
  reduce	
  total	
  system	
  cost	
  and	
  
improve	
  scalability	
...
Q&A	
  

Thanks	
  for	
  your	
  agenPon!	
  

This	
  research	
  was	
  parPally	
  supported	
  by	
  the	
  NEDO	
  r...
Visualiza:on	
  Applica:ons	
  
less	
  than	
  90%	
  of	
  the	
  upper	
  limit	
  
less	
  than	
  95%	
  of	
  the	
 ...
Upcoming SlideShare
Loading in...5
×

A Scalable and Distributed Electrical Power Monitoring System Utilizing Cloud Computing

480

Published on

CUTE 2013

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
480
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
22
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

A Scalable and Distributed Electrical Power Monitoring System Utilizing Cloud Computing

  1. 1. A  Scalable  and  Distributed     Electrical  Power  Monitoring  System    U:lizing  Cloud  Compu:ng   Ryousei  Takano,  Hidemoto  Nakada,   Toshiyuki  Shimizu,  Tomohiro  Kudoh     Informa(on  Technology  Research  Ins(tute,     Na(onal  Ins(tute  of  Advanced  Industrial  Science  and  Technology  (AIST),  Japan   CUTE2013@Da  Nang,  Vietnam,  Dec.  19  2013  
  2. 2. Outline   •  Background   •  System  overview   •  Design  of  hardware  and  soKware   •  Deployment  at  AIST  campus   •  Summary   2  
  3. 3. Background   •  The  power  consumpPon  of  data   centers  and  networks  becomes   an  issue  of  vital  importance  to     IT  industries.   Google  data  center  in  the  Dalles,  Oregon       •  In  Japan,  there  is  an  urgent   need  for  green  IT  technologies   aKer  March  11th,  2011.   Fukushima  Daiichi  Nuclear  Power  Plant   3  
  4. 4. Mo:va:on   •  VisualizaPon  is  key  to  plan  power  savings.   •  The  total  system  cost  and  scalability  are  problem.   –  Our  server  room  has  over  100  racks.   –  Our  campus  are  geographically  distributed  in  Japan.   •  The  system  has  to  be  low-­‐cost,  scalable,  and  also  ease   to  develop  applicaPons.   ➡ Cheap  power  monitoring  hardware   ➡ Power  monitoring  soKware  uPlizing  cloud  compuPng   ➡ A  simple  REST  API   4  
  5. 5. System  overview   Data collecting unit Data collecting unit 2 Data collecting unit … … Update power usage using REST w/ JSON 3 Data store Google App Engine Data store Retrieve data using REST w/ JSON Alert 4 Applications 1 Power measuring unit Viewer Observe the state of power consumption Plan power saving 5  
  6. 6. Small  start  Go  big   Google  App  Engine   Data  store   4  sensors   32  ports   =  128  sensors   Data  store   Sensors  can  be  incrementally  installed.   ...   6  
  7. 7. Low-­‐cost  power  measuring  unit     •  Send  data  to  data  collecPng  unit  every  second.   •  The  producPon  cost  is  approximately  120  USD,   including  the  cost  of  4  current  sensors.   Clamp-­‐on  current  sensor  (max:  4)   RJ-­‐45  port   Signal  processing  board   (dsPIC30F3013)   7  
  8. 8. Data  collec:ng  unit  (1/2)   •  Gather  data  from  up  to  32  power  measuring  unit   •  Push  data  to  GAE   –  Can  be  placed  behind  NAT   To  power  measuring  unit   (Not  Ethernet,  data  transfer  and  power  supply)   To  GAE  via  the  Internet   (Ethernet/100BaseT)   8  
  9. 9. Data  collec:ng  unit  (2/2)   Power Measuring Unit data store RJ-45 ports x 32 CPU board (T-SH7706LSR) -  SH3 Linux -  Buildroot 2011.05 -  pmon.py Serial/Parallel converter (Xilinx Spartan-3E) 9  
  10. 10. Data  store  and  REST  protocol   data store config DB Configuration power logging DB Data collecting unit “unit” Get, query Update Application pmon.py pmon.py pmon.py Power measuring unit “sensor” Current sensor “probe” Application … … 10  
  11. 11. Google  App  Engine   •  PaaS  cloud  service  for  web  applicaPons   –  Java,  Python,  and  Go  are  supported   –  Your  applicaPon  will  have  URL  like     hgp://XXXX.appspot.com   •  Scalable  and  stable  data  storage   –  Data  are  replicated  to  5  different  datacenters   –  Allows  2  of  them  to  be  lost  during  operaPon   •  Maintenance  free   –  No  need  to  manage,  almost   •  Cost  effecPve   –  Almost  free  of  charge   11  
  12. 12. REST  API   path   method   descrip:on   /update   POST   Upload  data   /latest   GET   Get  all  data  for  the  last  minute   /latest,N   GET   Get  all  data  for  the  last  N  minutes   /summary.s/YYYYmmDDHHMMSS,N   GET   Get  all  data  for  each  second  start  from   YYYYmmDDHHMMSS,  for  N  seconds   /summary.m/YYYYmmDDHHMM,N   GET   Get  all  data  for  each  minute  start  from   YYYYmmDDHHMM,  for  N  minutes   /summary.h/YYYYmmDDHH,N   GET   Get  all  data  for  each  hour  start  from  YYYYmmDDHH,   for  N  hours   /summary.d/YYYYmmDD,N   GET   Get  all  data  for  each  day  start  from  YYYYmmDD,  for   N  days   /query.s/LOC/YYYYmmDDHHMMSS,N   GET   Get  data  for  locaPons  that  name  start  with  LOC   /query.m/LOC/YYYYmmDDHHMM,N   GET   /unit-­‐config/UNIT_ID   GET   Get  configuraPon  data   /unit-­‐config/UNIT_ID   PUT   Set  configuraPon  data   12  
  13. 13. Update  from  Data  collec:ng  unit   Each  data  collecPon  unit  sends   data  every  20  seconds   GAE   xxx.appspot.com/update   –  POST  the  following  JSON  string   {            "id":      "UNIT_ID"            "Pme":  "1319837460”    /*  elapsed  seconds  from  the  UNIX  epoch  Pme  */            "power":    {                                      /*  data  for  the  last  20  seconds  per  measurement  point  */                  "sensor0.0":  [VAL0,  VAL1,  VAL2,  VA3,  ...,  VAL19],                  "sensor0.1":  [VAL0,  VAL1,  VAL2,  VA3,  ...,  VAL19],                  "sensor1.0":  [VAL0,  VAL1,  VAL2,  VA3,  ...,  VAL19],                  ....            }   }   13  
  14. 14. Data  retrieval   An  applicaPon  periodically  (e.g.,  1   min)  gets  data  from  GAE   GAE   xxx.appspot.com/latest,N   –  GET  the  following  JSON  string   {          "Pme":  “1319837460”  /*  epoch  Pme  */          "PmeStr":  “201110290631”  /*  human  readable   Pme  in  JST  */          "power":  {                  "LOCATION0":  [1234]                  "LOCATION1":  [1234]                  "LOCATION2":  [1234]                  "LOCATION3":  [1234]                  "LOCATION4":  [1234]                  ...          }   }   Viewer  applicaPon   14  
  15. 15. Deployment  at  AIST  campus   Server  room   10  data  collecPng  units   177  power  measuring  units   620  measurement  points   Data  collecPng   unit   Data  collecPng   unit   1 1 2 …   Sensor  module   Clamp-­‐on   current  transformer   Update  power  usage   using  REST  w/  JSON     2 store   3 …   gather   view   Google  App  Engine   Retrieve  data  using   REST  w/  JSON   Datastore   Clean  room   1 Data  collecPon   unit   2 3 billing  service   Viewer   15  
  16. 16. Installa:on  in  AIST  server  room   Data collecting unit in free access floor Clamp-on current sensor Power distribution board data store Power measuring unit 16  
  17. 17. Summary   •  Our  proposed  system  helps  reduce  total  system  cost  and   improve  scalability  by  employing  low-­‐cost  power  measuring   units  (30  USD  per  measurement  point),  and  uPlizing  cloud   compuPng.   –  The  development  of  the  system  was  completed  within  3  months.   –  We  have  successfully  operated  it  over  2  years  for  to  provide  an   electricity  billing  service  and  evaluate  the  power  efficiency  of  data   processing  middleware.   •  Future  work   –  Tolerance  for  network  failures.   –  More  applicaPons:  e.g.,  server  consolidaPon  on  a  private  cloud  to   reduce  power  consumpPon.   17  
  18. 18. Q&A   Thanks  for  your  agenPon!   This  research  was  parPally  supported  by  the  NEDO  research  project   enPtled  “Research  and  Development  Project  for  Green  Network/ System  Technology  (Green  IT  Project).”   18  
  19. 19. Visualiza:on  Applica:ons   less  than  90%  of  the  upper  limit   less  than  95%  of  the  upper  limit   more  than  95%  of  the  upper  limit   Offline   (a)  Web  applicaPon   (b)  Desktop  applicaPon   19  
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×