Building AWS Compatible Cloud Services

1,178 views
1,056 views

Published on

Presentation at Apache CloudStack Collaboration Conference Europe in Amsterdam on 21st November 2013.

http://lanyrd.com/2013/cloudstack-collaboration-conference-europe/scrdzm/

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,178
On SlideShare
0
From Embeds
0
Number of Embeds
48
Actions
Shares
0
Downloads
23
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Building AWS Compatible Cloud Services

  1. 1. Building  AWS-‐‑‒Compatible  Public   Cloud  Service Shinichiro  Kashiwagi Cloud  Services  Division NTT  Communications 1   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Copyright © 2013 NTT Communications Corporation. All right reserved.
  2. 2. Cloudn  introduction •  Who  I  am –  Lead  developer  of  a  public  cloud  service  in  NTT   Communications –  Working  in  UK  branch  now  for  a  VMware-‐‑‒based  private  cloud  service •   Cloudn  -‐‑‒  NTTComʼ’s  public  cloud  service –  Starting  from  6.9  EUR/VM –  AWS-‐‑‒compatible  services  and  APIs Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 2
  3. 3. Service  Concepts •  Comprehensive  low-‐‑‒cost  IaaS  services –  We  are  a  follower –  Support  standard  services,  not  only  Compute •  AWS  Compatible  as  much  as  possible •  Free  Network  traffic –  Benefit  from  our  Tier-‐‑‒1  Global  IP  Backbone  and   global  DC  coverage •  Multi-‐‑‒region,  multi-‐‑‒zone –  Available  in  United  States  and  Japan –  Planning  to  expand  to  other  regions Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 3
  4. 4. Product  Line-‐‑‒up •  Offering  most  popular  AWS  compatible   services  including  EC2,  S3,  ELB.. –  Over  CloudStack! Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 4
  5. 5. Feature  Comparison CloudStack  is  a  IaaS  pla?orm  while  AWS  is  a  comprehensive  service     Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 5
  6. 6. Challenges Feature   AWS   CloudStack   Compute   ✔ (EC2)   ✔   Load  Balancing   ✔ (ELB)   ✔  (beIer  with  NetScaler)   Autoscaling   ✔ (Autoscaling)   Dynamic  DNS   ✔ (Route53)   Monitoring   ✔ (CloudWatch)   Provisioning   ✔ (EC2)   Object  Storage   ✔ (S3)   Databases   ✔ (RDS)   Content  Delivery   ✔ (CloudFront)   Portal   ✔ (console)   ApplicaBon  services     ✔ (SQS,  SNS..)   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Service  Providers   have  to  prepare   6
  7. 7. Architecture Region   Portal   CloudStack   (Compute)   Addi3onal   Services   Zone   L7  Proxy   Monitoring   Opera3on   and  Support     Billing   Zone   Compute  Nodes   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Compute  Nodes   7
  8. 8. Compute •  Cloudstack  AWSAPI  module –  Supporting  important  EC2  APIs –  Limitations •  CloudStack  3.0.6~∼ •  Basic  networking  mode  only •  Mapping  AWS  concepts  to  CloudStack  world •  Regions,  Zones •  Compute  Offering  names •  Differences  in  compute  model –  IP  address  persistency –  Lack  of  local  disk  (Instance  Store  in  AWS) –  Difficult  to  share  templates Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 8
  9. 9. Compute  GUI Compute  GUI  for  CloudStack  2.x  zones   Compute  GUI  for  CloudStack  3.x  zones   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 9
  10. 10. Load  Balancing •  Evaluated  CloudStack  native  load   balancers –  VR  (haproxy),  NetScaler –  No  AWS  API! •  Newly  implemented –  Load  Balancing  “Advanced” –  AWS  ELB  compatible  features •  Multi-‐‑‒zone •  SSL  termination •  AWS  ELB  compatible  API Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 10
  11. 11. Load  Balancing  Advanced  -‐‑‒  GUI Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 11
  12. 12. Dynamic  DNS •  CloudStack  VR  DNS:  dnsmasq –  DHCP  server –  Static  configuration –  No  external  API •  Newly  implemented –  AWS  Route53  compatible  API •  Except  some  features  such  ash  latency  based  round   robin –  No  synchronisation  with  CloudStack  DNS Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 12
  13. 13. Monitoring •  CloudStack  native  HA  mechanism –  Slow  to  detect  failure –  Not  sure  about  DB  integrity  during  convergence –  No  external  interface •  Newly  implemented –  AWS  CloudWatch  compatible  API •  Challenges –  KVM  handler •  virsh  operations  should  be  serialised •  Security  group  bug  in  CloudPlatform  3.x Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 13
  14. 14. Autoscaling •  Available  in  CloudStack  4.1   –  Needs  NetScaler –  Coordination  with   Monitoring  and  Load   Balancing •  CloudStack  Autoscaling   uses  SNMP  for  monitoring   and  controls  CloudStack   load  balancing •  Not  pluggable,  not   extensitble  yet –  No  AWS  API •  Newly  implemented –  Works  without  NetScaler Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 14
  15. 15. Provisioning •  CloudStack  has  no  bulk  VM  provisioning   feature •  Newly  implemented Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 15
  16. 16. Object  Storage •  CloudStack  did  not  have  integrated  object  storage   service •  Adpoted  Cloudian –  Offering  AWS  S3  compatible  API –  Emulate  the  similar  domain  hierarchy  as  CloudStack Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 16
  17. 17. Relational  Database •  Anything  to  do  with  CloudStack? •  We  implemented  anyway –  offering  MySQL  clusters –  with  AWS  RDS  compatible  API Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 17
  18. 18. PaaS •  Anything  to  do  with  CloudStack? •  We  are  offering  CloudFoundry  on  top  of   CloudStack  IaaS Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 18
  19. 19. Portal Reseller specific function Reseller  A   Customer Management Billing Management Payment Management Customer  Support   Reseller-Portal API •  Create Customer •  Delete Customer •  Suspend Customer •  Resume Customer •  Get Billing Info Reseller  B   …..   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Various products Portal    +     Authen3ca3on  Servers   Customer  Management Order Management Common function •  SSO Authentication Portal GUI (SSO to Product GUI) Account Management Product Management Billing Calculation Portal-Product API •  Add Account • Delete Account • Suspend Account • Resume account • Update API Keys • Get Usage
  20. 20. Lessons  learned •  Built  a  subset  of  AWS  service  using  CloudStack –  Using  Ruby  on  Rails  (and  Java) –  AWSAPI  module  is  good –  Users  can  benefit  from  AWS  ecosystem,  including  various   tools  and  techniques •  Key  design  points –  Compute  –  difference  in  model  and  semantics –  API  versions  and  authentication  (signature  versions) –  Behavior  compatibility •  Error  messages •  Abnormal  cases Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 20
  21. 21. “Will  CloudStack  be  following  AWS?” •  AWS  API  is  only  available  for  Compute –  What  about  other  services? –  Will  such  related  services  be  included  in   CloudStack? •  NetScaler-‐‑‒dependence Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 21
  22. 22. Thank  you http://www.ntt.com/cloudn_̲e/ shinichiro.kashiwagi@ntt.eu @skash88 Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 22

×