Building AWS Compatible Cloud Services

  • 710 views
Uploaded on

Presentation at Apache CloudStack Collaboration Conference Europe in Amsterdam on 21st November 2013. …

Presentation at Apache CloudStack Collaboration Conference Europe in Amsterdam on 21st November 2013.

http://lanyrd.com/2013/cloudstack-collaboration-conference-europe/scrdzm/

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
710
On Slideshare
0
From Embeds
0
Number of Embeds
3

Actions

Shares
Downloads
19
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Building  AWS-‐‑‒Compatible  Public   Cloud  Service Shinichiro  Kashiwagi Cloud  Services  Division NTT  Communications 1   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Copyright © 2013 NTT Communications Corporation. All right reserved.
  • 2. Cloudn  introduction •  Who  I  am –  Lead  developer  of  a  public  cloud  service  in  NTT   Communications –  Working  in  UK  branch  now  for  a  VMware-‐‑‒based  private  cloud  service •   Cloudn  -‐‑‒  NTTComʼ’s  public  cloud  service –  Starting  from  6.9  EUR/VM –  AWS-‐‑‒compatible  services  and  APIs Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 2
  • 3. Service  Concepts •  Comprehensive  low-‐‑‒cost  IaaS  services –  We  are  a  follower –  Support  standard  services,  not  only  Compute •  AWS  Compatible  as  much  as  possible •  Free  Network  traffic –  Benefit  from  our  Tier-‐‑‒1  Global  IP  Backbone  and   global  DC  coverage •  Multi-‐‑‒region,  multi-‐‑‒zone –  Available  in  United  States  and  Japan –  Planning  to  expand  to  other  regions Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 3
  • 4. Product  Line-‐‑‒up •  Offering  most  popular  AWS  compatible   services  including  EC2,  S3,  ELB.. –  Over  CloudStack! Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 4
  • 5. Feature  Comparison CloudStack  is  a  IaaS  pla?orm  while  AWS  is  a  comprehensive  service     Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 5
  • 6. Challenges Feature   AWS   CloudStack   Compute   ✔ (EC2)   ✔   Load  Balancing   ✔ (ELB)   ✔  (beIer  with  NetScaler)   Autoscaling   ✔ (Autoscaling)   Dynamic  DNS   ✔ (Route53)   Monitoring   ✔ (CloudWatch)   Provisioning   ✔ (EC2)   Object  Storage   ✔ (S3)   Databases   ✔ (RDS)   Content  Delivery   ✔ (CloudFront)   Portal   ✔ (console)   ApplicaBon  services     ✔ (SQS,  SNS..)   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Service  Providers   have  to  prepare   6
  • 7. Architecture Region   Portal   CloudStack   (Compute)   Addi3onal   Services   Zone   L7  Proxy   Monitoring   Opera3on   and  Support     Billing   Zone   Compute  Nodes   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Compute  Nodes   7
  • 8. Compute •  Cloudstack  AWSAPI  module –  Supporting  important  EC2  APIs –  Limitations •  CloudStack  3.0.6~∼ •  Basic  networking  mode  only •  Mapping  AWS  concepts  to  CloudStack  world •  Regions,  Zones •  Compute  Offering  names •  Differences  in  compute  model –  IP  address  persistency –  Lack  of  local  disk  (Instance  Store  in  AWS) –  Difficult  to  share  templates Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 8
  • 9. Compute  GUI Compute  GUI  for  CloudStack  2.x  zones   Compute  GUI  for  CloudStack  3.x  zones   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 9
  • 10. Load  Balancing •  Evaluated  CloudStack  native  load   balancers –  VR  (haproxy),  NetScaler –  No  AWS  API! •  Newly  implemented –  Load  Balancing  “Advanced” –  AWS  ELB  compatible  features •  Multi-‐‑‒zone •  SSL  termination •  AWS  ELB  compatible  API Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 10
  • 11. Load  Balancing  Advanced  -‐‑‒  GUI Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 11
  • 12. Dynamic  DNS •  CloudStack  VR  DNS:  dnsmasq –  DHCP  server –  Static  configuration –  No  external  API •  Newly  implemented –  AWS  Route53  compatible  API •  Except  some  features  such  ash  latency  based  round   robin –  No  synchronisation  with  CloudStack  DNS Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 12
  • 13. Monitoring •  CloudStack  native  HA  mechanism –  Slow  to  detect  failure –  Not  sure  about  DB  integrity  during  convergence –  No  external  interface •  Newly  implemented –  AWS  CloudWatch  compatible  API •  Challenges –  KVM  handler •  virsh  operations  should  be  serialised •  Security  group  bug  in  CloudPlatform  3.x Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 13
  • 14. Autoscaling •  Available  in  CloudStack  4.1   –  Needs  NetScaler –  Coordination  with   Monitoring  and  Load   Balancing •  CloudStack  Autoscaling   uses  SNMP  for  monitoring   and  controls  CloudStack   load  balancing •  Not  pluggable,  not   extensitble  yet –  No  AWS  API •  Newly  implemented –  Works  without  NetScaler Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 14
  • 15. Provisioning •  CloudStack  has  no  bulk  VM  provisioning   feature •  Newly  implemented Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 15
  • 16. Object  Storage •  CloudStack  did  not  have  integrated  object  storage   service •  Adpoted  Cloudian –  Offering  AWS  S3  compatible  API –  Emulate  the  similar  domain  hierarchy  as  CloudStack Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 16
  • 17. Relational  Database •  Anything  to  do  with  CloudStack? •  We  implemented  anyway –  offering  MySQL  clusters –  with  AWS  RDS  compatible  API Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 17
  • 18. PaaS •  Anything  to  do  with  CloudStack? •  We  are  offering  CloudFoundry  on  top  of   CloudStack  IaaS Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 18
  • 19. Portal Reseller specific function Reseller  A   Customer Management Billing Management Payment Management Customer  Support   Reseller-Portal API •  Create Customer •  Delete Customer •  Suspend Customer •  Resume Customer •  Get Billing Info Reseller  B   …..   Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. Various products Portal    +     Authen3ca3on  Servers   Customer  Management Order Management Common function •  SSO Authentication Portal GUI (SSO to Product GUI) Account Management Product Management Billing Calculation Portal-Product API •  Add Account • Delete Account • Suspend Account • Resume account • Update API Keys • Get Usage
  • 20. Lessons  learned •  Built  a  subset  of  AWS  service  using  CloudStack –  Using  Ruby  on  Rails  (and  Java) –  AWSAPI  module  is  good –  Users  can  benefit  from  AWS  ecosystem,  including  various   tools  and  techniques •  Key  design  points –  Compute  –  difference  in  model  and  semantics –  API  versions  and  authentication  (signature  versions) –  Behavior  compatibility •  Error  messages •  Abnormal  cases Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 20
  • 21. “Will  CloudStack  be  following  AWS?” •  AWS  API  is  only  available  for  Compute –  What  about  other  services? –  Will  such  related  services  be  included  in   CloudStack? •  NetScaler-‐‑‒dependence Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 21
  • 22. Thank  you http://www.ntt.com/cloudn_̲e/ shinichiro.kashiwagi@ntt.eu @skash88 Copyright  ©  NTT  Communica3ons  Corpora3on.  All  right  reserved. 22