CLOUD BARCAMPInfrastructure07/06/2013Luigi1	  
Techology	  partners	  
Customers	  
HW	  Architecture	  
150+	  Servers	  15	  TB	  of	  ram	  2	  PB	  of	  Storage	  30+30Gbit	  of	  Internet	  3	  Datacenters	  
Customers	  
Architecture	  –	  Key	  points	  
Architecture	  –	  KVM	  stack	  
Joyent	  vs	  Amazon	  EC2	  
SmartOS: The Worlds Most Advanced Operating SystemJoyent SmartOS provides a combination of hardware and operating system (...
KVM	  OSs	  
SmartAppliances	  
CLOUD BARCAMPDeveloper07/06/2013Antonio13	  
Self-­‐provisioning	  
Self-­‐provisioning	  
16	  
AnalyQcs	  
Cloud-­‐api	  hSp://joyentapi-­‐mi.libero.it	  hSp://joyentapi-­‐rm.libero.it	  
DocumentaQon	  &	  Guides	  hSp://joyent.com/developers	  
CLOUD BARCAMPSDC 7 – Next features07/06/2013Luigi20	  
SDC 7 Next Features	  •  Firewall	  •  Load	  Balancing	  soluQon	  •  Auto-­‐scaling	  •  VPC	  Support	  •  MulQ-­‐user	...
Firewall	  &	  Load	  balancer	  •  AWS	  ELB	  CompaQble	  API	  •  LB	  Developed	  by	  Riverbed	  •  Shared	  or	  ded...
Auto-­‐scaling	  •  Automated	  full	  machine	  templaQng	  •  Including	  OS,	  AddiQonal	  packages,	  ApplicaQon	  &	 ...
VPC	  Support	  •  AWS	  VPC	  CompaQble	  API	  	  •  Developed	  by	  	  •  Private	  backend	  network	  •  Ability	  t...
MulQ-­‐user	  environment	  •  Resource	  controls	  •  Permissions	  •  AudiQng	  •  DelegaQon	  /	  CollaboraQon	  25	  
Manta	  (object	  store)	  •  MulQ-­‐datacenter	  •  No	  size	  limits	  •  API	  Language	  support	  – REST,	  Shell,	 ...
27	  
28	  Marlin‣ A facility for running compute jobs directly on Manta storage nodes‣ Complete EC2-like batch compute environm...
29	  Use Case Examples‣ Log processing• Clickstream analysis, map reduce on logs‣ Image processing• converting formats, ge...
Tips07/06/2013Luigi30	  
31	  	  -­‐  Balancer*	  -­‐  NGINX	  -­‐  Cache	  (NGINX	  /	  MEMCACHED	  /	  VARNISH)	  -­‐  PGPOOL2	  &	  MYSQL-­‐PROX...
Q & A07/06/2013Luigi32	  
Upcoming SlideShare
Loading in …5
×

Joyent Infrastructure, SmartOS, API - Cloud Barcamp Italia on Line - Luigi Erardi, Antonio Bevacqua

1,804 views

Published on

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,804
On SlideShare
0
From Embeds
0
Number of Embeds
93
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Joyent Infrastructure, SmartOS, API - Cloud Barcamp Italia on Line - Luigi Erardi, Antonio Bevacqua

  1. 1. CLOUD BARCAMPInfrastructure07/06/2013Luigi1  
  2. 2. Techology  partners  
  3. 3. Customers  
  4. 4. HW  Architecture  
  5. 5. 150+  Servers  15  TB  of  ram  2  PB  of  Storage  30+30Gbit  of  Internet  3  Datacenters  
  6. 6. Customers  
  7. 7. Architecture  –  Key  points  
  8. 8. Architecture  –  KVM  stack  
  9. 9. Joyent  vs  Amazon  EC2  
  10. 10. SmartOS: The Worlds Most Advanced Operating SystemJoyent SmartOS provides a combination of hardware and operating system (OS)virtualization to support efficient, reliable and high performing cloud computing.• Scale. An ultra-lean hypervisor that produces frictionless scale and fastprovisioning.• Trust. The ZFS file system guarantees data integrity and prevent silent datacorruption.• Secure. OS virtualization with highly secure zones, and KVM for legacy apps.• Reliable. Run from a live image. Impossible to fail upgrades when you canrollback to an earlier image.• Resilient. Service Management Facility (SMF) recovers faster from systemfailures. Fair share scheduling, CPU caps, and disk I/O throttling ensures betterperformance across the Joyent cloud.• Visibility. DTrace, lets you see everything thats happening throughout thesoftware stack - safely, in real time, in production.
  11. 11. KVM  OSs  
  12. 12. SmartAppliances  
  13. 13. CLOUD BARCAMPDeveloper07/06/2013Antonio13  
  14. 14. Self-­‐provisioning  
  15. 15. Self-­‐provisioning  
  16. 16. 16  
  17. 17. AnalyQcs  
  18. 18. Cloud-­‐api  hSp://joyentapi-­‐mi.libero.it  hSp://joyentapi-­‐rm.libero.it  
  19. 19. DocumentaQon  &  Guides  hSp://joyent.com/developers  
  20. 20. CLOUD BARCAMPSDC 7 – Next features07/06/2013Luigi20  
  21. 21. SDC 7 Next Features  •  Firewall  •  Load  Balancing  soluQon  •  Auto-­‐scaling  •  VPC  Support  •  MulQ-­‐user  environment  •  Object  store  (Manta)   21  
  22. 22. Firewall  &  Load  balancer  •  AWS  ELB  CompaQble  API  •  LB  Developed  by  Riverbed  •  Shared  or  dedicated  service  22  
  23. 23. Auto-­‐scaling  •  Automated  full  machine  templaQng  •  Including  OS,  AddiQonal  packages,  ApplicaQon  &  configuraQons  •  AutomaQc  provisioning  – Based  on  cpu/memory/network  thresholds  – AutomaQc  setup  for  Balancer/DNS    – Support  for  smartos  /  kvm  23  
  24. 24. VPC  Support  •  AWS  VPC  CompaQble  API    •  Developed  by    •  Private  backend  network  •  Ability  to  isolate  backend  network  among  different  costomers  •  VPN  naQve  support  24  
  25. 25. MulQ-­‐user  environment  •  Resource  controls  •  Permissions  •  AudiQng  •  DelegaQon  /  CollaboraQon  25  
  26. 26. Manta  (object  store)  •  MulQ-­‐datacenter  •  No  size  limits  •  API  Language  support  – REST,  Shell,  Node.js,  Python,  Ruby,  Java  •  Running  jobs  on  Manta  storage  26  
  27. 27. 27  
  28. 28. 28  Marlin‣ A facility for running compute jobs directly on Manta storage nodes‣ Complete EC2-like batch compute environment- A framework for distributing such work to the right physical servers, tracking whichpieces are complete, capturing the output, and repeating the whole process tofacilitate multi-phase computation onobjects at rest‣ Complete unix environment without any ETL• A non-interactive unix shell environment for doing "work" on Manta objects as localfiles  Revolutionary part‣ Customers are able to do queries,create datapipes, do transformationsand map reduce on objects very quicklyand without data movement and theadditional costs of spinning upinstances  
  29. 29. 29  Use Case Examples‣ Log processing• Clickstream analysis, map reduce on logs‣ Image processing• converting formats, generating thumbnails‣ Video processing• transcoding, extracting segments, resizing‣ “Hardcore" data analysis• NumPy, SciPy, R, machine learning, datamining‣  SQL-­‐like  queries  over  structured  data  •  Similar  to  what  Hive  provides  for  Hadoop  ‣  Datapipeling  •  MySQL,  Postgres  plus  other  clients  ‣  Text  processing  •  Internal  search  engines  ‣  Backup  and  Disaster  recovery  •  Encrypt  and  verify  integrity  without  moving/  downloading  the  data  Key Security &Sharing Example‣ With rich access controls in Manta,it is possible to run compute onother users data thats beenmade available to you• Without actually having access to it• Without having to ship it• Without being able to egress thedataset itself  
  30. 30. Tips07/06/2013Luigi30  
  31. 31. 31    -­‐  Balancer*  -­‐  NGINX  -­‐  Cache  (NGINX  /  MEMCACHED  /  VARNISH)  -­‐  PGPOOL2  &  MYSQL-­‐PROXY  -­‐  VPN  DC  to  DC*  -­‐  Go-­‐StaQc!  (Ajax  &  co.)  -­‐  Firewall  on  VM  
  32. 32. Q & A07/06/2013Luigi32  

×