SmartOS: The Worlds Most Advanced Operating SystemJoyent SmartOS provides a combination of hardware and operating system (OS)virtualization to support efficient, reliable and high performing cloud computing.• Scale. An ultra-lean hypervisor that produces frictionless scale and fastprovisioning.• Trust. The ZFS ﬁle system guarantees data integrity and prevent silent datacorruption.• Secure. OS virtualization with highly secure zones, and KVM for legacy apps.• Reliable. Run from a live image. Impossible to fail upgrades when you canrollback to an earlier image.• Resilient. Service Management Facility (SMF) recovers faster from systemfailures. Fair share scheduling, CPU caps, and disk I/O throttling ensures betterperformance across the Joyent cloud.• Visibility. DTrace, lets you see everything thats happening throughout thesoftware stack - safely, in real time, in production.
CLOUD BARCAMPSDC 7 – Next features07/06/2013Luigi20
SDC 7 Next Features • Firewall • Load Balancing soluQon • Auto-‐scaling • VPC Support • MulQ-‐user environment • Object store (Manta) 21
Firewall & Load balancer • AWS ELB CompaQble API • LB Developed by Riverbed • Shared or dedicated service 22
Auto-‐scaling • Automated full machine templaQng • Including OS, AddiQonal packages, ApplicaQon & conﬁguraQons • AutomaQc provisioning – Based on cpu/memory/network thresholds – AutomaQc setup for Balancer/DNS – Support for smartos / kvm 23
VPC Support • AWS VPC CompaQble API • Developed by • Private backend network • Ability to isolate backend network among diﬀerent costomers • VPN naQve support 24
28 Marlin‣ A facility for running compute jobs directly on Manta storage nodes‣ Complete EC2-like batch compute environment- A framework for distributing such work to the right physical servers, tracking whichpieces are complete, capturing the output, and repeating the whole process tofacilitate multi-phase computation onobjects at rest‣ Complete unix environment without any ETL• A non-interactive unix shell environment for doing "work" on Manta objects as localﬁles Revolutionary part‣ Customers are able to do queries,create datapipes, do transformationsand map reduce on objects very quicklyand without data movement and theadditional costs of spinning upinstances
29 Use Case Examples‣ Log processing• Clickstream analysis, map reduce on logs‣ Image processing• converting formats, generating thumbnails‣ Video processing• transcoding, extracting segments, resizing‣ “Hardcore" data analysis• NumPy, SciPy, R, machine learning, datamining‣ SQL-‐like queries over structured data • Similar to what Hive provides for Hadoop ‣ Datapipeling • MySQL, Postgres plus other clients ‣ Text processing • Internal search engines ‣ Backup and Disaster recovery • Encrypt and verify integrity without moving/ downloading the data Key Security &Sharing Example‣ With rich access controls in Manta,it is possible to run compute onother users data thats beenmade available to you• Without actually having access to it• Without having to ship it• Without being able to egress thedataset itself