Atmos Cloud -levytilaa pilvipalveluna, Antti Mäkinen


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Atmos Cloud -levytilaa pilvipalveluna, Antti Mäkinen

  1. 1. EMC ATMOS Storage Cloud today© Copyright 2010 EMC Corporation. All rights reserved. 1
  2. 2. EMC Atmos Products Deliver a Solution •  Eliminate file system limitations on namespace, size, location •  Make data globally available for custom or packaged applications •  Manage 10-times more scale in less time with policy- based automation •  Elastically deploy and manage multiple sites as one system •  Quickly offer self-service storage to better support developers •  Understand and reduce costs with utilization tracking© Copyright 2010 EMC Corporation. All rights reserved. 2
  3. 3. What is EMC Atmos? Custom or Packaged Applications REST, SOAP, or file services access No limits on namespace or location Multi-tenancy securely isolates data Automated location, protection, and efficiency services Self-Service Single GUI Available on purpose-built appliances or virtualized software Experience SITE #1 SITE #2 SITE #3 Los Angeles New York London© Copyright 2010 EMC Corporation. All rights reserved. 3
  4. 4. Atmos and Atmos Cloud Delivery PlatformProvide a Complete Storage Service Solution Traditional or web scale access/management Atmos Cloud Delivery Platform Ÿ  Web (REST/SOAP) and file services (IFS/NFS/CIFS) Metering Module Portal Ÿ  Unlimited namespace with rich metadata Atmos Software Ÿ  Multi-tenant secure isolation and metering Web Service APIs File Services Operational efficiency Namespace/Multi-tenancy/ Policies/Data Services Ÿ  Data replication, erasure coding, compression, deduplication, Spin Down by policy Ÿ  Advanced options for network management Elasticity and massive scalability Billions of objects, exabytes of capacity, multiple sites Ÿ  Management across sites with minimal overhead Ÿ  Exabyte-scale, scale-out object storage available Atmos Hardware Atmos Virtual Edition as an appliance or virtualized software VMware vSphere and Industry-standard servers/storage VMware-supported Self-service storage servers/storage Ÿ  Metering for billing/chargeback; turnkey portal© Copyright 2010 EMC Corporation. All rights reserved. 4
  5. 5. Atmos Makes Content a Tier 1 ApplicationContent-rich web applications • Solves global scale and access challenges • Reduces management, improves recovery • Application integration in daysInfrastructure as a service • Turnkey self-service storage capabilities AT&T • Natively isolates tenants for security and metering • Competitive cost of serviceArchiving to the cloud Hill Air Force Base • Supports multiple archives/applications with multi-tenancy • Natively provides disaster protection Global Financial Services Firm • Extends to Atmos-powered clouds Global Pharmaceutical Firm© Copyright 2010 EMC Corporation. All rights reserved. 5
  6. 6. Atmos Supports Custom and Packaged Apps Custom applications Packaged applications File/block on-ramps Business collaterals File Management Appliance E-commerce Medical imaging 3D imaging Atmos NFS/CIFS/IFS WAN or LAN access with lightweight Atmos REST API No limits on namespace or location Multi-tenancy and automated management EMC Enables ISVs to deliver and deploy Atmos cloud-based solutions to customers with minimal infrastructure and engineering investment© Copyright 2010 EMC Corporation. All rights reserved. 6
  7. 7. Content-Rich Web Application Customer-Facing Web Application Challenge Atmos Web Service Interfaces + Metadata •  Global distribution (Canada, U.S., EMEA) Atmos Policy “isPaid N” Atmos Policy “isPaid Y” •  Increasing mix of digital media (photos) Solution •  Deploy Atmos in three sites Canada •  Set different policies to enable different cost and margins for different types of customers: –  isPaid N—two local replicas, no asynchronous remote CIFS –  isPaid Y—two local replicas, one asynchronous remote U.S. EMEA –  Intelligently send content to printing facilities Backup •  Create another tenant to use Atmos as a backup Application target through CIFS Benefits§ Vistaprint —$500M global marketing company •  Saved ~$1.4 million storage/$300,000 bandwidth§ Critical web application for online document creation •  100% availability, meets or exceeds application latency requirements§ Three sites globally—Canada, U.S., EMEAC A S E S T U D Y© Copyright 2010 EMC Corporation. All rights reserved. 7
  8. 8. Infrastructure-as-a-Service Cloud Storage Service Portal Challenge Atmos REST + Metadata • Delivering disruptive technology as a service Atmos Policy 1 Atmos Policy 2 Reporting/Metering/Billing/Chargeback Solution • Deploy Atmos in multiple datacenters • Set policies for different levels of service • Integrate enablement technologies –  Self-service portal –  Reporting –  Metering (Atmos Cloud Delivery Platform) Atmos Site 1 Atmos Site 2 • Align with Atmos trusted ISV solutions Benefits§ AT&T—$100B telecommunications company • New business model, self-service storage to§ Enterprise-class hosting services and market in 90 days management capabilities§ Multiple datacenters across the globeC A S E S T U D Y© Copyright 2010 EMC Corporation. All rights reserved. 8
  9. 9. Archiving Content to the Cloud Internal Custom R&D Applications Challenge File Management Appliance Policies • Tier 1 NAS capacity reached Celerra NFS Interface Atmos REST + Metadata • Blocked by typical file system capacity limits Celerra NSX Solution File Management • Deploy Atmos to support Tier 1 NAS and File Appliance Management Appliance 16TB NFS • Extend Atmos to serve the archive as a new 12TB tenant—no application rewrites, no new cost • Set policy for two synch copies on one Atmos Atmos frame and one synch copy on the other Benefits§ $20B pharmaceutical company • “Limitless” storage repository§ Homegrown R&D applications generating • Multi-tenant flexibility for other uses overwhelming volume of unstructured content • Future extension to Atmos-powered external cloud serviceC A S E S T U D Y© Copyright 2010 EMC Corporation. All rights reserved. 9
  10. 10. Atmos In The Field: Real Benefits Traditional Storage Atmos Tens of terabytes in one namespace Several petabyte-scale systems in production 700 million objects in production in a single Millions of files system IOPs-oriented 9,000 objects served per second Difficult to support multiple sites or Many multi-site systems in production; millions of business models dollars saved with intelligent data management Access to storage takes one month with a Access to storage takes minutes with a self- ticketing system and standard process service process Self-service takes months of development Self-service production deployment in less than and deployment 90 days© Copyright 2010 EMC Corporation. All rights reserved. 10
  11. 11. Building the Most Comprehensive Cloud Atmos Hosted Cloud Delivery Platform PEER 1 Solutions Deploy Atmos-Powered And growing… Self-Service Service Providers CBICI Storage AT&T Unisys ISV Backup to the Cloud Collaboration Database Archiving Content Management Solutions Medical Imaging Content Delivery ILM File Archiving Atmos Virtual Edition Deployment Atmos Models Web Services Atmos Atmos .NET Java Technology Intel RSA Policy Based Architecture Developers C FX PHP Partners Dell VMware Global Scale© Copyright 2010 EMC Corporation. All rights reserved. 11
  12. 12. Atmos Architecture and Topology Apps/Bindings/OS .NET Java C FX PHP Web File File NetWorker File Mac Windows Application Share Management Backup Share Appliance Linux Archive Web Services File System Access REST SOAP CIFS NFS IFS REST NFS REST REST CIFS Atmos Object API Policy Engine Software Data Services Tenant 1 Tenant 2 Tenant 3 Federated Copy Hardware TCP/IP TCP/IP TCP/IP Atmos-Powered Los Angeles New York London Cloud Service© Copyright 2010 EMC Corporation. All rights reserved. 12
  13. 13. Atmos Adaptively Automates ManagementIncreasing operational efficiency: Accounts Payable example Business determines business objectives and value of data Applications trigger policy with metadata: “Status = inprogress” Policies drive actions at the object level: Where to store information (location) What data services to apply (Spin Down, compression, deduplication, striping) What protection techniques to use (Atmos GeoProtect) Active Workflow Longtail Retention Status = inprogress Status = complete One erasure-coded One erasure-coded Two synch copies, One asynch One asynch copy, spun down, copy, spun down, striped copy copy deduplicated deduplicated Los Angeles New York London New York London© Copyright 2010 EMC Corporation. All rights reserved. 13
  14. 14. EMC Atmos GeoProtectManaging storage at global scale•  Optimize your performance, protection, and cost by object•  Two policy-based techniques to choose from•  Leverage both to support flexible business models Replication Erasure coding Synchronous or Multiple encoded asynchronous copies fragments distributed distributed across across components locations for increased content durability© Copyright 2010 EMC Corporation. All rights reserved. 14
  15. 15. Additional Data Services •  Compression –  Reduction of physical space required for object storage •  Deduplication –  Reduction of replicated identical objects •  Spin Down Object-level –  Power-efficient method for long-term storage data services Node-level •  Striping data services –  Data striping within nodes or across nodes for higher System-level throughput auto-configuration services •  Auto-configuration and auto-healing –  Install once—new capacity is automatically added© Copyright 2010 EMC Corporation. All rights reserved. 15
  16. 16. Atmos Enables Grouping and Chargeback IP address: Tenant A IP address: Tenant B Multi-tenancy enables:User 1 User n User 2 User n App 3 App n App 4 App n •  Isolation of groups of users (tenants) and their data for NFS Subtenant CIFS Subtenant REST Subtenant REST Subtenant security and utilization tracking •  Isolation of administration Tenant A: R&D Tenant B: Human Resources •  Optimization of policies for tenant data NODE 1 NODE 5 NODE 1 NODE 5 NODE 2 NODE 6 NODE 2 NODE 6 •  Continued sharing of total NODE 3 NODE 7 NODE 3 NODE 7 available capacity—independent NODE 4 NODE 8 NODE 4 NODE 8 of location—for maximum Atmos in Boston Atmos in London utilization Shared Atmos Capacity and Data Services© Copyright 2010 EMC Corporation. All rights reserved. 16
  17. 17. Atmos Cloud Delivery PlatformRadically Accelerates IT Process Create Sign up groups Application Get Track IT Provider Developer storage utilization Atmos Cloud Delivery Platform Atmos StorageApplication developers/applications: IT providers: •  Access to storage in minutes instead of months •  Reduce management complexity •  Access to metadata for tagging, indexing, etc. •  Reduce bottlenecks and improve customer satisfaction •  Never worry about “free space” or storage again •  Drive chargeback based on actual storage consumption •  Focus on development instead of IT process •  Focus on strategic projects, not mundane chores© Copyright 2010 EMC Corporation. All rights reserved. 17
  18. 18. Unified System Management Browser-Based Management GUI •  Manage at petabyte scale across sites as one system –  Manage by browser-based GUI or programmable API –  Access through any Atmos REST server in the cloud Management API •  Levels of administration with different privileges Multiple sites, multiple petabytes, managed as one system –  SSL support encrypts access –  Integrates with customer LDAP Los Angeles New York London© Copyright 2010 EMC Corporation. All rights reserved. 18
  19. 19. Atmos Deployment Models Purpose-built hardware Software on VMware Ÿ  Standard components—factory configured, racked, and cabled Ÿ  Certified with EMC Unified Ÿ  Flexible, cost-effective service model/user-serviceable Storage (NFS, FC, iSCSI); Ÿ  Optional high availability and redundancy; 30 drives per 3U drawer VMware-supported servers and third-party storage WS2-120 WS2-240 WS2-360 Atmos Virtual Edition Small/Medium Compute Dense Compute Capacity Flexibility Intel Xeon 5500 “Nehalem” Micro architecture VMware vSphere 2 TB low-power SATA drives (lower power per BTU at two-times capacity) NFS/FC/iSCSI Storage Ÿ  1:15 servers-to-disks Ÿ  1:15 servers-to-disks Ÿ  1:60 servers-to-disks Ÿ  Starts at 10 TB Ÿ  60 TB cloud entry point Ÿ  Up to 480 TB per rack Ÿ  Up to 720 TB per rack Ÿ  Up to 960 TB per site Ÿ  Up to 240 TB per rack© Copyright 2010 EMC Corporation. All rights reserved. 19