Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Emc ecs 2 technical deep dive workshop

1,942 views

Published on

Emc ecs 2 technical deep dive workshop

Published in: Technology
  • Be the first to comment

Emc ecs 2 technical deep dive workshop

  1. 1. 1© Copyright 2015 EMC Corporation. All rights reserved. ELASTIC CLOUD STORAGE 2.0 ASD PRODUCT MANAGEMENT
  2. 2. 2© Copyright 2015 EMC Corporation. All rights reserved. • Student Guide & Workshop & Internal Training & Confidential Update Daily • https://goo.gl/VVmVZ0
  3. 3. 3© Copyright 2015 EMC Corporation. All rights reserved. UNSTRUCTURED DATA GROWTH Total Capacity Shipped, Worldwide Unstructured Data 80% 106 EB 133 EB71 EB 75% 78% Source: March 2014, IDC Structured vs. Unstructured Data, The balance of power continues to shift
  4. 4. 4© Copyright 2015 EMC Corporation. All rights reserved. SCALE-OUT OBJECT MARKET $- $0.2 $0.4 $0.6 $0.8 $1.0 $1.2 2014 2015 2016 2017 2018 $0.4 $0.5 $0.7 $0.9 $1.1 Source: IDC Worldwide File and Object Based Storage 2014–2018 Forecast, Oct. 2014 Revenue (in $B) 4© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
  5. 5. 5© Copyright 2015 EMC Corporation. All rights reserved. MODERN APPS ARE DRIVING CHANGE REQUIRE A DIFFERENT ARCHITECTURE/NEW CAPABILITIES  Multi-tenant  Universal Access/Geo-Distributed  Extremely Scalable  “Cloud-like” Attributes
  6. 6. 6© Copyright 2015 EMC Corporation. All rights reserved. CHANGE CREATES CHALLENGE MANAGING DATA GROWTH Private Cloud Public Cloud Hybrid Cloud CLOUD STRATEGY GAIN INSIGHTS FROM DATA
  7. 7. 7© Copyright 2015 EMC Corporation. All rights reserved.  Hyper Scale - Sales Out to Billions of Objects  “Public Cloud-Like” – Secure Access, Anytime, Anywhere  Comprehensive Multi-Tenant Management  Active/Active Geo-Distributed Architecture  Multiple Protocol Support – REST and HDFS Ready  Compelling Economics –Appliance or SW Only (DIY) ECS HYPERSCALE CLOUD STORAGE
  8. 8. 8© Copyright 2015 EMC Corporation. All rights reserved. ECS USE CASES Cloud Modern/ Apps Global Content Repository ArchiveAnalytics Global Namespace Internet of Things Sensor data SITE 1 SITE 2 SITE 3
  9. 9. 9© Copyright 2015 EMC Corporation. All rights reserved. ECS USE CASES UPDATE
  10. 10. 10EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY GLOBAL CONTENT REPOSITORY ON-PREMISE UNSTRUCTURED STORAGE PLATFORM PROBLEM • Can’t cost-effectively manage or scale storage to support explosive growth in unstructured content • Traditional storage not suited for new Web, mobile and cloud applications • Difficult and costly to manage data lifecycle and retention policies across archive silos and sites SOLUTION EMC ECS Appliance (Object and HDFS) VALUE • Reduce complexity and cost–one globally accessible, geo-efficient archive that serves multiple applications and content types at lower cost than public cloud • Anywhere data access – All data globally accessible by Web, mobile and cloud apps • Enterprise-grade data protection – Efficient geo-protection and policy-based retention for basic compliance and governance https://accesspoint.yourcompany.com U.K.L.A. Memphis Applications Tiering, Archiving, Backup
  11. 11. 11EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY MODERN APPLICATION PLATFORM EFFICIENT GEO-CAPABLE STORAGE & ANYWHERE ACCESS https://accesspoint.yourcompany.com U.K.L.A. Memphis PROBLEM • Traditional storage architecture not optimized for multi-site, mobile access to content • Writing to multiple file systems and proprietary APIs complicates development • Can’t access or process large data sets SOLUTION EMC ECS Appliance (Object and HDFS) VALUE • Anywhere access - Provides anywhere access to geo-replicated content • Simpler, faster development - Supports multiple industry standard APIs/protocols and anywhere access with strong consistency • Unmatched access and efficiency - Geo- protection, active-active architecture optimizes both access and storage efficiency for Big Data – large and small files
  12. 12. 12EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY GEO-SCALE BIG DATA ANALYTICS EFFICIENT GEO-SCALE STORAGE & GLOBAL BIG DATA ANALYTICS https://accesspoint.yourcompany.com U.K.L.A. New York ANALYTICS PROBLEM • Large (and growing) data volumes lead to exponential storage costs • Traditional Hadoop replication leads to unmanageable DC footprint with data growth • Always have to move data to the analytics cluster SOLUTION EMC ECS Appliance (Object and HDFS) VALUE • Cost Efficient Storage – ECS is 65% cheaper than even public cloud • HDFS Archive – ECS brings state of the art patented technology to provide highly dense storage for Hadoop • Global Analytics –Bring analytics to geo- distributed data and archives
  13. 13. 13EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY PROBLEM • Unstructured data growth - Reclaim costly Tier 1 storage • Current solutions aren’t scalable or cost efficient • Instant access to cold-stored data is required • “No Public Cloud” policy - Data needs to be on-premises SOLUTION EMC ECS Appliance (Object and HDFS) VALUE Costs less than public cloud - Provides on-premises security U.K.L.A. Memphis LAN/ WAN Video Unstructured Data Sensory Data Images COLD ARCHIVE COST EFFECTIVE LONG TERM RETENTION
  14. 14. 14EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY PROBLEM • Need cost effective solution to store hue amounts of unstructured data generated by IOT and sensors • “No Public Cloud” policy - Data needs to be on-premises • Data collection via modern cloud applications requires compatibility with APIS’s like S3 and OpenStack • Analytics workflow is slow, expensive and complicated using Hadoop direct attach or public cloud storage SOLUTION EMC ECS Appliance (Object and HDFS) VALUE • ECS cost per GB is less than public clouds • ECS provides high availability with on-premises security • ECS is compatible with S3, OpenStack, and other popular API’s • ECS is HDFS compatible and enables a streamlined Hadoop workflow for “data in place” analytics ‘IOT’ CLOUD STORAGE PLATFORM ‘INTERNET OF THINGS’ – SENSORY & TELEMETRY DATA COLLECTION
  15. 15. 15© Copyright 2015 EMC Corporation. All rights reserved. UPCOMING ECS INTEGRATIONS
  16. 16. 16© Copyright 2015 EMC Corporation. All rights reserved. ISILON CLOUDPOOLS SMART TIERING TO OBJECT STORES Key Features Benefits  Stub to Cloud of choice  Extending SmartPools workflow to CloudPools  Ability to send encrypted data to the cloud  Compression for efficient transport  Simple policy based management  Combine file & object store benefits  Use stubs to optimize local storage space, with offsite archive protection  Seamless placement and availability of data per policy  One Accessible namespace SmartPools -> CloudPools Clients SMB | NFS | REST| HDFS | SWIFT OneFS Service Provider Public Cloud ECS
  17. 17. 17© Copyright 2015 EMC Corporation. All rights reserved. EMC CLOUDBOOST LONG TERM RETENTION TO THE CLOUD LAN LAN/WAN CloudBoost appliance Desktops Laptops Files NAS/NDMP VMware & Hyper-V Databases Email Applications DB ROBO Protected by NetWorker, Avamar, NetBackup Key Features Benefits  Long-term retention to ECS for NetWorker, Avamar, NetBackup  Inline variable de-duplication and compression  Data encrypted in-flight and at rest  Cloud choice: private/public clouds  Appliance cache for ROBO  Capacity of up to 6PB logical per appliance  Central management via a cloud portal  Lower storage cost per TB  Efficiency: Reduced network and storage consumption  Lower risk, operational overhead than tape.  Airtight security
  18. 18. 18© Copyright 2015 EMC Corporation. All rights reserved.© Copyright 2015 EMC Corporation. All rights reserved. ECS FREE downloadNew Monitoring Diagnostics Better Multi-Site Performance/Availability
  19. 19. 19© Copyright 2015 EMC Corporation. All rights reserved.  Quota Management  Lock/unlock user/bucket capabilities  Retention Management  Replication policy across tenants and buckets  Operational management efficiency  Support for short and long term data retention Enterprise Features FEATURES KEY BENEFITS
  20. 20. 20© Copyright 2015 EMC Corporation. All rights reserved.  Improved failover scheme, Handling of Temporary Outages  Data is now shipped as it is written  Quick recovery from network outages  Access to data even in the event of a temporary outage  Improved RPO granularity Higher Availability FEATURES KEY BENEFITS
  21. 21. 21© Copyright 2015 EMC Corporation. All rights reserved.  Geo Caching  Better Multi-site Performance  Reduced latency FEATURES KEY BENEFITS Better Multi-Site Performance
  22. 22. 22© Copyright 2015 EMC Corporation. All rights reserved.  Improved tenant/bucket views  Comprehensive capacity reporting/graphs  Real-time Metering for tenants and buckets  Increased visibility, determine capacity across various metrics  Effectively monitor usage across your enterprise Monitoring FEATURES KEY BENEFITS
  23. 23. 23© Copyright 2015 EMC Corporation. All rights reserved.  New storage and replication metrics  Drill down trend charts, usage reports  See performance/system health  Flexible access GUI or API  Simplified management Comprehensive metering and reporting Diagnostics FEATURES KEY BENEFITS
  24. 24. 24© Copyright 2015 EMC Corporation. All rights reserved.  Self Contained /controller-less design  Easy, single command install  Improved User Experience  Rapid Deployment Simplified Deployment FEATURES KEY BENEFITS
  25. 25. 25© Copyright 2015 EMC Corporation. All rights reserved. FREE ECS SOFTWARE 2.0 • Free Unlimited capacity • Free Unlimited time • Go from application prototype to production faster • Container-ized download available on github.com/emcecs/ • Community driven support
  26. 26. 26© Copyright 2015 EMC Corporation. All rights reserved. ECS ECOSYSTEM Enterprise Information Archiving Enterprise Content Management Analytics Cloud Gateways Migration Sync & Share 26© Copyright 2015 EMC Corporation. All rights reserved. Analytics Protocols CAS
  27. 27. 27© Copyright 2015 EMC Corporation. All rights reserved. ECS IN ACTION Analytics: Data in Place Analysis Required ECS created a multi-protocol data lake that is geo-distributed and can accept huge volumes of data from a variety of sources Analytics - Ability to add dense storage without more compute ECS scales compute and storage independently to ensure that the data in the HDFS archive is accessible to analytics applications Modern Applications: Multi protocol object support ECS delivers multi protocol object support to offer customized tax software services using S3 and Swift Global Content Repository – Massive Scale Required ECS is being used to Digitize 40 million pages, and deliver the content to anyone, anywhere on any device Tensor Company LTD *NDA Only – Not public references

×