Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Introducing Cloudera Director at Big Data Bash

My slide deck for Big Data Bash. This is a quick introduction on Cloudera Director and it ends with a list of open questions around some interesting future problems we are planning to work on.

  • Be the first to comment

Introducing Cloudera Director at Big Data Bash

  1. 1. Introducing Cloudera Director July 28, 2015 @ Big Data Bash! Andrei Savu, asavu@cloudera.com Tech Lead, Cloudera Director
  2. 2. © 2014 Cloudera, Inc. All rights reserved. Agenda Introduction Product Demo What’s next? Questions
  3. 3. Journey to the Cloud
  4. 4. © 2014 Cloudera, Inc. All rights reserved. Deployment Easy deployment; no post-setup configurations AWS Quick Start Cloning clusters Support for elasticity of compute and storage Enterprise Deep security integration: Kerberos & Sentry Cloudera Navigator : Audit / Lineage / Workflow High Availability and resilient services Manageability Manage clusters across multiple environments – on-premises and cloud One dashboard to view all deployed clusters Templates for saved workloads Integration Open console API for simple scripting and automation for scheduled actions Open API plugin for cloud vendor of choice Flexible Integration for controlled deployment in the cloud
  5. 5. © 2014 Cloudera, Inc. All rights reserved. Object Storage (AWS S3, WASB, Swift, Google Cloud Storage) Short running clusters Elastic workload No local storage Long-running clusters Sized to demand Some local storage Fixed clusters Periodic sync Local storage App delivery - HBaseBI / Analysis – Impala, Search ETL / Modeling– MR, Spark Source Data DR/BackupSeed data
  6. 6. © 2014 Cloudera, Inc. All rights reserved. Cloudera Director Cloudera Navigator Cloudera Manager CDH Cluster Cloudera Navigator CLOUDERA ENTERPRISE CDH Cluster CDH Cluster Cloudera Navigator Cloudera Manager CDH Cluster Cloudera Navigator CLOUDERA ENTERPRISE CDH Cluster CDH Cluster
  7. 7. Product Demo
  8. 8. © 2014 Cloudera, Inc. All rights reserved.
  9. 9. © 2014 Cloudera, Inc. All rights reserved.
  10. 10. © 2014 Cloudera, Inc. All rights reserved.
  11. 11. © 2014 Cloudera, Inc. All rights reserved.
  12. 12. © 2014 Cloudera, Inc. All rights reserved.
  13. 13. © 2014 Cloudera, Inc. All rights reserved.
  14. 14. © 2014 Cloudera, Inc. All rights reserved.
  15. 15. © 2014 Cloudera, Inc. All rights reserved.
  16. 16. © 2014 Cloudera, Inc. All rights reserved.
  17. 17. © 2014 Cloudera, Inc. All rights reserved.
  18. 18. © 2014 Cloudera, Inc. All rights reserved.
  19. 19. © 2014 Cloudera, Inc. All rights reserved.
  20. 20. What’s next?
  21. 21. © 2014 Cloudera, Inc. All rights reserved. Extensibility AWS us-east-1Web UI API console SDKs Orchestration EngineAPI SPI Your Cloud Cloudera Director Cloudera Manager
  22. 22. © 2014 Cloudera, Inc. All rights reserved. Improved User Interface
  23. 23. © 2014 Cloudera, Inc. All rights reserved. Objectives for the cloud Best performing Hadoop on any cloud environment – public or on-premises Optimized software for new cloud deployment models Deep integration with object stores for storage management Cloud specific capabilities: elasticity, shared data across clusters, DevOps development model, flexible usage models
  24. 24. © 2014 Cloudera, Inc. All rights reserved. Open questions. Got answers? Join us! • How can 10s of minutes of configuration be reduced to a single digit? • How can the size of the cluster be determined by usage? • Do we need to expose clusters at all? Or just service endpoints? • How can we create self-managing systems? And enable higher level ops? • How can we scale to 10s of clusters with 100s of instances? • What are the best ways to leverage cloud platform services?
  25. 25. Thanks! Join us! asavu@cloudera.com

×