What the Enterprise Requires - Usability


Published on

Hadoop is quickly becoming the standard for data management for enterprises. But Enterprise buyers have more demanding requirements for their systems beyond what the early adopters needed. Join us for our 2-part webinar series and learn about our new advancements within Cloudera Enterprise, the Platform for Big Data, with new capabilities that extend our leadership in delivering what organizations require.

Cloudera set the industry standard with Cloudera Manager, the first end-to-end management application for Apache Hadoop. Now, it is extending that lead with the release of Cloudera Manager 4.5, which delivers expanded capabilities designed to simplify the management and adoption of Hadoop.

This presentation will show you how Cloudera Manager 4.5 allows you to:

- perform rolling platform upgrades
- consistently meet or exceed SLAs and RTOs through simplified management and process automation
- easily correlate and visualize metrics through intuitive and interactive charts
- manage heterogeneous clusters
- better integrate with existing enterprise IT management tools via SNMP
…and much more

Published in: Technology
  • Be the first to comment

  • Be the first to like this

What the Enterprise Requires - Usability

  1. 1. Cloudera Manager 4.5 Bala Venkatrao Director, Products March 20131 CONFIDENTIAL - RESTRICTED
  2. 2. Agenda • Brief overview of new product releases • Cloudera Manager deep dive • Key features • Demo • Q&A2 ©2013Cloudera, Inc. All Rights Reserved.
  3. 3. Delivering What the Enterprise Requires Cloudera’s Primary Focus Areas Business IT Build a Solution For New & Deliver a Production-Ready System Better Data Management Build a system that is easy-to-use and integrates with Enterprise IT Revolutionize how enterprises manage and use their data Use Familiar Tools Access More Data Reduced Risk Price-Performance Get Faster Results Ask New Questions Robust Management Seamless Integration3 ©2013Cloudera, Inc. All Rights Reserved.
  5. 5. New Capabilities Cloudera Navigator, Cloudera Enterprise BDR, Cloudera Manager 4.5 ENTERPRISE READINESS REGULATORY COMPLIANCE FOR SENSITIVE DATA ••• BUSINESS CONTINUITY ••• ENTERPRISE INTEGRATION & EASIER UPGRADES 2009 2010 2011 2013 20135 ©2013Cloudera, Inc. All Rights Reserved.
  6. 6. What We Announced in Feb 2013 • Cloudera Navigator 1.0 Auditing & Access Control • Cloudera Enterprise BDR Backup and Disaster Recovery • Cloudera Manager 4.5 Interoperability, Monitoring & Integration6 ©2013Cloudera, Inc. All Rights Reserved.
  7. 7. Cloudera Manager End-to-End Administration for CDH 1 Manage Easily deploy, configure & optimize clusters 2 Monitor Maintain a central view of all activity 3 Diagnose Easily identify and resolve issues 4 Integrate Use Cloudera Manager with existing tools7 ©2013Cloudera, Inc. All Rights Reserved.
  8. 8. Cloudera Manager Key Features Installs the complete Hadoop stack in minutes via a wizard-based interface Gives you complete, end-to-end visibility and control over your Hadoop cluster from a single interface Allows you to manage multiple clusters from a single instance of Cloudera Manager Integrate Cloudera Manager with Active Directory Establishes the time context globally for almost all views Correlates jobs, activities, logs, system changes, configuration changes and service metrics along a single timeline to simplify diagnosis Set server roles, configure services and manage security across the cluster Gracefully start, stop and restart of services as needed Supports Administrator and Read-Only users Maintains a complete record of configuration changes with the ability to roll back to previous states Monitors dozens of service performance metrics and alerts you when you approach critical thresholds8 ©2013 Cloudera, Inc. All Rights Reserved.
  9. 9. Cloudera Manager Key Features Gather, view and search Hadoop logs collected from across the cluster Scans Hadoop logs for irregularities and warns you before they impact the cluster Creates and aggregates relevant Hadoop events pertaining to system health, log messages, user services and activities and make them available for alerting and searching Generates email alerts when certain events occur Consolidates all cluster activity into a single, real-time view View information pertaining to hosts in your cluster including status, resident memory, virtual memory and roles Visualize health status and metrics across the cluster to quickly identify problem nodes and take action Visualize current and historical disk usage by user, group and directory Track MapReduce activity on the cluster by job or user Takes a snapshot of the cluster state and automatically sends it to Cloudera support to assist with resolution Easily integrate Cloudera Manager with your existing enterprise-wide management and monitoring tools9 ©2013 Cloudera, Inc. All Rights Reserved.
  10. 10. Cloudera Manager 4.5 Continuing to Deliver Critical Hadoop Management Capabilities Value Proposition Making Cloudera Enterprise easier to integrate with existing systems and processes as part of a mission-critical, production-level data management infrastructure New Capabilities Rolling Advanced SNMP Node Configurable Restarts/Updates Monitoring Support Templating “Phone Home” Perform updates and Create and save Integrate with Easily deploy & expand Proactively send service restarts custom dashboards enterprise monitoring heterogeneous clusters cluster stats to without downtime tools Cloudera Support10 ©2013Cloudera, Inc. All Rights Reserved.
  11. 11. Cloudera Manager 4.5 – Rolling Upgrades/Restarts • Rolling upgrades • Manage and upgrade the CDH binaries on the cluster with minimal downtime • Supports a new packaging format called “Parcels" to facilitate the upgrade mechanism • Download, distribute, and activate a new CDH version parcel all from within Cloudera Manager • Rolling restarts • Restart services with zero/minimal downtime as related to upgrades (new versions of parcels) or configuration changes. • Workflow is available at individual service level or instance level or at the entire cluster level (if HA is enabled)11 ©2013Cloudera, Inc. All Rights Reserved.
  12. 12. Cloudera Manager 4.5 – Node Templating• Improved configuration management for role instances • Group an arbitrary set of roles instances (of the same type, for example, DataNodes) together and manage their configuration as a unit. Example – DN-Large, DN-Medium, DN-Small etc. • Simplifies configuring groups of roles that need to be managed differently, for example when running on nodes with heterogeneous hardware• Improved role to host assignment with Host Templates • Host Templates let you designate a set of role configuration groups that can be applied in a single operation to a host or a set of hosts. • Simplifies the process of adding hosts and instantiating the roles that should run on those hosts12 ©2013Cloudera, Inc. All Rights Reserved.
  13. 13. Cloudera Manager 4.5 – Charts & SNMP • Advanced charting • Provides intuitive and customizable charts to display relevant time- series metrics across the board (services, role instances, hosts) • Helps better correlate metrics from services to roles to hosts • Includes a new "Charts" tab to create (and save) dashboards of metrics to enable quick diagnostics/trouble shooting • SNMP Support • Makes alerts available as SNMP traps which enables easier integration with IT management tools such as IBM Tivoli, HP Openview, and others • Automated cluster statistics • Scheduled, periodic diagnostics gathering enable Cloudera Support to proactively address customer issues13 ©2013Cloudera, Inc. All Rights Reserved.
  14. 14. Cloudera Manager 4.5 – Other Features • Resource Management • Enables partitioning of cluster resources (CPU, memory) across different services (MapReduce, Impala etc.) in use. • Broader service management (Hive, Impala) support • Manage a CDH POC clusters on Amazon (AWS) • Event search usability • Improved Error handling • Support for HBase REST and Thrift servers • HBase monitoring improvements: • New health checks, metrics (Region Server etc.), events (track compactions, splits), periodic hbck (HBase canary) etc. • Automatic creation of Oozie ShareLib when adding an Oozie service14 ©2013Cloudera, Inc. All Rights Reserved.
  15. 15. Demo15 ©2013Cloudera, Inc. All Rights Reserved.
  16. 16. Why Cloudera Manager Simple End-to-End Hadoop administration in a single tool Intelligent Manages Hadoop at a system level – Cloudera’s experience realized in software Efficient Simplifies complex workflows & makes administrators more productive Best-in-Class The only enterprise-grade Hadoop management application available16 ©2013Cloudera, Inc. All Rights Reserved.
  17. 17. Q&A • Type it in the “Q&A” panel Download cloudera.com/downloads • Recording will be available on demand at cloudera.com Learn more about Cloudera Manager • After webinar, inquire at http://bit.ly/ZMx4Mf info@cloudera.com Part 1: What the Enterprise Requires – Business Continuity and Visibility http://www.cloudera.com/content/cloude Thank you for attending! ra/en/resources.html17 ©2013Cloudera, Inc. All Rights Reserved.
  18. 18. Key Features Cloudera Manager18
  19. 19. Install A Cluster In 3 Simple Steps Cloudera Manager Key Features 1 Find Nodes 2 Install Components 3 Assign Roles Enter the names of the hosts which will be Cloudera Manager automatically installs the CDH Verify the roles of the nodes within your cluster.included in the Hadoop cluster. Click Continue. components on the hosts you specified. Make changes as necessary.19
  20. 20. View Service Health & Performance Cloudera Manager Key Features20
  21. 21. Get Host-Level Snapshots Cloudera Manager Key Features21
  22. 22. Monitor & Diagnose Cluster Workloads Cloudera Manager Key Features22
  23. 23. Gather, View & Search Hadoop Logs Cloudera Manager Key Features23
  24. 24. Track Events From Across The Cluster Cloudera Manager Key Features24
  25. 25. Report On System Performance & Usage Cloudera Manager Key Features25
  26. 26. Visualize Health Status With Heatmaps Cloudera Manager Key Features26
  27. 27. Manage Multiple CDH Clusters Cloudera Manager Key Features27
  28. 28. Easily Configure High Availability Cloudera Manager Key Features28
  29. 29. Set The Time Context Globally Cloudera Manager Key Features29
  30. 30. Manage Backup & DR Cloudera Manager Key Features30
  31. 31. Create Customized Reports Cloudera Manager Key Features31
  32. 32. Create Node Role Templates Cloudera Manager Key Features32
  33. 33. Rolling Upgrades Cloudera Manager Key Features33