Your SlideShare is downloading. ×
0
Page1 © Hortonworks Inc. 2014
Discover HDP 2.1
Using Apache Ambari to Manage Hadoop Clusters
Hortonworks. We do Hadoop.
Page2 © Hortonworks Inc. 2014
Speakers
Justin Sears
Hortonworks Product Marketing Manager
Jeff Sposetti
Hortonworks Senior...
Page3 © Hortonworks Inc. 2014
Agenda
• Overview of Apache Ambari
• New Ambari Features
• Demo
• Q & A
We’ll move quickly:
...
Page4 © Hortonworks Inc. 2014
OPERATIONS TOOLS
Provision,
Manage &
Monitor
DEV & DATA TOOLS
Build & Test
A Modern Data Arc...
Page5 © Hortonworks Inc. 2014
HDP 2.1: Enterprise Hadoop
HDP 2.1
Hortonworks Data Platform
Provision,
Manage &
Monitor
Amb...
Page6 © Hortonworks Inc. 2014
HDP 2.1: Enterprise Hadoop
HDP 2.1
Hortonworks Data Platform
Scheduling
Oozie
Data Workflow,...
Page7 © Hortonworks Inc. 2014
Agenda
Ambari
Overview
New
Ambari
Features
Demo Q & A
Page8 © Hortonworks Inc. 2014
Driving Themes for Apache Ambari
Operate Hadoop
at Scale
Integrate with
the Enterprise
Exten...
Page9 © Hortonworks Inc. 2014
Apache Ambari
Apache Ambari is a 100% open source
framework for provisioning, managing and
m...
Page10 © Hortonworks Inc. 2014
100% Apache Open Source
2014
April
Apache Ambari 1.5 Released
Adds support for Hortonworks ...
Page11 © Hortonworks Inc. 2014
Agenda
Ambari
Overview
New
Ambari
Features
Demo Q & A
Page12 © Hortonworks Inc. 2014
New Ambari Features
Operating at Scale
• Maintenance Mode
• Rolling Restarts
• Ambari Bluep...
Page13 © Hortonworks Inc. 2014
Maintenance Mode
• Silence alerts for services and hosts when performing maintenance
• Abil...
Page14 © Hortonworks Inc. 2014
Rolling Restarts
• Minimize cluster downtime + service impact when making changes
• Ability...
Page15 © Hortonworks Inc. 2014
Ambari Blueprints
• API-driven method for consistent and rapid creation of clusters
• Enabl...
Page16 © Hortonworks Inc. 2014
Ambari Stacks
• Ambari operational control is dynamically driven by “Stacks”
• Defines a co...
Page17 © Hortonworks Inc. 2014
Agenda
Ambari
Overview
New
Ambari
Features
Demo Q & A
Page18 © Hortonworks Inc. 2014
Agenda
Ambari
Overview
New
Ambari
Features
Demo Q & A
Page19 © Hortonworks Inc. 2014
Learn More About Hadoop Cluster Operations
Hortonworks.com/labs/operations/
Learn About It
...
Page20 © Hortonworks Inc. 2014
Thank you!
Upcoming SlideShare
Loading in...5
×

Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters

2,735

Published on

Apache Ambari is a single framework for IT administrators to provision, manage and monitor a Hadoop cluster. Hortonworks Data Platform 2.1. includes Apache Ambari 1.6.1.

This presentation gives an overview of Apache Ambari and discusses recent Ambari innovations for operating at scale and extensibility, including:

+ Maintenance mode
+ Rolling restarts
+ Ambari Blueprints
+ Ambari Stacks

Published in: Technology

Transcript of "Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters "

  1. 1. Page1 © Hortonworks Inc. 2014 Discover HDP 2.1 Using Apache Ambari to Manage Hadoop Clusters Hortonworks. We do Hadoop.
  2. 2. Page2 © Hortonworks Inc. 2014 Speakers Justin Sears Hortonworks Product Marketing Manager Jeff Sposetti Hortonworks Senior Director of Product Management and Committer for Apache Ambari Mahadev Konar Hortonworks Co-Founder, Committer and PMC Member for Apache Hadoop, Apache Ambari & Apache ZooKeeper
  3. 3. Page3 © Hortonworks Inc. 2014 Agenda • Overview of Apache Ambari • New Ambari Features • Demo • Q & A We’ll move quickly: • Attendee phone lines are muted • Text any questions to Mahadev Konar using Webex chat • Questions will be answered at the end of the presentation • Unanswered questions and answers in upcoming FAQ/blog post
  4. 4. Page4 © Hortonworks Inc. 2014 OPERATIONS TOOLS Provision, Manage & Monitor DEV & DATA TOOLS Build & Test A Modern Data Architecture APPLICATIONSDATASYSTEM REPOSITORIES RDBMS EDW MPP Business Analytics Custom Applications Packaged Applications Governance &Integration ENTERPRISE HADOOP Security Operations Data Access Data Management SOURCES OLTP, ERP, CRM Systems Documents, Emails Web Logs, Click Streams Social Networks Machine Generated Sensor Data Geolocation Data
  5. 5. Page5 © Hortonworks Inc. 2014 HDP 2.1: Enterprise Hadoop HDP 2.1 Hortonworks Data Platform Provision, Manage & Monitor Ambari Zookeeper Scheduling Oozie Data Workflow, Lifecycle & Governance Falcon Sqoop Flume NFS WebHDFS YARN : Data Operating System DATA MANAGEMENT DATA ACCESS GOVERNANCE & INTEGRATION OPERATIONS Script Pig Search Solr SQL Hive/Tez, HCatalog NoSQL HBase Accumulo Stream Storm Others In-Memory Analytics, ISV engines 1 ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° N HDFS (Hadoop Distributed File System) Batch Map Reduce SECURITY Authentication Authorization Accounting Data Protection Storage: HDFS Resources: YARN Access: Hive, … Pipeline: Falcon Cluster: Knox
  6. 6. Page6 © Hortonworks Inc. 2014 HDP 2.1: Enterprise Hadoop HDP 2.1 Hortonworks Data Platform Scheduling Oozie Data Workflow, Lifecycle & Governance Falcon Sqoop Flume NFS WebHDFS YARN : Data Operating System DATA MANAGEMENT DATA ACCESS GOVERNANCE & INTEGRATION Script Pig Search Solr SQL Hive/Tez, HCatalog NoSQL HBase Accumulo Stream Storm Others In-Memory Analytics, ISV engines 1 ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° N HDFS (Hadoop Distributed File System) Batch Map Reduce SECURITY Authentication Authorization Accounting Data Protection Storage: HDFS Resources: YARN Access: Hive, … Pipeline: Falcon Cluster: Knox Provision, Manage & Monitor Ambari Zookeeper OPERATIONS
  7. 7. Page7 © Hortonworks Inc. 2014 Agenda Ambari Overview New Ambari Features Demo Q & A
  8. 8. Page8 © Hortonworks Inc. 2014 Driving Themes for Apache Ambari Operate Hadoop at Scale Integrate with the Enterprise Extend for the Ecosystem
  9. 9. Page9 © Hortonworks Inc. 2014 Apache Ambari Apache Ambari is a 100% open source framework for provisioning, managing and monitoring Apache Hadoop clusters AMBARI WEB Others compute & storage . . . . . . . . compute & storage . .EXTEND AMBARI REST API AMBARI SERVER PROVISION | MANAGE | MONITOR Integration With Existing Operations Tools OPERATE AMBARI STACKS
  10. 10. Page10 © Hortonworks Inc. 2014 100% Apache Open Source 2014 April Apache Ambari 1.5 Released Adds support for Hortonworks Data Platform 2.1 Apache Ambari Graduates to Top Level Project 2013 Dec 2014 June Apache Ambari 1.6 Released Adds new operational and extensibility capabilities
  11. 11. Page11 © Hortonworks Inc. 2014 Agenda Ambari Overview New Ambari Features Demo Q & A
  12. 12. Page12 © Hortonworks Inc. 2014 New Ambari Features Operating at Scale • Maintenance Mode • Rolling Restarts • Ambari Blueprints Extensibility • Ambari Stacks
  13. 13. Page13 © Hortonworks Inc. 2014 Maintenance Mode • Silence alerts for services and hosts when performing maintenance • Ability to put Service or Host “Out of Service” • Retain full operational control during maintenance period
  14. 14. Page14 © Hortonworks Inc. 2014 Rolling Restarts • Minimize cluster downtime + service impact when making changes • Ability to initiate a "rolling restart" of components across many hosts • Optionally include only hosts with configurations changes
  15. 15. Page15 © Hortonworks Inc. 2014 Ambari Blueprints • API-driven method for consistent and rapid creation of clusters • Enables automation for dev, test and short-lived cluster use cases • Encapsulates “Best Practices” for cluster layout and configuration STACK DEFINITION LAYOUT & CONFIGS BLUEPRINT INSTANTIATE CLUSTER
  16. 16. Page16 © Hortonworks Inc. 2014 Ambari Stacks • Ambari operational control is dynamically driven by “Stacks” • Defines a consistent lifecycle management interface • Dynamically extend a “Stack”, bring complementary Services to Ambari AMBARI SERVER Stacks Command Scripts Service Definitions AMBARI AGENT/S AMBARI AGENT/S AMBARI AGENT/S pythonxml Repos
  17. 17. Page17 © Hortonworks Inc. 2014 Agenda Ambari Overview New Ambari Features Demo Q & A
  18. 18. Page18 © Hortonworks Inc. 2014 Agenda Ambari Overview New Ambari Features Demo Q & A
  19. 19. Page19 © Hortonworks Inc. 2014 Learn More About Hadoop Cluster Operations Hortonworks.com/labs/operations/ Learn About It ambari.apache.org OR cwiki.apache.org/confluence/display/AMBARI/Ambari Get It hortonworks.com/hdp/downloads/ Try It with Hortonworks Sandbox hortonworks.com/products/hortonworks-sandbox/
  20. 20. Page20 © Hortonworks Inc. 2014 Thank you!
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×