SlideShare a Scribd company logo
© Hortonworks Inc. 2014
Apache Ambari
Provisioning, Managing and Monitoring Hadoop
© Hortonworks Inc. 2014
Agenda
• Ambari Overview and the Community
• Ambari Architecture
• Provisioning Clusters and Services
• Extensibility Features
– Ambari Stacks
– Ambari Views
– Ambari Blueprints
• Releases
• Learn More
• Q & A
Page 2
© Hortonworks Inc. 2014
Hadoop Operations with Ambari
Provision: Simplified deployment across platforms
Manage: Consistent controls across the Stack
Monitor: Visibility into key cluster metrics
-  Single pane of glass for Hadoop & System status
-  Pre-configured metrics & alerts
-  Single point for cluster operations
-  Advanced configurations and host controls
-  Wizard-driven cluster install experience
-  Cloud, virtual and physical environments
Apache Ambari is a 100% open source framework for
provisioning, managing and monitoring Hadoop clusters
© Hortonworks Inc. 2014
100% Apache Open Source
• Active Community
•  60+ Contributors / 30+ Committers
•  200+ Ambari User Group Members
Page 4
2013
Oct
Apache Ambari 1.4.1 Released
Adds operations for Hadoop 2 Stack
Ambari Ambari 1.2.0 Released
Operations for Hadoop 1 Stack
2013
Jan
2013
Dec
Apache Ambari Graduates to Top Level Project
© Hortonworks Inc. 2014
Ambari Release Cadence
Page 5
Ambari 1.4.3
Jan 2014
Ambari 1.4.4
Feb 2014
Ambari 1.5.0
Apr 2014
Ambari 1.7.0
2H2014
Ambari 1.6.0
May 2014
© Hortonworks Inc. 2014
Demo #1
Cluster Management
Page 6
© Hortonworks Inc. 2014
System Architecture
7
Ambari Server
Host
Agent
Host
Agent
Host
Agent
Ambari
Web
DB
/clusters!
Host
Agent
© Hortonworks Inc. 2014
Ambari Server Architecture
8
DB
Orchestrator Monitoring
REST API
Request Dispatcher
Ambari
Web
Ambari
Server
Ambari
Agents
Metrics
Providers
AuthProvider
/clusters!
User!
Repo!
java!
python!
JS!
RDBMS!
LDAP!
REST API
Configurable
Auth Provider
Cluster
Configurations
and Topology
Web Client
AD!
© Hortonworks Inc. 2014
Installing Ambari
• Install Ambari Server
• Setup Options
– JDK (Oracle JDK 6, Oracle JDK 7, Custom JDK)
– Database (PostgreSQL, MySQL or Oracle)
– Server Port and HTTPS
– User Authentication (Local, LDAP or AD)
– Server-Agent Two-way SSL
• Start Ambari Server
• Browse to Ambari Web for Cluster Install Wizard
• Install Ambari Agents
– Option #1: Automate via SSH
– Option #2: Manual
Page 9
© Hortonworks Inc. 2014
Installing Agents
Page 10
OPTION 1!
automate!
provide SSH Key!
OPTION 2!
manual!
© Hortonworks Inc. 2014
Option #1: Ambari Agent via SSH
Page 11
Ambari Server Ambari Agent
1) Configure Ambari Repo!
2) Copy Ambari Agent Setup script!
3) Execute Ambari Agent Setup script!
4) Install ambari-agent!
5) Configure ambari-agent.ini!
6) Start ambari-agent!
7) Begin Ambari Agent Registration!
Uses
the SSH
© Hortonworks Inc. 2014
Option #2: Ambari Agent via Manual
Page 12
Ambari Server Ambari Agent
2) Install ambari-agent!
3) Configure ambari-agent.ini!
4) Start ambari-agent!
5) Begin Ambari Agent Registration!
1) Configure Ambari repo!
** User executes all ops on the Agent host(s). No requirement for SSH Private Key.
No SSH
© Hortonworks Inc. 2014
Ambari Agent Registration
Page 13
Ambari Server Ambari Agent
11) Agent Heartbeat Begins!
1) Connect on Handshake port 8441!
4) Sign Agent Cert!
2) Download Server Cert!
6) Connect on Registration port 8440!
7) Perform 2WAY auth using Agent Cert!
10) Complete Host Registration!
Agent Host
8) Get FQDN!
9) Register host!
8a)
Host
Script!
3) Request to Sign Agent Cert!
5) Download Agent Cert + Disconnect!
© Hortonworks Inc. 2014
Demo #2
Cluster Install
Page 14
© Hortonworks Inc. 2014
Extensibility Features
Ambari Stacks
Ambari Blueprints
Ambari Views
Page 15
© Hortonworks Inc. 2014
Ambari Stacks
Page 16
© Hortonworks Inc. 2014
Ambari Stacks
• Separate “the Stack” from “Ambari”
• Make it easier to bring more than a traditional
“Hadoop Stack” under Ambari management
• Defining a consistent Service lifecycle management
interface that can be extended
• Dynamically add Stacks + Services definitions
Page 17
© Hortonworks Inc. 2014
Stack Details
• Stacks define Services + Repos
– What is in the Stack, and where to get the bits
• Each Service has a definition
– What Components are part of the Service
• Each Service has defined lifecycle commands
– start, stop, status, install, configure
• Lifecycle is controlled via command scripts
• Ability to define “custom” commands
• Ability to “extend” Stacks
Page 18
AMBARI	
  
SERVER	
  
Stack
Command	
  
Scripts	
  
Service	
  
Defini:ons	
  
AMBARI	
  
AGENT/S	
  
AMBARI	
  
AGENT/S	
  
AMBARI	
  
AGENT/S	
  
python!xml!
Repos
© Hortonworks Inc. 2014
Stack Mechanics
• Ambari Server reads Stack definitions on start
• Ambari Server sends a command to Agents
• Agents download Stack definition + command scripts
• Agent executes command
• If the Stack definition changes, Agent will request
latest Stack definition + command scripts
Page 19
© Hortonworks Inc. 2014
Ambari Blueprints
Page 20
© Hortonworks Inc. 2014
Ambari Blueprints
Page 21
STACK	
   HOSTS	
   BLUEPRINT	
  
© Hortonworks Inc. 2014
Automating Installs
•  Blueprint defines a cluster layout and
component configuration for a Stack
•  Provide Blueprint to Ambari to perform
cluster installation (no wizard required)
•  Export Blueprint from existing cluster
BLUEPRINT!
Ambari	
  
Submit Blueprint
to Ambari Hadoop	
  
Cluster
Ambari provisions
cluster
BLUEPRINT!
<stack>!
<host>!
<service>!
<component>!
<config>!
HOST!
MANIFEST!
<host>!
<meta>!
SERVICE!
CONFIGS!
<props>!
Page 22
© Hortonworks Inc. 2014
Ambari + OpenStack
Page 23
OpenStack	
  Infrastructure	
  
Horizon
Savanna
AMBARI	
  
SERVER	
  
Hadoop	
  Cluster
© Hortonworks Inc. 2014
Ambari Views
Page 24
© Hortonworks Inc. 2014
Ambari Views
•  Goal: Customize the Ambari Web experience
•  Views compliment Stack Extensibility
– Stack Extensibility makes custom Stack Services available to Ambari
– Views expose custom UI features for Services
•  Ambari Admins can entitle “views” to Ambari Web users
–  Entitlements framework for finer-grained permissions control for Ambari users
Page 25
© Hortonworks Inc. 2014
View Usage
• Developer Creates a View
• Deploys View to Ambari Server
• Ambari Admin creates instances of Views
• Ambari Admin entitles Views to users
Page 26
© Hortonworks Inc. 2014
View Configuration + Entitlement
Page 27
© Hortonworks Inc. 2014
Customized Views
Page 28
“admin” gets operator controls “joe.user” gets specific views
based on entitlements
© Hortonworks Inc. 2014
Releases
What’s Up Next
Page 29
© Hortonworks Inc. 2014
What’s New in Ambari 1.5.0
• Maintenance Mode
• Rolling Restarts
• Bulk Host Operations
• Decommission TTs, NMs, RSs
• Add Service
• Refresh Client Configs
• Default JDK 7
• For a complete list of changes:
https://issues.apache.org/jira/browse/AMBARI/fixforversion/12325019
Page 30
© Hortonworks Inc. 2014
Ambari Futures
• Operations
– Ambari Blueprints
– Component log access + search
– Ubuntu and Windows support
• Extensibility
– Finer-grain user entitlements
– Ambari Views
• Insight
– Troubleshooting + Performance Tuning
– Capacity Planning
Page 31
© Hortonworks Inc. 2014
Learn More
Page 32
Resource Location
Apache Ambari Project Page http://ambari.apache.org
Ambari Project Wiki https://cwiki.apache.org/confluence/display/AMBARI
Ambari Project JIRA https://issues.apache.org/jira/browse/AMBARI
© Hortonworks Inc. 2014
Q & A
Page 33

More Related Content

What's hot

Apache Ranger
Apache RangerApache Ranger
Apache Ranger
Rommel Garcia
 
Building Lakehouses on Delta Lake with SQL Analytics Primer
Building Lakehouses on Delta Lake with SQL Analytics PrimerBuilding Lakehouses on Delta Lake with SQL Analytics Primer
Building Lakehouses on Delta Lake with SQL Analytics Primer
Databricks
 
Introduction SQL Analytics on Lakehouse Architecture
Introduction SQL Analytics on Lakehouse ArchitectureIntroduction SQL Analytics on Lakehouse Architecture
Introduction SQL Analytics on Lakehouse Architecture
Databricks
 
Introduction to apache spark
Introduction to apache spark Introduction to apache spark
Introduction to apache spark
Aakashdata
 
YARN Ready: Integrating to YARN with Tez
YARN Ready: Integrating to YARN with Tez YARN Ready: Integrating to YARN with Tez
YARN Ready: Integrating to YARN with Tez
Hortonworks
 
Apache Hadoop Security - Ranger
Apache Hadoop Security - RangerApache Hadoop Security - Ranger
Apache Hadoop Security - Ranger
Isheeta Sanghi
 
Integrating Apache Spark and NiFi for Data Lakes
Integrating Apache Spark and NiFi for Data LakesIntegrating Apache Spark and NiFi for Data Lakes
Integrating Apache Spark and NiFi for Data Lakes
DataWorks Summit/Hadoop Summit
 
What's New in Apache Hive
What's New in Apache HiveWhat's New in Apache Hive
What's New in Apache Hive
DataWorks Summit
 
A Thorough Comparison of Delta Lake, Iceberg and Hudi
A Thorough Comparison of Delta Lake, Iceberg and HudiA Thorough Comparison of Delta Lake, Iceberg and Hudi
A Thorough Comparison of Delta Lake, Iceberg and Hudi
Databricks
 
Apache Kafka Architecture & Fundamentals Explained
Apache Kafka Architecture & Fundamentals ExplainedApache Kafka Architecture & Fundamentals Explained
Apache Kafka Architecture & Fundamentals Explained
confluent
 
Apache Ranger Hive Metastore Security
Apache Ranger Hive Metastore Security Apache Ranger Hive Metastore Security
Apache Ranger Hive Metastore Security
DataWorks Summit/Hadoop Summit
 
Owning Your Own (Data) Lake House
Owning Your Own (Data) Lake HouseOwning Your Own (Data) Lake House
Owning Your Own (Data) Lake House
Data Con LA
 
Large Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured StreamingLarge Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured Streaming
Databricks
 
Ozone- Object store for Apache Hadoop
Ozone- Object store for Apache HadoopOzone- Object store for Apache Hadoop
Ozone- Object store for Apache Hadoop
Hortonworks
 
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
Hortonworks
 
A Rusty introduction to Apache Arrow and how it applies to a time series dat...
A Rusty introduction to Apache Arrow and how it applies to a  time series dat...A Rusty introduction to Apache Arrow and how it applies to a  time series dat...
A Rusty introduction to Apache Arrow and how it applies to a time series dat...
Andrew Lamb
 
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on KubernetesApache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
DataWorks Summit
 
Simplifying Big Data Analytics with Apache Spark
Simplifying Big Data Analytics with Apache SparkSimplifying Big Data Analytics with Apache Spark
Simplifying Big Data Analytics with Apache Spark
Databricks
 
Spark DataFrames and ML Pipelines
Spark DataFrames and ML PipelinesSpark DataFrames and ML Pipelines
Spark DataFrames and ML Pipelines
Databricks
 
Managing your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache AmbariManaging your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache Ambari
DataWorks Summit
 

What's hot (20)

Apache Ranger
Apache RangerApache Ranger
Apache Ranger
 
Building Lakehouses on Delta Lake with SQL Analytics Primer
Building Lakehouses on Delta Lake with SQL Analytics PrimerBuilding Lakehouses on Delta Lake with SQL Analytics Primer
Building Lakehouses on Delta Lake with SQL Analytics Primer
 
Introduction SQL Analytics on Lakehouse Architecture
Introduction SQL Analytics on Lakehouse ArchitectureIntroduction SQL Analytics on Lakehouse Architecture
Introduction SQL Analytics on Lakehouse Architecture
 
Introduction to apache spark
Introduction to apache spark Introduction to apache spark
Introduction to apache spark
 
YARN Ready: Integrating to YARN with Tez
YARN Ready: Integrating to YARN with Tez YARN Ready: Integrating to YARN with Tez
YARN Ready: Integrating to YARN with Tez
 
Apache Hadoop Security - Ranger
Apache Hadoop Security - RangerApache Hadoop Security - Ranger
Apache Hadoop Security - Ranger
 
Integrating Apache Spark and NiFi for Data Lakes
Integrating Apache Spark and NiFi for Data LakesIntegrating Apache Spark and NiFi for Data Lakes
Integrating Apache Spark and NiFi for Data Lakes
 
What's New in Apache Hive
What's New in Apache HiveWhat's New in Apache Hive
What's New in Apache Hive
 
A Thorough Comparison of Delta Lake, Iceberg and Hudi
A Thorough Comparison of Delta Lake, Iceberg and HudiA Thorough Comparison of Delta Lake, Iceberg and Hudi
A Thorough Comparison of Delta Lake, Iceberg and Hudi
 
Apache Kafka Architecture & Fundamentals Explained
Apache Kafka Architecture & Fundamentals ExplainedApache Kafka Architecture & Fundamentals Explained
Apache Kafka Architecture & Fundamentals Explained
 
Apache Ranger Hive Metastore Security
Apache Ranger Hive Metastore Security Apache Ranger Hive Metastore Security
Apache Ranger Hive Metastore Security
 
Owning Your Own (Data) Lake House
Owning Your Own (Data) Lake HouseOwning Your Own (Data) Lake House
Owning Your Own (Data) Lake House
 
Large Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured StreamingLarge Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured Streaming
 
Ozone- Object store for Apache Hadoop
Ozone- Object store for Apache HadoopOzone- Object store for Apache Hadoop
Ozone- Object store for Apache Hadoop
 
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
Modern Data Architecture for a Data Lake with Informatica and Hortonworks Dat...
 
A Rusty introduction to Apache Arrow and how it applies to a time series dat...
A Rusty introduction to Apache Arrow and how it applies to a  time series dat...A Rusty introduction to Apache Arrow and how it applies to a  time series dat...
A Rusty introduction to Apache Arrow and how it applies to a time series dat...
 
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on KubernetesApache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
Apache Druid Auto Scale-out/in for Streaming Data Ingestion on Kubernetes
 
Simplifying Big Data Analytics with Apache Spark
Simplifying Big Data Analytics with Apache SparkSimplifying Big Data Analytics with Apache Spark
Simplifying Big Data Analytics with Apache Spark
 
Spark DataFrames and ML Pipelines
Spark DataFrames and ML PipelinesSpark DataFrames and ML Pipelines
Spark DataFrames and ML Pipelines
 
Managing your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache AmbariManaging your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache Ambari
 

Viewers also liked

Ambari Views - Overview
Ambari Views - OverviewAmbari Views - Overview
Ambari Views - Overview
Hortonworks
 
Ambari Meetup: Architecture and Demo
Ambari Meetup: Architecture and DemoAmbari Meetup: Architecture and Demo
Ambari Meetup: Architecture and Demo
Hortonworks
 
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
Hortonworks
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
DataWorks Summit
 
Deploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARIDeploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARI
DataWorks Summit
 
Ambari Meetup: Ambari Futures
Ambari Meetup: Ambari FuturesAmbari Meetup: Ambari Futures
Ambari Meetup: Ambari Futures
Hortonworks
 
Prdc2012
Prdc2012Prdc2012
Prdc2012
Yusuke Shimizu
 
Soldagem 2009 2-emi
Soldagem 2009 2-emiSoldagem 2009 2-emi
Soldagem 2009 2-emi
Tadeu Granato
 
Apache Ambari - What's New in 2.0.0
Apache Ambari - What's New in 2.0.0Apache Ambari - What's New in 2.0.0
Apache Ambari - What's New in 2.0.0
Hortonworks
 
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
Swiss Big Data User Group
 
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated HadoopHadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
Yafang Chang
 
Managing your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariManaging your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with Ambari
DataWorks Summit
 
Cloudera security and enterprise license by Athemaster(繁中)
Cloudera security and enterprise license by Athemaster(繁中)Cloudera security and enterprise license by Athemaster(繁中)
Cloudera security and enterprise license by Athemaster(繁中)
Athemaster Co., Ltd.
 
Ambari: Agent Registration Flow
Ambari: Agent Registration FlowAmbari: Agent Registration Flow
Ambari: Agent Registration Flow
Hortonworks
 
Secure Hadoop Cluster With Kerberos
Secure Hadoop Cluster With KerberosSecure Hadoop Cluster With Kerberos
Secure Hadoop Cluster With Kerberos
Edureka!
 
DevOps Overview
DevOps OverviewDevOps Overview
DevOps Overview
Omri Spector
 
Dev ops
Dev opsDev ops
The Value of Visualization by @columnfive
The Value of Visualization by @columnfiveThe Value of Visualization by @columnfive
The Value of Visualization by @columnfive
Column Five
 
Conference on Nagios: Reinhard Scheck on Cacti
Conference on Nagios: Reinhard Scheck on CactiConference on Nagios: Reinhard Scheck on Cacti
Conference on Nagios: Reinhard Scheck on Cacti
Würth Phoenix
 
Apache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARNApache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARN
Hortonworks
 

Viewers also liked (20)

Ambari Views - Overview
Ambari Views - OverviewAmbari Views - Overview
Ambari Views - Overview
 
Ambari Meetup: Architecture and Demo
Ambari Meetup: Architecture and DemoAmbari Meetup: Architecture and Demo
Ambari Meetup: Architecture and Demo
 
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
Discover HDP 2.1: Using Apache Ambari to Manage Hadoop Clusters
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
 
Deploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARIDeploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARI
 
Ambari Meetup: Ambari Futures
Ambari Meetup: Ambari FuturesAmbari Meetup: Ambari Futures
Ambari Meetup: Ambari Futures
 
Prdc2012
Prdc2012Prdc2012
Prdc2012
 
Soldagem 2009 2-emi
Soldagem 2009 2-emiSoldagem 2009 2-emi
Soldagem 2009 2-emi
 
Apache Ambari - What's New in 2.0.0
Apache Ambari - What's New in 2.0.0Apache Ambari - What's New in 2.0.0
Apache Ambari - What's New in 2.0.0
 
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
14.05.2012 Social Media Monitoring with Hadoop (Nils Kübler, MeMo News)
 
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated HadoopHadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
HadoopCon2015 Multi-Cluster Live Synchronization with Kerberos Federated Hadoop
 
Managing your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariManaging your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with Ambari
 
Cloudera security and enterprise license by Athemaster(繁中)
Cloudera security and enterprise license by Athemaster(繁中)Cloudera security and enterprise license by Athemaster(繁中)
Cloudera security and enterprise license by Athemaster(繁中)
 
Ambari: Agent Registration Flow
Ambari: Agent Registration FlowAmbari: Agent Registration Flow
Ambari: Agent Registration Flow
 
Secure Hadoop Cluster With Kerberos
Secure Hadoop Cluster With KerberosSecure Hadoop Cluster With Kerberos
Secure Hadoop Cluster With Kerberos
 
DevOps Overview
DevOps OverviewDevOps Overview
DevOps Overview
 
Dev ops
Dev opsDev ops
Dev ops
 
The Value of Visualization by @columnfive
The Value of Visualization by @columnfiveThe Value of Visualization by @columnfive
The Value of Visualization by @columnfive
 
Conference on Nagios: Reinhard Scheck on Cacti
Conference on Nagios: Reinhard Scheck on CactiConference on Nagios: Reinhard Scheck on Cacti
Conference on Nagios: Reinhard Scheck on Cacti
 
Apache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARNApache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARN
 

Similar to An Overview of Ambari

Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0
Hortonworks
 
Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5
Hortonworks
 
Ambari Meetup: What's New in Ambari
Ambari Meetup: What's New in AmbariAmbari Meetup: What's New in Ambari
Ambari Meetup: What's New in Ambari
Hortonworks
 
Hortonworks Technical Workshop: Apache Ambari
Hortonworks Technical Workshop:   Apache AmbariHortonworks Technical Workshop:   Apache Ambari
Hortonworks Technical Workshop: Apache Ambari
Hortonworks
 
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
Hortonworks
 
Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1
Hortonworks
 
Ambari hadoop-ops-meetup-2013-09-19.final
Ambari hadoop-ops-meetup-2013-09-19.finalAmbari hadoop-ops-meetup-2013-09-19.final
Ambari hadoop-ops-meetup-2013-09-19.final
Chris Westin
 
October 2014 HUG : Apache Slider
October 2014 HUG : Apache SliderOctober 2014 HUG : Apache Slider
October 2014 HUG : Apache Slider
Yahoo Developer Network
 
What's new OpenStack kilo
What's new OpenStack kiloWhat's new OpenStack kilo
What's new OpenStack kilo
Anil Bidari ( CEO , Cloud Enabled)
 
Apache Ambari BOF - Overview - Hadoop Summit 2013
Apache Ambari BOF - Overview - Hadoop Summit 2013Apache Ambari BOF - Overview - Hadoop Summit 2013
Apache Ambari BOF - Overview - Hadoop Summit 2013
Hortonworks
 
第1回福岡SoftLayer勉強会
第1回福岡SoftLayer勉強会第1回福岡SoftLayer勉強会
第1回福岡SoftLayer勉強会
Shin Sakamoto
 
Docker based Hadoop provisioning - anywhere
Docker based Hadoop provisioning - anywhere Docker based Hadoop provisioning - anywhere
Docker based Hadoop provisioning - anywhere
Janos Matyas
 
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache AmbariManaging Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Jayush Luniya
 
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache AmbariManaging Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Hortonworks
 
Clocker: Docker in the Cloud
Clocker: Docker in the CloudClocker: Docker in the Cloud
Clocker: Docker in the Cloud
Andrew Kennedy
 
Hello OpenStack, Meet Hadoop
Hello OpenStack, Meet HadoopHello OpenStack, Meet Hadoop
Hello OpenStack, Meet Hadoop
DataWorks Summit
 
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in AzureHeading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
Xenox Garavito
 
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
CloudBees
 
Ambari: Agent Registration Flow
Ambari: Agent Registration FlowAmbari: Agent Registration Flow
Ambari: Agent Registration Flow
jsposetti
 

Similar to An Overview of Ambari (20)

Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache Accumulo
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0
 
Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5
 
Ambari Meetup: What's New in Ambari
Ambari Meetup: What's New in AmbariAmbari Meetup: What's New in Ambari
Ambari Meetup: What's New in Ambari
 
Hortonworks Technical Workshop: Apache Ambari
Hortonworks Technical Workshop:   Apache AmbariHortonworks Technical Workshop:   Apache Ambari
Hortonworks Technical Workshop: Apache Ambari
 
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
 
Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1
 
Ambari hadoop-ops-meetup-2013-09-19.final
Ambari hadoop-ops-meetup-2013-09-19.finalAmbari hadoop-ops-meetup-2013-09-19.final
Ambari hadoop-ops-meetup-2013-09-19.final
 
October 2014 HUG : Apache Slider
October 2014 HUG : Apache SliderOctober 2014 HUG : Apache Slider
October 2014 HUG : Apache Slider
 
What's new OpenStack kilo
What's new OpenStack kiloWhat's new OpenStack kilo
What's new OpenStack kilo
 
Apache Ambari BOF - Overview - Hadoop Summit 2013
Apache Ambari BOF - Overview - Hadoop Summit 2013Apache Ambari BOF - Overview - Hadoop Summit 2013
Apache Ambari BOF - Overview - Hadoop Summit 2013
 
第1回福岡SoftLayer勉強会
第1回福岡SoftLayer勉強会第1回福岡SoftLayer勉強会
第1回福岡SoftLayer勉強会
 
Docker based Hadoop provisioning - anywhere
Docker based Hadoop provisioning - anywhere Docker based Hadoop provisioning - anywhere
Docker based Hadoop provisioning - anywhere
 
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache AmbariManaging Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
 
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache AmbariManaging Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
 
Clocker: Docker in the Cloud
Clocker: Docker in the CloudClocker: Docker in the Cloud
Clocker: Docker in the Cloud
 
Hello OpenStack, Meet Hadoop
Hello OpenStack, Meet HadoopHello OpenStack, Meet Hadoop
Hello OpenStack, Meet Hadoop
 
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in AzureHeading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
Heading to the Cloud : Introduction to deploying a Provider-Hosted App in Azure
 
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)
 
Ambari: Agent Registration Flow
Ambari: Agent Registration FlowAmbari: Agent Registration Flow
Ambari: Agent Registration Flow
 

More from Chicago Hadoop Users Group

Kinetica master chug_9.12
Kinetica master chug_9.12Kinetica master chug_9.12
Kinetica master chug_9.12
Chicago Hadoop Users Group
 
Chug dl presentation
Chug dl presentationChug dl presentation
Chug dl presentation
Chicago Hadoop Users Group
 
Yahoo compares Storm and Spark
Yahoo compares Storm and SparkYahoo compares Storm and Spark
Yahoo compares Storm and Spark
Chicago Hadoop Users Group
 
Using Apache Drill
Using Apache DrillUsing Apache Drill
Using Apache Drill
Chicago Hadoop Users Group
 
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
Chicago Hadoop Users Group
 
Meet Spark
Meet SparkMeet Spark
Choosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your BusinessChoosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your Business
Chicago Hadoop Users Group
 
Hadoop and Big Data Security
Hadoop and Big Data SecurityHadoop and Big Data Security
Hadoop and Big Data Security
Chicago Hadoop Users Group
 
Introduction to MapReduce
Introduction to MapReduceIntroduction to MapReduce
Introduction to MapReduce
Chicago Hadoop Users Group
 
Advanced Oozie
Advanced OozieAdvanced Oozie
Scalding for Hadoop
Scalding for HadoopScalding for Hadoop
Scalding for Hadoop
Chicago Hadoop Users Group
 
Financial Data Analytics with Hadoop
Financial Data Analytics with HadoopFinancial Data Analytics with Hadoop
Financial Data Analytics with Hadoop
Chicago Hadoop Users Group
 
Everything you wanted to know, but were afraid to ask about Oozie
Everything you wanted to know, but were afraid to ask about OozieEverything you wanted to know, but were afraid to ask about Oozie
Everything you wanted to know, but were afraid to ask about Oozie
Chicago Hadoop Users Group
 
An Introduction to Impala – Low Latency Queries for Apache Hadoop
An Introduction to Impala – Low Latency Queries for Apache HadoopAn Introduction to Impala – Low Latency Queries for Apache Hadoop
An Introduction to Impala – Low Latency Queries for Apache Hadoop
Chicago Hadoop Users Group
 
HCatalog: Table Management for Hadoop - CHUG - 20120917
HCatalog: Table Management for Hadoop - CHUG - 20120917HCatalog: Table Management for Hadoop - CHUG - 20120917
HCatalog: Table Management for Hadoop - CHUG - 20120917
Chicago Hadoop Users Group
 
Map Reduce v2 and YARN - CHUG - 20120604
Map Reduce v2 and YARN - CHUG - 20120604Map Reduce v2 and YARN - CHUG - 20120604
Map Reduce v2 and YARN - CHUG - 20120604
Chicago Hadoop Users Group
 
Hadoop in a Windows Shop - CHUG - 20120416
Hadoop in a Windows Shop - CHUG - 20120416Hadoop in a Windows Shop - CHUG - 20120416
Hadoop in a Windows Shop - CHUG - 20120416
Chicago Hadoop Users Group
 
Running R on Hadoop - CHUG - 20120815
Running R on Hadoop - CHUG - 20120815Running R on Hadoop - CHUG - 20120815
Running R on Hadoop - CHUG - 20120815
Chicago Hadoop Users Group
 
Avro - More Than Just a Serialization Framework - CHUG - 20120416
Avro - More Than Just a Serialization Framework - CHUG - 20120416Avro - More Than Just a Serialization Framework - CHUG - 20120416
Avro - More Than Just a Serialization Framework - CHUG - 20120416
Chicago Hadoop Users Group
 

More from Chicago Hadoop Users Group (19)

Kinetica master chug_9.12
Kinetica master chug_9.12Kinetica master chug_9.12
Kinetica master chug_9.12
 
Chug dl presentation
Chug dl presentationChug dl presentation
Chug dl presentation
 
Yahoo compares Storm and Spark
Yahoo compares Storm and SparkYahoo compares Storm and Spark
Yahoo compares Storm and Spark
 
Using Apache Drill
Using Apache DrillUsing Apache Drill
Using Apache Drill
 
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...
 
Meet Spark
Meet SparkMeet Spark
Meet Spark
 
Choosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your BusinessChoosing the Right Big Data Architecture for your Business
Choosing the Right Big Data Architecture for your Business
 
Hadoop and Big Data Security
Hadoop and Big Data SecurityHadoop and Big Data Security
Hadoop and Big Data Security
 
Introduction to MapReduce
Introduction to MapReduceIntroduction to MapReduce
Introduction to MapReduce
 
Advanced Oozie
Advanced OozieAdvanced Oozie
Advanced Oozie
 
Scalding for Hadoop
Scalding for HadoopScalding for Hadoop
Scalding for Hadoop
 
Financial Data Analytics with Hadoop
Financial Data Analytics with HadoopFinancial Data Analytics with Hadoop
Financial Data Analytics with Hadoop
 
Everything you wanted to know, but were afraid to ask about Oozie
Everything you wanted to know, but were afraid to ask about OozieEverything you wanted to know, but were afraid to ask about Oozie
Everything you wanted to know, but were afraid to ask about Oozie
 
An Introduction to Impala – Low Latency Queries for Apache Hadoop
An Introduction to Impala – Low Latency Queries for Apache HadoopAn Introduction to Impala – Low Latency Queries for Apache Hadoop
An Introduction to Impala – Low Latency Queries for Apache Hadoop
 
HCatalog: Table Management for Hadoop - CHUG - 20120917
HCatalog: Table Management for Hadoop - CHUG - 20120917HCatalog: Table Management for Hadoop - CHUG - 20120917
HCatalog: Table Management for Hadoop - CHUG - 20120917
 
Map Reduce v2 and YARN - CHUG - 20120604
Map Reduce v2 and YARN - CHUG - 20120604Map Reduce v2 and YARN - CHUG - 20120604
Map Reduce v2 and YARN - CHUG - 20120604
 
Hadoop in a Windows Shop - CHUG - 20120416
Hadoop in a Windows Shop - CHUG - 20120416Hadoop in a Windows Shop - CHUG - 20120416
Hadoop in a Windows Shop - CHUG - 20120416
 
Running R on Hadoop - CHUG - 20120815
Running R on Hadoop - CHUG - 20120815Running R on Hadoop - CHUG - 20120815
Running R on Hadoop - CHUG - 20120815
 
Avro - More Than Just a Serialization Framework - CHUG - 20120416
Avro - More Than Just a Serialization Framework - CHUG - 20120416Avro - More Than Just a Serialization Framework - CHUG - 20120416
Avro - More Than Just a Serialization Framework - CHUG - 20120416
 

Recently uploaded

Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 

Recently uploaded (20)

Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 

An Overview of Ambari

  • 1. © Hortonworks Inc. 2014 Apache Ambari Provisioning, Managing and Monitoring Hadoop
  • 2. © Hortonworks Inc. 2014 Agenda • Ambari Overview and the Community • Ambari Architecture • Provisioning Clusters and Services • Extensibility Features – Ambari Stacks – Ambari Views – Ambari Blueprints • Releases • Learn More • Q & A Page 2
  • 3. © Hortonworks Inc. 2014 Hadoop Operations with Ambari Provision: Simplified deployment across platforms Manage: Consistent controls across the Stack Monitor: Visibility into key cluster metrics -  Single pane of glass for Hadoop & System status -  Pre-configured metrics & alerts -  Single point for cluster operations -  Advanced configurations and host controls -  Wizard-driven cluster install experience -  Cloud, virtual and physical environments Apache Ambari is a 100% open source framework for provisioning, managing and monitoring Hadoop clusters
  • 4. © Hortonworks Inc. 2014 100% Apache Open Source • Active Community •  60+ Contributors / 30+ Committers •  200+ Ambari User Group Members Page 4 2013 Oct Apache Ambari 1.4.1 Released Adds operations for Hadoop 2 Stack Ambari Ambari 1.2.0 Released Operations for Hadoop 1 Stack 2013 Jan 2013 Dec Apache Ambari Graduates to Top Level Project
  • 5. © Hortonworks Inc. 2014 Ambari Release Cadence Page 5 Ambari 1.4.3 Jan 2014 Ambari 1.4.4 Feb 2014 Ambari 1.5.0 Apr 2014 Ambari 1.7.0 2H2014 Ambari 1.6.0 May 2014
  • 6. © Hortonworks Inc. 2014 Demo #1 Cluster Management Page 6
  • 7. © Hortonworks Inc. 2014 System Architecture 7 Ambari Server Host Agent Host Agent Host Agent Ambari Web DB /clusters! Host Agent
  • 8. © Hortonworks Inc. 2014 Ambari Server Architecture 8 DB Orchestrator Monitoring REST API Request Dispatcher Ambari Web Ambari Server Ambari Agents Metrics Providers AuthProvider /clusters! User! Repo! java! python! JS! RDBMS! LDAP! REST API Configurable Auth Provider Cluster Configurations and Topology Web Client AD!
  • 9. © Hortonworks Inc. 2014 Installing Ambari • Install Ambari Server • Setup Options – JDK (Oracle JDK 6, Oracle JDK 7, Custom JDK) – Database (PostgreSQL, MySQL or Oracle) – Server Port and HTTPS – User Authentication (Local, LDAP or AD) – Server-Agent Two-way SSL • Start Ambari Server • Browse to Ambari Web for Cluster Install Wizard • Install Ambari Agents – Option #1: Automate via SSH – Option #2: Manual Page 9
  • 10. © Hortonworks Inc. 2014 Installing Agents Page 10 OPTION 1! automate! provide SSH Key! OPTION 2! manual!
  • 11. © Hortonworks Inc. 2014 Option #1: Ambari Agent via SSH Page 11 Ambari Server Ambari Agent 1) Configure Ambari Repo! 2) Copy Ambari Agent Setup script! 3) Execute Ambari Agent Setup script! 4) Install ambari-agent! 5) Configure ambari-agent.ini! 6) Start ambari-agent! 7) Begin Ambari Agent Registration! Uses the SSH
  • 12. © Hortonworks Inc. 2014 Option #2: Ambari Agent via Manual Page 12 Ambari Server Ambari Agent 2) Install ambari-agent! 3) Configure ambari-agent.ini! 4) Start ambari-agent! 5) Begin Ambari Agent Registration! 1) Configure Ambari repo! ** User executes all ops on the Agent host(s). No requirement for SSH Private Key. No SSH
  • 13. © Hortonworks Inc. 2014 Ambari Agent Registration Page 13 Ambari Server Ambari Agent 11) Agent Heartbeat Begins! 1) Connect on Handshake port 8441! 4) Sign Agent Cert! 2) Download Server Cert! 6) Connect on Registration port 8440! 7) Perform 2WAY auth using Agent Cert! 10) Complete Host Registration! Agent Host 8) Get FQDN! 9) Register host! 8a) Host Script! 3) Request to Sign Agent Cert! 5) Download Agent Cert + Disconnect!
  • 14. © Hortonworks Inc. 2014 Demo #2 Cluster Install Page 14
  • 15. © Hortonworks Inc. 2014 Extensibility Features Ambari Stacks Ambari Blueprints Ambari Views Page 15
  • 16. © Hortonworks Inc. 2014 Ambari Stacks Page 16
  • 17. © Hortonworks Inc. 2014 Ambari Stacks • Separate “the Stack” from “Ambari” • Make it easier to bring more than a traditional “Hadoop Stack” under Ambari management • Defining a consistent Service lifecycle management interface that can be extended • Dynamically add Stacks + Services definitions Page 17
  • 18. © Hortonworks Inc. 2014 Stack Details • Stacks define Services + Repos – What is in the Stack, and where to get the bits • Each Service has a definition – What Components are part of the Service • Each Service has defined lifecycle commands – start, stop, status, install, configure • Lifecycle is controlled via command scripts • Ability to define “custom” commands • Ability to “extend” Stacks Page 18 AMBARI   SERVER   Stack Command   Scripts   Service   Defini:ons   AMBARI   AGENT/S   AMBARI   AGENT/S   AMBARI   AGENT/S   python!xml! Repos
  • 19. © Hortonworks Inc. 2014 Stack Mechanics • Ambari Server reads Stack definitions on start • Ambari Server sends a command to Agents • Agents download Stack definition + command scripts • Agent executes command • If the Stack definition changes, Agent will request latest Stack definition + command scripts Page 19
  • 20. © Hortonworks Inc. 2014 Ambari Blueprints Page 20
  • 21. © Hortonworks Inc. 2014 Ambari Blueprints Page 21 STACK   HOSTS   BLUEPRINT  
  • 22. © Hortonworks Inc. 2014 Automating Installs •  Blueprint defines a cluster layout and component configuration for a Stack •  Provide Blueprint to Ambari to perform cluster installation (no wizard required) •  Export Blueprint from existing cluster BLUEPRINT! Ambari   Submit Blueprint to Ambari Hadoop   Cluster Ambari provisions cluster BLUEPRINT! <stack>! <host>! <service>! <component>! <config>! HOST! MANIFEST! <host>! <meta>! SERVICE! CONFIGS! <props>! Page 22
  • 23. © Hortonworks Inc. 2014 Ambari + OpenStack Page 23 OpenStack  Infrastructure   Horizon Savanna AMBARI   SERVER   Hadoop  Cluster
  • 24. © Hortonworks Inc. 2014 Ambari Views Page 24
  • 25. © Hortonworks Inc. 2014 Ambari Views •  Goal: Customize the Ambari Web experience •  Views compliment Stack Extensibility – Stack Extensibility makes custom Stack Services available to Ambari – Views expose custom UI features for Services •  Ambari Admins can entitle “views” to Ambari Web users –  Entitlements framework for finer-grained permissions control for Ambari users Page 25
  • 26. © Hortonworks Inc. 2014 View Usage • Developer Creates a View • Deploys View to Ambari Server • Ambari Admin creates instances of Views • Ambari Admin entitles Views to users Page 26
  • 27. © Hortonworks Inc. 2014 View Configuration + Entitlement Page 27
  • 28. © Hortonworks Inc. 2014 Customized Views Page 28 “admin” gets operator controls “joe.user” gets specific views based on entitlements
  • 29. © Hortonworks Inc. 2014 Releases What’s Up Next Page 29
  • 30. © Hortonworks Inc. 2014 What’s New in Ambari 1.5.0 • Maintenance Mode • Rolling Restarts • Bulk Host Operations • Decommission TTs, NMs, RSs • Add Service • Refresh Client Configs • Default JDK 7 • For a complete list of changes: https://issues.apache.org/jira/browse/AMBARI/fixforversion/12325019 Page 30
  • 31. © Hortonworks Inc. 2014 Ambari Futures • Operations – Ambari Blueprints – Component log access + search – Ubuntu and Windows support • Extensibility – Finer-grain user entitlements – Ambari Views • Insight – Troubleshooting + Performance Tuning – Capacity Planning Page 31
  • 32. © Hortonworks Inc. 2014 Learn More Page 32 Resource Location Apache Ambari Project Page http://ambari.apache.org Ambari Project Wiki https://cwiki.apache.org/confluence/display/AMBARI Ambari Project JIRA https://issues.apache.org/jira/browse/AMBARI
  • 33. © Hortonworks Inc. 2014 Q & A Page 33