© Hortonworks Inc. 2014
Apache Ambari
1.6.0
May 2014
© Hortonworks Inc. 2014
What’s New in 1.6.0
• PostgreSQL Support
• Ambari Blueprints (and /stacks API)
• For a complete li...
© Hortonworks Inc. 2014
Database Support
Page 3
Hive Metastore Oozie Ambari DB
MySQL 5.x
Oracle 11g
PostgreSQL 8, 9
Defaul...
© Hortonworks Inc. 2014
Ambari DB
• Ambari Server Setup
ambari-server setup
Page 4
© Hortonworks Inc. 2014
Hive Metastore and Oozie DB
• Cluster Install Wizard > Customize Services
• Hive and Oozie
Page 5
© Hortonworks Inc. 2014
/stacks API
Page 6
© Hortonworks Inc. 2014
Ambari Stacks
Page 7
AMBARI
SERVER
Stack
Command
Scripts
Service
Definitions
AMBARI
AGENT/S
AMBARI...
© Hortonworks Inc. 2014
/stacks API
• REST API for reading Stacks information
• Including Services and Repositories
• Stac...
© Hortonworks Inc. 2014
OS Families + Repositories
Page 9
HDP 2.1
redhat5*
redhat6*
suse11* HDP-2.1
HDP-2.1
HDP-2.1
* Repr...
© Hortonworks Inc. 2014
HDP.repo
Page 10
Ambari Server Ambari Agent
4) Server sends HDP.repo
2) Reads Stacks for
HDP-2.1 b...
© Hortonworks Inc. 2014
HDP.repo
Page 11
Ambari Server Ambari Agent
4) Server sends HDP.repo
2) Reads Stacks for
HDP-2.1 b...
© Hortonworks Inc. 2014
Set Base URL: During Install
Page 12
Ambari will
set Base
URL using
input from
user.
Ambari gets t...
© Hortonworks Inc. 2014
Set Base URL: During Upgrade
Page 13
ambari-server upgradestack
HDP-2.1 http://your.local.reposito...
© Hortonworks Inc. 2014
Ambari Blueprints
Page 14
© Hortonworks Inc. 2014
Ambari Blueprints
Page 15
STACK
DEFINITION
COMPONENT
LAYOUT
BLUEPRINT
BLUEPRINT INSTANTIATE CLUSTER
© Hortonworks Inc. 2014
Using Blueprints
Page 16
Install, Setup and Start Ambari Server1
Install, Setup and Start Ambari A...
© Hortonworks Inc. 2014
Blueprint API Calls
Page 17
BLUEPRINT
POST /blueprints/my-blueprint
CLUSTER
INSTANCE POST /cluster...
© Hortonworks Inc. 2014
Example: Single-Node Definitions
Page 18
{
"configurations" : [
{
”hdfs-site" : {
"dfs.namenode.na...
© Hortonworks Inc. 2014
New Blueprint API Parameters
• Configurations
• Password Checking
Page 19
© Hortonworks Inc. 2014
Configurations
Page 20
{
"configurations" : [
{
”hdfs-site" : {
"dfs.namenode.name.dir" : ”/hadoop...
© Hortonworks Inc. 2014
Password Checking
• Certain Stack components require passwords
–Nagios – Nagios Web Password
–Hive...
© Hortonworks Inc. 2014
Learn More
Page 22
Resource Location
Apache Ambari Project Page http://ambari.apache.org
Ambari Pr...
Upcoming SlideShare
Loading in …5
×

Apache Ambari - What's New in 1.6.0

1,874 views

Published on

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,874
On SlideShare
0
From Embeds
0
Number of Embeds
20
Actions
Shares
0
Downloads
75
Comments
0
Likes
7
Embeds 0
No embeds

No notes for slide
  • PUT /api/v1/stacks2/HDP/versions/2.1/operatingSystems/redhat6/repositories/HDP-2.1{"Repositories":{"base_url":"http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.1.2.0","verify_base_url":true}}
  • Apache Ambari - What's New in 1.6.0

    1. 1. © Hortonworks Inc. 2014 Apache Ambari 1.6.0 May 2014
    2. 2. © Hortonworks Inc. 2014 What’s New in 1.6.0 • PostgreSQL Support • Ambari Blueprints (and /stacks API) • For a complete list of changes https://issues.apache.org/jira/browse/AMBARI/fixforversion/12326544 Page 2
    3. 3. © Hortonworks Inc. 2014 Database Support Page 3 Hive Metastore Oozie Ambari DB MySQL 5.x Oracle 11g PostgreSQL 8, 9 Default New in Ambari 1.6.0 PostgreSQLMySQL Derby
    4. 4. © Hortonworks Inc. 2014 Ambari DB • Ambari Server Setup ambari-server setup Page 4
    5. 5. © Hortonworks Inc. 2014 Hive Metastore and Oozie DB • Cluster Install Wizard > Customize Services • Hive and Oozie Page 5
    6. 6. © Hortonworks Inc. 2014 /stacks API Page 6
    7. 7. © Hortonworks Inc. 2014 Ambari Stacks Page 7 AMBARI SERVER Stack Command Scripts Service Definitions AMBARI AGENT/S AMBARI AGENT/S AMBARI AGENT/S pythonxml Repos
    8. 8. © Hortonworks Inc. 2014 /stacks API • REST API for reading Stacks information • Including Services and Repositories • Stack -> Versions -> Services -> Components • Stack -> Versions -> Operating Systems -> Repositories Page 8
    9. 9. © Hortonworks Inc. 2014 OS Families + Repositories Page 9 HDP 2.1 redhat5* redhat6* suse11* HDP-2.1 HDP-2.1 HDP-2.1 * Represents the “OS Family” (for example: “redhat6 = centos6 = oraclelinux6”) OS REPOSITORYSTACK
    10. 10. © Hortonworks Inc. 2014 HDP.repo Page 10 Ambari Server Ambari Agent 4) Server sends HDP.repo 2) Reads Stacks for HDP-2.1 base url* 6) Agent uses HDP.repo when instructed to install packages 1) Agent reports OS 3) Creates HDP.repo 5) Agent puts HDP.repo in place
    11. 11. © Hortonworks Inc. 2014 HDP.repo Page 11 Ambari Server Ambari Agent 4) Server sends HDP.repo 2) Reads Stacks for HDP-2.1 base url* 6) Agent uses HDP.repo when instructed to install packages 1) Agent reports OS 3) Creates HDP.repo 5) Agent puts HDP.repo in place
    12. 12. © Hortonworks Inc. 2014 Set Base URL: During Install Page 12 Ambari will set Base URL using input from user. Ambari gets the default values from Stack definition (and Latest Base URL, if internet available).
    13. 13. © Hortonworks Inc. 2014 Set Base URL: During Upgrade Page 13 ambari-server upgradestack HDP-2.1 http://your.local.repository redhat6 Stack Base URL OS Family
    14. 14. © Hortonworks Inc. 2014 Ambari Blueprints Page 14
    15. 15. © Hortonworks Inc. 2014 Ambari Blueprints Page 15 STACK DEFINITION COMPONENT LAYOUT BLUEPRINT BLUEPRINT INSTANTIATE CLUSTER
    16. 16. © Hortonworks Inc. 2014 Using Blueprints Page 16 Install, Setup and Start Ambari Server1 Install, Setup and Start Ambari Agents2 Define Blueprint (stack, layout and configurations)3 Define cluster instance4 Instantiate cluster instance and “watch” progress5
    17. 17. © Hortonworks Inc. 2014 Blueprint API Calls Page 17 BLUEPRINT POST /blueprints/my-blueprint CLUSTER INSTANCE POST /clusters/MyCluster 1 2
    18. 18. © Hortonworks Inc. 2014 Example: Single-Node Definitions Page 18 { "configurations" : [ { ”hdfs-site" : { "dfs.namenode.name.dir" : ”/hadoop/nn" } } ], "host_groups" : [ { "name" : ”uber-host", "components" : [ { "name" : "NAMENODE” }, { "name" : "SECONDARY_NAMENODE” }, { "name" : "DATANODE” }, { "name" : "HDFS_CLIENT” }, { "name" : "RESOURCEMANAGER” }, { "name" : "NODEMANAGER” }, { "name" : "YARN_CLIENT” }, { "name" : "HISTORYSERVER” }, { "name" : "MAPREDUCE2_CLIENT” } ], "cardinality" : "1" } ], "Blueprints" : { "blueprint_name" : "single-node-hdfs-yarn", "stack_name" : "HDP", "stack_version" : "2.1" } } { "blueprint" : "single-node-hdfs-yarn", "host_groups" :[ { "name" : ”uber-host", "hosts" : [ { "fqdn" : "c6401.ambari.apache.org” } ] } ] } BLUEPRINT CLUSTER INSTANCE Description • Single-node cluster • Use HDP 2.0 Stack • HDFS + YARN + MR2 • Everything on c6401
    19. 19. © Hortonworks Inc. 2014 New Blueprint API Parameters • Configurations • Password Checking Page 19
    20. 20. © Hortonworks Inc. 2014 Configurations Page 20 { "configurations" : [ { ”hdfs-site" : { "dfs.namenode.name.dir" : ”/hadoop/nn" } } ], "host_groups" : [ { ... } ], "Blueprints" : { "blueprint_name" : "single-node-hdfs-yarn", "stack_name" : "HDP", "stack_version" : "2.1" } } SET AT BLUEPRINT { "blueprint" : "single-node-hdfs-yarn", "configurations" : [ { "hdfs-site" : { "dfs.namenode.name.dir" : "/h/d/f/s/nn" } } ], "host_groups" :[ { "name" : "host_group_1", "hosts" : [ { "fqdn" : "c6402.ambari.apache.org" } ] } ] } OVERRIDE AT CLUSTER
    21. 21. © Hortonworks Inc. 2014 Password Checking • Certain Stack components require passwords –Nagios – Nagios Web Password –Hive Metastore “MySQL” – Database connection password –Oozie Server “Derby” – Database connection password • Set each individually (with blueprint or cluster) • OR set with a “default password” Page 21 { "blueprint" : "single-node-hdfs-yarn", ”default_password" : ”mypass", "configurations" : [ ...
    22. 22. © Hortonworks Inc. 2014 Learn More Page 22 Resource Location Apache Ambari Project Page http://ambari.apache.org Ambari Project Wiki https://cwiki.apache.org/confluence/display/AMBARI Ambari Project JIRA https://issues.apache.org/jira/browse/AMBARI

    ×