Apache Ambari - What's New in 1.6.0

1,759 views
1,455 views

Published on

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,759
On SlideShare
0
From Embeds
0
Number of Embeds
20
Actions
Shares
0
Downloads
73
Comments
0
Likes
7
Embeds 0
No embeds

No notes for slide
  • PUT /api/v1/stacks2/HDP/versions/2.1/operatingSystems/redhat6/repositories/HDP-2.1{"Repositories":{"base_url":"http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.1.2.0","verify_base_url":true}}
  • Apache Ambari - What's New in 1.6.0

    1. 1. © Hortonworks Inc. 2014 Apache Ambari 1.6.0 May 2014
    2. 2. © Hortonworks Inc. 2014 What’s New in 1.6.0 • PostgreSQL Support • Ambari Blueprints (and /stacks API) • For a complete list of changes https://issues.apache.org/jira/browse/AMBARI/fixforversion/12326544 Page 2
    3. 3. © Hortonworks Inc. 2014 Database Support Page 3 Hive Metastore Oozie Ambari DB MySQL 5.x Oracle 11g PostgreSQL 8, 9 Default New in Ambari 1.6.0 PostgreSQLMySQL Derby
    4. 4. © Hortonworks Inc. 2014 Ambari DB • Ambari Server Setup ambari-server setup Page 4
    5. 5. © Hortonworks Inc. 2014 Hive Metastore and Oozie DB • Cluster Install Wizard > Customize Services • Hive and Oozie Page 5
    6. 6. © Hortonworks Inc. 2014 /stacks API Page 6
    7. 7. © Hortonworks Inc. 2014 Ambari Stacks Page 7 AMBARI SERVER Stack Command Scripts Service Definitions AMBARI AGENT/S AMBARI AGENT/S AMBARI AGENT/S pythonxml Repos
    8. 8. © Hortonworks Inc. 2014 /stacks API • REST API for reading Stacks information • Including Services and Repositories • Stack -> Versions -> Services -> Components • Stack -> Versions -> Operating Systems -> Repositories Page 8
    9. 9. © Hortonworks Inc. 2014 OS Families + Repositories Page 9 HDP 2.1 redhat5* redhat6* suse11* HDP-2.1 HDP-2.1 HDP-2.1 * Represents the “OS Family” (for example: “redhat6 = centos6 = oraclelinux6”) OS REPOSITORYSTACK
    10. 10. © Hortonworks Inc. 2014 HDP.repo Page 10 Ambari Server Ambari Agent 4) Server sends HDP.repo 2) Reads Stacks for HDP-2.1 base url* 6) Agent uses HDP.repo when instructed to install packages 1) Agent reports OS 3) Creates HDP.repo 5) Agent puts HDP.repo in place
    11. 11. © Hortonworks Inc. 2014 HDP.repo Page 11 Ambari Server Ambari Agent 4) Server sends HDP.repo 2) Reads Stacks for HDP-2.1 base url* 6) Agent uses HDP.repo when instructed to install packages 1) Agent reports OS 3) Creates HDP.repo 5) Agent puts HDP.repo in place
    12. 12. © Hortonworks Inc. 2014 Set Base URL: During Install Page 12 Ambari will set Base URL using input from user. Ambari gets the default values from Stack definition (and Latest Base URL, if internet available).
    13. 13. © Hortonworks Inc. 2014 Set Base URL: During Upgrade Page 13 ambari-server upgradestack HDP-2.1 http://your.local.repository redhat6 Stack Base URL OS Family
    14. 14. © Hortonworks Inc. 2014 Ambari Blueprints Page 14
    15. 15. © Hortonworks Inc. 2014 Ambari Blueprints Page 15 STACK DEFINITION COMPONENT LAYOUT BLUEPRINT BLUEPRINT INSTANTIATE CLUSTER
    16. 16. © Hortonworks Inc. 2014 Using Blueprints Page 16 Install, Setup and Start Ambari Server1 Install, Setup and Start Ambari Agents2 Define Blueprint (stack, layout and configurations)3 Define cluster instance4 Instantiate cluster instance and “watch” progress5
    17. 17. © Hortonworks Inc. 2014 Blueprint API Calls Page 17 BLUEPRINT POST /blueprints/my-blueprint CLUSTER INSTANCE POST /clusters/MyCluster 1 2
    18. 18. © Hortonworks Inc. 2014 Example: Single-Node Definitions Page 18 { "configurations" : [ { ”hdfs-site" : { "dfs.namenode.name.dir" : ”/hadoop/nn" } } ], "host_groups" : [ { "name" : ”uber-host", "components" : [ { "name" : "NAMENODE” }, { "name" : "SECONDARY_NAMENODE” }, { "name" : "DATANODE” }, { "name" : "HDFS_CLIENT” }, { "name" : "RESOURCEMANAGER” }, { "name" : "NODEMANAGER” }, { "name" : "YARN_CLIENT” }, { "name" : "HISTORYSERVER” }, { "name" : "MAPREDUCE2_CLIENT” } ], "cardinality" : "1" } ], "Blueprints" : { "blueprint_name" : "single-node-hdfs-yarn", "stack_name" : "HDP", "stack_version" : "2.1" } } { "blueprint" : "single-node-hdfs-yarn", "host_groups" :[ { "name" : ”uber-host", "hosts" : [ { "fqdn" : "c6401.ambari.apache.org” } ] } ] } BLUEPRINT CLUSTER INSTANCE Description • Single-node cluster • Use HDP 2.0 Stack • HDFS + YARN + MR2 • Everything on c6401
    19. 19. © Hortonworks Inc. 2014 New Blueprint API Parameters • Configurations • Password Checking Page 19
    20. 20. © Hortonworks Inc. 2014 Configurations Page 20 { "configurations" : [ { ”hdfs-site" : { "dfs.namenode.name.dir" : ”/hadoop/nn" } } ], "host_groups" : [ { ... } ], "Blueprints" : { "blueprint_name" : "single-node-hdfs-yarn", "stack_name" : "HDP", "stack_version" : "2.1" } } SET AT BLUEPRINT { "blueprint" : "single-node-hdfs-yarn", "configurations" : [ { "hdfs-site" : { "dfs.namenode.name.dir" : "/h/d/f/s/nn" } } ], "host_groups" :[ { "name" : "host_group_1", "hosts" : [ { "fqdn" : "c6402.ambari.apache.org" } ] } ] } OVERRIDE AT CLUSTER
    21. 21. © Hortonworks Inc. 2014 Password Checking • Certain Stack components require passwords –Nagios – Nagios Web Password –Hive Metastore “MySQL” – Database connection password –Oozie Server “Derby” – Database connection password • Set each individually (with blueprint or cluster) • OR set with a “default password” Page 21 { "blueprint" : "single-node-hdfs-yarn", ”default_password" : ”mypass", "configurations" : [ ...
    22. 22. © Hortonworks Inc. 2014 Learn More Page 22 Resource Location Apache Ambari Project Page http://ambari.apache.org Ambari Project Wiki https://cwiki.apache.org/confluence/display/AMBARI Ambari Project JIRA https://issues.apache.org/jira/browse/AMBARI

    ×