Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Horton works hdp 2.5 sandpit on microsoft azure v0 5

598 views

Published on

Creating a Hortonworks Data Platform 2.5 Sandbox on Microsoft Azure

Published in: Data & Analytics
  • Be the first to comment

Horton works hdp 2.5 sandpit on microsoft azure v0 5

  1. 1. INSTALLING HORTONWORKS HDP 2.5 SANDBOX VM ON MICROSOFT AZURE Jeff Moss Oramoss Ltd
  2. 2. CONTENTS  About Me  HortonWorks  Microsoft Azure  Installation Of Hortonworks HDP 2.5 on Microsoft Azure  Prerequisites  Create VM  Set Firewall Rules  Change Passwords  Access Ambari
  3. 3. ABOUT ME  Independent Consultant  Working with “big data” long before it became trendy!  Extensive Oracle background  25 years experience from Oracle 5 onwards  Former presenter UKOUG  Currently Supplying Services To E.On UK  Lead Technical Architect role  75TB Relational Enterprise Data Warehouse  Support for several other European warehouses  Contact Me  http://www.oramoss.com  http://www.oramoss.com/blog  jeff.moss@oramoss.com
  4. 4. MICROSOFT AZURE  Microsoft Cloud platform  2nd largest by share, behind Amazon (AWS)  A collection of cloud services  Most trusted cloud (compliance certifications)  More geographical regions than Amazon  Vendor Services  Microsoft, Oracle, SAP…  Open Source tools and technologies  Linux, Docker, Chef, Puppet, GitLab, WordPress…  Windows or Linux OS  Big Data, Machine Learning, Blockchain, IoT, Microservices  IAAS, PAAS, DBAAS, SAAS
  5. 5. HORTONWORKS HDP  Commercial Hadoop Distribution  One of the major distributions  Partnership with Microsoft to deliver on Azure (Cloud)
  6. 6. HORTONWORKS HDP SANDBOX  Prebuilt environment  Virtualised  VMWare  VirtualBox  Docker  Useful for test and learn
  7. 7. PREREQUISITES  Must Haves:  A Microsoft Azure account  I used the free month trial which gives £125 credit  An SSH Client  A Web Browser  Optional (Not really)  A generated public/private key pair
  8. 8. NAVIGATE TO THE PORTAL DASHBOARD
  9. 9. SEARCH FOR HORTONWORKS SANDBOX WITH HDP 2.5
  10. 10. SELECT THE HDP 2.5 VARIANT, PRESS CREATE
  11. 11. CONFIG STEP 1 – BASIC SETTINGS
  12. 12. CONFIG STEP 2 - SIZE
  13. 13. CONFIG STEP 3 - SETTINGS
  14. 14. CONFIG STEP 4 – SUMMARY PAGE
  15. 15. CONFIG STEP 5 – BUY
  16. 16. DEPLOYING
  17. 17. ONCE FINISHED DEPLOYING
  18. 18. CLICK ON THE HDP25SANDBOX
  19. 19. ADD A DNS NAME LABEL
  20. 20. INBOUND SECURITY RULES
  21. 21. INBOUND SECURITY RULES
  22. 22. INBOUND SECURITY RULES  Create additional rules for accessing optional components  default-allow-4200 (Web SSH Access)  default-allow-50070 (Default Name Node)  default-allow-21000 (Atlas)  default-allow-9995 (Zeppelin)  default-allow-15000 (Falcon)  default-allow-6080 (Ranger)
  23. 23. SSH ACCESS
  24. 24. CHANGE PASSWORDS  Login as jeff  sudo su – root  ssh root@172.17.0.2  Set a new password for root (previously hadoop)  Run ambari-admin-password-reset  Set a new password for admin
  25. 25. HTTP ACCESS
  26. 26. AFTER ENTERING DETAILS
  27. 27. LAUNCH DASHBOARD (LHS)
  28. 28. WE’RE IN!
  29. 29. BACK TO HDP MAIN ENTRY
  30. 30. WEB BASED SSH ACCESS
  31. 31. WEB SSH TERMINAL
  32. 32. SIMPLE HDFS ACCESS
  33. 33. SIMPLE HDFS COMMANDS

×