Installation  7/6/2012© 2012 MapR Technologies   Installation 1
Installation   Agenda   • Installation Overview   • Installation Methods   • Installation Details   • High Availability Co...
Installation   Objectives   At the end of this module you will be able to:   • Describe the steps involved in MapR install...
Installation Overview© 2012 MapR Technologies     Installation 4
Installation Overview     What needs to happen to install MapR on each node ?      –   Add MapR repository      –   Insta...
Installation Methods© 2012 MapR Technologies     Installation 6
Installation Methods     Cluster installation      –   Bring up an entire cluster with a script from one node          • ...
Installation Methods     Individual node installation      –   Scripted          • Download the maprinstall script and mo...
Installation Details© 2012 MapR Technologies         Installation 9
MapR Repository     From MapR repositories      –   apt-get or yum     From local repositories      –   Download .tar.gz...
Configuration Script     configure.sh      –   Run on each node      –   Sets up mapr-clusters.conf      –   Writes ZK no...
Choosing Disks for MapR     MapR formats and uses disks for MapR-FS      –   Should use physical drives/partitions     D...
Disk Setup Script     disksetup      –   Takes input from a text file listing usable disks. E.g.          /dev/sdb       ...
Installing MapR Metrics     Prerequisites      –   MySQL server (on a node or separate machine)      –   EPEL repository ...
Starting the Cluster     Bring up ZooKeeper on ZooKeeper nodes     Bring up Warden      –   Wait for services to start (...
High Availability                           Considerations© 2012 MapR Technologies       Installation 16
High Availability (HA)     CLDB     JobTracker     NFS© 2012 MapR Technologies   Installation 17
High Availability CLDB     Warm standby      –   One Primary CLDB active at a time      –   Secondary CLDB supports reads...
High Availability JobTracker     Cold standby      –   One active JobTracker at a time      –   Stateful failover preserv...
High Availability NFS     Active standby      –   Multiple concurrent NFS servers allowed      –   VIPs provide immediate...
Setting Up NFS HA     Install and run mapr-nfs service on assigned nodes     Create a pool of VIPs     Use MapR Control...
LAB: Installation© 2012 MapR Technologies       Installation 22
Questions© 2012 MapR Technologies   Installation 23
Upcoming SlideShare
Loading in …5
×

20a installation

1,317 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,317
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

20a installation

  1. 1. Installation 7/6/2012© 2012 MapR Technologies Installation 1
  2. 2. Installation Agenda • Installation Overview • Installation Methods • Installation Details • High Availability Considerations • LAB: Installation© 2012 MapR Technologies Installation 2
  3. 3. Installation Objectives At the end of this module you will be able to: • Describe the steps involved in MapR installation • Install a cluster using the maprinstall script • Install MapR on a single node manually and with the maprinstall script • Install MapR Metrics • Explain what is involved in setting up HA for MapR© 2012 MapR Technologies Installation 3
  4. 4. Installation Overview© 2012 MapR Technologies Installation 4
  5. 5. Installation Overview  What needs to happen to install MapR on each node ? – Add MapR repository – Install MapR services and packages from repository – Configure the node (configure.sh) – Format disks (disksetup) – Install and configure MapR Metrics (optional) – Start the cluster – Additional configuration steps after install • Set up HA • Set up node topology (covered in Configuration module)© 2012 MapR Technologies Installation 5
  6. 6. Installation Methods© 2012 MapR Technologies Installation 6
  7. 7. Installation Methods  Cluster installation – Bring up an entire cluster with a script from one node • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall –R <roles_file> – Performs node validation (OS partition, ports, memory, swap space, etc.) – Assumes ability to SSH from node running script to other nodes – Provide a roles file with comma-delimited lists of: » Nodes » Packages » Disks 10.10.100.2 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.3 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.1 mapr-cldb,mapr-zookeeper,mapr-jobtracker,mapr- webserver,mapr-fileserver,mapr-tasktracker /dev/sdb© 2012 MapR Technologies Installation 7
  8. 8. Installation Methods  Individual node installation – Scripted • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall – Assumes you can provide mandatory data (package list, CLDB, Zookeeper) – Performs node validation (OS partition, ports, memory, swap space, etc.) – Executes all steps below from one script – Manual • Add MapR repository • Install MapR services (apt-get, yum, etc.) • configure.sh • disksetup • Bring up the cluster© 2012 MapR Technologies Installation 8
  9. 9. Installation Details© 2012 MapR Technologies Installation 9
  10. 10. MapR Repository  From MapR repositories – apt-get or yum  From local repositories – Download .tar.gz – Set up repository – apt-get or yum  From local packages – Use dpkg or rpm – Must resolve dependencies manually© 2012 MapR Technologies Installation 10
  11. 11. Configuration Script  configure.sh – Run on each node – Sets up mapr-clusters.conf – Writes ZK node IPs several places (mapr-cldb.conf is one) – Registers node with ZooKeeper and CLDB© 2012 MapR Technologies Installation 11
  12. 12. Choosing Disks for MapR  MapR formats and uses disks for MapR-FS – Should use physical drives/partitions  Disk ready for MapR? – mount: partition in use? – df: partition in use? – Entry in /etc/fstab? – Not accessible to mkfs? mkfs fails?  If any above are true, disk is not ready© 2012 MapR Technologies Installation 12
  13. 13. Disk Setup Script  disksetup – Takes input from a text file listing usable disks. E.g. /dev/sdb /dev/sdc1 /dev/sdc2 /dev/sdc4 /dev/sdd – Adds disks to disktab – Use –F option to force formatting – Creates storage pools (-w option specifies stripe width) – Run after configure.sh© 2012 MapR Technologies Installation 13
  14. 14. Installing MapR Metrics  Prerequisites – MySQL server (on a node or separate machine) – EPEL repository – M5 license for all features (M3: no charts or histograms)  Installation procedure: – Install MapR Metrics package on all JobTracker and Webserver nodes • e.g. apt-get install mapr-metrics – MCS: System Settings > Metrics • Enter <hostname/IP>:<port> of MySQL server • Enter MySQL credentials – Source /opt/mapr/bin/setup.sql at mysql> prompt on a node where MapR Metrics is installed© 2012 MapR Technologies Installation 14
  15. 15. Starting the Cluster  Bring up ZooKeeper on ZooKeeper nodes  Bring up Warden – Wait for services to start (use jps to see)  Set up administrative user  Log onto MapR Control System  Add license© 2012 MapR Technologies Installation 15
  16. 16. High Availability Considerations© 2012 MapR Technologies Installation 16
  17. 17. High Availability (HA)  CLDB  JobTracker  NFS© 2012 MapR Technologies Installation 17
  18. 18. High Availability CLDB  Warm standby – One Primary CLDB active at a time – Secondary CLDB supports reads  Configure multiple CLDBs – Up to 6  Install across physical topology  Can isolate from all other services  Can also isolate CLDB volume on its own topology  Don’t run active JobTracker on primary CLDB node© 2012 MapR Technologies Installation 18
  19. 19. High Availability JobTracker  Cold standby – One active JobTracker at a time – Stateful failover preserves running jobs  In most cases 3 – Unless > 100 nodes, then 5© 2012 MapR Technologies Installation 19
  20. 20. High Availability NFS  Active standby – Multiple concurrent NFS servers allowed – VIPs provide immediate failover – Failover triggered by CLDB if NFS server fails – Reads/writes continue after failover© 2012 MapR Technologies Installation 20
  21. 21. Setting Up NFS HA  Install and run mapr-nfs service on assigned nodes  Create a pool of VIPs  Use MapR Control System or the API to assign VIPs to NFS nodes – One VIP across multiple NFS nodes – Multiple VIPs across multiple NFS nodes© 2012 MapR Technologies Installation 21
  22. 22. LAB: Installation© 2012 MapR Technologies Installation 22
  23. 23. Questions© 2012 MapR Technologies Installation 23

×