• Save
20a installation
Upcoming SlideShare
Loading in...5
×
 

20a installation

on

  • 842 views

 

Statistics

Views

Total Views
842
Views on SlideShare
842
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

20a installation 20a installation Presentation Transcript

  • Installation 7/6/2012© 2012 MapR Technologies Installation 1
  • Installation Agenda • Installation Overview • Installation Methods • Installation Details • High Availability Considerations • LAB: Installation© 2012 MapR Technologies Installation 2
  • Installation Objectives At the end of this module you will be able to: • Describe the steps involved in MapR installation • Install a cluster using the maprinstall script • Install MapR on a single node manually and with the maprinstall script • Install MapR Metrics • Explain what is involved in setting up HA for MapR© 2012 MapR Technologies Installation 3
  • Installation Overview© 2012 MapR Technologies Installation 4
  • Installation Overview  What needs to happen to install MapR on each node ? – Add MapR repository – Install MapR services and packages from repository – Configure the node (configure.sh) – Format disks (disksetup) – Install and configure MapR Metrics (optional) – Start the cluster – Additional configuration steps after install • Set up HA • Set up node topology (covered in Configuration module)© 2012 MapR Technologies Installation 5
  • Installation Methods© 2012 MapR Technologies Installation 6
  • Installation Methods  Cluster installation – Bring up an entire cluster with a script from one node • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall –R <roles_file> – Performs node validation (OS partition, ports, memory, swap space, etc.) – Assumes ability to SSH from node running script to other nodes – Provide a roles file with comma-delimited lists of: » Nodes » Packages » Disks 10.10.100.2 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.3 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.1 mapr-cldb,mapr-zookeeper,mapr-jobtracker,mapr- webserver,mapr-fileserver,mapr-tasktracker /dev/sdb© 2012 MapR Technologies Installation 7
  • Installation Methods  Individual node installation – Scripted • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall – Assumes you can provide mandatory data (package list, CLDB, Zookeeper) – Performs node validation (OS partition, ports, memory, swap space, etc.) – Executes all steps below from one script – Manual • Add MapR repository • Install MapR services (apt-get, yum, etc.) • configure.sh • disksetup • Bring up the cluster© 2012 MapR Technologies Installation 8
  • Installation Details© 2012 MapR Technologies Installation 9
  • MapR Repository  From MapR repositories – apt-get or yum  From local repositories – Download .tar.gz – Set up repository – apt-get or yum  From local packages – Use dpkg or rpm – Must resolve dependencies manually© 2012 MapR Technologies Installation 10
  • Configuration Script  configure.sh – Run on each node – Sets up mapr-clusters.conf – Writes ZK node IPs several places (mapr-cldb.conf is one) – Registers node with ZooKeeper and CLDB© 2012 MapR Technologies Installation 11
  • Choosing Disks for MapR  MapR formats and uses disks for MapR-FS – Should use physical drives/partitions  Disk ready for MapR? – mount: partition in use? – df: partition in use? – Entry in /etc/fstab? – Not accessible to mkfs? mkfs fails?  If any above are true, disk is not ready© 2012 MapR Technologies Installation 12
  • Disk Setup Script  disksetup – Takes input from a text file listing usable disks. E.g. /dev/sdb /dev/sdc1 /dev/sdc2 /dev/sdc4 /dev/sdd – Adds disks to disktab – Use –F option to force formatting – Creates storage pools (-w option specifies stripe width) – Run after configure.sh© 2012 MapR Technologies Installation 13
  • Installing MapR Metrics  Prerequisites – MySQL server (on a node or separate machine) – EPEL repository – M5 license for all features (M3: no charts or histograms)  Installation procedure: – Install MapR Metrics package on all JobTracker and Webserver nodes • e.g. apt-get install mapr-metrics – MCS: System Settings > Metrics • Enter <hostname/IP>:<port> of MySQL server • Enter MySQL credentials – Source /opt/mapr/bin/setup.sql at mysql> prompt on a node where MapR Metrics is installed© 2012 MapR Technologies Installation 14
  • Starting the Cluster  Bring up ZooKeeper on ZooKeeper nodes  Bring up Warden – Wait for services to start (use jps to see)  Set up administrative user  Log onto MapR Control System  Add license© 2012 MapR Technologies Installation 15
  • High Availability Considerations© 2012 MapR Technologies Installation 16
  • High Availability (HA)  CLDB  JobTracker  NFS© 2012 MapR Technologies Installation 17
  • High Availability CLDB  Warm standby – One Primary CLDB active at a time – Secondary CLDB supports reads  Configure multiple CLDBs – Up to 6  Install across physical topology  Can isolate from all other services  Can also isolate CLDB volume on its own topology  Don’t run active JobTracker on primary CLDB node© 2012 MapR Technologies Installation 18
  • High Availability JobTracker  Cold standby – One active JobTracker at a time – Stateful failover preserves running jobs  In most cases 3 – Unless > 100 nodes, then 5© 2012 MapR Technologies Installation 19
  • High Availability NFS  Active standby – Multiple concurrent NFS servers allowed – VIPs provide immediate failover – Failover triggered by CLDB if NFS server fails – Reads/writes continue after failover© 2012 MapR Technologies Installation 20
  • Setting Up NFS HA  Install and run mapr-nfs service on assigned nodes  Create a pool of VIPs  Use MapR Control System or the API to assign VIPs to NFS nodes – One VIP across multiple NFS nodes – Multiple VIPs across multiple NFS nodes© 2012 MapR Technologies Installation 21
  • LAB: Installation© 2012 MapR Technologies Installation 22
  • Questions© 2012 MapR Technologies Installation 23