Your SlideShare is downloading. ×
0
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
20a installation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

20a installation

675

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
675
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Installation 7/6/2012© 2012 MapR Technologies Installation 1
  • 2. Installation Agenda • Installation Overview • Installation Methods • Installation Details • High Availability Considerations • LAB: Installation© 2012 MapR Technologies Installation 2
  • 3. Installation Objectives At the end of this module you will be able to: • Describe the steps involved in MapR installation • Install a cluster using the maprinstall script • Install MapR on a single node manually and with the maprinstall script • Install MapR Metrics • Explain what is involved in setting up HA for MapR© 2012 MapR Technologies Installation 3
  • 4. Installation Overview© 2012 MapR Technologies Installation 4
  • 5. Installation Overview  What needs to happen to install MapR on each node ? – Add MapR repository – Install MapR services and packages from repository – Configure the node (configure.sh) – Format disks (disksetup) – Install and configure MapR Metrics (optional) – Start the cluster – Additional configuration steps after install • Set up HA • Set up node topology (covered in Configuration module)© 2012 MapR Technologies Installation 5
  • 6. Installation Methods© 2012 MapR Technologies Installation 6
  • 7. Installation Methods  Cluster installation – Bring up an entire cluster with a script from one node • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall –R <roles_file> – Performs node validation (OS partition, ports, memory, swap space, etc.) – Assumes ability to SSH from node running script to other nodes – Provide a roles file with comma-delimited lists of: » Nodes » Packages » Disks 10.10.100.2 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.3 mapr-fileserver,mapr-tasktracker /dev/sdb 10.10.100.1 mapr-cldb,mapr-zookeeper,mapr-jobtracker,mapr- webserver,mapr-fileserver,mapr-tasktracker /dev/sdb© 2012 MapR Technologies Installation 7
  • 8. Installation Methods  Individual node installation – Scripted • Download the maprinstall script and move to /opt/install-mapr • Run/opt/install-mapr/maprinstall – Assumes you can provide mandatory data (package list, CLDB, Zookeeper) – Performs node validation (OS partition, ports, memory, swap space, etc.) – Executes all steps below from one script – Manual • Add MapR repository • Install MapR services (apt-get, yum, etc.) • configure.sh • disksetup • Bring up the cluster© 2012 MapR Technologies Installation 8
  • 9. Installation Details© 2012 MapR Technologies Installation 9
  • 10. MapR Repository  From MapR repositories – apt-get or yum  From local repositories – Download .tar.gz – Set up repository – apt-get or yum  From local packages – Use dpkg or rpm – Must resolve dependencies manually© 2012 MapR Technologies Installation 10
  • 11. Configuration Script  configure.sh – Run on each node – Sets up mapr-clusters.conf – Writes ZK node IPs several places (mapr-cldb.conf is one) – Registers node with ZooKeeper and CLDB© 2012 MapR Technologies Installation 11
  • 12. Choosing Disks for MapR  MapR formats and uses disks for MapR-FS – Should use physical drives/partitions  Disk ready for MapR? – mount: partition in use? – df: partition in use? – Entry in /etc/fstab? – Not accessible to mkfs? mkfs fails?  If any above are true, disk is not ready© 2012 MapR Technologies Installation 12
  • 13. Disk Setup Script  disksetup – Takes input from a text file listing usable disks. E.g. /dev/sdb /dev/sdc1 /dev/sdc2 /dev/sdc4 /dev/sdd – Adds disks to disktab – Use –F option to force formatting – Creates storage pools (-w option specifies stripe width) – Run after configure.sh© 2012 MapR Technologies Installation 13
  • 14. Installing MapR Metrics  Prerequisites – MySQL server (on a node or separate machine) – EPEL repository – M5 license for all features (M3: no charts or histograms)  Installation procedure: – Install MapR Metrics package on all JobTracker and Webserver nodes • e.g. apt-get install mapr-metrics – MCS: System Settings > Metrics • Enter <hostname/IP>:<port> of MySQL server • Enter MySQL credentials – Source /opt/mapr/bin/setup.sql at mysql> prompt on a node where MapR Metrics is installed© 2012 MapR Technologies Installation 14
  • 15. Starting the Cluster  Bring up ZooKeeper on ZooKeeper nodes  Bring up Warden – Wait for services to start (use jps to see)  Set up administrative user  Log onto MapR Control System  Add license© 2012 MapR Technologies Installation 15
  • 16. High Availability Considerations© 2012 MapR Technologies Installation 16
  • 17. High Availability (HA)  CLDB  JobTracker  NFS© 2012 MapR Technologies Installation 17
  • 18. High Availability CLDB  Warm standby – One Primary CLDB active at a time – Secondary CLDB supports reads  Configure multiple CLDBs – Up to 6  Install across physical topology  Can isolate from all other services  Can also isolate CLDB volume on its own topology  Don’t run active JobTracker on primary CLDB node© 2012 MapR Technologies Installation 18
  • 19. High Availability JobTracker  Cold standby – One active JobTracker at a time – Stateful failover preserves running jobs  In most cases 3 – Unless > 100 nodes, then 5© 2012 MapR Technologies Installation 19
  • 20. High Availability NFS  Active standby – Multiple concurrent NFS servers allowed – VIPs provide immediate failover – Failover triggered by CLDB if NFS server fails – Reads/writes continue after failover© 2012 MapR Technologies Installation 20
  • 21. Setting Up NFS HA  Install and run mapr-nfs service on assigned nodes  Create a pool of VIPs  Use MapR Control System or the API to assign VIPs to NFS nodes – One VIP across multiple NFS nodes – Multiple VIPs across multiple NFS nodes© 2012 MapR Technologies Installation 21
  • 22. LAB: Installation© 2012 MapR Technologies Installation 22
  • 23. Questions© 2012 MapR Technologies Installation 23

×