Working with a Remote Cluster
  7/6/2012

© 2012 MapR Technologies   Remote Cluster 1
Working with a Remote Cluster
   Agenda
   • Prerequisites
   • Configuring the Clusters
   • Managing Multiple Clusters
   • Mirroring between Clusters
   • Transferring Data with Dump Files




© 2012 MapR Technologies    Remote Cluster 2
Working with a Remote Cluster
   Objectives
   At the end of this module you will be able to:
   • List the prerequisites for working with multiple clusters
   • Understand how to configure each node when working with multiple
     clusters
   • Describe what is involved in managing multiple clusters
   • Explain how mirroring between clusters works
   • Understand how to transfer data from a dump file




© 2012 MapR Technologies         Remote Cluster 3
Prerequisites




© 2012 MapR Technologies     Remote Cluster 4
Prerequisites

     Clusters must already be established and running
     Clusters must have different names
     Forward and reverse hostname resolution between all nodes
      –   Yes, even between the clusters
      –   Either in /etc/hosts or via DNS




© 2012 MapR Technologies            Remote Cluster 5
Configuring the Clusters




© 2012 MapR Technologies   Remote Cluster 6
Configuring the Clusters

     Use configure.sh to create new entries in mapr-clusters.conf
      –   On cluster 1: configure.sh –C <cluster 2> -N <cluster 2>
      –   On cluster 2, do the reverse (only if you plan to mirror back to cluster 1>
     -N option adds a new line to mapr-clusters.conf
      –   First line is the local cluster; other lines point to other clusters
      –   To remove clusters from mapr-clusters.conf you must edit the file
     Restart the warden on all nodes on both clusters




© 2012 MapR Technologies             Remote Cluster 7
Managing Multiple
                               Clusters



© 2012 MapR Technologies       Remote Cluster 8
Managing Multiple Clusters




© 2012 MapR Technologies   Remote Cluster 9
Mirroring between
                                Clusters



© 2012 MapR Technologies       Remote Cluster 10
Mirroring between Clusters

     Set up mirror volume with source on named cluster
      –   maprcli volume create
             -name vol1-mirror
             -source vol1@cluster1
             -path /vol1-mirror
             -mount 1
             -type 1




© 2012 MapR Technologies     Remote Cluster 11
Transferring Data with
                          Dump Files



© 2012 MapR Technologies   Remote Cluster 12
Restoration from Dump Files




          Restore dump files to new mirror volumes
               Restore each incremental dump!
          If volumes need to be writable
               Create volumes to receive data
                Copy data from mirror volumes
© 2012 MapR Technologies        Remote Cluster 13
Questions




© 2012 MapR Technologies   Remote Cluster 14

55a remote cluster

  • 1.
    Working with aRemote Cluster 7/6/2012 © 2012 MapR Technologies Remote Cluster 1
  • 2.
    Working with aRemote Cluster Agenda • Prerequisites • Configuring the Clusters • Managing Multiple Clusters • Mirroring between Clusters • Transferring Data with Dump Files © 2012 MapR Technologies Remote Cluster 2
  • 3.
    Working with aRemote Cluster Objectives At the end of this module you will be able to: • List the prerequisites for working with multiple clusters • Understand how to configure each node when working with multiple clusters • Describe what is involved in managing multiple clusters • Explain how mirroring between clusters works • Understand how to transfer data from a dump file © 2012 MapR Technologies Remote Cluster 3
  • 4.
    Prerequisites © 2012 MapRTechnologies Remote Cluster 4
  • 5.
    Prerequisites  Clusters must already be established and running  Clusters must have different names  Forward and reverse hostname resolution between all nodes – Yes, even between the clusters – Either in /etc/hosts or via DNS © 2012 MapR Technologies Remote Cluster 5
  • 6.
    Configuring the Clusters ©2012 MapR Technologies Remote Cluster 6
  • 7.
    Configuring the Clusters  Use configure.sh to create new entries in mapr-clusters.conf – On cluster 1: configure.sh –C <cluster 2> -N <cluster 2> – On cluster 2, do the reverse (only if you plan to mirror back to cluster 1>  -N option adds a new line to mapr-clusters.conf – First line is the local cluster; other lines point to other clusters – To remove clusters from mapr-clusters.conf you must edit the file  Restart the warden on all nodes on both clusters © 2012 MapR Technologies Remote Cluster 7
  • 8.
    Managing Multiple Clusters © 2012 MapR Technologies Remote Cluster 8
  • 9.
    Managing Multiple Clusters ©2012 MapR Technologies Remote Cluster 9
  • 10.
    Mirroring between Clusters © 2012 MapR Technologies Remote Cluster 10
  • 11.
    Mirroring between Clusters  Set up mirror volume with source on named cluster – maprcli volume create -name vol1-mirror -source vol1@cluster1 -path /vol1-mirror -mount 1 -type 1 © 2012 MapR Technologies Remote Cluster 11
  • 12.
    Transferring Data with Dump Files © 2012 MapR Technologies Remote Cluster 12
  • 13.
    Restoration from DumpFiles  Restore dump files to new mirror volumes  Restore each incremental dump!  If volumes need to be writable  Create volumes to receive data  Copy data from mirror volumes © 2012 MapR Technologies Remote Cluster 13
  • 14.
    Questions © 2012 MapRTechnologies Remote Cluster 14