CHa

1. Clustered Services with Apache
Whirr: From Ops Down
Chad Metcalf
@metcalfc
Cloudera

2. The Big Picture

3. 6 Node Hadoop Cluster
# Change the cluster name here
whirr.cluster-name=hadoop
# Change the number of machines in the
cluster here
whirr.instance-templates=1 hadoop-
namenode+hadoop-jobtracker,5 hadoop-
datanode+hadoop-tasktracker

4. What Does It Do?

5. How?

6. Why Use It?

7. Developer Way

8. Operator Way

9. Fortify with Puppet
+puppet:ntp
+puppet:pig
+puppet:hive
+puppet:demo::users

10. Modules
# Git
puppet.pig.module=
git://github.com/metcalfc/puppet-pig.git
# With branch
puppet.ntp.module=
git://github.com/metcalfc/puppet-ntp.git
puppet.ntp.module.branch=puppetconf2011
# Tarball
puppet.demo.module=/tmp/demo.tgz

11. Manifests
# Default
+puppet:pig
# Specific Class
+puppet:demo::users
# Parameterized Class
+puppet:ntp
ntp.servers=[ '0.pool.ntp.org' ]
ntp.autoupdate=true

12. puppet apply
node default {
class {'ntp':
servers => [ '0.pool.ntp.org' ],
autoupdate => true,
}
class { 'pig': }
class { 'hive': }
class { 'demo::users': }
}

13. Masterless

14. One Shot

15. Test Locally

16. Demo

17. Whats Next?

18. Questions?