How to plan a hadoop cluster for testing and production environmentAnna Yen
Athemaster wants to share our experience to plan Hardware Spec, server initial and role deployment with new Hadoop Users. There are 2 testing environments and 3 production environments for case study.
How to plan a hadoop cluster for testing and production environmentAnna Yen
Athemaster wants to share our experience to plan Hardware Spec, server initial and role deployment with new Hadoop Users. There are 2 testing environments and 3 production environments for case study.
update:2016/06/28
Example & homework: https://github.com/Phate334/MapReduceExample
簡報已更新並重新整理
This slide show you how to deploy Hadoop cluster with Cloudera and set up your own development environment to easy to test your MapReduce app.
這份簡報分成三個部分:
1.架設hadoop叢集,今年縮短了這部分的介紹,只放上一些參考的連結。
2.準備一個可以在本機端測試Mapreduce的開發環境,而不需要每次都將程式送到叢集中。
3.三個簡單的例子,用來介紹Mapreduce框架。
該投影片介紹了利用CDH(Cloudera’s Cloudera Distribution Including Apache Hadoop)來架設Hadoop叢集時所需要準備的環境,其中包括硬體規格、系統環境與軟體版本。
未來蒐集的相關資源會放在Diggo如下的兩個library中:
https://www.diigo.com/user/phate334/cloudera
https://www.diigo.com/user/phate334/hadoop
update:2016/06/28
Example & homework: https://github.com/Phate334/MapReduceExample
簡報已更新並重新整理
This slide show you how to deploy Hadoop cluster with Cloudera and set up your own development environment to easy to test your MapReduce app.
這份簡報分成三個部分:
1.架設hadoop叢集,今年縮短了這部分的介紹,只放上一些參考的連結。
2.準備一個可以在本機端測試Mapreduce的開發環境,而不需要每次都將程式送到叢集中。
3.三個簡單的例子,用來介紹Mapreduce框架。
該投影片介紹了利用CDH(Cloudera’s Cloudera Distribution Including Apache Hadoop)來架設Hadoop叢集時所需要準備的環境,其中包括硬體規格、系統環境與軟體版本。
未來蒐集的相關資源會放在Diggo如下的兩個library中:
https://www.diigo.com/user/phate334/cloudera
https://www.diigo.com/user/phate334/hadoop