Porting your Hadoop app  to HortonWorks HDP  Based on one mans experience
Lets talk about distributionsOnes that I played with include1. Cloudera2. MapR3. HortonWorks4. Intel (future)Extended Q&A :)
What stands out about HortonWorks(From their site)Birthplace of HadoopMany Apache contributorsAll open sourceSpinoff from ...
Where I come fromI want to put my eDiscovery application onHortonWorks●   All Java and standard Hadoop, but●   Uses Cloude...
Find an RHEL (required) on EC2
Start it
Thats all the install commands
It finds the machine (you give ips)
Good luck finding
Choose services to install
Java is installed automatically
Its a 6GB root (can be increased)
Keep installing through the browser
Customize your Nagios
Start deploying the services
Watch the progress
HBase install failed
Remove the services I dont need
Re-install attempt
This time it worked
Working cluster
Command-line check
More info from Rohit1. I want instructions, please -- Coming(Many customers want their own controlscripts)2. Re-starting c...
Q&A with Rohit BakhshiJoin.me
Upcoming SlideShare
Loading in...5
×

Porting your hadoop app to horton works hdp

1,201

Published on

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,201
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
7
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Porting your hadoop app to horton works hdp

  1. 1. Porting your Hadoop app to HortonWorks HDP Based on one mans experience
  2. 2. Lets talk about distributionsOnes that I played with include1. Cloudera2. MapR3. HortonWorks4. Intel (future)Extended Q&A :)
  3. 3. What stands out about HortonWorks(From their site)Birthplace of HadoopMany Apache contributorsAll open sourceSpinoff from Yahoo
  4. 4. Where I come fromI want to put my eDiscovery application onHortonWorks● All Java and standard Hadoop, but● Uses Cloudera on EC2● Uses custom machine images● Uses custom managing software written in Java
  5. 5. Find an RHEL (required) on EC2
  6. 6. Start it
  7. 7. Thats all the install commands
  8. 8. It finds the machine (you give ips)
  9. 9. Good luck finding
  10. 10. Choose services to install
  11. 11. Java is installed automatically
  12. 12. Its a 6GB root (can be increased)
  13. 13. Keep installing through the browser
  14. 14. Customize your Nagios
  15. 15. Start deploying the services
  16. 16. Watch the progress
  17. 17. HBase install failed
  18. 18. Remove the services I dont need
  19. 19. Re-install attempt
  20. 20. This time it worked
  21. 21. Working cluster
  22. 22. Command-line check
  23. 23. More info from Rohit1. I want instructions, please -- Coming(Many customers want their own controlscripts)2. Re-starting clusters on EC2? - Better newones3. My own customer startup scripts? -- Shoulduse the instructions that will be provided
  24. 24. Q&A with Rohit BakhshiJoin.me
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×