Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Life of a Hadoop Administrator, with and without SmartSense


Published on

This cartoon shows how easy it is to troubleshoot and resolve support cases quickly, saving a Hadoop Administrator hours of time. By providing up-front access to diagnostic information needed to resolve issues, it helps reduce the back-and-forth nature of troubleshooting that consumes valuable time and resources.

Published in: Data & Analytics
  • Be the first to comment

The Life of a Hadoop Administrator, with and without SmartSense

  1. 1. The Life of a Hadoop Administrator, with and without Hortonworks SmartSense With SmartSense 3 hours later. 1 hour later. 8 hours later. 2 days later. 1 week later. Hello, thank you for calling Hortonworks Support. This is Chris. How can I help you? Ok, do you have SmartSense installed? OK. Please send us HBASE logs from all 150 servers. Logs arrive, Chris calls Parker Chris calls Steve They need to increase their max transfer threads from 4x to 16x Thanks, Steve! Set the max transfer threads from 4k to 16k and then restart HDFS and HBASE. Alex is a Hadoop Administrator at a Fortune 1000 company. Chris is a Hortonworks support engineer. Parker is a Hortonworks HBASE engineer. Steve is a Hortonworks HDFS engineer. Found half the cluster had transparent pages enabled, causing performance issues. Hello Alex. We have new SmartSense recommendations for you. Oh great. I’ll log into the support portal and take a look. Thank you! Wow. This is awesome! Increase datanode Xcievers Disable transparent huge pages Hortonworks is working for me while I sleep. I love my job! HDFS upgrade not finalized HDFS outage 1 week later due to incomplete upgrade. Without SmartSense "I took a look and it's definitely an HDFS issue. Please send us HDFS logs from all 150 servers. And you want to scrub them for IPs and FQDN's this time. Trouble Shooting Purgatory Repeats Itself Trouble Shooting Purgatory Avoided