Teradata Unified Data Architecture• Combination of Teradata Database, Aster, and Hadoop in a single appliance• Connectors between the different systems• Monitor the entire appliance with Teradata Viewpoint DISCOVERY Aster Teradata INTEGRATED PLATFORM DATA WAREHOUSE Connector SQL-H SQL-H Aster Connector for Hadoop Teradata Connector for Hadoop CAPTURE | STORE | REFINE2 Copyright Teradata 2012
Viewpoint Architecture TD 1 Viewpoint Managed Server Data TD n Viewpoint Postgres Collection Portal Database Service Aster 1 ActiveMQ Aster n Alert Service HDP 1 Email SNMP Portlet HDP n3 Copyright Teradata 2012
Monitoring Hadoop without Ambari• Different technologies and formats: > Ganglia > Nagios > JMX > Screen scraping HTML• Connection to multiple nodes: > Connectivity to all nodes > Access to several ports > Location of each service, especially when using high availability4 Copyright Teradata 2012
Ambari to the Rescue!• RESTful APIs• JSON response format• Single server and port5 Copyright Teradata 2012
Accessing Ambari APIs• Viewpoint uses Java and Spring• Used Spring’s RestTemplate class: > Makes HTTP call to specified URL > Binds JSON results to Java model objects• Data is collected every minute and stored in Viewpoint’s Postgres database > Use of Rewind to view previous state of system > Easy generation of trending charts and graphs6 Copyright Teradata 2012
Benefits of Using Ambari• Viewpoint delivered comprehensive Hadoop monitoring solution in a couple of months• Java and web developers focused on collecting data and building UI• Didn’t waste time dealing with intricacies of Hadoop and Hadoop monitoring12 Copyright Teradata 2012
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.