TERADATA VIEWPOINTHADOOP INTEGRATION WITH AMBARISteve RatayChief Architect, Teradata ViewpointApril 2, 2013
Teradata Unified Data Architecture• Combination of Teradata Database, Aster, and Hadoop in a  single appliance• Connectors...
Viewpoint Architecture                                                             TD 1        Viewpoint Managed Server   ...
Monitoring Hadoop without Ambari• Different technologies and formats:    > Ganglia    > Nagios    > JMX    > Screen scrapi...
Ambari to the Rescue!• RESTful APIs• JSON response format• Single server and port5                          Copyright Tera...
Accessing Ambari APIs• Viewpoint uses Java and Spring• Used Spring’s RestTemplate class:    > Makes HTTP call to specified...
System Health7               Copyright Teradata 2012
Metric Analysis8                 Copyright Teradata 2012
Node Monitor9              Copyright Teradata 2012
Hadoop Services10                Copyright Teradata 2012
Hadoop Alerts11              Copyright Teradata 2012
Benefits of Using Ambari• Viewpoint delivered comprehensive Hadoop monitoring  solution in a couple of months• Java and we...
Upcoming SlideShare
Loading in...5
×

Ambari Meetup: 2nd April 2013: Teradata Viewpoint Hadoop Integration with Ambari

1,925

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,925
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
54
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Ambari Meetup: 2nd April 2013: Teradata Viewpoint Hadoop Integration with Ambari

  1. 1. TERADATA VIEWPOINTHADOOP INTEGRATION WITH AMBARISteve RatayChief Architect, Teradata ViewpointApril 2, 2013
  2. 2. Teradata Unified Data Architecture• Combination of Teradata Database, Aster, and Hadoop in a single appliance• Connectors between the different systems• Monitor the entire appliance with Teradata Viewpoint DISCOVERY Aster Teradata INTEGRATED PLATFORM DATA WAREHOUSE Connector SQL-H SQL-H Aster Connector for Hadoop Teradata Connector for Hadoop CAPTURE | STORE | REFINE2 Copyright Teradata 2012
  3. 3. Viewpoint Architecture TD 1 Viewpoint Managed Server Data TD n Viewpoint Postgres Collection Portal Database Service Aster 1 ActiveMQ Aster n Alert Service HDP 1 Email SNMP Portlet HDP n3 Copyright Teradata 2012
  4. 4. Monitoring Hadoop without Ambari• Different technologies and formats: > Ganglia > Nagios > JMX > Screen scraping HTML• Connection to multiple nodes: > Connectivity to all nodes > Access to several ports > Location of each service, especially when using high availability4 Copyright Teradata 2012
  5. 5. Ambari to the Rescue!• RESTful APIs• JSON response format• Single server and port5 Copyright Teradata 2012
  6. 6. Accessing Ambari APIs• Viewpoint uses Java and Spring• Used Spring’s RestTemplate class: > Makes HTTP call to specified URL > Binds JSON results to Java model objects• Data is collected every minute and stored in Viewpoint’s Postgres database > Use of Rewind to view previous state of system > Easy generation of trending charts and graphs6 Copyright Teradata 2012
  7. 7. System Health7 Copyright Teradata 2012
  8. 8. Metric Analysis8 Copyright Teradata 2012
  9. 9. Node Monitor9 Copyright Teradata 2012
  10. 10. Hadoop Services10 Copyright Teradata 2012
  11. 11. Hadoop Alerts11 Copyright Teradata 2012
  12. 12. Benefits of Using Ambari• Viewpoint delivered comprehensive Hadoop monitoring solution in a couple of months• Java and web developers focused on collecting data and building UI• Didn’t waste time dealing with intricacies of Hadoop and Hadoop monitoring12 Copyright Teradata 2012
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×