Confidential
OPERATIONAL EXCELLENCEFORBIGDATAAPPS
Confidential2
TRUSTED
by over 10,000
companies as their big
data app platform
BACKED
by top Silicon Valley
investors True Ventures,
Rembrandt VP, Bain
Capital
FOUNDED
in 2008, with
headquarters in San
Francisco
Confidential
WHY NOW?
3
As Big Data applications become the
engine driving innovation and new revenue
models, they graduate to 1st class citizens
demanding higher standards of quality,
reliability, and manageability
Confidential
PERFORMANCE MANAGEMENT FOR
BIG DATA APPLICATIONS
your big data
apps
MONITOR
to resolve
issues faster
big data apps
more effectively
MANAGECOLLABORATE
Confidential5
Heterogeneous Application Environments Cluster Performance Monitoring Application Performance Monitor
Production Hadoop Environments Contain a Variety of Application Technologies
CHALLENGES
Confidential6
Application Performance MonitorCluster Performance MonitoringHeterogeneous Application Environments
Cluster Monitoring Products Do Not Provide Application Insight
CHALLENGES
Confidential7
Cluster Performance Monitoring Application Performance MonitorHeterogeneous Application Environments
Existing Tools Offer Limited Value for Monitoring Application Performance
Leaving us blind to business context, priority, ownership and performance of our data applications
CHALLENGES
Confidential8
Enterprise Scale Monitoring and Management for Big Data Apps
Business&
OperationalContext
Data& TechnologyConnecting Business and Data
PERFORMANCEMONITORING&VISIBILITY
Confidential
ACHIEVINGOPERATIONALEXCELLENCE
9
Balancing a fully operational data processing cluster and customer demands is challenging.
Performance monitoring and visibility for big data applications
• See everything in one place with a single view of all data applications real-time
performance metrics across the entire enterprise
Instantly understand the business context of a problem
• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, the
owner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster
• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and
can work together to resolution
Manage the business of big data
• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
1
3
2
4
Confidential
ACHIEVINGOPERATIONALEXCELLENCE
10
2
1
3
4
Performance monitoring and visibility for big data apps
• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem
• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, the
owner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster
• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and
can work together to resolution
Manage the business of big data
• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
ACHIEVINGOPERATIONALEXCELLENCE
11
3
1
2
4
Performance monitoring and visibility for big data apps
• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem
• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, the
owner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster
• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and
can work together to resolution
Manage the business of big data
• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
ACHIEVINGOPERATIONALEXCELLENCE
12
4
3
2
1
Performance monitoring and visibility for big data apps
• A single integrated view of your data applications and real-time performance metrics
across your entire environment
Instantly understand the business context of a problem
• Knowing you have a problem is one thing but understanding the end to end &
downstream dependencies, the quality and service guarantees, who is impacted, the
owner(s) and the business criticality of the failure is game changing
Easily collaborate across teams to resolve issues faster
• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering
the right information to the appropriate individuals and teams so everyone is informed and
can work together to resolution
Manage the business of big data
• Get the operational visibility and controls you need to effectively manage priorities,
policies, capacity, compliance and utilization.
Balancing a fully operational data processing cluster and customer demands is challenging.
Confidential
NURTUREA CULTUREOFOPERATIONALEXCELLENCE
13
Ensure that business, development, IT operations can collaborate seamlessly when it matters
ConfidentialConfidential
THANKYOU
Confidential
Go to our website: www.driven.io
TO LEARN MORE
ConfidentialConfidential16
APPENDIX
Confidential
End-to-end operational telemetry metadata for big data applications
Accessible via Web browser, command-line interface (CLI), or simple search queries
Easy integrations through JMX and upcoming Driven SDK
SCALABLE,SEARCHABLE METADATA STORE
17
Telemetry metadata
(SSL)
YARN
HADOOP APPS AND INFRASTRUCTURE
APPLICATIONS
Plugin
HADOOP CLUSTERS
WARfiles
Web App
Server
Server
Web CLI JMX
Web App
Server
SCALE OUT
SCALE OUT

4 Best Practices to Achieve Operational Excellence Across Multiple Big Data Technologies

  • 1.
  • 2.
    Confidential2 TRUSTED by over 10,000 companiesas their big data app platform BACKED by top Silicon Valley investors True Ventures, Rembrandt VP, Bain Capital FOUNDED in 2008, with headquarters in San Francisco
  • 3.
    Confidential WHY NOW? 3 As BigData applications become the engine driving innovation and new revenue models, they graduate to 1st class citizens demanding higher standards of quality, reliability, and manageability
  • 4.
    Confidential PERFORMANCE MANAGEMENT FOR BIGDATA APPLICATIONS your big data apps MONITOR to resolve issues faster big data apps more effectively MANAGECOLLABORATE
  • 5.
    Confidential5 Heterogeneous Application EnvironmentsCluster Performance Monitoring Application Performance Monitor Production Hadoop Environments Contain a Variety of Application Technologies CHALLENGES
  • 6.
    Confidential6 Application Performance MonitorClusterPerformance MonitoringHeterogeneous Application Environments Cluster Monitoring Products Do Not Provide Application Insight CHALLENGES
  • 7.
    Confidential7 Cluster Performance MonitoringApplication Performance MonitorHeterogeneous Application Environments Existing Tools Offer Limited Value for Monitoring Application Performance Leaving us blind to business context, priority, ownership and performance of our data applications CHALLENGES
  • 8.
    Confidential8 Enterprise Scale Monitoringand Management for Big Data Apps Business& OperationalContext Data& TechnologyConnecting Business and Data PERFORMANCEMONITORING&VISIBILITY
  • 9.
    Confidential ACHIEVINGOPERATIONALEXCELLENCE 9 Balancing a fullyoperational data processing cluster and customer demands is challenging. Performance monitoring and visibility for big data applications • See everything in one place with a single view of all data applications real-time performance metrics across the entire enterprise Instantly understand the business context of a problem • Knowing you have a problem is one thing but understanding the end to end & downstream dependencies, the quality and service guarantees, who is impacted, the owner(s) and the business criticality of the failure is game changing Easily collaborate across teams to resolve issues faster • Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution Manage the business of big data • Get the operational visibility and controls you need to effectively manage priorities, policies, capacity, compliance and utilization. 1 3 2 4
  • 10.
    Confidential ACHIEVINGOPERATIONALEXCELLENCE 10 2 1 3 4 Performance monitoring andvisibility for big data apps • A single integrated view of your data applications and real-time performance metrics across your entire environment Instantly understand the business context of a problem • Knowing you have a problem is one thing but understanding the end to end & downstream dependencies, the quality and service guarantees, who is impacted, the owner(s) and the business criticality of the failure is game changing Easily collaborate across teams to resolve issues faster • Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution Manage the business of big data • Get the operational visibility and controls you need to effectively manage priorities, policies, capacity, compliance and utilization. Balancing a fully operational data processing cluster and customer demands is challenging.
  • 11.
    Confidential ACHIEVINGOPERATIONALEXCELLENCE 11 3 1 2 4 Performance monitoring andvisibility for big data apps • A single integrated view of your data applications and real-time performance metrics across your entire environment Instantly understand the business context of a problem • Knowing you have a problem is one thing but understanding the end to end & downstream dependencies, the quality and service guarantees, who is impacted, the owner(s) and the business criticality of the failure is game changing Easily collaborate across teams to resolve issues faster • Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution Manage the business of big data • Get the operational visibility and controls you need to effectively manage priorities, policies, capacity, compliance and utilization. Balancing a fully operational data processing cluster and customer demands is challenging.
  • 12.
    Confidential ACHIEVINGOPERATIONALEXCELLENCE 12 4 3 2 1 Performance monitoring andvisibility for big data apps • A single integrated view of your data applications and real-time performance metrics across your entire environment Instantly understand the business context of a problem • Knowing you have a problem is one thing but understanding the end to end & downstream dependencies, the quality and service guarantees, who is impacted, the owner(s) and the business criticality of the failure is game changing Easily collaborate across teams to resolve issues faster • Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution Manage the business of big data • Get the operational visibility and controls you need to effectively manage priorities, policies, capacity, compliance and utilization. Balancing a fully operational data processing cluster and customer demands is challenging.
  • 13.
    Confidential NURTUREA CULTUREOFOPERATIONALEXCELLENCE 13 Ensure thatbusiness, development, IT operations can collaborate seamlessly when it matters
  • 14.
  • 15.
    Confidential Go to ourwebsite: www.driven.io TO LEARN MORE
  • 16.
  • 17.
    Confidential End-to-end operational telemetrymetadata for big data applications Accessible via Web browser, command-line interface (CLI), or simple search queries Easy integrations through JMX and upcoming Driven SDK SCALABLE,SEARCHABLE METADATA STORE 17 Telemetry metadata (SSL) YARN HADOOP APPS AND INFRASTRUCTURE APPLICATIONS Plugin HADOOP CLUSTERS WARfiles Web App Server Server Web CLI JMX Web App Server SCALE OUT SCALE OUT