The client, a large agricultural machinery manufacturer, sought to enhance data visualization of performance measurements from 200,000 machines by implementing OpenTSDB and Cloudera to store, index, and serve metrics collected every 5 seconds. YASH Technologies tuned applications and databases, distributed storage, and eliminated down-sampling to maximize performance. This provided benefits like real-time graphs, capacity planning, and measuring service levels.

1. Enhanced Data Visualization
provided for 200,000 Machines
with OpenTSDB and Cloudera .

2. Industry: Manufacturing
Geography: US
Employee Size: 60,000+
Revenue Range: $35 billion+
The Client
A world leader in providing advanced products and services and is committed
to the success of those whose work is linked to the land-those who cultivate,
harvest, transform, enrich and build upon the land to meet the world’s
dramatically increasing need for food, fuel, shelter and infrastructure. Since
1837, it has delivered innovative products of superior quality built on a
tradition of integrity.
Background
▪▪ Recorded performance measurements for 200,000
machines, every 30 minutes
▪▪ Planned to record machine data every five seconds in the
near future
▪▪ Sought the ability to store, index, and serve metrics
collected from different devices at large scale
▪▪ Make this data easily accessible and be able to graph the
data
Solution
▪▪ YASH suggested sophisticated approach to measure
different entities within a specific time frame
▪▪ Utilization of OpenTSDB, or time series database, was
suggested
▪▪ Assessed systems and methodologies
▪▪ Implemented following proven best practices and rapid
deployment methodologies
Implementation
▪▪ Tuned applications and databases to maximize system
performance
▪▪ Distributed the storage of monitored data
▪▪ Eliminated destructive down-sampling
▪▪ Followed best practices
Benefits
▪▪ Ability to plot real-time graphs with all values aggregated
together from different time series
▪▪ Real-time status information about services or
infrastructure can be retrieved
▪▪ Enabled capacity planning
▪▪ Maximized system performance with tuned applications
and databases
▪▪ Measured service-level agreements, such as availability
or latency
Background
Solution
Implementation
Benefits
Quick Facts

3. The client, one of the largest manufacturers of agricultural machinery in the world, recorded performance
measurements for approximately 200,000 of its machines for every 30 minutes, and planned to record every five
seconds in the near future. It sought the ability to store, index, and serve these metrics collected from different
sensor devices at a large scale, make this data easily accessible, and be able to graph the data. The granule level
data points for machine measurements that were to be captured included:
In addition to the individual measurements for the data points, each of those had an aggregated set of rules, which
included the Sum, Maximum, Minimum, and Average.
The client desired to plot, analyze, and use this granule level data from its distributed systems, which would allow
engineers and operations staff to better understand and manage the structures.
Business Challenges:
• The collection, loading/storage, and querying of data
• Capturing data points such as metric name, timestamp, and associated value from system generated records
Oil
Temperature
Gear
Level
Fuel
Level
Quick Facts
Solution
Implementation
Benefits
Background

4. YASH Technologies, the client’s strategic partner since 2011, was approached to assess all of the machine
data and was selected for this engagement. YASH suggested a sophisticated approach to drill down to the granular
level to measure different entities within a specific time frame.
To capture metrics collected from different sensor devices at a large scale, and make this data easily accessible
and able to be graphed, YASH assessed its systems and methodologies, and suggested the utilization of OpenTSDB,
which is a time series database.
OpenTSDB is a distributed and scalable Time Series Database (TSDB) written on top of HBase, part of the Cloudera
ecosystem, which stored billions of data points without the need for destructive down-sampling and without deleting
data. OpenTSDB would enable the storage of raw data and provide very fast aggregates to achieve the client’s
business goal. This comprehensive, secured and integrated solution would be implemented following proven best
practices and rapid deployment methodologies from YASH.
Background
Quick Facts
Implementation
Benefits
Solution

5. During the implementation of OpenTSDB, YASH tuned applications and databases to maximize system performance,
distributed the storage of monitored data, and eliminated destructive down-sampling. YASH performed the following
activities to allow the salient features of OpenTSDB to be experienced:
• Assigned Lock-less User Interface Design (UID) for
accelerated writing speed regarding the storage
of new metrics, tag names, or values
• Enabled Cross Origin Resource Sharing for the API
to make Asynchronous JavaScript + XML (AJAX)
calls easily
• Designed the configuration file, which is a key/
value file shared by the Time Series Daemons
(TSD) and command line tools
• Formed search plugins to send meta data to
search engines to explore into data and figure
out what's in the database
• Formed pluggable serializers to enable different
inputs and outputs for the API
• Created annotations to record meta data about
specific time series or data points
• Established a restful Application Programming
Interface (API) to provide access to all of
OpenTSDB's features and offered new options,
defaulting to JavaScript Object Notation (JSON)
• Record meta data for each time series, metrics,
tag names, or values
• Flattened metrics and tag combinations into
a single name for navigation or usage with
different tools
• Implemented real-time publishing plugin to send
data to external systems as its arrives to the
TSDB
• Created ingest plugins for the acceptance of data
points in different formats
• Established millisecond resolution for data
storage with millisecond precision
In order to efficiently implement OpenTSDB, YASH followed best practices, including:
• Business workflow, which was strictly adhered to processes? and was followed throughout the
organization
• Well documented development and deployment guidelines
• Bi-weekly status calls with the customer
Background
Solution
Quick Facts
Benefits
Implementation

6. OpenTSDB allowed the client to collect metrics from different applications, every few seconds, as opposed to every
30 minutes. This aggregated all the values from the different time series together and allowed the user to plot real-
time graphs.
Additional benefits of OpenTSDB were:
• Ability to retrieve real-time status information about services or infrastructure
• Enabled capacity planning
• Measured service-level agreements, such as availability or latency
• No single point of failure
• Scaled to billions of data points from thousands of machines
• Multi-layered graphs are plotted in real-time
Background
Solution
Implementation
Quick Facts
Benefits

7. YASH-OpenTSDB-Mfg92-CS-0617
For more information,
please visit www.yash.com or email info@yash.com.
© 2017 YASH Technologies. All rights reserved. Referred products/ services may be registered trademarks of belonging companies.
About YASH Technologies
YASH Technologies focuses on customer success. As a leading technology services and outsourcing partner for large and fast growing global
customers, the company leverages technology and flexible business models to drive innovation and value throughout its customer’s enterprise.
YASH customer centric engagement and delivery framework integrates specialized domain and consulting capabilities with proprietary
methodologies and solution offerings to provision application, infrastructure and end user focused Right-Sourcing services. YASH is a SEI CMMI
(Level 3) and an ISO 9001:2015 certified company with U.S. and India headquarters and regional sales and development offices globally with
customers spread across 6 continents.
.
YASH Technologies Global Presence www.yash.com/contactus
AMERICAS | EUROPE | APAC | MEA
World HQ: 605-17th Avenue East Moline IL 61244 USA | Toll Free: 877-766-8934 | Tel: 309-755-0433 | Fax: 309-796-1242