Technology Primer: Hey IT—Your Big Data
Infrastructure Can’t Sit in a Silo Anymore
Rajaraman Sundaram
DevOps: Agile Ops
CA Technologies
Sr. Principal Product Marketing Manager
DO5X142S
2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
The importance of adopting big data management technologies is
unquestionable these days. As a result the business side of organizations is
aggressively investing in big data, at times on their own without involving
central IT teams. Join us in session to learn why IT needs to unify big data
and traditional IT infrastructure to ensure optimal customer experience
and return on investment. We shall also be highlighting how CA Unified
Infrastructure Management (CA UIM) allows you to unify big data and IT
Infrastructure management through a unified view and architecture.
Rajaraman
Sundaram
CA Technologies
Sr. Principal Product
Marketing Manager
4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
BIG DATA IN NUMBERS
WHY A SILOED APPROACH WON’T WORK ANYMORE?
CA UIM FOR MONGODB
CA UIM FOR BIG DATA
CA UIM FOR HADOOP
CA UIM FOR CASSANDRA
1
2
3
4
5
6
5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Value of Big Data is Unquestionable
55%
of respondents’ have
already implemented
Big Data projects
are planning to
implement within the
next year
2X
likely to be in top
quartile of financial
performance within
their industries if they
use these technologies
29%
http://www.ca.com/us/~/media/Files/IndustryResearch/the-state-of-big-data-infrastructure.pdf
http://www.bain.com/Images/BAIN_BRIEF_Big_Data_The_organizational_challenge.pdf
6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Big Data Projects Are Sitting In Silo’s
44%
integrating individual
projects across
functions and
departments
organizations’ Big
Data projects are not
integrated across
departments
21%
have a project limited
to a single
department or area
29%
7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
But this approach won’t cut it anymore here’s why….
8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
1. Both the growth and velocity of big data projects are increasing
 Continued growth of tools
and techniques
 More siloes and tools would
only result in more
complexity
 Lack of scale and visibility
9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
2. More transactional applications need to leverage Big Data
 Big Data not only for “top
management” decision
making anymore
 Examples include product
recommendation engines
 Need holistic visibility into
Big Data & IT Infrastructures
10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
3.Finding skilled staff would become even a bigger challenge
 Skills are high in demand
 More siloes and tools would
only result in more
complexity
 Lack of scale and visibility
CA UIM for Big Data
12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Solution Overview
StorageSystems Network Database Apps Cloud
Data
center
CA Unified Infrastructure Management
Big
Data
13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for Big Data
Unify Big Data and traditional infrastructure performance management
 Unified visibility. Incorporate monitoring into a central
platform that can track all the environments from a
business service prospective.
 Proactive service management. Leverage intelligent
insights and alerts that help your team resolve issues
faster and before service levels take a hit.
 Reduce cost and complexity. Harness the
comprehensive coverage and capabilities that can
reduce the costs associated with buying and
supporting multiple, disconnected and complex tools.
14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for Big Data
Comprehensive picture of your entire IT & big data infrastructure
15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Hadoop® 101
 Software framework for distributed storage and
distributed processing of very large data sets.
 Core components include
– Hadoop Common – contains libraries and utilities
needed by other Hadoop modules;
– Hadoop Distributed File System (HDFS) – a distributed
file-system
– Hadoop YARN – a resource-management platform
– Hadoop MapReduce – a programming model for large
scale data processing
16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for Hadoop
 Comprehensive monitoring coverage for all elements
daemons in Hadoop environments, including clusters
HDFS, NameNode, Resource Manager and Hbase.
 Out of the box monitoring dashboard and ability to
create custom dashboards
 Historical Performance trending and analysis
 Intelligent and predictive alerts
17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Cassandra® 101
 Open source distributed database management system
designed to handle large amounts of data across many
commodity servers
 Providing high availability with no single point of failure.
 Cassandra offers robust support for clusters spanning
multiple datacenters, with asynchronous masterless
replication allowing low latency operations for all clients.
18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for Cassandra
 Comprehensive monitoring coverage for all elements daemons
in Hadoop environments, including Keyspace, JVM, column
family, storage volumes and more.
 Out of the box monitoring dashboard and ability to create
custom dashboards
 Historical Performance trending and analysis
 Intelligent and predictive alerts
19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
MongoDB® 101
 Open source database that uses a document-oriented data model.
 Document Database
– Documents (objects) map nicely to programming language data
types.
 High Performance
– Embedding makes reads and writes fast.
 High Availability
– Replicated servers with automatic master failover.
 Easy Scalability
– Automatic sharding distributes collection data across machines.
20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for MongoDB
 Monitors the internal performance and resource usage
throughout a node in a MongoDB cluster.
 Out of the box monitoring dashboard and ability to
create custom dashboards
 Historical Performance trending and analysis
 Intelligent and predictive alerts
21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA UIM for Big Data
Summary
• I want to monitor availability
and performance of all the
elements within the Big Data
framework and supporting IT
infrastructure.
• I want a single pane of glass
for my Big Data and traditional
IT environment.
• I don’t want to spend time
managing multiple
monitoring tools.
Customer Pain
• Comprehensive monitoring
coverage for Big Data
framework and supporting IT
Infrastructure.
• Real-time intelligent and,
automated alerts about your
Hadoop environment.
• Out of the box and
customizable reports and
dashboards for availability,
performance and SLA’s.
Solution Features
• Unified Visibility across Big
Data & traditional IT
infrastructures.
• Improved services levels with
holistic and proactive
performance monitoring.
• Reduce cost & complexity of
managing Big Data and IT
monitoring tools.
Benefits
22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A
23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15

Technology Primer: Hey IT—Your Big Data Infrastructure Can’t Sit in a Silo Anymore

  • 1.
    Technology Primer: HeyIT—Your Big Data Infrastructure Can’t Sit in a Silo Anymore Rajaraman Sundaram DevOps: Agile Ops CA Technologies Sr. Principal Product Marketing Manager DO5X142S
  • 2.
    2 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA. For Informational Purposes Only Terms of this Presentation
  • 3.
    3 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Abstract The importance of adopting big data management technologies is unquestionable these days. As a result the business side of organizations is aggressively investing in big data, at times on their own without involving central IT teams. Join us in session to learn why IT needs to unify big data and traditional IT infrastructure to ensure optimal customer experience and return on investment. We shall also be highlighting how CA Unified Infrastructure Management (CA UIM) allows you to unify big data and IT Infrastructure management through a unified view and architecture. Rajaraman Sundaram CA Technologies Sr. Principal Product Marketing Manager
  • 4.
    4 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Agenda BIG DATA IN NUMBERS WHY A SILOED APPROACH WON’T WORK ANYMORE? CA UIM FOR MONGODB CA UIM FOR BIG DATA CA UIM FOR HADOOP CA UIM FOR CASSANDRA 1 2 3 4 5 6
  • 5.
    5 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Value of Big Data is Unquestionable 55% of respondents’ have already implemented Big Data projects are planning to implement within the next year 2X likely to be in top quartile of financial performance within their industries if they use these technologies 29% http://www.ca.com/us/~/media/Files/IndustryResearch/the-state-of-big-data-infrastructure.pdf http://www.bain.com/Images/BAIN_BRIEF_Big_Data_The_organizational_challenge.pdf
  • 6.
    6 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Big Data Projects Are Sitting In Silo’s 44% integrating individual projects across functions and departments organizations’ Big Data projects are not integrated across departments 21% have a project limited to a single department or area 29%
  • 7.
    7 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD But this approach won’t cut it anymore here’s why….
  • 8.
    8 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD 1. Both the growth and velocity of big data projects are increasing  Continued growth of tools and techniques  More siloes and tools would only result in more complexity  Lack of scale and visibility
  • 9.
    9 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD 2. More transactional applications need to leverage Big Data  Big Data not only for “top management” decision making anymore  Examples include product recommendation engines  Need holistic visibility into Big Data & IT Infrastructures
  • 10.
    10 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD 3.Finding skilled staff would become even a bigger challenge  Skills are high in demand  More siloes and tools would only result in more complexity  Lack of scale and visibility
  • 11.
    CA UIM forBig Data
  • 12.
    12 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Solution Overview StorageSystems Network Database Apps Cloud Data center CA Unified Infrastructure Management Big Data
  • 13.
    13 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for Big Data Unify Big Data and traditional infrastructure performance management  Unified visibility. Incorporate monitoring into a central platform that can track all the environments from a business service prospective.  Proactive service management. Leverage intelligent insights and alerts that help your team resolve issues faster and before service levels take a hit.  Reduce cost and complexity. Harness the comprehensive coverage and capabilities that can reduce the costs associated with buying and supporting multiple, disconnected and complex tools.
  • 14.
    14 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for Big Data Comprehensive picture of your entire IT & big data infrastructure
  • 15.
    15 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Hadoop® 101  Software framework for distributed storage and distributed processing of very large data sets.  Core components include – Hadoop Common – contains libraries and utilities needed by other Hadoop modules; – Hadoop Distributed File System (HDFS) – a distributed file-system – Hadoop YARN – a resource-management platform – Hadoop MapReduce – a programming model for large scale data processing
  • 16.
    16 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for Hadoop  Comprehensive monitoring coverage for all elements daemons in Hadoop environments, including clusters HDFS, NameNode, Resource Manager and Hbase.  Out of the box monitoring dashboard and ability to create custom dashboards  Historical Performance trending and analysis  Intelligent and predictive alerts
  • 17.
    17 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Cassandra® 101  Open source distributed database management system designed to handle large amounts of data across many commodity servers  Providing high availability with no single point of failure.  Cassandra offers robust support for clusters spanning multiple datacenters, with asynchronous masterless replication allowing low latency operations for all clients.
  • 18.
    18 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for Cassandra  Comprehensive monitoring coverage for all elements daemons in Hadoop environments, including Keyspace, JVM, column family, storage volumes and more.  Out of the box monitoring dashboard and ability to create custom dashboards  Historical Performance trending and analysis  Intelligent and predictive alerts
  • 19.
    19 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD MongoDB® 101  Open source database that uses a document-oriented data model.  Document Database – Documents (objects) map nicely to programming language data types.  High Performance – Embedding makes reads and writes fast.  High Availability – Replicated servers with automatic master failover.  Easy Scalability – Automatic sharding distributes collection data across machines.
  • 20.
    20 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for MongoDB  Monitors the internal performance and resource usage throughout a node in a MongoDB cluster.  Out of the box monitoring dashboard and ability to create custom dashboards  Historical Performance trending and analysis  Intelligent and predictive alerts
  • 21.
    21 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD CA UIM for Big Data Summary • I want to monitor availability and performance of all the elements within the Big Data framework and supporting IT infrastructure. • I want a single pane of glass for my Big Data and traditional IT environment. • I don’t want to spend time managing multiple monitoring tools. Customer Pain • Comprehensive monitoring coverage for Big Data framework and supporting IT Infrastructure. • Real-time intelligent and, automated alerts about your Hadoop environment. • Out of the box and customizable reports and dashboards for availability, performance and SLA’s. Solution Features • Unified Visibility across Big Data & traditional IT infrastructures. • Improved services levels with holistic and proactive performance monitoring. • Reduce cost & complexity of managing Big Data and IT monitoring tools. Benefits
  • 22.
    22 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD Q & A
  • 23.
    23 © 2015CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD For More Information To learn more, please visit: http://cainc.to/Nv2VOe CA World ’15