IT operations, as well as IT in general, are often fragmented in the face of cloud, agile, and mobile, along with other pressures to adapt and perform as a true business. As a result, in most organizations, digital transformation remains more of a promise than a reality. Fortunately, there are signs of progress.
These slides--based on the webinar hosted by leading IT analyst firm Enterprise Management Associates (EMA) and StreamWeaver --provide insights on:
- Why digital transformation depends on IT transformation
- The growth of advanced IT analytics
- The need for well-integrated data from across a wide variety of sources
- The benefits when data and analytics do come together
- Real-world examples taken from EMA research and StreamWeaver customers
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Data + Analytics: Turning the Corner on IT Chaos for Digital Transformation
1. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Data+ Analytics: Turning the
Corner on IT Chaos for
Digital Transformation
Dennis Nils Drogseth
Vice President
EMA
Clay Roach
CTO
StreamWeaver
(formerly J9 Technologies)
3. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Featured Speakers
Dennis Drogseth, Vice President, EMA
Dennis joined Enterprise Management Associates in 1998 and currently manages the
New Hampshire office. Dennis brings several years of experience in various aspects of
marketing and business planning for service management solutions. He supports EMA
through leadership in IT Service Management (ITSM), CMDB systems, as well as
megatrends like advanced operations analytics, cross-domain automation systems, IT-
to-business alignment, and service-centric financial optimization. Dennis also works
over several practice areas to promote dialogue across critical areas of technology and
market interdependencies.
Clay Roach, CTO, StreamWeaver
Clay Roach founded StreamWeaver (formerly J9 Technologies) in 2005, following 10
successful years of solving some of the toughest challenges facing IT operations
management. Before founding StreamWeaver, Clay worked for Mercury Interactive
(later acquired by HP), The Middleware Company, and Momentum Software. His
background as an architect and developer, combined with his extensive experience in
performance management has given him the reputation as one of the most trusted
leaders in the industry.
4. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Logistics
An archived version of the event recording
will be available at
www.enterprisemanagement.com
• Log questions in the chat panel located on
the lower left-hand corner of your screen
• Questions will be addressed during the
Q&A session of the event
QUESTIONS
EVENT RECORDING
A PDF of the speaker slides will be
distributed to all attendees
PDF SLIDES
5. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Agenda
• Why digital transformation depends on IT
transformation
• The growth of advanced IT analytics
• The need for well-integrated data and analytics to
come together
• The benefits when data and analytics do come
together
• Summary/Conclusion
5
6. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Why Digital Transformation
Depends on IT Transformation
6
7. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Digital or IT Transformation
• “Digital transformation” targets optimizing business
or organizational effectiveness via digital investments
and IT services.
• “IT transformation” is directed at optimizing IT
performance to more effectively address business or
organizational needs and outcomes
WHICH APPLIES MOST TO YOU?
7
8. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT Transformation Was More Pervasive than Digital, but
35% Were 50/50; 8% Used the Terms Interchangably
[qual1] Which optimizing approach applies most to you and your transformation initiative?
BASE: (All: N=306)
0%
8%
15%
35%
43%
We are focused on neither one
We use the terms
interchangeably
We are primarily focused on
digital transformation
We are focused on both about
50/50
We are primarily focused on IT
transformation
8
9. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Technology was a “Driver” for 73% of Respondents, While
27% Saw Technology Investments as “Supportive”
[Functional2] You indicated that some technologies were in some way associated with your digital/IT transformation initiative. How were they
associated?
BASE: (All: N=304)
“driven”
73%
“supported”
27% One (or more) of our
transformation initiatives
was driven by a technology-
related initiative
One (or more) of our
transformation initiatives
was supported by our
current/planned technology
investments
9
10. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Technology Priorities for the “Extremely Successful”
• “Extremely Successful” were more likely to view technology as a
“driver” and had significantly higher adoption rates of technology
rates overall:
– Extremely successful averaged 6 technologies adopted in
support of their transformational initiatives
– Very successful averaged 4.69
– Successful in some areas but not in
others averaged 3.25
– Somewhat successful averaged 3.67
• Technologies most dramatically different were:
– Social IT or social media
– Application performance management
– CMDB/CMS/ADDM
– Data quality management
10
11. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Top Transformational Obstacles
• Digital Transformation
– Organizational and political issues
– Lack of effectively defined processes
• IT Transformation
– Organizational and political issues
– Ineffective IT leadership
• As perceived by IT stakeholders
– Organizational and political issues
– Ineffective IT leadership/inaccurate or incomplete
data (tied)
• As perceived by business stakeholders
– Lack of a clear and compelling/ lack of effective processes
– Ineffective IT leadership/ warring-siloed tools
11
12. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
The Growth of
Advanced IT Analytics
12
13. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
What is Advanced IT Analytics (AIA) in Our Research?
• Cross-domain—not restricted to network, systems,
application, database, or business outcomes only.
• Assimilates many different sources, whether third-
party monitoring tools or different data sources or,
ideally both. And many different data types
• Requires the application of advanced
heuristics e.g. machine learning,
advanced correlation, anomaly
detection, predictive trending, etc.
13
14. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Priorities for Advanced Analytics Intelligence –
Average Nearly 4 per Respondent
1. Process analytics
2. Anomaly detection
3. Predictive trending
4. Data mining
5. Real-time predictive
6. Rule-based analytics
7. Predictive simulation
8. Machine learning
14
15. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Performance at 100% Was More Prevalent than Change
Management and Capacity Planning at 60% for AIA
Deployments
59%
41%
38%
22%
0%
Cross-domain application/business service performance
(including but not restricted to cloud, hybrid cloud and/or
agile/DevOps initiatives) -actively using
Cross-domain application/business service performance
(including but not restricted to cloud, hybrid cloud and/or
agile/DevOps initiatives) - currently in deployment but not
yet actively using
Analytics to support change management and/or capacity
management and infrastructure optimization (including but
not restricted to the move to cloud, and/or agile or DevOps)
- actively using
Analytics to support change management and/or capacity
management and infrastructure optimization (including but
not restricted to the move to cloud, and/or agile or DevOps)
- currently in deployment but not yet actively using
None of the above
Are you actively using, or in deployment with,
analytic capabilities to support any of the following:
15
16. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Roles Supported by the AIA Investment
2016
• Domain average = 4.38
• X-domain average = 4
• Non-IT business average =
2.82
• Total role support = 11
2014
• Domain average = 4
• X-domain average = 3
• Non-IT business = 2
• Total role support = 9
16
17. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
AIA is Maturing, But…
• AIA is maturing well beyond being a point of technical
fascination to becoming a truly transformative
investment
• But the industry is struggling as a whole to
understand:
– How and why to make the AIA investment
– What benefits to expect
– How to provide a more unified
approach to data collection
and assimilation
17
18. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
The Need For Well-Integrated
Data and Analytics to Come
Together
18
19. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Data Management Issues Loom Large in AIA Concerns
What is the biggest roadblock that you foresee in
adopting advanced analytic technologies?
1. Products are not yet fully baked
2. Data quality issues
3. Internal politics/leadership
4. Availability of relevant skillsets
5. Internal resources for budgeting
6. We have trouble extracting data
7. We’re not used to sharing data sources
19
20. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
A Problem Magnified by the Need for Diverse AIA
Data Sources: Average Response= 5
31%
30%
27%
25%
25%
24%
22%
22%
22%
22%
21%
21%
21%
21%
21%
20%
20%
19%
18%
17%
17%
15%
0%
Security information and event management (SIEM)
Internet of Things
Business process impacts
Transaction - application performance
Transaction - business performance
Log files/Access logs
Agent data (byte code instrumentation)
Flow
End user keystroke
Configuration/topology
Time series (performance)
Packets
Events/time series - security related
Spreadsheets
Wire Data
Events - performance related
Web 2.0 (Ajax etc.)
Web proxies
Events/time series business related
Sentiment analysis
Unstructured data (text, videos, images)
IDS/IPS
Other
20
21. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
As Well As by Breadth of Domain Sources
Top 10 were…
1. Database
2. Security/compliance
3. Network
4. Systems
5. Security/vulnerability/event management
6. Cloud-native apps (containers, microservices)
7. Desktop
8. Public cloud
9. End user experience (synthetic)
10. Internal/private cloud
Average of 6 per respondent
21
22. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
OpStream Architecture
22
23. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
…And Monitoring Tool Integrations– Average
Respondent Wants Circa 15!
2%
18%
18%
24%
19%
10%
3%
6%
None
1/5/
6/10/
11/20/
21-30
31-40
41-50
More than 50
How many monitoring or other tools (third-party, in-house developed, of
otherwise) would you expect to integrate into your organizations
advanced analytics solution within the next 12 months
None 1/5/ 6/10/ 11/20/ 21-30 31-40 41-50 More than 50
23
24. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Service Modeling and Dependency Insights
Are Also Key
Interdependencies Viewed as Critical for AIA
Investments:
• Infrastructure-to-infrastructure
• Infrastructure-to-application
• Application-to-application
(ecosystem)
• Non-virtualized-to-virtualized
infrastructure
• Interdependencies across the
virtualized environment
24
25. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Some Perspectives
on AIA Benefits
25
26. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
AIA Benefits Are Myriad:
Average Respondent = 4 Benefits
29%
28%
26%
26%
24%
24%
23%
23%
23%
23%
22%
22%
22%
21%
19%
19%
18%
16%
0%
More efficient use of cloud resources
More efficient use of storage
Faster time to repair problems
Faster time to deliver new IT services
Improved OpEx efficiencies within IT
Improved compliance with industry requirements
Proactive ability to prevent problems
More efficient use of infrastructure re capacity
Improved efficiencies in managing change
Improved user experience
Better correlation between change and performance
Better alignment with IT service and business service performance
Faster identification of advanced threats and internal security threats
Optimized capacity for service delivery
Institute better security controls without impacting performance
Real-time insights and historical trends on IT services
Understanding of customer behavior to drive innovation
Less time spent in writing and maintaining rules and thresholds
Other
What benefits has your organization seen so far from its investment in advanced analytics?
26
27. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
MTTR Reduction
Global provider of Internet-based entertainment
• “The move to AIA allowed us to unify our operations team
with a single-pane-of-glass view so that we could share
information more effectively. In the past we caught only
3% of our problems proactively. That percentage went
up to 88%.”
• “Mean time to repair dropped from hours to as low as 12
minutes, and we are now able to automate resolutions to
known issues.”
27
28. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Expanding Stakeholder Breadth
Large government agency in the Pacific Rim
• “Our stakeholders overall are loving [the AIA solution]
with dramatic reductions in mean time to repair. This
includes our DevOps teams—who instantaneously
make adjustments to the development process.”
• “In the future, we’re hoping to get more
support for SecOps, with more integrated
insight across security and operations—
as we continue to get more and more of
our IT stakeholders engaged.”
28
29. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Optimizing to Pre-Defined Business Outcomes
North American managed services provider
“Rather than just looking proactively at different data,
which was itself of value, with our new solution we were
able to relate what was happening to business
outcomes and business objectives. That was good for
our business because most CIOs we sell to are focused
on business outcomes.”
29
30. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Conclusion: Guidelines for
Effective Deployment
30
31. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Seven Steps to Effective AIA
1. Choose an AIA solution that can deliver the right use-case
requirements. Don’t fall into the “technology-for-technology’s
sake” trap.
2. AIA projects should be run by senior management—ideally CIO
or CEO.
3. Process and dialog are critical.
4. AIA integrations with advanced automation can deliver huge
gains in efficiency.
5. Budget and plan appropriately.
6. Begin with your most critical use cases and build from there.
7. Ensure that the data you need to go forward is fully
assimilated, current and relevant to the outcomes you’re
pursuing.
31
32. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Q&A: Log Questions in the Q&A Panel
32
To schedule a demo of the only enterprise grade IT operations
management integration solution:
Email: info@streamweaver.com
Visit: www.streamweaver.com