SlideShare a Scribd company logo
1 of 42
Download to read offline
Copyright © 2012, SAS Institute Inc. All rights reserved.
ADVANCED VISUALISATION ON MAINFRAME
RMF AND SMF DATA
(APPLYING BIG DATA SOLUTIONS TO IT SYSTEM UTILISATION DATA)
ANDREW GADSBY, MAINFRAME BUSINESS DEVELOPMENT
andrew.gadsby@sas.com
MIKE WROOT, MAINFRAME TECHNICAL SPECIALIST
michael.wroot@sas.com
Copyright © 2012, SAS Institute Inc. All rights reserved.
ABSTRACT ANDREW GADSBY and MIKE WROOT
Title:
Advanced Visualisation and Analytics on Mainframe RMF and SMF Data
(Applying Big Data techniques to IT system utilisation data)
Abstract:
Much has been written about applying analytics to Big Data problems and how advanced visualisation techniques allow
businesses to create new value from Big Data. At SAS we are seeing many customer facing organisations make
extensive use of new visualisation techniques to derive significant business value from the mass of data available to
them.
IT also suffers from its own Big Data problem with the 4 V’s (volume, velocity, variety and variability) applying to IT
systems performance and capacity data. We wondered if it would be possible to apply Big Data visualisation and
analytic techniques to mainframe RMF and SMF data. In particular, we wanted to understand if analysis in this way
could deliver value back into IT.
This session will present an overview of the approach we took to analyse and visualise this data, and illustrate some of
the value that could be derived from such analysis. We will also give a live demonstration of our solution.
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
ACKNOWLEDGEMENT FROM THE MAGIC CIRCLE….
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
“The Greatest Value Of A Picture
Is When It Forces Us To Notice
What We Never Expected To See.”
John W. Tukey, Exploratory Data Analysis 1977
Copyright © 2012, SAS Institute Inc. All rights reserved.
BUSINESS USERS
VIEW
VISUALISATION OF BIG DATA
• Visually Exploring Their Data Using Tablets
• User Self Service is Becoming the Norm
• Speed of Thought Investigation and Discovery
• Building Analytical Data Warehouses (ADW)
• Improved Decision Taking Across the Business
• Static Reports are No Longer Acceptable
Copyright © 2012, SAS Institute Inc. All rights reserved.
Central Entry Point Integration Role-Based Views
DELIVERPREPARE EXPLORE DESIGN
• SAS
®
Mobile BI - native
tablet applications
delivering interactive
reports
• Web and PDF
• Manage data
• Load and join data
• Create calculated
columns
• Perform ad-hoc data
exploration
• Insights generated
through analytic
visualizations
• Create dashboard style
reports for web or
mobile
IN-MEMORY ANALYTICS ENGINE
SAS®
VISUAL
ANALYTICS
A SOLUTION FOR FASTER, SMARTER DECISIONS
www.sas.com/visualanalytics
Copyright © 2012, SAS Institute Inc. All rights reserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS
MEGACORP
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
HOW I.T. LOOKS AT
PERFORMANCE
DATA
VISUALISATION OF I.T. DATA
• Mainframe e.g. MXG, MICS using SMF and RMF data
• Distributed e.g. SAR, NMON…
• Static Reports - GIFs
• Export to Excel
Copyright © 2012, SAS Institute Inc. All rights reserved.
AGENDA ADVANCED VISUALISATION
• Introductions
• How are Your Business Users Looking at their Data?
Demonstration
• How does IT undertake capacity reporting today?
• Linking Visualisation to Capacity Reporting and Forecasting
Demonstration
• Observations and Conclusion
Copyright © 2012, SAS Institute Inc. All rights reserved.
LINKING
VISUALISATION TO
I.T. DATA
EXAMPLE HIGH-LEVEL ARCHITECTURE
SAS® VISUAL ANALYTICS ENVIRONMENT
Desktop
Web
Mobile
SAS VA CLIENTS
SMF/RMF
SAR
OpenView
AWR
Workspace Server
Mid-Tier
VA Server
Co-Located Data
Storage
Co-Located Data
Storage
Co-Located Data
Storage
SAS® LASR Analytic
Server
LASR Cluster
Copyright © 2012, SAS Institute Inc. All rights reserved.
DEMONSTRATION
SAS® VISUAL ANALYTICS FOR I.T.
MEGACORP I.T.
Copyright © 2012, SAS Institute Inc. All rights reserved.
OBSERVATIONS &
CONCLUSIONS
VISUALISATION OF I.T. DATA
• Loading and Visualisation of the underlying data was the easy bit
• Understanding what the data means is critical
• Just because you can view things a certain way doesn’t mean it makes sense!
• Good news here as a capacity planning expert you will still keep your job
• Correlation is hard
• Drill down from CPU utilisation at point of time to recreate workload/job step view
is difficult
• Resolving this needs effort at data preparation / load time
• Changes way that capacity planning and forecasting is approached
• Could drive significant reduction in static report production on mainframe (CPU saving ? )
• We are Continuing Development of this Technology and Use Case
Copyright © 2012, SAS Institute Inc. All rights reserved.
QUESTIONS?
THANK YOU

More Related Content

What's hot

DataOps: Nine steps to transform your data science impact Strata London May 18
DataOps: Nine steps to transform your data science impact  Strata London May 18DataOps: Nine steps to transform your data science impact  Strata London May 18
DataOps: Nine steps to transform your data science impact Strata London May 18
Harvinder Atwal
 
Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014
Marty Loughlin
 
GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017
Jeremy Maranitch
 
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQLDataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax
 
Data-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile DevelopmentData-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile Development
DATAVERSITY
 

What's hot (20)

Data Science in Enterprise
Data Science in EnterpriseData Science in Enterprise
Data Science in Enterprise
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lon
 
DataOps: Nine steps to transform your data science impact Strata London May 18
DataOps: Nine steps to transform your data science impact  Strata London May 18DataOps: Nine steps to transform your data science impact  Strata London May 18
DataOps: Nine steps to transform your data science impact Strata London May 18
 
Traditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonTraditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A Comparison
 
The Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubThe Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data Hub
 
Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014Anzo smart data integration dgiq 2014
Anzo smart data integration dgiq 2014
 
Best Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyBest Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse Quickly
 
Visual Analytics
Visual AnalyticsVisual Analytics
Visual Analytics
 
Unlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and ClouderaUnlocking data science in the enterprise - with Oracle and Cloudera
Unlocking data science in the enterprise - with Oracle and Cloudera
 
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike FergusonMapR Enterprise Data Hub Webinar w/ Mike Ferguson
MapR Enterprise Data Hub Webinar w/ Mike Ferguson
 
Enterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over EverythingEnterprise Capacity Optimization - Capacity Management Over Everything
Enterprise Capacity Optimization - Capacity Management Over Everything
 
Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)Transforming Business for the Digital Age (Presented by Microsoft)
Transforming Business for the Digital Age (Presented by Microsoft)
 
IBM Industry Models and Data Lake
IBM Industry Models and Data Lake IBM Industry Models and Data Lake
IBM Industry Models and Data Lake
 
How Businesses use Big Data to Impact the Bottom Line
How Businesses use Big Data to Impact the Bottom LineHow Businesses use Big Data to Impact the Bottom Line
How Businesses use Big Data to Impact the Bottom Line
 
Hadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata CompanyHadoop 2015: what we larned -Think Big, A Teradata Company
Hadoop 2015: what we larned -Think Big, A Teradata Company
 
GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017GigaOm-sector-roadmap-cloud-analytic-databases-2017
GigaOm-sector-roadmap-cloud-analytic-databases-2017
 
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQLDataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
DataStax GeekNet Webinar - Apache Cassandra: Enterprise NoSQL
 
Data-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile DevelopmentData-Centric Infrastructure for Agile Development
Data-Centric Infrastructure for Agile Development
 
IBM Governed Data Lake
IBM Governed Data LakeIBM Governed Data Lake
IBM Governed Data Lake
 
Informatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake EcosystemInformatica Becomes Part of the Business Data Lake Ecosystem
Informatica Becomes Part of the Business Data Lake Ecosystem
 

Similar to Visualisation and forecasting on IT capacity planning data

Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users
Senturus
 
How to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategyHow to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategy
Redpath Consulting Group
 

Similar to Visualisation and forecasting on IT capacity planning data (20)

High Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is HereHigh Performance Analytics - The Future of Analytics is Here
High Performance Analytics - The Future of Analytics is Here
 
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
How to Merge the Data Lake and the Data Warehouse: The Power of a Unified Ana...
 
Big Data Analytics in Government
Big Data Analytics in GovernmentBig Data Analytics in Government
Big Data Analytics in Government
 
resume
resumeresume
resume
 
Create your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouseCreate your Big Data vision and Hadoop-ify your data warehouse
Create your Big Data vision and Hadoop-ify your data warehouse
 
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
Self Service Analytics and a Modern Data Architecture with Data Virtualizatio...
 
Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.Why Data Virtualization? An Introduction.
Why Data Virtualization? An Introduction.
 
SAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázkaSAS - Visual Analytics a živá ukázka
SAS - Visual Analytics a živá ukázka
 
Unleashing the Power of your Data
Unleashing the Power of your DataUnleashing the Power of your Data
Unleashing the Power of your Data
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsights
 
Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users Data Integration for Both Self-Service Analytics and IT Users
Data Integration for Both Self-Service Analytics and IT Users
 
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
6 Principles of Modern Change Data Capture: How to Build Fast, Agile, Reliabl...
 
Four Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics StrategyFour Key Considerations for your Big Data Analytics Strategy
Four Key Considerations for your Big Data Analytics Strategy
 
Business Visualization: Dashboard & Storyboarding
Business Visualization: Dashboard & StoryboardingBusiness Visualization: Dashboard & Storyboarding
Business Visualization: Dashboard & Storyboarding
 
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data VirtualizationKASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
KASHTECH AND DENODO: ROI and Economic Value of Data Virtualization
 
BAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, SydneyBAR360 open data platform presentation at DAMA, Sydney
BAR360 open data platform presentation at DAMA, Sydney
 
Is your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and ClouderaIs your big data journey stalling? Take the Leap with Capgemini and Cloudera
Is your big data journey stalling? Take the Leap with Capgemini and Cloudera
 
Introduction to SAS Forecasting
Introduction to SAS ForecastingIntroduction to SAS Forecasting
Introduction to SAS Forecasting
 
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
Profiting from the Digital Shift: Time Series Databases as Value Creation Eng...
 
How to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategyHow to utilize cloud in your corporate it strategy
How to utilize cloud in your corporate it strategy
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 

Recently uploaded (20)

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Visualisation and forecasting on IT capacity planning data

  • 1. Copyright © 2012, SAS Institute Inc. All rights reserved. ADVANCED VISUALISATION ON MAINFRAME RMF AND SMF DATA (APPLYING BIG DATA SOLUTIONS TO IT SYSTEM UTILISATION DATA) ANDREW GADSBY, MAINFRAME BUSINESS DEVELOPMENT andrew.gadsby@sas.com MIKE WROOT, MAINFRAME TECHNICAL SPECIALIST michael.wroot@sas.com
  • 2. Copyright © 2012, SAS Institute Inc. All rights reserved. ABSTRACT ANDREW GADSBY and MIKE WROOT Title: Advanced Visualisation and Analytics on Mainframe RMF and SMF Data (Applying Big Data techniques to IT system utilisation data) Abstract: Much has been written about applying analytics to Big Data problems and how advanced visualisation techniques allow businesses to create new value from Big Data. At SAS we are seeing many customer facing organisations make extensive use of new visualisation techniques to derive significant business value from the mass of data available to them. IT also suffers from its own Big Data problem with the 4 V’s (volume, velocity, variety and variability) applying to IT systems performance and capacity data. We wondered if it would be possible to apply Big Data visualisation and analytic techniques to mainframe RMF and SMF data. In particular, we wanted to understand if analysis in this way could deliver value back into IT. This session will present an overview of the approach we took to analyse and visualise this data, and illustrate some of the value that could be derived from such analysis. We will also give a live demonstration of our solution.
  • 3. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 4. Copyright © 2012, SAS Institute Inc. All rights reserved. ACKNOWLEDGEMENT FROM THE MAGIC CIRCLE….
  • 5. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 6. Copyright © 2012, SAS Institute Inc. All rights reserved. “The Greatest Value Of A Picture Is When It Forces Us To Notice What We Never Expected To See.” John W. Tukey, Exploratory Data Analysis 1977
  • 7. Copyright © 2012, SAS Institute Inc. All rights reserved. BUSINESS USERS VIEW VISUALISATION OF BIG DATA • Visually Exploring Their Data Using Tablets • User Self Service is Becoming the Norm • Speed of Thought Investigation and Discovery • Building Analytical Data Warehouses (ADW) • Improved Decision Taking Across the Business • Static Reports are No Longer Acceptable
  • 8. Copyright © 2012, SAS Institute Inc. All rights reserved. Central Entry Point Integration Role-Based Views DELIVERPREPARE EXPLORE DESIGN • SAS ® Mobile BI - native tablet applications delivering interactive reports • Web and PDF • Manage data • Load and join data • Create calculated columns • Perform ad-hoc data exploration • Insights generated through analytic visualizations • Create dashboard style reports for web or mobile IN-MEMORY ANALYTICS ENGINE SAS® VISUAL ANALYTICS A SOLUTION FOR FASTER, SMARTER DECISIONS www.sas.com/visualanalytics
  • 9. Copyright © 2012, SAS Institute Inc. All rights reserved. DEMONSTRATION SAS® VISUAL ANALYTICS MEGACORP
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 21. Copyright © 2012, SAS Institute Inc. All rights reserved. HOW I.T. LOOKS AT PERFORMANCE DATA VISUALISATION OF I.T. DATA • Mainframe e.g. MXG, MICS using SMF and RMF data • Distributed e.g. SAR, NMON… • Static Reports - GIFs • Export to Excel
  • 22. Copyright © 2012, SAS Institute Inc. All rights reserved. AGENDA ADVANCED VISUALISATION • Introductions • How are Your Business Users Looking at their Data? Demonstration • How does IT undertake capacity reporting today? • Linking Visualisation to Capacity Reporting and Forecasting Demonstration • Observations and Conclusion
  • 23. Copyright © 2012, SAS Institute Inc. All rights reserved. LINKING VISUALISATION TO I.T. DATA EXAMPLE HIGH-LEVEL ARCHITECTURE SAS® VISUAL ANALYTICS ENVIRONMENT Desktop Web Mobile SAS VA CLIENTS SMF/RMF SAR OpenView AWR Workspace Server Mid-Tier VA Server Co-Located Data Storage Co-Located Data Storage Co-Located Data Storage SAS® LASR Analytic Server LASR Cluster
  • 24. Copyright © 2012, SAS Institute Inc. All rights reserved. DEMONSTRATION SAS® VISUAL ANALYTICS FOR I.T. MEGACORP I.T.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41. Copyright © 2012, SAS Institute Inc. All rights reserved. OBSERVATIONS & CONCLUSIONS VISUALISATION OF I.T. DATA • Loading and Visualisation of the underlying data was the easy bit • Understanding what the data means is critical • Just because you can view things a certain way doesn’t mean it makes sense! • Good news here as a capacity planning expert you will still keep your job • Correlation is hard • Drill down from CPU utilisation at point of time to recreate workload/job step view is difficult • Resolving this needs effort at data preparation / load time • Changes way that capacity planning and forecasting is approached • Could drive significant reduction in static report production on mainframe (CPU saving ? ) • We are Continuing Development of this Technology and Use Case
  • 42. Copyright © 2012, SAS Institute Inc. All rights reserved. QUESTIONS? THANK YOU