Investigate what contributes to business intelligence systems performance issues: presentation layer, databases and host server architecture. View the webinar video recording and download this deck: http://www.senturus.com/resources/testing-improving-performance-ibm-cognos-bi-motio-2/.
We review several OS-level and Cognos-specific tools available to help gather relevant information and pinpoint the causes of performance issues. Plus, we show how to use an integrated performance testing method, along with how tuning changes can be used to reach the target level of performance.
Highlighted tools include the automated Cognos testing system, MotioCI. MotioCI is an iterative testing tool that enables repeatable, automated testing to evaluate changes in report execution performance as tuning changes are made.
Senturus, a business analytics consulting firm, has a resource library with hundreds of free recorded webinars, trainings, demos and unbiased product reviews. Take a look and share them with your colleagues and friends: http://www.senturus.com/resources/.
Testing & Improving Performance in IBM Cognos BI, Plus Automated Cognos Testing System, MotioCI
1. Plus Automated Cognos Testing System, MotioCI
TESTING& IMPROVINGPERFORMANCEINIBM COGNOSBI
2. questions
here
Copyright2014Senturus,Inc.
AllRightsReserved
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
HEARTHERECORDING
3. RESOURCELIBRARY
Senturus’ whole purpose is to make you successful with Business Analytics. Thus, we offer a series of technology-neutral webinars, training on specific software, demonstrations, and no-holds-barred reviews of new software releases. We host dozens of live webinars every year and we offer a comprehensive library of recorded webinars, demos, white papers, presentations and case studies on our website--a wealth of learning resources. Most of our content is custom created and constantly updated, so visit us often to see what’s new in the industry.
www.senturus.com/resources/
3
Copyright 2014 Senturus, Inc. All Rights Reserved
4. •Quick introduction
•Sources of Performance Problems
•A Three-Phase Approach to Testing and Tuning
•About Senturus
•Other Resources
•Q & A
Today’s Agenda
4
Copyright 2014 Senturus, Inc. All Rights Reserved
5. John Boyer
Proven Practice Lead
Motio
John Peterson
CEO & Co-Founder
Senturus
Introduction: Today’s Presenters
Copyright 2014 Senturus, Inc. All Rights Reserved
5
Steve Reed-Pittman
Practice Director-Systems Integration & Optimization Senturus
6. Where Is My Problem Coming From?
SOURCESOFTROUBLE
7. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com
8. •Performance troubleshooting requires detective work
–Gather data from systems andpeople
–What changed, and when?
–Consider all of the possible layers
–Options for addressing performance issues vary across different Cognos versions and configurations
WHERETOBEGIN?
9. Performance issues can originate from multiple layers:
•Configuration Layer
–Cognos software configuration and tuning (install/config inconsistencies, esp. in distributed environments)
•Database Layer
–Data warehouse schema design
•Metadata Layer
–Framework Manager model
•Presentation Layer
–Report Studio, Workspace Advanced, etc.
COGNOS-SPECIFICPROBLEMAREAS
10. Performance issues can also originate outside of Cognos:
•Network (network speed, latency)
•Database server (concurrent query execution, contention with other databases hosted on the same db server or cluster)
•Host server architecture (CPU, RAM, disk, virtual vs. physical infrastructure)
OTHERPROBLEMAREAS
12. •Is your organization proactive or reactive with regard to the performance of your Cognos systems?
•When trouble strikes, quick answers can be hard to find – preventing the fire is better than fighting it!
•Tools can make this easier by providing:
•Baseline performance data
•Replicable test cases
FIREPREVENTIONVS. FIREFIGHTING
13. •MotioCI as an iterative testing tool for determining changes in report execution performance (SLA testing)
•LoadRunner scripting
•Commercial and open-source application performance monitoring tools (e.g., SolarWinds, Opsview)
•Built-in OS tools (e.g., Resource Monitor, perfmon)
•Cognos Administration dashboards
SOMETOOLOPTIONS
14. The risk of doing this without tools or methodology:
•Lack of repeatability makes it difficult or impossible to know whether changes have made a difference
•Tools enable repeatable testing for reliable performance comparisons
WHYUSETOOLS?
16. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com
17. Solving performance issues is like playing “Whack-a-Mole”. Every time you thought you killed the beast, it will pop up again!
The Key to Improving Performance
A three-phase approach to successfully beat performance issues in IBM CognosThere is a need for an integrated approach in solving this problem
19. 1.Build
a)Identify all elements that can impact performance
b)Set up monitoring for capturing system performance metrics
c)Analyze user and system behavior
d)Set up test cases using MotioCI
2.Measure
a)Run test cases and metrics to capture initial baseline
b)Review test results and captured metrics
c)Run load test
d)Analyze system behavior
3.Learn
a)Implement tuning changes based on the results
b)Return to step 2c
c)Repeat steps until the target level of performance is achieved
A Three-Phase Approach to Solving Performance Issues
A tailor-made approach for IBM Cognos
20. What does your multi-disciplinary
medical team look like?
1.Cognos knowledge
a)Cognos Admin
b)Cognos Architect
c)Cognos Modeler
2.Infrastructure
a)DBA
b)Network/firewall specialist
c)Hardware specialist
3.General roles
a)Project management
b)Senturus BI specialist
•Knowledge of methodology
•Knowledge of Cognos
•Knowledge of MotioCI
•Experience at different environments, organizations and infrastructure set ups
22. How to Build Your Test Case
Four essential steps to being well prepared
a) Identify all elements that can impact performance
23. How to Build Your Test Case
Four essential steps to being well preparedb) Set up monitoring tools for capturing system performance metrics
24. How to Build Your Test Case
Four essential steps to being well prepared
c) Analyze user and system behavior
•Who is using IBM Cognos?
•When are they using it?
•How long, what frequency?
•What do they execute?
•How often?
•What is used the most?
•What is used during peak time?
•What is taking the most time?
26. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com
27. How to Build Your Test Case
Four essential steps to being well prepared
Set up test cases using MotioCI
28. •Define Test Cases
Cognos Stress Test with MotioCI
Cognos Reports
MotioCI Test Cases
29. Cognos Stress Test with MotioCI
•Configure Stress Test
Selected Stress Test includes the Performance Test Cases created above.
Configure end condition
Configure login options
Configure report execution options
Configure ramp execution options
30. •Customizing a Stress Test
–Ramped User Logins and Ramped Report Executions
–Ramped User Logins
–Ramped Report Executions
–Simulated User Interactivity
Cognos Stress Test with MotioCI
35. How to Build Your Test Case
Four essential steps to being well prepared
d) Set up test cases using MotioCI
36. How to Measure Your Test Case and Analyze the Results
Executing repeatable test cases with comparable results
a) Run test cases and metrics to capture initial baseline
b) Review test results and captured metrics
37. How to Measure Your Test Case and Analyze the Results
Executing repeatable test cases with comparable results
c) Run load test
d) Analyze system behavior
39. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com
40. How to Measure Your Test Case and Analyze the Results
Examining the test case results
41. How to Improve and Tweak the Settings
Solve the bottleneck and retesta) Implement tuning changes based on the results
b) Return to step 2c.
42. How to Measure Your Test Case and Analyze the Results
Reviewing metrics from Cognos Administration
server1
server2
server3
Process -Batch report service
Number of configured processes
4
4
4
Number of processes high watermark
4
4
4
Process -Report service
Number of configured processes
8
8
8
Number of processes high watermark
8
8
8
Request -Batch report service
Number of processed requests
226
210
189
Percentage of failed requests
0.00%
0.00%
0.53%
Response time high watermark
0:00:32
0:00:31
0:00:34
Seconds per successful request
0:00:26
0:00:26
0:00:27
Service time
1:36:16
1:32:13
1:24:19
Request -Report service
Number of processed requests
149
105
113
Percentage of failed requests
0.00%
0.00%
0.88%
Response time high watermark
0:00:07
0:00:22
0:00:20
Seconds per successful request
0:00:01
0:00:02
0:00:03
Service time
0:03:34
0:03:27
0:05:08
43. How to Measure Your Test Case and Analyze the Results
Executing repeatable test cases and viewing final results
44. What is so Revolutionary About This?
1.Key problem: Performance issues are hard to tackle without reliable metrics and deep knowledge of the systems in question.
2.Without a simple and repeatable approach, troubleshooting and tuning is difficult to perform effectively:
a)Unstructured troubleshooting is hard to manage, and can be both expensive and slow to produce results
b)Dependencies across multiple layers aren’t always obvious
c)Custom-made test cases often require lots of programming/scripting
3.MotioCI helps the project team focus on the core, repeatable test cases: test, analyze and measure improvement
4.Deep Cognos system expertise from Senturus provides multi-layer examination of the affected systems, interpretation of test results, recommendation of tuning changes, and implementation assistance when needed.
The right combination of tools and expertise promotes rapid results
45. Aftercare
Proactive monitoring of your Cognos BI environment
1.When the problems are solved, organizations need to stay healthy!
2.By constantly monitoring performance, BICC’s stay in control and on top of the quality of their BI environment:
1.Regarding performance
2.Regardingdata quality
3.Regarding IBM best practices and corporate standards
47. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com
48. Our Team:
Business depth combined with technical expertise. Former CFOs, CIOs, Controllers, Directors
Senturus: Business Analytics Consultants
48
Copyright 2014 Senturus, Inc. All Rights ReservedBusiness Intelligence
Enterprise Planning
Predictive Analytics
49. 700+ Clients, 1400 Projects, 13 Years
49
Copyright 2014 Senturus, Inc. All Rights Reserved
51. One hour consulting with Systems Integration and Optimization Team in which we
–Learn your organization’s performance challenges
–Provide high level guidance on the state of your environment
–Provide next steps toward potential resolution
–No cost, no obligation
Free Assessment and Recommendation
51
Copyright 2014 Senturus, Inc. All Rights Reserved.
52. More Information on www.senturus.com
Copyright 2014 Senturus, Inc. All Rights Reserved
52
53. *Custom, tailored training also available*
Cognos Training Options
Copyright 2014 Senturus, Inc. All Rights Reserved
53
54. For more information about the Free Assessment or MotioCI, contact
Jim Frazier
Vice-President of Client Solutions
Senturus
jfrazier@senturus.com
650 949 2921
FOLLOWUP
55. questions
here
Copyright 2014Senturus,Inc.
AllRightsReserved
HEARTHERECORDING
This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to
www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/
Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website.
www.senturus.com