SlideShare a Scribd company logo
1 of 8
Performance
Monitoring Best
Practices
Zishan Malik
Technical Project Manager
Synthetic Monitor Expert
22 www.apicasystems.com
Introduction
1. Environmental Testing and Monitoring
2. Top-Down Approach to Monitoring
3. Mobile Synthetic Monitoring
4. Monitoring Success Story
5. Remedies & Recipes
6. Questions?
33 www.apicasystems.com
Environment Testing and Monitoring
44 www.apicasystems.com
Top-Down Approach
55 www.apicasystems.com
Mobile-Tablet Synthetic Monitoring
• The time spent per user with digital media on mobile in US daily in 2015 – 2.8 hours
• The total number of iOS app downloads in 2015 – 25 billions
• The total number of Android app downloads in 2015 – 50 billions
• The app category people spend time the most – Social Networking (29% of users)
• The age group that spends the most time on apps monthly – 18-24 (90.6 hrs on smartphone apps,
34.7 hrs. on tablet apps)
• The Top number of apps people use the most – 3 (78% of smartphone app users, 77% of tablet app
users)
• The major age group of uses that operate a smartphone with two hands – 55+ (34% of users)
66 www.apicasystems.com
Monitoring Success Story
• Background:
– App released to Production
– New Sign-Up page
– Multiple Mule Services in the background
– Multiple Load Balancers
77 www.apicasystems.com
Remedies & Recipes to Success
• Understanding the stack, completely.
• Spoke to the Developers to understand main components
of the application stack.
• Did an assessment of the current synthetic monitoring
infrastructure.
• Implemented Uptime checks on servers.
• Build specific user journey scenarios monitoring multiple
depended services.
Thank you!

More Related Content

What's hot

Tuesday Social #22: Facebook Growth is still unstoppable
Tuesday Social #22: Facebook Growth is still unstoppableTuesday Social #22: Facebook Growth is still unstoppable
Tuesday Social #22: Facebook Growth is still unstoppable
imas_communication_team
 
Apps solidify leadership
Apps solidify leadershipApps solidify leadership
Apps solidify leadership
Wonk Mobile
 
M2 roadshow us gavin patterson, mobilesquared
M2 roadshow us   gavin patterson, mobilesquaredM2 roadshow us   gavin patterson, mobilesquared
M2 roadshow us gavin patterson, mobilesquared
mobilesquared Ltd
 
Consumer Barometer
Consumer BarometerConsumer Barometer
Consumer Barometer
Anh Le
 

What's hot (16)

Tuesday Social #22: Facebook Growth is still unstoppable
Tuesday Social #22: Facebook Growth is still unstoppableTuesday Social #22: Facebook Growth is still unstoppable
Tuesday Social #22: Facebook Growth is still unstoppable
 
A World of Apps: Mobile Technology for Your Club Webinar
A World of Apps: Mobile Technology for Your Club WebinarA World of Apps: Mobile Technology for Your Club Webinar
A World of Apps: Mobile Technology for Your Club Webinar
 
FITC NETPULSE WEBINAR 2015 - A WORLD OF APPS
FITC NETPULSE WEBINAR 2015 - A WORLD OF APPSFITC NETPULSE WEBINAR 2015 - A WORLD OF APPS
FITC NETPULSE WEBINAR 2015 - A WORLD OF APPS
 
Consumerization at the Crossroads Infographic
Consumerization at the Crossroads InfographicConsumerization at the Crossroads Infographic
Consumerization at the Crossroads Infographic
 
Apps solidify leadership
Apps solidify leadershipApps solidify leadership
Apps solidify leadership
 
M'sia Digital Scene - APRC 2013 Summit, Bankok.
M'sia Digital Scene - APRC 2013 Summit, Bankok.M'sia Digital Scene - APRC 2013 Summit, Bankok.
M'sia Digital Scene - APRC 2013 Summit, Bankok.
 
#Gamification project - fitness tools for "the wider" population
#Gamification project - fitness tools for "the wider" population#Gamification project - fitness tools for "the wider" population
#Gamification project - fitness tools for "the wider" population
 
Facebook statistics
Facebook statisticsFacebook statistics
Facebook statistics
 
Echelon Asia Summit 2015: State of App Nation: Asia Edition
Echelon Asia Summit 2015: State of App Nation: Asia EditionEchelon Asia Summit 2015: State of App Nation: Asia Edition
Echelon Asia Summit 2015: State of App Nation: Asia Edition
 
The Irish Radioplayer App
The Irish Radioplayer AppThe Irish Radioplayer App
The Irish Radioplayer App
 
Infographic
InfographicInfographic
Infographic
 
M2 roadshow us gavin patterson, mobilesquared
M2 roadshow us   gavin patterson, mobilesquaredM2 roadshow us   gavin patterson, mobilesquared
M2 roadshow us gavin patterson, mobilesquared
 
2014 Mobile Behavior Report
2014 Mobile Behavior Report2014 Mobile Behavior Report
2014 Mobile Behavior Report
 
Consumer Barometer
Consumer BarometerConsumer Barometer
Consumer Barometer
 
Indonesia Mobile and Internet Survey 2015
Indonesia Mobile and Internet Survey 2015Indonesia Mobile and Internet Survey 2015
Indonesia Mobile and Internet Survey 2015
 
Mobile Internet User Distribution in Iran
Mobile Internet User Distribution in IranMobile Internet User Distribution in Iran
Mobile Internet User Distribution in Iran
 

Similar to Performance Monitoring Best Practices

Understanding the Test Automation Culture of App Developers
Understanding the Test Automation Culture of App DevelopersUnderstanding the Test Automation Culture of App Developers
Understanding the Test Automation Culture of App Developers
Pavneet Singh Kochhar
 

Similar to Performance Monitoring Best Practices (20)

Mobile Analytics – Driving Consumer Insights
Mobile Analytics – Driving Consumer InsightsMobile Analytics – Driving Consumer Insights
Mobile Analytics – Driving Consumer Insights
 
Intro To Mobile Analytics
Intro To Mobile AnalyticsIntro To Mobile Analytics
Intro To Mobile Analytics
 
Understanding the Test Automation Culture of App Developers
Understanding the Test Automation Culture of App DevelopersUnderstanding the Test Automation Culture of App Developers
Understanding the Test Automation Culture of App Developers
 
Transforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish KosarajuTransforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
 
How do YOU compare to others in Mobile DevOps Performance, Productivity, and ...
How do YOU compare to others in Mobile DevOps Performance, Productivity, and ...How do YOU compare to others in Mobile DevOps Performance, Productivity, and ...
How do YOU compare to others in Mobile DevOps Performance, Productivity, and ...
 
20110521 Testistanbul
20110521 Testistanbul20110521 Testistanbul
20110521 Testistanbul
 
World & Indonesia digital media monitoring may June 2014
World & Indonesia digital media monitoring may June 2014World & Indonesia digital media monitoring may June 2014
World & Indonesia digital media monitoring may June 2014
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
Advancement in mobile apps
Advancement in mobile appsAdvancement in mobile apps
Advancement in mobile apps
 
Processus de Développement des Apps Mobiles
Processus de Développement des Apps MobilesProcessus de Développement des Apps Mobiles
Processus de Développement des Apps Mobiles
 
3 UA Megatrends 2015
3 UA Megatrends 20153 UA Megatrends 2015
3 UA Megatrends 2015
 
How to develop successful mobile products
How to develop successful mobile productsHow to develop successful mobile products
How to develop successful mobile products
 
“What the App?”… A Modernization Strategy for Your Business Applications
“What the App?”… A Modernization Strategy for Your Business Applications “What the App?”… A Modernization Strategy for Your Business Applications
“What the App?”… A Modernization Strategy for Your Business Applications
 
App Lifecycle Engagement
App Lifecycle EngagementApp Lifecycle Engagement
App Lifecycle Engagement
 
Linking strat initiatives pres 161010
Linking strat initiatives pres 161010Linking strat initiatives pres 161010
Linking strat initiatives pres 161010
 
Linking strat initiatives pres 161010
Linking strat initiatives pres 161010Linking strat initiatives pres 161010
Linking strat initiatives pres 161010
 
Newly released app: tap-tap-tap or crap?
Newly released app: tap-tap-tap or crap?Newly released app: tap-tap-tap or crap?
Newly released app: tap-tap-tap or crap?
 
Internet, Smartphone & Social Media usage statistics by RapidValue Solutions
Internet, Smartphone & Social Media usage statistics by RapidValue SolutionsInternet, Smartphone & Social Media usage statistics by RapidValue Solutions
Internet, Smartphone & Social Media usage statistics by RapidValue Solutions
 
MELJUN CORTES research tcu_student_metro_south_abstract_thesis_bscs_llames_ma...
MELJUN CORTES research tcu_student_metro_south_abstract_thesis_bscs_llames_ma...MELJUN CORTES research tcu_student_metro_south_abstract_thesis_bscs_llames_ma...
MELJUN CORTES research tcu_student_metro_south_abstract_thesis_bscs_llames_ma...
 
"App Marketing. Essentials." by Alex Drobyshev
"App Marketing. Essentials." by Alex Drobyshev"App Marketing. Essentials." by Alex Drobyshev
"App Marketing. Essentials." by Alex Drobyshev
 

More from Apica

More from Apica (14)

Top 7 DevOps Trends to follow in 2024 by Apica
Top 7 DevOps Trends to follow in 2024 by ApicaTop 7 DevOps Trends to follow in 2024 by Apica
Top 7 DevOps Trends to follow in 2024 by Apica
 
Load Testing and Continuous Integration
Load Testing and Continuous IntegrationLoad Testing and Continuous Integration
Load Testing and Continuous Integration
 
July webinar l How to Handle the Holiday Retail Rush with Agile Performance T...
July webinar l How to Handle the Holiday Retail Rush with Agile Performance T...July webinar l How to Handle the Holiday Retail Rush with Agile Performance T...
July webinar l How to Handle the Holiday Retail Rush with Agile Performance T...
 
Apica Company Summary 2016
Apica Company Summary 2016Apica Company Summary 2016
Apica Company Summary 2016
 
How agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processesHow agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processes
 
Performance Testing Terms
Performance Testing Terms Performance Testing Terms
Performance Testing Terms
 
Apica Company Summary
Apica Company SummaryApica Company Summary
Apica Company Summary
 
EMA/Apica October 2016 Event: User Environment Management For Digital Transfo...
EMA/Apica October 2016 Event: User Environment Management For Digital Transfo...EMA/Apica October 2016 Event: User Environment Management For Digital Transfo...
EMA/Apica October 2016 Event: User Environment Management For Digital Transfo...
 
Eli Stull STPCon Spring 2017 Keynote
Eli Stull STPCon Spring 2017 KeynoteEli Stull STPCon Spring 2017 Keynote
Eli Stull STPCon Spring 2017 Keynote
 
Apica 2016 Statistics
Apica 2016 StatisticsApica 2016 Statistics
Apica 2016 Statistics
 
How to successfully load test over a million concurrent users stp con demo
How to successfully load test over a million concurrent users stp con demoHow to successfully load test over a million concurrent users stp con demo
How to successfully load test over a million concurrent users stp con demo
 
Holiday Readiness: Best Practices for Successful Holiday Readiness Testing
Holiday Readiness: Best Practices for Successful Holiday Readiness TestingHoliday Readiness: Best Practices for Successful Holiday Readiness Testing
Holiday Readiness: Best Practices for Successful Holiday Readiness Testing
 
Load Testing Best Practices
Load Testing Best PracticesLoad Testing Best Practices
Load Testing Best Practices
 
Apica Corporate Overview and Summary
Apica Corporate Overview and SummaryApica Corporate Overview and Summary
Apica Corporate Overview and Summary
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 

Performance Monitoring Best Practices

  • 1. Performance Monitoring Best Practices Zishan Malik Technical Project Manager Synthetic Monitor Expert
  • 2. 22 www.apicasystems.com Introduction 1. Environmental Testing and Monitoring 2. Top-Down Approach to Monitoring 3. Mobile Synthetic Monitoring 4. Monitoring Success Story 5. Remedies & Recipes 6. Questions?
  • 5. 55 www.apicasystems.com Mobile-Tablet Synthetic Monitoring • The time spent per user with digital media on mobile in US daily in 2015 – 2.8 hours • The total number of iOS app downloads in 2015 – 25 billions • The total number of Android app downloads in 2015 – 50 billions • The app category people spend time the most – Social Networking (29% of users) • The age group that spends the most time on apps monthly – 18-24 (90.6 hrs on smartphone apps, 34.7 hrs. on tablet apps) • The Top number of apps people use the most – 3 (78% of smartphone app users, 77% of tablet app users) • The major age group of uses that operate a smartphone with two hands – 55+ (34% of users)
  • 6. 66 www.apicasystems.com Monitoring Success Story • Background: – App released to Production – New Sign-Up page – Multiple Mule Services in the background – Multiple Load Balancers
  • 7. 77 www.apicasystems.com Remedies & Recipes to Success • Understanding the stack, completely. • Spoke to the Developers to understand main components of the application stack. • Did an assessment of the current synthetic monitoring infrastructure. • Implemented Uptime checks on servers. • Build specific user journey scenarios monitoring multiple depended services.

Editor's Notes

  1. At Apica we advise our clients on how to improve their monitoring framework for web application, mobile applications, and implement synthetic monitoring. We have worked my way up from support to noc to ops to tam, and now TPM. We’ll be covering Performance Monitoring Best Practices in this presentation.
  2. Here is our Agenda for today, we’ll be covering various topics, the methods that have worked, some of the horror stories, and what we did to remedy them by applying different recipes. I’ll answer all the question in the last part of our webinar.
  3. We’ve all seen some aspect of the image to your left, the infamous SDLC! What most people miss in the SDLC is the monitoring aspect. However, when should we really start thinking about monitoring? From my experience, (back this up) it should be done in design phase, not the development phase. The reason you want to do this in the design phase is because you want to account for how your users are going to use the product, that will give you an indication on how to synthetically monitor the site. For example, you have e-commerce site, your prospect customer comes to the site, search’s for the item, select’s the item and adds it to the cart, finally the customer goes to the and checks out, at which the customer is directed to a payment gateway. What you have here is a user journey! Studies have shown that 32% of consumers will start abandoning slow site between 1 to 5 secs. This can be reduced by small page sizes and speed improvements. Which should be considered in design, so when the developers start developing they have something to work towards and against. Monitoring implementation will help you realize how fast your site is and what your page size is. Take a look at amazon’s site on your right. They’re average response time is 8 secs, that’s with a full user journey. On an average their home page only takes 3.5 secs to load. That’s should be the goal to retain customers and conversions.
  4. On the left you have your traditional APM tool which gives you some insight on your top 5 web transactions. This is a traditional bottom up approach, giving you the ability to drill down on the stack trace. Top-down approaches emphasize planning and a complete understanding of the application. Top-down requires that you reach a sufficient level of detail in the design phase. A top-down approach ensures you have fault-free system, application, at low response time. Risks of only implementing bottom-up approach is that modules may be coded without having a clear idea of how they link to other parts of the application. Monitoring was never included in the start of the conversation rather it was an after thought. Top-Down gives you the ability to start that conversation early in the development cycle. The picture on the right shows Top-down synthetic monitoring, all the domains called and 10 slowest urls, which gives you an indication of where you need to concentrate your effort. Remember every click is revenue on the table.
  5. What this numbers represent is the growth of mobile application usage in US and around the world. We see that as human attention span is decreasing, the ability to get things done on tap of our finger is increasing more and more. One bad experience with the app and customer finds an alternative app to accomplish the same with. Moreover, the time spent on mobile application vs mobile web is 89% to 11%. So what does this all mean to monitoring? If you don’t have the right monitoring in place how will you know if your app is functioning as it should be? Let me ask you what sort of mobile application monitoring do you have in place currently? Some of the monitoring that I have seen be in place is, user-agent monitoring, which all you are doing is manipulating a user-agent in the browser, do you think that’s accurate? I believe not because it doesn’t really track user experience. Think of it as a sandbox environment, it’s good for a test but to apply that logic in continuous monitoring isn’t the best practice. What I have seen work is a Tool like ZebraTester, which sniffs traffic from the device to the backend. We see what calls are being made, if the images are being rendered. This can be recorded and then set as a base for monitoring, not only will you know the functionality, also, what the response time for the application is.
  6. Weight Watchers recently updated their site with a new sign-up page, however, in the backend they changed from their legacy stuff to nodejs/angularjs. However, they did not have much monitoring in place when they released the sign-up page. Moreover, the new sign up page had multiple mule services in the stack that associate with the new sign-up page, such as, meeting finder, geo-location appointment, plan services. Additionally, WW also released an app in iOS and Android, but when users with subscription would try to log in they were redirected to purchasing a new subscription. In the world where ratings really matter, their application really took a hit with bad ratings. Soon after, WW contacted us, Apica, to help them resolve the issue. What WW wanted to achieve is monitor every service to see if there are any breaks in the user experience. Bring the app rating up again. Help determine where the breaks were happening by using both an APM tool and an SM tool. So how did Apica help them achieve such results?
  7. You can see here exactly what we did to achieve these results.