- Steve Thair presented on whether the current model of load/performance testing is broken for modern web applications.
- He discussed how Betfair separated load injection from performance measurement due to the complexity of their system.
- The current model of load testing with waterfalls, single reports, and scripted user journeys is insufficient for continuous delivery and real user monitoring needs.
- Thair advocated for cheaper and more continuous methods like session replay from logs and APM tools to align with modern development practices.
Agile Open Source Performance Testing Workshop for Business ManagersClever Moe
Use Selenium, soapUI, Sahi, TestMaker Performance Testing In Your Organization. These are slides from a free Webinar titled "The Agile Open Source Way To Load Test, Scalability Test, and Stress Test In Your Organization". Your organization may have adopted Agile Software Development Methodology and forgot about load and performance testing! Learn the Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
Are you tired of spending hours trying to reproduce and diagnose bugs? Do you have a hard time getting testers and developers to talk to each other? Is it difficult to determine which tests are most important to run after you produce a new build? Software testing is perhaps the #1 area of investment for the application lifecycle management capabilities of Microsoft Visual Studio 2010. In this session, we will introduce the software testing capabilities offered by Visual Studio 2010, which are covered comprehensively in the respective sessions. Given that you want to deliver high quality code, when you drive your entire software development lifecycle with tests – you will dramatically improve overall quality.
Quality Best Practices & Toolkit for Enterprise FlexFrançois Le Droff
Quality Best Practices & Toolkit for Enterprise Flex
Presentation given at the French Flex User group : "les tontons flexeurs" on the 21st of July 2009
Author : Xavier Agnetti, François Le Droff (and Alex Ulhmann)
Copyright: Adobe
Agile Open Source Performance Testing Workshop for Business ManagersClever Moe
Use Selenium, soapUI, Sahi, TestMaker Performance Testing In Your Organization. These are slides from a free Webinar titled "The Agile Open Source Way To Load Test, Scalability Test, and Stress Test In Your Organization". Your organization may have adopted Agile Software Development Methodology and forgot about load and performance testing! Learn the Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
Are you tired of spending hours trying to reproduce and diagnose bugs? Do you have a hard time getting testers and developers to talk to each other? Is it difficult to determine which tests are most important to run after you produce a new build? Software testing is perhaps the #1 area of investment for the application lifecycle management capabilities of Microsoft Visual Studio 2010. In this session, we will introduce the software testing capabilities offered by Visual Studio 2010, which are covered comprehensively in the respective sessions. Given that you want to deliver high quality code, when you drive your entire software development lifecycle with tests – you will dramatically improve overall quality.
Quality Best Practices & Toolkit for Enterprise FlexFrançois Le Droff
Quality Best Practices & Toolkit for Enterprise Flex
Presentation given at the French Flex User group : "les tontons flexeurs" on the 21st of July 2009
Author : Xavier Agnetti, François Le Droff (and Alex Ulhmann)
Copyright: Adobe
OTM DELIVERED: How Business Process Outsourcing and Preconfigured Solutions...MavenWire
How to leverage BPO (Business Process Outsourcing) to reduce your OTM (Oracle Transportation Management) implementation costs and focus on your core competencies.
Presented by Samuel Levin at MavenWire.
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsClever Moe
Training For Selenium, soapUI, Sahi, TestMaker Performance Testing. Slide deck from the free Webinar titled "Technical Training On The Agile Open Source Way To Load Test, Scalability Test, and Stress Test." Learn the Agile Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
=============================
THIS PRESENTATION IS OUTDATED
See a newer version here: http://www.slideshare.net/openservices/introduction-to-oslc-and-linked-data
===================================
An introduction to Open Services for Lifecycle Collaboration (OSLC):
- The OSLC community
- Linked Data and RDF
- OSLC specifications
Java technology allows programs to run on a variety of hardware platforms, including the mainframe computing platform epitomized by z Systems. The z Systems zOS operating system has a set of unique capabilities, and IBM SDK for Java provides a set of high performance Java APIs complemented by z/OS specific APIs for applications that require deep integration. This talk shows how IBM makes use of the z/OS platform to deliver world-class runtimes on the world leading mainframe.
Originally presented at the z/OS bootcamp in Hursley, 2015
Using the Groovy dynamic language for primarily functional / acceptance / customer / BDD testing with a forward looking perspective. Also considers polyglot options. The techniques and lessons learned can be applied to other kinds of testing and are also applicable to similar languages. Drivers and Runners discussed include: Native Groovy, HttpBuilder, HtmlUnit, WebTest, Watij, Selenium, WebDriver, Tellurium, JWebUnit, JUnit, TestNG, Spock, EasyB, JBehave, Cucumber, Robot Framework and FitNesse/Slim. Also looks at JMeter, ScalaCheck, Choco, AllPairs and ModelJUnit
London web performance WPO Lessons from the field June 2013Stephen Thair
Web Performance - random lessons learnt from delivering WPO, Load testing and APM consulting in the UK. PLus a bit about WebPageTest Private Instances etc
Measuring mobile performance (@LDNWebPerf Version)Stephen Thair
A presentation to the London Web Performance User Group covering the different ways of measuring Mobile web performance and some of the strength & weaknesses of each, depending on your needs.
Velocity 2011 Feedback - architecture, statistics and SPDYStephen Thair
A presentation on the Velocity 2011 conference from Pieter Ennes from Watchmouse to the London Web Performance Meetup Group. He covers some of this thoughts on the conference and also a brief overview of SPDY.
Continuous Integration - A Performance Engineer's TaleStephen Thair
Andrew Harding from Betfair's presentation on web performance testing in a continuous integration environment. Covers some good reasons why and why not to do perf testing during continuous integration.
Web Performance Optimisation at times.co.ukStephen Thair
Optimizing dynamic websites like www.thetimes.co.uk and www.thesundaytimes.co.uk isn't an easy task!
Speeding up a site requires a "war plan" and having a clear vision, dedicated team, appropriate tools and most importantly speed comparison data with similar sites.
Mehdi Ali, Optimisation Manager for the Times websites, will show us how this strategy was applied for The Times and Sunday Times sites with great results.
Practical web performance - Site Confidence Web Performance SeminarStephen Thair
Over of Web performance optimisation (WPO) as well as some results from 25 web performance site analysis. Some information on Mobile web performance as well.
5.5+ years of experience at JK Technosoft as Senior Quality Analyst. I am serving notice period and can join with a week. I have done manual testing, database testing, migration testing, API testing and performance testing. I have working experience in agile as well as waterfall model.
DevOps in Practice: When does "Practice" Become "Doing"?Michael Elder
DevOps has emerged as the hot trend in development buzzword-ology. With a few quick paragraphs, it proposes to decimate all of the traditional problems you've encountered during your development experience.
In IBM UrbanCode, we build products to help customers follow good DevOps practices. You may think DevOps is about the release process, but really it's about applying a mix of automation and operational practices earlier in your development life cycle so that rolling out to production becomes easier. DevOps promotes a focus on small-batch changes over large complex updates which are harder to predict and harder to roll back when problems occur. With greater velocity, rolling out smaller changes becomes more common place. Additionally, IBM UrbanCode makes extensive application of cloud technology that intercepts well with practices in DevOps around production-like environments.
In this talk, Michael Elder describes how we practice DevOps internally with a mixture of IBM-built and open source tools. He'll discuss the areas that we do well and the challenges that we have with changing our culture around areas like test automation. On top of that, he'll describe how you can leverage these approaches in your own development process!
OTM DELIVERED: How Business Process Outsourcing and Preconfigured Solutions...MavenWire
How to leverage BPO (Business Process Outsourcing) to reduce your OTM (Oracle Transportation Management) implementation costs and focus on your core competencies.
Presented by Samuel Levin at MavenWire.
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsClever Moe
Training For Selenium, soapUI, Sahi, TestMaker Performance Testing. Slide deck from the free Webinar titled "Technical Training On The Agile Open Source Way To Load Test, Scalability Test, and Stress Test." Learn the Agile Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
=============================
THIS PRESENTATION IS OUTDATED
See a newer version here: http://www.slideshare.net/openservices/introduction-to-oslc-and-linked-data
===================================
An introduction to Open Services for Lifecycle Collaboration (OSLC):
- The OSLC community
- Linked Data and RDF
- OSLC specifications
Java technology allows programs to run on a variety of hardware platforms, including the mainframe computing platform epitomized by z Systems. The z Systems zOS operating system has a set of unique capabilities, and IBM SDK for Java provides a set of high performance Java APIs complemented by z/OS specific APIs for applications that require deep integration. This talk shows how IBM makes use of the z/OS platform to deliver world-class runtimes on the world leading mainframe.
Originally presented at the z/OS bootcamp in Hursley, 2015
Using the Groovy dynamic language for primarily functional / acceptance / customer / BDD testing with a forward looking perspective. Also considers polyglot options. The techniques and lessons learned can be applied to other kinds of testing and are also applicable to similar languages. Drivers and Runners discussed include: Native Groovy, HttpBuilder, HtmlUnit, WebTest, Watij, Selenium, WebDriver, Tellurium, JWebUnit, JUnit, TestNG, Spock, EasyB, JBehave, Cucumber, Robot Framework and FitNesse/Slim. Also looks at JMeter, ScalaCheck, Choco, AllPairs and ModelJUnit
London web performance WPO Lessons from the field June 2013Stephen Thair
Web Performance - random lessons learnt from delivering WPO, Load testing and APM consulting in the UK. PLus a bit about WebPageTest Private Instances etc
Measuring mobile performance (@LDNWebPerf Version)Stephen Thair
A presentation to the London Web Performance User Group covering the different ways of measuring Mobile web performance and some of the strength & weaknesses of each, depending on your needs.
Velocity 2011 Feedback - architecture, statistics and SPDYStephen Thair
A presentation on the Velocity 2011 conference from Pieter Ennes from Watchmouse to the London Web Performance Meetup Group. He covers some of this thoughts on the conference and also a brief overview of SPDY.
Continuous Integration - A Performance Engineer's TaleStephen Thair
Andrew Harding from Betfair's presentation on web performance testing in a continuous integration environment. Covers some good reasons why and why not to do perf testing during continuous integration.
Web Performance Optimisation at times.co.ukStephen Thair
Optimizing dynamic websites like www.thetimes.co.uk and www.thesundaytimes.co.uk isn't an easy task!
Speeding up a site requires a "war plan" and having a clear vision, dedicated team, appropriate tools and most importantly speed comparison data with similar sites.
Mehdi Ali, Optimisation Manager for the Times websites, will show us how this strategy was applied for The Times and Sunday Times sites with great results.
Practical web performance - Site Confidence Web Performance SeminarStephen Thair
Over of Web performance optimisation (WPO) as well as some results from 25 web performance site analysis. Some information on Mobile web performance as well.
5.5+ years of experience at JK Technosoft as Senior Quality Analyst. I am serving notice period and can join with a week. I have done manual testing, database testing, migration testing, API testing and performance testing. I have working experience in agile as well as waterfall model.
DevOps in Practice: When does "Practice" Become "Doing"?Michael Elder
DevOps has emerged as the hot trend in development buzzword-ology. With a few quick paragraphs, it proposes to decimate all of the traditional problems you've encountered during your development experience.
In IBM UrbanCode, we build products to help customers follow good DevOps practices. You may think DevOps is about the release process, but really it's about applying a mix of automation and operational practices earlier in your development life cycle so that rolling out to production becomes easier. DevOps promotes a focus on small-batch changes over large complex updates which are harder to predict and harder to roll back when problems occur. With greater velocity, rolling out smaller changes becomes more common place. Additionally, IBM UrbanCode makes extensive application of cloud technology that intercepts well with practices in DevOps around production-like environments.
In this talk, Michael Elder describes how we practice DevOps internally with a mixture of IBM-built and open source tools. He'll discuss the areas that we do well and the challenges that we have with changing our culture around areas like test automation. On top of that, he'll describe how you can leverage these approaches in your own development process!
Managing Application Performance: A Simplified Universal ApproachTechWell
In response to increasing market demand for well-performing applications, many organizations implement performance testing programs, often at great expense. Sadly, these solutions alone are often insufficient to keep pace with emerging expectations and competitive pressures. Scott Barber shares the fundamentals of implementing T4APM™ including specific examples from recent client implementations. T4APM™ is a simple and universal approach that is valuable independently or as an extension of existing performance testing programs. The approach hinges on applying a simple and unobtrusive "Target, Test, Trend, Tune” cycle to tasks in your application lifecycle—from a single unit test through entire system production monitoring. Leveraging T4APM™ on a particular task may require knowledge specific to the task, but learning how to leverage the approach does not. Scott provides everything you need to become the T4APM™ coach and champion, and to help your team keep up with increasing demand for better performance, regardless of your current title or role.
The Tester’s Role: Balancing Technical Acumen and User AdvocacyTechWell
Ten years ago, many of us started our careers in testing, generally moving from a different internal role. It was common for people who were product users to be hired to jump start their technical career. Now, we see the growth of tester positions that require coding experience or a computer science degree. Melissa Tondi discusses the changing landscape of the role of testers, the challenges when hiring developers with no previous testing experience, and a way to shift the pendulum back to balance technical acumen with a user advocacy role. Melissa leads a thoughtful discussion on what makes a good tester, how we can continue to promote our profession, and how to accentuate the value testers bring to organizations. She identifies factors that caused the test/QA role to become mainstream and how it shifted to become more technically focused. Melissa helps fill in the gaps with a test strategy that balances time for the test team to continue supporting the development efforts while equally emphasizing user advocacy tests. She presents recommendations you can take back to your team to achieve the right balance for your organization.
Consistently delivering and maintaining well performing applications doesn't just happen, it requires a solid architecture, sound development, continual attention, diligence and expertise. It also requires appropriate testing, not simply of release-candidate builds, but of designs, units, integrations, and physical components... both during development and in production. The question is, how can a team accomplish all of that under all of today's pressure to deliver quickly and cheaply?
Join Scott Barber for this Keynote Address to hear about what successful organizations are doing to consistently deliver well performing applications, to learn the underlying principles and practices that enable those organizations to create, test, and maintain those well performing applications without breaking either the budget or the schedule, and what the key items are that virtually every team can implement right away, to dramatically improve the consistency and overall performance of their applications.
How CapitalOne Transformed DevTest or Continuous Delivery - AppSphere16AppDynamics
Making the leap to continuous delivery is precarious for any organization, but the concerns are greatly exacerbated when your organization services approximately 45 million bank accounts. Committed to maintaining flawless user experiences while accelerating release cadence, Capital One faced a daunting challenge as it transformed culture, processes, and technical infrastructure in its evolution to continuous delivery.
Join this session with Capital One's Michael Bonamassa and Parasoft's Wayne Airole and learn from their insights on what DevTest changes are critical for responding to extreme digital disruption.
Key takeaways:
o The changing responsibilities of DevTest in a "continuous everything" world
o What skill sets software testers need to ride the wave of digital transformation
o How service virtualization and continuous testing measure the risk of a release candidate
o How to evolve the culture and process to support continuous delivery
o What technical infrastructure is required for real-time test automation and continuous delivery maturation
For more information, go to: www.appdynamics.com
Neotys organized its first Performance Advisory Council in Scotland, the 14th & 15th of November.
With 15 Load Testing experts from several countries (UK, France, New-Zeland, Germany, USA, Australia, India…) we explored several theme around Load Testing such as DevOps, Shift Right, AI etc.
By discussing around their experience, the methods they used, their data analysis and their interpretation, we created a lot of high-value added content that you can use to discover what will be the future of Load Testing.
You want to know more about this event ? https://www.neotys.com/performance-advisory-council
San Jose Selenium Meet-up PushToTest TestMaker PresentationClever Moe
With the Selenium project team's focus on making the WebDriver APIs a W3C standard, this is a good time to talk about where Selenium is going and the support it is getting from commercial open source companies. Frank Cohen, CEO at PushToTest, will discuss Selenium tools - record/playback utilities, deploying Selenium scripts to the Cloud, results analysis tools to surface functional issues and performance bottlenecks, and operational test database repositories - needed to be productive and successful with Selenium.
How to Improve Performance Testing Using InfluxDB and Apache JMeterInfluxData
Apache JMeter is a useful way to run performance tests across different servers. In order to monitor these results, SAP chose to integrate JMeter with InfluxDB, their time series database, to collect and store the temporary transactions. They use Grafana to visualize real-time performance metrics. What happens if your database goes down – for any reason? It could be because of too many JMeter threads trying to access the database or because Grafana is trying to access too many cores of transactions during a performance test. Discover how SAP improves their performance monitoring team’s productivity.
In this webinar, Subhodeep Ganguly will cover:
SAP’s approach to recovering transactions due to database failure
How JMeter execution threads will store the data in a temporary flat/CSV file compatible with InfluxDB
Their ability to reduce recovery times and to improve automatic performance testing
Usage of influx-replay tool as a plugin or compact jar file during the execution of an end-to-end performance test
7 lessons from velocity 2011 (Meetup feedback session for London Web Performa...Stephen Thair
A presentation on the Velocity 2011 conference to the London Web Performance Meetup group by Stephen Thair (Seriti Consulting) covering some of the key messages and takeaways from this year's event.
Measuring Mobile Web Performance presentation at the London Ajax Mobile Conference 2nd July 2011. Covers the basics of web performance measurement and looks specifically at the measurement of page load speed from mobile devices.
Web performance and measurement - UKCMG Conference 2011 - steve thairStephen Thair
The slides from my presentation on web performance and measurement at the UK CMG conference in May 2011. It incorporates some of my slides from the earlier Web Performance 101 presentation with new material focussing on measuring web performance
An overview of web performance automation in the Production environment - "faster ways to make your website faster". Covers things like sample .htaccess files through to performance accelerators like mod_pagespeed and Aptimize through to DSA's like Cotendo.
Web Performance 101 presentation from Feb 2011 meetup, presented by Steve Thair from Seriti Consulting.
Covers the basics of why web performance is important for your business, the key "rules" and the tools that are available in the market today.
Seatwave Web Peformance Optimisation Case StudyStephen Thair
A web performance optimisation case study presented by Seatwave at the London Web Performance Meetup, Jan 2011.
The PDF is in Landscape so you might be better to download it and then shift-ctrl-+ to rotate it clockwise in Adobe Acrobat Reader.
Configuration Management - The Operations Managers ViewStephen Thair
A presentation from the BCS COnfiguration Management Special Interest Group conference 2009. It gives "the other side of the story from a Operation Manager\'s perspective.
4. 4
The Killer Comment…
“We’ve had to look at separating load
injection from performance
measurement”.
- Andrew Harding, Betfair
http://www.seriticonsulting.com/blog/2011
/12/9/is-the-current-model-of-
loadperformance-testing-broken.html
(c) Seriti Consulting, 2011 @TheOpsMgr #ukcmg #webperf
5. So why are you paying all 5
that money for that
What are key expensive brand-name
reasons behind load testing tool then?
that decision?
Surely there are
open source or
cheap cloud
tools if all you
want is load?
What other
issues might we
have with
What are you
“traditional” load
using to measure
testing models
Performance
in a Web 2.0
then?
world?
@TheOpsMgr #ukcmg #webperf
6. 6
Defining the “current model”
“Stephen didn’t explicitly define
what the current model of
load/performance testing is…”
Alex Podelko
http://applicationperformanceengineeringhub.com/is-the-current-model-
of-loadperformance-testing-broken/
@TheOpsMgr #ukcmg #webperf
7. 7
“Current Model Straw Man”
(1) Waterfall Development Cycle
(2) Load Tool compiles the report
(3) Reporting at the end of the test
(4) Request / Response paradigm
(5) Well-defined customer journeys
(c) Seriti Consulting, 2011
8. 8
Testing in a CI/Agile world
Performance testing initiated every time code is committed to
the CM repository (e.g. SVN, GIT etc)
Betfair issue was that their system was complex with many
layers of caching etc so it took longer to “warm up” the
environment (to achieve a steady performance state) than
they had between check-ins…
So they needed “continuous injection” to keep the
environment constantly warm…
The test tool never “stopped” to “compile the report”…
So any tool that “reported at the end” wasn’t as useful…
@TheOpsMgr #ukcmg #webperf
9. 9
Test tools in a APM & RUM world
“traditional test tools” generally have the ability to deploy
agents to gather metrics from the target environment
But the depth of analysis and correlation falls well below that
of modern Application Performance Management tools e.g.
AppDynamics
APM tools offer a deeper insight and better event correlation
across tiers…
And they are getting (much) cheaper…
@TheOpsMgr #ukcmg #webperf
12. 12
WebSockets
HTTP 1.1
Start Timer
GET /index.html
Response 200 OK
Stop Timer
WebSockets
Start Timer
Socket “upgrade”
N many frames…
Stop??? Bi-directional socket channel
@TheOpsMgr #ukcmg #webperf
13. 13
HTTP 2.0
HTTP 1.1
Sequential
ordered
HTTP 2.0 (& SPDY)
Multiplexed over a
single connection
Responses
returned out of
sequence…
Hard to time!
http://stackoverflow.com/questions/10480122/difference-between-http-pipeling-and-http-multiplexing-with-spdy
@TheOpsMgr #ukcmg #webperf
15. 15
Visitor Flow
How many paths thru a
website?
Classic script-driven
approaches can’t hope to
address the complexity
Network and log file
replay solutions?
@TheOpsMgr #ukcmg #webperf
16. 16
A PCAP Solution to Replay?
POC solution based on Cloudmeter
Pion + custom scripts
Read a PCAP (network capture)
Identify the HTTP traffic
Filter it (based on your requirements)
Parameterise it (query strings, POST
parameters etc)
Randomise inputs from SQL, CSV etc
Replay it against a test environment
i.e. change the base URL
Amplify & rate throttle req/sec as
required
http://www.cloudmeter.com/pion/data-processing.php
@TheOpsMgr #ukcmg #webperf
17. 17
Personal Opinion!
YMMV…
So what’s the Answer?
Use the cheapest method to generate load that you can
find…
Move away from scripting-based approaches towards using
real-user session replay (if possible!)
Generate load continuously
Measure continuously
using APM & RUM type tools – FOSS or Commercial
Look for changes in histograms, averages, standard dev etc
Protocol and Framework aware instrumentation
AFAIK this currently doesn’t exist…
@TheOpsMgr #ukcmg #webperf
18. 18
@LDNWebPerf User Group!
Join our London Web Performance Meetup
http://www.meetup.com/London-Web-Performance-Group/
Next Wednesday 17th Oct – 7pm – Central London
Follow us on Twitter @LDNWebPerf
#LDNWebPerf & #WebPerf
(c) Seriti Consulting, 2011 @TheOpsMgr #ukcmg #webperf
19. 19
About Me
21yrs IT experience.
Started with www in 1998 (IIS3! Site Server 3!).
Web Architect @ BNP Paribas, CSFB etc
Web Operations Manager for www.totaljobs.com, www.tes.co.uk
Professional Services Manager @ www.siteconfidence.com
Seriti Consulting – specialising in web operations, management and
Performance
e:stephen.thair@seriticonsulting.com
m:+44 7971 815 940
Twitter: http://twitter.com/TheOpsMgr
Blog: http://www.seriticonsulting.com/blog/
LinkedIn: http://uk.linkedin.com/in/stephenthair
Skype: seriti-steve
(c) Seriti Consulting, 2011 @TheOpsMgr #ukcmg #webperf
Thanks for coming to my talk… I know it must have been hard to tear yourself away from all about “Workload License charges in IBM System Z” so I appreciate your trust! We have lot of really interesting stuff to talk about…You will get a lot of food for thought and I will confess right now that I don’t know all the answers to this as yet, but hopefully we might find some out along the way!
I run a monthly Meetup group on Web Performance… and back in December 2011 we had a presentation from the Performance team at Betfair about performance testing in their continuous integration environment.
And they presented an environment like this…
So I am like what, huh, that’s that? You separated load injection from performance measurement? Doesn’t that sort of destroy half the value proposition of the all those expensive load testing tools? Why did you do that?How are you measuring it then? And then all sorts of other issues came out of that…
So I had all these questions in my head… but before I get to that I need to address Alex Podelko’s objection raised in a comment on my blog…
True, I didn’t…. So say hello to my little friend… the Straw Man!
How do you get “results” when the testing never “stops”…
APM tools offer more insight…. I mean, that’s what they are designed to do so it’s hardly a surprise. So increasing in my load testing I search
Some RUM tools are even free – like Google SiteSpeedSo why do I need expensive load tools if I all I am doing is measuring load?
WebSockets is a new HTML 5 API protocol for bi-directional real-time communication between browser (client) and server.But the key here is that there isn’t a nice request/response “round-trip” any more – the very thing that most of the current generation of test tools rely on (especially the HTTP 1.1 level protocol tools like JmeterAnd in a HTTP 2.0 world it gets even worse… because you have HTTP channel multiplexing…
Websites are getting more and more complex… especially as we add in new functionality like AJAX and HTML5 I have been playing with a solution
I created a proof of concept
DB2 was the reason I moved into local area networking…