This document summarizes keynote monitoring of a demo server over two days. It measured response times and availability from 5 US locations every 30 minutes, and internally every 5 minutes. There were two load tests run against the server that decreased availability and increased response times, particularly for the home page. The internal measurements showed specific steps like the about page being impacted. Overall, the monitoring identified performance issues during the load tests and provided detailed response time data down to the page level.

1. Gaining Insight into Web Performance and
Availability
Keynote Demonstration & Example Overview and Data Review for
Glenn Huang, Solutions Consultant

2. November 9, 2013
What Keynote Measured
3 Steps using a public-facing Keynote
Demonstration server called
TSPDemo04 from 2/15/12 to 2/16/12
Using an emulated browser (ApP) 5 US
Locations every 30 minutes (average one
measurement every 6 minutes)
1. TSPDEMO04 Home Page
http://tspdemo04.keynote.com
1. Dallas SBC ApP
2. Click Link for About Page
3. San Francisco Sprint ApP
3. Submit Comment on About Page
4. Denver CenturyLink ApP
2. Chicago SBC ApP
5. New York Cogent ApP
During that time, there were two Load
Tests run against this same TSPDEMO04
server.
Using an emulated browser private
agent (CApP) San Mateo HQ Location
every 5 minutes
1. 2/15/12 @6:15 PM 15 minute ramp
1. (Keynote) CApP Glenn_Huang_CApP
2. 2/15/12 @8:40 PM 15 minute ramp
2

3. November 9, 2013
Path Screenshots
1
2
3
3

4. November 9, 2013
What was the Performance and
Availability measured?
• Track ongoing response time
patterns and availability %
• Results of all measurements of
all steps averaged From 2/15@5
PM to 2/16@2PM PST
• We see the load test had a
direct impact on availability for
those periods.
• We note too that there was
additional response time
between 4AM to 7:30 AM;
possibly another load test
without comments.
• Database server was down
2/16@12:20-12:47 PM
4

5. November 9, 2013
Where did it Happen?
Average performance by Agent over the time period
5

6. November 9, 2013
Where did it Happen?
Average performance by Agent
over time
•
Another more detailed view of
each agent as they experienced
these load tests
•
There were other page errors
during this time due to the
database server being down.
•
Let’s see what steps were
affected during this time
6

7. November 9, 2013
On Which Steps?
Average performance by Step over
time
• For External Measurements
only
•
Note that the Home Page was
very sensitive to database
connectivity and load tests
•
How did it look from a local
internal view?
7

8. November 9, 2013
On Which Steps?
Average performance by Step over
time
• For Internal CApP
Measurements only
•
Note that the higher 5 minute
granularity allows us to see
when the Home Page was
down due to the 1st load test.
•
We also see that the About
page was also down during the
2nd load test and the Homepage
response time jumped.
8

9. November 9, 2013
Scatter Plot: Page and Content Errors
This scatterplot
shows all points
taken from
both Internal
and External
agents 2/15/12
from 5-11:59
PM PST.
Again, Keynote
picked up all
server errors
during the load
test periods.
9

10. November 9, 2013
Drill Down: Page Summaries
• Comparing measurements
• Top is before Load Test
Before Load
• Bottom is during the Load
Test
• Note the time scales are
not identical between top
and bottom graphs
• We see Increased
Times under load
During Load
1st
Byte
• Redirect on Step 3 also
increased from .23s to
1.2s, a 5X increase
10

11. November 9, 2013
Drill Down: Page Summary
Slow CApP result
• This data point was not during one of the two load tests but was one of a
few outliers noted for the CApP agent.
• In every data point on the Comments step where there was an increase in
time, the Redirection component was the reason, adding about 5-6
seconds.
11

12. November 9, 2013
Page-Detail Level Performance Before Load Test
This is the
Homepage
from Chicago
SBC ApP at
2012-02-15
17:54:54 PST
Note First
Byte of Base
Page.
12

13. November 9, 2013
Page-Detail Level Performance During First Load Test
This is the
Homepage
from Chicago
SBC ApP at
2012-02-15
18:24:54 PST
Note 5X
increase in
First Byte time
of Base Page.
13

14. November 9, 2013
Summary
Keynote measures end-user web performance from either inside
or outside the firewall via Private or Public agents, respectively
Detailed measurement data facilitates:
• Tracking of response times and availability over time
• Troubleshooting of performance issues before they
become critical
• Enforcement of SLAs for your own content, 3rd party or
CDN-delivered content
• Virtual Pages can be provided to segregate this information
14

15. November 9, 2013
Keynote Web Monitoring Solutions
Application Perspective (ApP)
•
•
•
Used for general Web performance and availability monitoring
Supports any Web browser (IE, Firefox, Safari, Opera, Chrome, etc)
Employs an emulated browser to playback measurement scripts
Cloud Application Perspective (CApP)
•
•
Just like ApP but a private agent installable behind firewalls, load
balancers, in virtualized environments.
Can be placed wherever a public agent is not available.
15