Presentation to Large Scale Production Engineering meetup at Yahoo campus on June 27, 2012. Dan Bartow, VP Product Management at SOASTA discussed critical performance metrics.

1. #lspe Meetup © 2012 SOASTA. All rights reserved. 1

2. SOASTA : 12/2009 - Present
VP, Product Management
Intuit : 4/2007 – 12/2009
Sr. Manger, Engineering
TurboTax Online and E-Com
ATG : 10/2000 – 4/2007
Sr. Deployment Engineer
American Airlines, Best Buy, Target, Turbotax Online, Quicken Online, MySpace, Dennys, Dominos,
Mattel, Hallmark, FAA, US Army, AT&T Wireless, Alcatel, Newsweek, Oprah, Neiman Marcus,
Plantronics, Kodak, Jcrew, Newell Rubbermaid, Walmart, Target, Paychex, Fidelity Investments
© 2012 SOASTA. All rights reserved. June 27th, 2012 2

3. Poor
Performance
Can be painful.
© 2012 SOASTA. All rights reserved. June 27th, 2012 3

4. © 2012 SOASTA. All rights reserved. June 27th, 2012 4

5. Full Scale – To and Above Expected Peak (2x/3x)
Millions of Concurrent Users
Tens of Millions of Page Views per Hour
Many Thousands of Orders per Minute
In Production
Usually Live and During Off-Hours
© 2012 SOASTA. All rights reserved. June 27th, 2012 5

6. © 2012 SOASTA. All rights reserved. June 27th, 2012 6

7. T n gfru- cl n wl eo d
u in o fl a …a d e b yn
l e
s l
L tn y ew e sse s
ae c b t e n ytm
N tok
e r
w N t ok o f uaio
ew r c nig rt n
& p
Os
N t ok a d idh
ew r b n w t C Nf p c m n
D il l e e t
e a
C nlt it oh r p s
o f w h te a p
ic D Sruin
N o tg
t / em
L a B l c r o f uaio
o d a n e c nig rt n
a
F e a m x a a it
irwl a c p c y
l
Sa e T a
A t-s a gfil e
uo c l au s
in r U b l c dwbs res
n a n e e evr
a
s
Rls
e ae
e M x o kt ec e e
a s c es x e d d Go a l e c v r n e
l l tn y aia c
b a
& el
Dp y
o
g
So tir-p r p g s
l h d at l -in
w y u S c ry ot n c s
e uit b te e k
l
D fu c nig rt ns t g
ea l o f uaio et s
t in S ac tc n l yim s
e rh e h o g l it
o
I d q aesre rs uc s
n e u t ev reo re
a
G ra ec lcio
ab g oe t n
l
Mm rl k
e oye s
a D tb s tra c u t
aa ae he d o ns
Dv
e
& et
Ts So p g s
l ae
w I f ie t aa a eq eie
n f n d tb s u r s
e ic
M to -l e tn g
eh d e lu in
v
T sL b
et a Sa in
t g
g Po u tn 1 0 +++)
rd c ( 0 %
io
S a o Ts
cl f et
e
© 2012 SOASTA. All rights reserved. June 27th, 2012 7

8. Re
ve
nu
e
$$
$
m e 
Ti 
se 
on
sp
Re
© 2012 SOASTA. All rights reserved. June 27th, 2012 8

9. © 2012 SOASTA. All rights reserved. June 27th, 2012 9

10. Real-Time (within a few seconds)
Combine and Correlate
© 2012 SOASTA. All rights reserved. June 27th, 2012 10

11. L vl
ee1 L vl
ee2 L vl
ee3
External Infrastructure Application
© 2012 SOASTA. All rights reserved. June 27th, 2012 11

12. L vl
ee1 L vl
ee2 L vl
ee3
External Infrastructure Application
1. Response Time 1. CPU 1. Container thread
2. Three Critical 2. Memory usage
Transactions 3. Network and Disk 2. Container
(counts and I/O memory usage
durations) 4. Load Balancer 3. Method response
3. Errors 1. CPU time
4. Bandwidth 2. SSL TX/Sec 4. Concurrency
A few at each tier - This can be a ton of data just by itself
© 2012 SOASTA. All rights reserved. June 27th, 2012 12

13. Start Simple Work in Layers Keep it Real (Time)
• Pick three at each • Start from the outside and • Data within a few
level work inwards seconds is
• Average response • Must be able to easily important to be
time is king combine and correlate actionable
metrics – it’s about
reltionships
Actionable Metrics
© 2012 SOASTA. All rights reserved. June 27th, 2012 13

14. Email: dan@soasta.com
Twitter: www.twitter.com/PerfDan
LinkedIn: www.linkedin.com/in/danbartow
© 2012 SOASTA. All rights reserved. June 27th, 2012 14