Mining for gold 2.0
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Mining for gold 2.0

  • 242 views
Uploaded on

Presented at Gluecon 2014 by James Urquhart and Rob Dickinson of Dell. ...

Presented at Gluecon 2014 by James Urquhart and Rob Dickinson of Dell.

"Mining" for application performance "gold" is harder than ever before. Applications are becoming parts of larger complex systems, and developers need to understand how the system behaves as much as how each application behaves.

Following transaction details is an excellent way of monitoring application performance in these systems, and triggering automation activities such as autoscaling and recovery.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
242
On Slideshare
241
From Embeds
1
Number of Embeds
1

Actions

Shares
Downloads
7
Comments
0
Likes
0

Embeds 1

https://twitter.com 1

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • You experience complex adaptive systems every day. In ecosystems… <br />
  • Give an example of an end to end resolution that follow this path: <br /> * Hi IO on one DB Shard due to a lot of users logging in and doing expensive activity
  • Give an example of an end to end resolution that follow this path: <br /> * Hi IO on one DB Shard due to a lot of users logging in and doing expensive activity

Transcript

  • 1. Miningfor Gold How Browser,Network,andApplicationTraceMash-UpsCanBoost ApplicationPerformance
  • 2. Software Group IntroducingDellSoftware • QuestSoftware, Enstratius are the foundation •Part of “World’s Largest Startup” with 110k people •Sponsors at GlueCon and Velocity •6 employees in Boulder (shameless hometown plug)
  • 3. Software Group “Mining” for performance“gold”is moredifficult than it everwas.
  • 4. Software Group Our “units of deployment”may begetting a bit simpler But our systems aregetting much more complex…
  • 5. Software Group
  • 6. Software Group We used to shoot for stability in a controlled environment But wenow shoot for resiliencyin an ever changing environment
  • 7. Software Group
  • 8. Software Group How do we handle thiscomplexity? Observe,Measure and Filter Understand Intrinsic Latencies Understand the Transaction Path Understand User Behavior Understand Resource Contention Improve Logical Complexity Tune, Balance, Scale How are your tools andtechniques helping you dothis today?
  • 9. Software Group Applications: Definedby Infrastructure? CDN 3rd party Challenges of Scale, Co-location, Tenancy, Cost
  • 10. Software Group Applications Should be Definedby Activity How doyoutroubleshootandassessproblemsin complex dynamicenvironments? How areactivities identified andunderstood?
  • 11. Software Group System Complexity is Emergent/Entropic WhataboutNoSQL?RoR?Ansible?AWS?(ormagic unicorns?) Complexityis linkedwith marketsuccess, is driven bycustomers,contributors,competitors,investors, partners,even time itself Complexity doesn’t really fade, but takes onnew forms
  • 12. Software Group CompleteDiscrete Transaction Traces • Enduser data(navigation timing andfull content) • Transactionpathandparametersandtiming • Relatedbackendresources(databases,queues) • Full detailofusersession in context Web server App server DB server End users Internet Firewall Traceand mergebeforeaggregation Related Infrastructure
  • 13. Software Group WhyDiscrete Traces?
  • 14. Software Group Response TimeBreakdown
  • 15. Software Group Response TimeAnalysis (multi-dimensional)
  • 16. Software Group So, your next question shouldbe“IfI’m analyzing all thisdata in a constantly changing environment,how the heckdo Ikeepup?”
  • 17. Software Group Answer?: Automation
  • 18. Software Group The only way to ensure resilienceat scaleis to makeeachagent (or cluster of agents) as“self-resilient” as possible.
  • 19. Software Group In an automated system, provisioning, scaling, failure tolerance, and disaster recovery are different names for the same workflows • The trigger for the workflow is the distinguishing characteristic • All are executions of the same workflows addressing insufficient or excess computing resources • All tend to focus on at the workload level
  • 20. Software Group Anything you can monitor can serve as a trigger for a scaling workflow • Raw resource utilization • Basic application metrics • Understanding the transaction path
  • 21. Software Group Aggregated and/or discrete transaction data can help identify the proper workload to scale/recover/etc.* *No way of predicting exactly which measure is best for all time
  • 22. Software Group Example: Uses aggregate order rate for specific movies by region to make scaling decisions. What scales determined by APM data.
  • 23. Software Group Example: Several financial services firms combine market trading volume with transaction volume to determine when to scale.
  • 24. Software Group How do we handle thiscomplexity? Observe,Measure and Filter Understand Intrinsic Latencies Understand the Transaction Path Understand User Behavior Understand Resource Contention Improve Logical Complexity Tune, Balance, Scale How are your tools andtechniques helping you dothis today?
  • 25. Software Group Questions and Answers