Web Performance tuning presentation given at http://www.chippewavalleycodecamp.com/
Covers basic http flow, measuring performance, common changes to improve performance now, and several tools and techniques you can use now.
improving the performance of Rails web ApplicationsJohn McCaffrey
This presentation is the first in a series on Improving Rails application performance. This session covers the basic motivations and goals for improving performance, the best way to approach a performance assessment, and a review of the tools and techniques that will yield the best results. Tools covered include: Firebug, yslow, page speed, speed tracer, dom monster, request log analyzer, oink, rack bug, new relic rpm, rails metrics, showslow.org, msfast, webpagetest.org and gtmetrix.org.
The upcoming sessions will focus on:
Improving sql queries, and active record use
Improving general rails/ruby code
Improving the front-end
And a final presentation will cover how to be a more efficient and effective developer!
This series will be compressed into a best of session for the 2010 http://windycityRails.org conference
A walkthrough of various application performance tuning tools and a good workflow for where to start, from a presentation at WindyCityRails 2011 in Chicago, IL.
See the video, and more Web and Ruby/Rails Performance info at www.RailsPerformance.com
-John McCaffrey
improving the performance of Rails web ApplicationsJohn McCaffrey
This presentation is the first in a series on Improving Rails application performance. This session covers the basic motivations and goals for improving performance, the best way to approach a performance assessment, and a review of the tools and techniques that will yield the best results. Tools covered include: Firebug, yslow, page speed, speed tracer, dom monster, request log analyzer, oink, rack bug, new relic rpm, rails metrics, showslow.org, msfast, webpagetest.org and gtmetrix.org.
The upcoming sessions will focus on:
Improving sql queries, and active record use
Improving general rails/ruby code
Improving the front-end
And a final presentation will cover how to be a more efficient and effective developer!
This series will be compressed into a best of session for the 2010 http://windycityRails.org conference
A walkthrough of various application performance tuning tools and a good workflow for where to start, from a presentation at WindyCityRails 2011 in Chicago, IL.
See the video, and more Web and Ruby/Rails Performance info at www.RailsPerformance.com
-John McCaffrey
Npm, bower, Angular, jQuery, grunt, gulp, browserify, requirejs, ember, backbone, requirejs, amd .... thousands of micro frameworks, libraries and tools.
The question is how do you avoid getting lost within the jungle of modern JS frameworks, libraries and tools? How to be effective and actually deliver while every day there is a new cool framework or tool coming out and one of the developers in your team would love to try it. In production.
In this talk I will explain the right strategy for dealing with the rapid changes in JS landscape and choosing the right set of tools for doing the job.
Key takeaways:
Get to know which js tools/libraries works well together.
Which tools/libraries are not cool anymore and why?
How to deal with library/tool dependency conflicts?
How to find good quality tools and frameworks?
An Overview of the Javascript Ecosystem in 2015. Slides from this talk given at San Diego Javascript on June 2: https://www.youtube.com/watch?v=CGkPsNyI07A
Our presentation on Israel Rails Conference 2012. Vitaly talking about rails performance, how to measure, what to improve and just as much important - what not to improve
Best Practices in SharePoint Development - Just Freakin Work! Overcoming Hurd...Geoff Varosky
Abstract: “Why am I getting a security error??” “Why does my code work sometimes, but not others?” “I wonder if McDonalds is hiring.” Writing custom code in SharePoint opens up unlimited possibilities but also throws many hurdles in your way that will slow you down if you don’t take them into account. So, before giving up and searching for careers in the fast food industry, equip yourself with the knowledge you need to succeed in writing custom code for SharePoint.
Flexible UI Components for a Multi-Framework WorldKevin Ball
Slides from Flexible UI Components talk given at Web Unleashed 2017
Build UI components that work seamlessly in every JavaScript Framework.
Your core UI elements shouldn’t have to be different for your marketing site than they are in your application just because the former uses jQuery while the latter is built using Angular or React.
Lessons learned from work on ZURB Foundation 7.
10 Things You Can Do to Speed Up Your Web App TodayChris Love
Web Performance is a serious issues these days. 80% of web performance issues are in the client. Many developers either do not realize what they are leaving on the table and how that affects the success of their application. These are 10 things any web developer can do in about 30-60 minutes to drastically increase page load times and thus increase the application's profitability.
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...John McCaffrey
(reposting with clearer title)
Performance tuning presentation from WindyCityRails 2010.
Why performance matters
The right way to approach it
Front end testing tools
Automated testing tools
Common problems and the ways to solve them in Rails
Rails specific tools
bullet
slim_scrooge
rack bug
request log analyzer
rails indexes
10 things you can do to speed up your web app today stir trek editionChris Love
Why is Web Performance Optimization Important and what are some things developers can do to ensure their applications perform well and please end users?
Npm, bower, Angular, jQuery, grunt, gulp, browserify, requirejs, ember, backbone, requirejs, amd .... thousands of micro frameworks, libraries and tools.
The question is how do you avoid getting lost within the jungle of modern JS frameworks, libraries and tools? How to be effective and actually deliver while every day there is a new cool framework or tool coming out and one of the developers in your team would love to try it. In production.
In this talk I will explain the right strategy for dealing with the rapid changes in JS landscape and choosing the right set of tools for doing the job.
Key takeaways:
Get to know which js tools/libraries works well together.
Which tools/libraries are not cool anymore and why?
How to deal with library/tool dependency conflicts?
How to find good quality tools and frameworks?
An Overview of the Javascript Ecosystem in 2015. Slides from this talk given at San Diego Javascript on June 2: https://www.youtube.com/watch?v=CGkPsNyI07A
Our presentation on Israel Rails Conference 2012. Vitaly talking about rails performance, how to measure, what to improve and just as much important - what not to improve
Best Practices in SharePoint Development - Just Freakin Work! Overcoming Hurd...Geoff Varosky
Abstract: “Why am I getting a security error??” “Why does my code work sometimes, but not others?” “I wonder if McDonalds is hiring.” Writing custom code in SharePoint opens up unlimited possibilities but also throws many hurdles in your way that will slow you down if you don’t take them into account. So, before giving up and searching for careers in the fast food industry, equip yourself with the knowledge you need to succeed in writing custom code for SharePoint.
Flexible UI Components for a Multi-Framework WorldKevin Ball
Slides from Flexible UI Components talk given at Web Unleashed 2017
Build UI components that work seamlessly in every JavaScript Framework.
Your core UI elements shouldn’t have to be different for your marketing site than they are in your application just because the former uses jQuery while the latter is built using Angular or React.
Lessons learned from work on ZURB Foundation 7.
10 Things You Can Do to Speed Up Your Web App TodayChris Love
Web Performance is a serious issues these days. 80% of web performance issues are in the client. Many developers either do not realize what they are leaving on the table and how that affects the success of their application. These are 10 things any web developer can do in about 30-60 minutes to drastically increase page load times and thus increase the application's profitability.
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...John McCaffrey
(reposting with clearer title)
Performance tuning presentation from WindyCityRails 2010.
Why performance matters
The right way to approach it
Front end testing tools
Automated testing tools
Common problems and the ways to solve them in Rails
Rails specific tools
bullet
slim_scrooge
rack bug
request log analyzer
rails indexes
10 things you can do to speed up your web app today stir trek editionChris Love
Why is Web Performance Optimization Important and what are some things developers can do to ensure their applications perform well and please end users?
Single Page Applications: Your Browser is the OS!Jeremy Likness
Single Page Applications have gained tremendous popularity over the past few years and have prompted the creation of several frameworks to support their development. Unlike traditional web applications, most of the heavy lifting for SPA happens on the client side in your web browser. These applications rely on hundreds of lines of JavaScript coupled with asynchronous web service calls to provide a desktop-like experience that is accessible from virtually any device.
Join Principal Architect, Jeremy Likness, to learn more about SPA, including how to determine when you should choose this approach, how SPA compares and contrasts with traditional server-based approaches including ASP.NET WebForms and MVC, and what frameworks and tools (such as jQuery, AngularJS, and Aurelia) make building SPA easier. Discover how single page applications powered by HTML5 and JavaScript transform your browser into a web-based operating system.
Does This Theme Make My Website Look Fat? (Wordcamp SLC 2013)Adam Dunford
While the principles of responsive web design can make sites look better on mobile devices, they don’t necessarily load faster than a site designed for desktops. And as more and more sophisticated WordPress themes emerge, with their multiple options and fancy sliders, websites just keep getting more and more bloated.
This presentation will help cut out the junk that’s larding up your sites so you can better meet the demand of users wanting fast-loading user experiences–no matter the device or connection.
Presented at WordCamp Salt Lake City 2013 (http://2013.slc.wordcamp.org/)
Why your slow loading website is costing you sales and how to fix itRobert Flournoy
Learn: Why your website MUST be fast to be competitive, how a page is loaded by the browser, how to measure page speed and 5 simple ways to speed up YOUR website
.
This is my latest version of my client side performance presentations. This has been presented at TechEd NZ 2009 & to a couple of .NET user groups around NZ. This presentation focuses on the basics of client-side performance tuning.
[Srijan Wednesday Webinars] Developing Large Scale Applications in AngularJSSrijan Technologies
AngularJS is currently at the forefront of MVC (Model View Controller) frameworks for the web, and it makes it very simple to develop prototypes and web applications in it. But how do we ensure that the large scale applications we develop remain high performance, bug free and fast?
In this webinar, our speaker shared his learnings from developing various large scale AngularJS applications. He also shared how to create a maintainable project structure, and cover common performance bottlenecks and best practices to follow.
Watch complete webinar recording: http://youtu.be/b92Y77TExiA
Web Components at Scale, HTML5DevConf 2014-10-21Chris Danford
At Pinterest, we've begun experimenting in production with Web Components. This talk will discuss some challenges of implementing Web Components in a large scale production environment such as SEO concerns, reasonable fallbacks for browsers not supported by Platform.js, migrating a large code base component-by-component to mitigate risk, and optimizing page load and scroll performance.
Lets look at an example of what a performant website can look like. This discuss what concepts should we be considering when looking at website performance. Next we will go over two areas pertaining to website performance: 1) website performance tweaks that you as a web developer can directly make 2) website performance tweaks that you may have to work with your hosting provider or IT department to achieve
A Taste of TDD: The basics of TDD, why it is hard and how to do it betterJohn McCaffrey
A Taste of TDD: Basic overview of Agile Testing, TDD in practice, Pros/Cons of Test Driven Development, Recent TDD Controversey (DHH, Kent Beck, Martin Fowler), and some strategies for doing it well.
This is a lead in to a full Agile Workshop on Scrum/XP, TDD, and Pairing
Becoming a more Productive Rails DeveloperJohn McCaffrey
Tips and tricks for how to accelerate your technical learning, take better notes, search in the right places, get help faster, solidify your understanding and hold on to what you've learned.
Becoming a more productive Rails DeveloperJohn McCaffrey
A presentation by John McCaffrey of RailsPerformance.com on how to manage technical information, ask technical questions, expand Ruby and Rails knowledge, and work on interesting side projects for open source, non-profits or as a freelancer
PDF Generation in Rails with Prawn and Prawn-to: John McCaffreyJohn McCaffrey
breakdown of the most commonly used pdf libraries in rails projects,and an in depth review of prawn
example pdfs and code can be seen at prawn.heroku.com
More info at www.RailsPerformance.com
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
2. John McCaffrey: Its all about me
• Doing Java since 2000, Rails since 2007
• Presented at WindyCityRails
– 2008: Advanced Firebug and JS unit testing
– 2009: PDF Generation in Rails
– 2010: Rails Performance Tuning
• Addicted to Performance Tuning
• railsperformance.blogspot.com
• Feedback: http://spkr8.com/t/4961
@J_McCaffrey
railsperformance@gmail.com
(the slides will be available, with additional references)
3. What are we gonna cover?
• Performance touches a lot of layers
• We have a very diverse audience
6. def organization_branches
get_organizations.flatten.uniq.select{|org| org.children.size > 0}
end
def organization_leaves
get_organizations.flatten.uniq.select{|org| org.children.size == 0}
end
def load_organizations
branches = current_user.organization_branches
leaves = current_user.organization_leaves
@branches = branches.to_json(:only => [:id, :name])
@leaves = leaves.to_json(:only => [:id, :name])
@organizations = @criteria.branch ?
leaves.collect {|o| [ o.name.titleize, o.id ] }.sort :
branches.collect {|o| [ o.name.titleize, o.id ] }.sort
end
It all started...
2811 queries!
Down to 17!!
7. And then...
Invoicing issue:
If a customer resubmits an order with 2 years,
they should be charged $9 but were only being
charged $4.50
How common are ROI calculations on software projects?
53626 * $4.50 = $241,317 (just in the last year)
8. Our theme of the day: Leverage
to achieve the greatest value
10. Performance and Business metrics: Speed matters
Amazon: 100 ms delay caused a 1% drop in revenue.
Google: 400 ms delay caused a 0.59% decrease in search requests per user.
Yahoo!: 400 ms delay caused a 5-9% decrease in traffic.
Bing: 2 sec delay caused a 4.3% drop in revenue per user.
Mozilla made their download page 2.2 seconds faster and saw an
increase of 15.4% in downloads.
Google Maps reduced the file volume by 30% and observed a
30% increase in map requests.
Netflix enabled gzip on the server; pages became 13-25% faster and
saved 50% of traffic volume!
11. Performance and Business metrics: Shopzilla.com
Went from 6 sec
down to 1.2sec
http://www.phpied.com/the-performance-business-pitch/
12. Fred Wilson: Speed is the most important feature
10 Golden Principles of Successful Web Apps
Fred Wilson, Venture Capitalist www.avc.com
•Speed• Instant Utility
• Software is media
• Less is More
• Make it programmable
• Make it personal
• Make it RESTful
• Discoverability
• Clean
• Playful
14. Give yourself a fighting chance, make a plan
Alois Reitbauer, dynatrace
Anti-patterns
• Thinking Scalability something you just sprinkle on later
• Guessing, not testing
• Ad-hoc, unstructured
• Waiting until it hurts, not proactively planning
• Thinking that any early planning is Premature optimization
Video on Parleys.com
18. Premature optimization
"Premature optimization is
the root of all evil'
-Donald Knuth
"Quoting Knuth, as a way to
avoid planning for performance
issues, is a cop-out"
@J_McCaffrey
Don't waste time on making
optimization changes until you
KNOW they are necessary
19. If you can not measure it,
you can not improve it.
— Lord Kelvin
20. Let's do this the right way
Measure:
• Understand the tools to use, at each layer, to measure
and monitor performance
Create repeatable tests:
• Be able to invoke the system and easily test
• A/B, before/after tests, long-term monitoring
Isolate your changes:
• One thing at a time
That's it: Measure, Test, and Isolate your changes
21. Terminology
Load:
How much work is
there?
Utilization:
How much of the
resources are in use?
Scalability:
How well can we
handle the load?
Throughput:
How many tasks can
be done per unit of
time?
Concurrency:
How many tasks can
we do at once?
Capacity:
How big can our
throughput go before
things fall apart?
Response time (avg) == Latency
Requests per second == Throughput
22. Terminology
Performance:
• The resources and Time for a single request
• Measured in Response Time
Throughput:
• The number requests that can be handled per/time
• Measured in Requests per second
Scalability:
• Ability to grow and handle more requests, without
significantly degrading the experience
Performance != Scalability
23. Terminology
Let's say:
1 worker that can compute a job in .5 sec
Throughput = 2 jobs per sec
Latency = .5 sec per job
Performance != Scalability
Adding more workers will not improve the latency
But not having enough workers can increase the
response time, due to Queuing and delay
25. Waterfall: Twitter.com
Waterfall
Total time: 3815 ms
Dynamic generation: 250 ms
(~7%)
Static: 3369 ms (~89%)
* Will not add to 100%
When the html is downloaded
When the rest
of it is loaded
28. Firebug Netpanel
Simple and repeatable way to measure page load
Usually, less than 20% of the time is spent in fetching the HTML
So how do we optimize the other 80%?
29. YSlow
• Created by Steve Souders
• Observes the netpanel data, applies rules and gives you a
score.
• Deep understanding of how the browser works
• Its the best way to have a repeatable, measurement of your
site's load performance
http://developer.yahoo.com/yslow
30. YSlow
• Minimize HTTP Requests
• Use a Content Delivery Network
• Add an Expires or a Cache-Control Header
• Gzip Components
• Put StyleSheets at the Top
• Put Scripts at the Bottom
• Avoid CSS Expressions
• Make JavaScript and CSS External
• Reduce DNS Lookups
• Minify JavaScript and CSS
• Avoid Redirects
• Remove Duplicate Scripts
• Configure ETags
• Make AJAX Cacheable
• Use GET for AJAX Requests
• Reduce the Number of DOM Elements
• No 404s
• Reduce Cookie Size
• Use Cookie-Free Domains for Components
• Avoid Filters
• Do Not Scale Images in HTML
• Make favicon.ico Small and Cacheable
32. Google Page speed
• Similar to YSlow
• includes paint events
• separates out ads, trackers from your content
• better recommendations and optimizations
• 1 click to see optimized version of your files
http://code.google.com/speed/page-speed
36. Summary
• Page load is the place to start
• Read everything in the Yslow and PageSpeed rules
• Encourage other devs to play with YSlow, PageSpeed
• Show Webpagetest.org, and zoompf.com to the boss
Now that we have a way to measure page
performance, we can think about making changes
38. Isn't everyone already doing this?
Analysis of the Alexa top 1000 sites found:
• 42% don't gzip
• 44% have more than 2 css files
• 56% serve css from a cookied domain
• 62% don't minify
• 31% have more than 100k size css
Top 1000 retail sites
50% aren't doing both keep-alive and compression
(the 2 easiest things!!)
39. Compress with Gzip
• Can save you 50% to 80% of your bandwidth
• Simplest performance improvement you can make
• Beware differences in browsers
• File types: html, js, css, xml, rss, txt, font, json
Probably the simplest and smartest
thing you can do for your app!
40. Combine and minify javascript and css
Rails
• javascript_include_tag :all, :cache => "all"
• Asset_packager, Jammit
Load common js libraries from google
http://github.com/rpheath/google_ajax_libraries_api
Jsmin or YUICompressor
Closure compiler
Let's check it out!
41. Combine and minify javascript and css
Sprites and image optimization
• spriteme.org
• JqueryUI already gives you sprited images
Image optimization
• Smush.it
42. Expires and Browser Caching
Setting a far future expires tells the browser not to ask for the file
Expires:Mon, 02 Sep 2030 21:23:08 GMT
/images/logo.png?1234567890
Using the query string lets us break the caching by having the
browser ask for a new file
There is a problem with using a URL query string this way
http://blog.eliotsykes.com/2010/05/06/why-rails-asset-caching-is-broken/
/images/logo-fp-839b180ff39a24f8d6e0ee70e4c40fed.png
43. Rails Caching
Take your dynamic content, and make it static
• Page
• Action
• Fragment
Full length tutorials
• http://railslab.newrelic.com/
• http://railscasts.com/episodes?search=caching
• Greg Pollack Aloha on Rails http://vimeo.com/10860860
49. Commercial tools
New Relic
• Developer plugin is a good start
• Free version doesn’t get you much (Bronze version with heroku)
• Works for .NET
• Scoutapp.com
• Similar to new Relic
• Large selection of community plugins
50. Testing tools
Apache bench
ab -n 10 -c 2 http://www.somewhere.com/
Httperf
httperf --server localhost --port 3000 --uri / --num-conns 10000
Jmeter
yes, its ugly, but its powerful
52. Database issues
Common database issues
• Bad queries
• Not utilizing explain
• Inadequate indexes
• N+1 queries
• Selecting more data than is needed
• Inconsistent queries for the same data
53. Query_reviewer
Common database issues
• Bad queries
• Not utilizing explain and slow query log
• http://github.com/dsboulder/query_reviewer
• Runs explain on all of your queries, outputs to div in
page
55. Bullet plugin
Bullet plugin
• http://github.com/flyerhzm/bullet
Help you reduce the number of queries
with alerts (and growl).
56. Slim_scrooge
Be more specific in your select
• http://github.com/sdsykes/slim_scrooge
• Instruments your code
• Observes the usage pattern
• Suggests/changes your select statement
• When invoked within the exact same context
57. Ruby Issues
Most are due to memory problems
• Slow GC
• Not release references
• Capturing scope
• Profiling will reveal what’s going on
• http://guides.rubyonrails.org/performance_testing.html
If you want to learn everything there is to know about profiling
• Aman Gupta & Joe Damato
• http://timetobleed.com/
• http://memprof.com/
• They’ve already identified and fixed several memory leaks
58. Ruby issues: Faster Ruby Libraries
C Extension++
• XML parser http://nokogiri.org/
• JSON parser http://github.com/brianmario/yajl-ruby/
• CSV parser http://www.toastyapps.com/excelsior/
• HTTP client http://github.com/pauldix/typhoeus
Date
http://github.com/jeremyevans/home_run
59. Take home points
Performance
• Performance affects the bottom line
• The biggest performance win is usually in improving the load time
• Continue to monitor and test your apps performance over time
• Gzip, combine and minify to get a big boost
• Lack of indexes is likely to be one of your biggest backend issues
• Try to stay up to date with Libraries and patches
• A well tested codebase is easier to tune!
• Upgrading to ruby 1.9 will give you a huge performance boost
60. Links: great info on performance
Performance
• Scaling Rails series http://railslab.newrelic.com
• RailsCasts.com
• Velocity Conf http://en.oreilly.com/velocity2010
• Google io conf http://code.google.com/events/io/2010/
• dynatrace site http://ajax.dynatrace.com/pages/
• http://www.igvita.com
• http://www.mysqlperformanceblog.com
61. Wait, I made it through that?
Designing for performance
• Watch how they really use it
• Multiple tabs?
• Back and forth between list and detail view
• Great presentation at WindyCityRails2009 by David Eisinger
• Optimizing perceived performance
• Make it feel fast
62. Wait, I made it through that?
Architectural musings
•Background long running tasks
• Email, image processing, reports, feeds
•Leverage Rack, Sinatra or Padrino
•Parallel processing, Event Machine
•Learn from heroku, scalable from the start
•Revaluate your cloudy-ness
• Great RailsConf presentation by James Golick
64. Beyond ySlow:
improving page
performance
outside the
initial load
MySql and
Postgres
Database tuning
Heroku: Building
Scalable apps
from the start
Tuning
performance
for Mobile
devices
Performance
Improvements
coming in Rails
3, and 3.1
Speeding up
your tests
65. Questions for you
Architectural musings
• Moving to or already on Ruby 1.9?
• Serving your content from a separate domain
• Cookieless?
Editor's Notes
I really enjoy helping people get the most out of their apps
add some color to these slides!
There is so much to cover, and I want to make sure that everyone gets something valuable out of this talk, whether you are just starting out, or you work for Groupon, serving mils of hits a day.
My main objective is to help you get started. To know where to look, which tools to use, which techniques to investigate, and where to find the resources you need.
I won't be able to teach you everything about performance, but I can at least get you excited, and point you in the right direction.
If i don't teach you something new, or you don't get what you were looking for, please come up and talk to me. We can chat afterwards, if you have a specific issue, I'm sure I can help you out.
how I got started
customer complained report page was slow in prod
first 2 methods are from the model, the 3rd is from the controller
This code basically sets up 2 drop downs to pick which organization you want to run a report for.
I knew it was slow, and I knew it was wrong, but I didn't know all the ways that it was wrong
got my first taste of poorly performing Rails code
I learned:
test with real data
review your queries
let the database do what it do
watch out for N+1 queries
avoid unnecessary columns
add indexes
optimize the page
lack of testing, leads to an odd pattern of reuse without refactoring or improving
It was a rewarding experience knowing that a few basic changes were now going to improve the performance in several places in the app, and make a lot of people very happy.
The next day they asked me if I could look into a discrepancy they had in the billing code.
This only occurs if they have to resubmit due to their own delay, and then only if they have more than one year ordered.
I fixed the issue, but then became ridiculously curious about how much this bug had cost.
Its not just having 2yrs, its having more than one, and there are several orders with 3 or 4yrs.
It was one of the first times I knew how much a bug cost, and could measure the return on the time it took to fix it.
i then became obsessed with knowing how much a unit of development was going to be worth.
It was a powerful feeling, to have real numbers.
This is info that the rest of the business world is used to having, and how McDonald's knows that it can sell 59cent cheesburgers.
What's the ROI?
When will we break even?
These 2 experiences, where I was able to observe massive improvements with a small but focused effort, encouraged me to seek out more opportunities to maximize return
Leverage is an important theme here. When it comes to making the right performance decisions, we want to use the greatest leverage, and get big gains for small effort.
Gzip is a great example of leverage
Open source software
Jake’s talk on metric_fu is a great example of leverage
Nick’s talk on improving test performance is extremely valuable
Improving performance is all about leverage, and its all about money
The major sites know this, and you can see it in the work they do.
Google just released instant search, because they know that faster search means more money
google includes it in their adwords calculation
velocity conference 2009
google did a similar experiment, adding a delay of only 400ms, and saw a .6% drop in searches, but most interestingly, even after they were done with the experiment,and removed the delay, those users still did significantly less searches,, showing that bad performance leaves a lasting impression
Yahoo also added 400ms delay, and saw a 5-9% drop in full page traffic, meaning that as soon as the users started to feel a slow experience, they killed the page and went somewhere else (something to think about if you are the #3 player)
http://www.phpied.com/the-performance-business-pitch/
Improving performance is all about leverage, and its all about money
The major sites know this, and you can see it in the work they do.
Google just released instant search, because they know that faster search means more money
google includes it in their adwords calculation
velocity conference 2009
google did a similar experiment, adding a delay of only 400ms, and saw a .6% drop in searches, but most interestingly, even after they were done with the experiment,and removed the delay, those users still did significantly less searches,, showing that bad performance leaves a lasting impression
Yahoo also added 400ms delay, and saw a 5-9% drop in full page traffic, meaning that as soon as the users started to feel a slow experience, they killed the page and went somewhere else (something to think about if you are the #3 player)
http://www.phpied.com/the-performance-business-pitch/
Shopzilla wasn't doing an experiment, they had a slow site and they needed to fix it
big comparison site
100mil impressions aday
8000 requests per sec
Improved response time from 6
down to 1.2
These slides from a deck that was put together for the purpose of explaining performance tuning to business users,
http://thinkvitamin.com/business/fred-wilsons-10-golden-principles-of-successful-web-apps/
Said what they look for in the web apps they invest in
"not just a feature, but the most critical feature"
especially true of non-power users, users that have a choice
As part of their due dillegence they investigate the speed of the app, and they continue to monitor it, like watching a stock ticker.
They know that when the app gets slow, less users use it.
Its a great video, you should check it out
Any discussion of performance monitoring or measurement is met with sneers and the oft quoted 'Premature optimization is the root of all evil'
http://wiki.parleys.com/display/PARLEYS/Home#talk=35061764;title=Common%20Performance%20Antipatterns
I like Donald Knuth
ka-nooth
http://www-cs-faculty.stanford.edu/~uno/faq.html
author of the are of software programming
its true, and its worth reminding ourselves.
We should forget about small efficiencies, say about 97% of the time: Premature optimization is the root of all evil
We should forget about small efficiencies, say about 97% of the time: Premature optimization is the root of all evil
some people quote it, and to them it means even thinking about performance is premature
Let's make a distinction between premature optimization, and baseline measuring.
we're gonna make sure we measure, and tackle the most critical problems
Measuring your performance is not premature optimization
Makes sense for capacity planning
SLA
Should line up with performance expectations of the project
You need to establish the expectations, state your assumptions, and keep an eye on things
why do people say that?
scalability is a term that is thrown around a lot, its meaning becomes unclear, and people make bad decisions because of it
Its possible to have an app with great performance, that can not scale
And its possible to have an app that scales, but its performance is horrible
We need to know what we are measuring
Today we're going to focus on Response time and Requests per second
why do people say that?
scalability is a term that is thrown around a lot, its meaning becomes unclear, and people make bad decisions because of it
Its possible to have an app with great performance, that can not scale
And its possible to have an app that scales, but its performance is horrible
why do people say that?
scalability is a term that is thrown around a lot, its meaning becomes unclear, and people make bad decisions because of it
10 workers = 20req sec
If latency goes up to a full sec...
Its possible to have an app with great performance, that can not scale
And its possible to have an app that scales, but its performance is horrible
This kind of queuing and delay is what we want to eliminate, it represents time not working, just waiting
Here's your typical stack
at each one of these layers there are performance considerations
Our goal will be to get each layer to do less work, and distribute the load from busy workers to not so busy workers
Traditionally, performance tuning focuses on the backend, as it is logical that dynamic data takes more effort to serve up
How do we know if our site is slow?
What is it doing?
waterfalls from
zoompf
How do we know if our site is slow?
What is it doing?
How do we know if our site is slow?
What is it doing?
steve souders
steve souders
http://stevesouders.com/cuzillion/
steve souders
now we have 2 tools that allow us to measure the speed of our app
anyone on the team can do it.
I encourage you to test out your apps, if you haven't already
look up your competition, industry, etc
You can ask showslow to check on a site for you everyday
There is so much to cover, and I want to make sure that everyone gets something valuable out of this talk, whether you are just starting out, or you work for Groupon, serving mils of hits a day.
My main objective is to help you get started. To know where to look, which tools to use, which techniques to investigate, and where to find the resources you need.
I won't be able to teach you everything about performance, but I can at least get you excited, and point you in the right direction.
If i don't teach you something new, or you don't get what you were looking for, please come up and talk to me. We can chat afterwards, if you have a specific issue, I'm sure I can help you out.
www.stubornella.org
netflix saw 43% decrease in bandwidth after they turned on compression
google ajax library allows you to load local files, great when you are on the train
to minimize delays due to network performance, and the browsers limitations on parallel downloads, we want to reduce http calls
google ajax library allows you to load local files, great when you are on the train
to minimize delays due to network performance, and the browsers limitations on parallel downloads, we want to reduce http calls
There is so much to cover, and I want to make sure that everyone gets something valuable out of this talk, whether you are just starting out, or you work for Groupon, serving mils of hits a day.
My main objective is to help you get started. To know where to look, which tools to use, which techniques to investigate, and where to find the resources you need.
I won't be able to teach you everything about performance, but I can at least get you excited, and point you in the right direction.
If i don't teach you something new, or you don't get what you were looking for, please come up and talk to me. We can chat afterwards, if you have a specific issue, I'm sure I can help you out.
no instrumentation
Rawk
Pl_analyze
Splunk
There is so much to cover, and I want to make sure that everyone gets something valuable out of this talk, whether you are just starting out, or you work for Groupon, serving mils of hits a day.
My main objective is to help you get started. To know where to look, which tools to use, which techniques to investigate, and where to find the resources you need.
I won't be able to teach you everything about performance, but I can at least get you excited, and point you in the right direction.
If i don't teach you something new, or you don't get what you were looking for, please come up and talk to me. We can chat afterwards, if you have a specific issue, I'm sure I can help you out.
Images from ihower presentation
Make sure you repeat their question
what we couldn't cover this time, but might make for the latter half of a full day's tutorial...