Uploaded byJohn Allspaw
Operational Efficiency Hacks Web20 Expo2009
The document discusses operational efficiency hacks for systems operations. It provides examples of optimizations that can be made through software changes like upgrading versions or compilers, hardware changes by upgrading equipment, and reusing old hardware for offline tasks. Specific optimizations discussed include upgrading image processing software and compilers, performing diagonal scaling by replacing older servers with more powerful new ones, and using old servers for an offline queuing system. The overall message is that ongoing optimizations through both software and hardware changes can help systems do more work with fewer resources.
In this document
Powered by AI
Focus on operational efficiency, optimization rules, and practical challenges at Flickr's infrastructure.
Discusses infrastructure hacks, including software changes and hardware upgrades that enhance performance.
Improvements in image processing by transitioning from ImageMagick to GraphicsMagick, focusing on speed and efficiency.
Details on how diagonal scaling reduced power consumption and increased performance by replacing old servers.
Discusses strategies for handling outdated machines through liquidation and repurposing.
Implementation of an asynchronous queuing system for managing non-realtime tasks efficiently.
The importance of automated configuration and deployment management in maintaining efficiency.
Introduction to aggregate monitoring and self-healing mechanisms to manage failures autonomously.
Strategies for internal communications, logging, and essential information sharing within teams.
Final thoughts on weighing optimization efforts against potential gains based on experience.
More Related Content
![[AKIBA.AWS] EC2の基礎 - パフォーマンスを100%引き出すオプション設定 -](https://cdn.slidesharecdn.com/ss_thumbnails/akibaaws01-170901004726-thumbnail.jpg?width=640&height=640&fit=bounds)
![제 19회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [백발백준] : 백준봇 : 컨테이너 오케스트레이션 기반 백준 문제 추천 봇](https://cdn.slidesharecdn.com/ss_thumbnails/random-240209055922-328cce98-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Operational Efficiency Hacks Web20 Expo2009
Editor's Notes
- #8 Finding huge gains from tweaking gets harder as you turn the knobs and pull the levers.
- #24 He had some evidence that suggested compilers and versions would make a difference for PHP.
- #25 So, we did it. (not just for performance reasons, but still...) Will this happen to you, too? Maybe. Maybe not.
- #26 Performance gains like this don’t come very often, for “free”.
- #27 We don’t need 80% of what ImageMagick has.
- #28 We don’t need 80% of what ImageMagick has.
- #29 We don’t need 80% of what ImageMagick has.
- #31 Cascading resizing: Original -> Large Large -> Medium Large -> Small Medium -> Thumb Medium -> Square
- #32 This was done before OpenMP support was in. Compilers and optimization flags can make a difference!
- #33 Enter OpenMP. Example of how
- #34 These have been the revisions of our image processing hardware over time. 4x faster
- #49 Examples are contact notifications, large photoset deletions, etc.
- #50 Examples are contact notifications, large photoset deletions, etc.
- #51 Examples are contact notifications, large photoset deletions, etc.
- #52 Examples are contact notifications, large photoset deletions, etc.
- #53 Examples are contact notifications, large photoset deletions, etc.
- #54 Examples are contact notifications, large photoset deletions, etc.
- #55 Runbook hacks: tuning the process of operations failure handling and mitigation.
- #66 Low water marks as indirect trouble indicators.
- #67 Low water marks as indirect trouble indicators.
- #68 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #69 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #70 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #71 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #72 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #73 Can be as simple as cron jobs, or nagios plugins. NRPE or NSCA.
- #83 Skippable errors: “can’t drop”, “already exists”, “duplicate key name”
- #84 Skippable errors: “can’t drop”, “already exists”, “duplicate key name”
- #85 Skippable errors: “can’t drop”, “already exists”, “duplicate key name”
- #86 Skippable errors: “can’t drop”, “already exists”, “duplicate key name”
- #87 Simple tips and tricks that can help in fixing things when they break.
- #88 This shouldn’t be considered optional.
- #89 This shouldn’t be considered optional.
- #100 Our IRC and IM logs get injected into a search engine, almost exactly like Lucene.
- #101 Our IRC and IM logs get injected into a search engine, almost exactly like Lucene.
- #102 Our IRC and IM logs get injected into a search engine, almost exactly like Lucene.
- #103 Our IRC and IM logs get injected into a search engine, almost exactly like Lucene.