Making more informed Linux hardware Choices - Phoronix


Published on

Presentation by Michael Larabel & Matthew Tippet at SCALE. Available at:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Making more informed Linux hardware Choices - Phoronix

  1. 1. Making More InformedLinux Hardware Choices With Phoronix Test Suite 3.0 and Michael Larabel & Matthew Tippett
  2. 2. Evolution Of Linux Hardware Support Linux hardware support has improved a lot over the years. Most hardware now works "out of the box" with new distributions. Theres still troublesome areas (mainly graphics processors, select motherboard, peripherals). With the maturity of Linux has also come new problems: multiple drivers covering the same hardware and offering different features/performance, different tuning options, and optimizations/completeness of the driver. There will always be the challenges that face even Windows users: what component to upgrade, finding the hardware thats the best value
  3. 3. The Phoronix Ecosystem was founded in 2004. Phoronix Test Suite 1.0 was publicly released in 2008.Our Software Ecosystem: Phoronix Test Suite OpenBenchmarking Phoromatic
  4. 4. The EcosystemPhoronix Test SuiteTesting & Benchmarking Platform Cross Platform PHP based solution Local and cloud based results aggregation Runs on Linux, Mac OS X, Solaris, BSD, Windows Available natively on almost all distributionsSince Inception in 2008 More than 38,000 results shared on Phoronix Global Used near universally by Tier-1 IHVs, ISVs, other organizations More than 72,000 individual systems activated on PTS
  5. 5. The EcosystemOpenBenchmarking.orgCollaborative benchmarking platform (launching today!)Allowing users to compare their platform against thousands ofother users.Allowing projects and companies to crowd source performanceand functional testing over hundreds or thousands of usersAll driven by Phoronix Test Suite 3.0.
  6. 6. The EcosystemPhoromaticCoordinated, remote test execution across a number ofsystems.Automatically directs clients to switch between configurationstates to allow ongoing automated testing.Can be configured to automatically detect regressing behaviorsacross suites.
  7. 7. So you are looking for new hardware... So many choices.
  8. 8. Lots of QuestionsDoes it work?How fast is it?How do I make my system faster?
  9. 9. Does it work?Google, Google, GoogleWeve all done it.1. Google for hardware2. Read, read, read3. Download, compile4. Cross fingers5. Hope for a good return policy.You are really relying on the success of other usersdocumenting what they didOver time, the distributions make it easy, but new hardwaremeans a lot of research.
  10. 10. Does it work?Hardware Compatibility ListsDistribution Vendors such as SuSE, Red Hat and Canonicalmaintain large lists of products that are "certified"Certification usual means it kind of works (?) the manufacturer has requested the certification.Unfortunately, there are no standardized tests It "works" for graphics may mean just pixels on the screen with the VESA driver.HCLs provide some value, but dont guarantee experience
  11. 11. Does it work?OpenBenchmarking searchesExistent proof that the system with that hardware works and anindication of the configurations that showed the hardwareworking.
  12. 12. Does it work?OpenBenchmarking searchesLots of tests to explore
  13. 13. Does it work?OpenBenchmarking searchesNews articles to read, both Linux orientedand general
  14. 14. How fast is it? PerformanceSearch for Hardware, get some benchmarks.
  15. 15. How fast is it? HeatmapsFor a given test... There area lot of results.Collapse these against time,and you get a histogram witha particular distribution.
  16. 16. How fast is it? HeatmapsHistograms provide sparseinformation and are kind ofboring if we had lots of them.Weve created an alternateview of the histogram - theOPC Heatmap
  17. 17. How fast is it?OpenBenchmarking Performance ClassificationOPC allows you in a snapshot understand where your results sitagainst other systems in the OpenBenchmarking database.This system is a "High" performer in encoding. Ranked performance 33rd 66th percentile percentile
  18. 18. How fast is it?Understand your hardwares performance
  19. 19. How fast is it?Understand your hardwares performanceAt a glance, you can see that this system is a "High" performingsystem, always above the 66th percentile.But... The filesystem performance is "Low"... Maybe a badfilesystem?
  20. 20. How fast is it?How does it compare?Find your hardwareFilter for your test
  21. 21. How fast is it?How does it compare?Find how you stack upFind some comparative testsSee how that hardware stacks up
  22. 22. What else can I do?CompilersMaybe the Gentoo crowd is onto something after all
  23. 23. What else can I do?New HardwareUpgrade the GPU or switch drivers?
  24. 24. Future StandardizationOPC SuiteStandard suite that exercises the primary attributes of asystem.Trivially executable by any user.Provides a standard performance benchmark that fits into theOPC groupings.
  25. 25. Future StandardizationPCQS SuitePhoronix Certification and Qualification Suite (PCQS)Formal validation of a system across a number of functionaland system performance areas.Provides a very high confidence that a system will work.
  26. 26. Future WorkVirtual Build-a-systemGiven a particular set of components, explore other systemsthat contain similar hardware.Burrow down to a particular set of components that maximizeperformance.
  27. 27. Future WorkVirtual Build-a-systemGiven a particular set of components, explore other systemsthat contain similar hardware.Burrow down to a particular set of components that maximizeperformance.
  28. 28. Future WorkCrowd Sourced Validation & BenchmarksOpen Source projects can trivially define a suite to be executedby their users.Email the users to run a benchmark command, PTS takes careof the hard work, OpenBenchmarking gives a view of therelative behavior of a large portion of the user base.No longer do developers need to be tied to their own PCs.
  29. 29. Future WorkHighly interactive comparisonsTaking the scenario described above and making it fullyinteractive across the entire discovery process.
  30. 30. Future WorkAutomated Regression Identification SystemSimilar to git-bisect, PTS can run a collection of automatedtests across a set of builds and determine a break point.
  31. 31. Questions?Phoronix Test Suite - - - Larabel - michael@phoronix.comMatthew Tippett -