We will explain the purpose of the PMWG farm and the current goals we have (e.g. collect power measurements, share reference platforms, monitor power trends of the kernel). We will also address the limitations of our farm and invite everyone to discuss which results should be displayed for further analysis.

1. Presented by
Date
Event
PMWG Farm
Introduction to our testing farm
Lisa Nguyen
Vincent Guittot
BKK16-506 March 11, 2016
Linaro Connect BKK16

2. Agenda
● Introduction
● Purpose
● Setup
● Advantages
● Limitations
● Test results
● Next steps

3. Purpose
● Have a low-cost efficient way to share
reference boards with everyone in the Power
Management Working Group (PMWG)
● Automate benchmarking process

4. Setup
● Boards
○ Mediatek, TC2, Pandaboard
○ Kernels on the platforms
■ Android
■ Ubuntu
■ Mainline
● Server
○ Debian
○ Tools
■ Workload Automation (WA) test framework
■ arm-probe command-line tool
○ Equipment
■ ARM Energy Probes
■ PCBs with shunt resistor

5. Advantages
● Everyone who uses the farm will work with
the same setup
○ Easier to compare results
● Improve Linux support on WA

6. Limitations
● PMWG farm is currently managed by
another team
○ Response time to our requests varies
● Multiple users running tests at the same time
○ No easy way to communicate who is using what
board and length of test runs vary

7. Sample Benchmarks
● ebizzy
● hackbench
● cyclictest
● sysbench
● rt-app

8. Test Results
● Two level perspective
○ High level view: Gives a trend, ideally one number
○ Low level view: Give details for internal use and
debug

9. Next steps
● Add more boards
● Define metrics for reporting
● Continuous testing on various kernels
● Provide a global trend and per area trend

10. Discussion
● How can we make the farm useful to
improve your workflow?