"I've seen things you wouldn't believe," but every wise developer knows there's no shame in the performance game. The only way to learn is by doing. This year we implemented New Relic's Pro-level APM service across thousands of websites. With access to the details of their performance at scale we can learn truths with statistical significance. Here are our early findings. This is available on video here: https://2016.badcamp.net/session/drupal-performance-census-lessons-over-2500-sites

1. Drupal Performance
Census: Live Lessons
From Over 2000 Sites
1

2. Josh Koenig
Co-Founder
Head of Product
pantheon.io
drupal.org/user/3313
@outlandishjosh
2

3. 3

4. 4
Efficient Dev Teams + Elastic Platform

5. 5

6. 6

7. 7

8. 8

9. 9

10. Pantheon.io
Traditional Hosting
Even “fanatical” support
can’t help with your app.
Happy to reboot the box!
CMS Support Spectrum: What’s Missing?
10
“IaaS”
On your own vs the
Zombie Apocalypse.
Good luck!
Managed CMS
Sacrifice developer velocity to
“guarantee” the application.
Sorry, you can’t deploy that.

11. Pantheon.io
Traditional Hosting
Even “fanatical” support
can’t help with your app.
Happy to reboot the box!
CMS Support Spectrum: What’s Missing?
11
“IaaS”
On your own vs the
Zombie Apocalypse.
Good luck!
Managed CMS
Sacrifice developer velocity to
“guarantee” the application.
Sorry, you can’t deploy that.
?

12. 12
There’s a better way to do this...

13. Pantheon.io
New Relic APM Pro: Launched June 26th
13

14. 14

15. 15

16. 16

17. Pantheon.io
How the Data Flows
17
PHP
new_relic.so
Data Cloud
rpm.newrelic.com
Collector
newrelic.daemon
On Pantheon In New Relic

18. Pantheon.io
What That Looks Like
18

19. Pantheon.io
New Relic Measures App Execution
19

20. Pantheon.io
Reverse-Proxy is Effectively Light-Speed
20

21. Pantheon.io
This Is Where The APM Action Is
21

22. 22

23. 23

24. 24

25. 25

26. 26

27. Get the Data Already!
27

28. Pantheon.io
Census Methodology
● Actual Population: ~2000 sites ~3M transactions
● Mid-day one-hour data samples
● Queried out of New Relic’s API and then stored in MySQL
● Data Captured:
⌾ Total Throughput & response time
⌾ Query count & response time
⌾ External call count & response time
⌾ Views call count & response time
28

29. 29

30. 30
Only the names have
been changed, to
protect the innocent.
Just the facts,
maam. Just the
facts.

31. Pantheon.io
On Average: pretty good!
31

32. Pantheon.io
On Average: pretty good!
32

33. Pantheon.io
But… Painfully Slow at Times
33

34. Pantheon.io
Throughput and Performance Correlate
34

35. Pantheon.io
I/O is Still The Big Pain Point
> SELECT name, call_count, average_response_time, nrm.max_response_time FROM
New_relic_metrics WHERE application_id = 513593
+-------------------------+------------+-----------------------+-------------------+
| name | call_count | average_response_time | max_response_time |
+-------------------------+------------+-----------------------+-------------------+
| WebTransactionTotalTime | 4628 | 2570 | 426000.0000 |
| External/all | 7236 | 317 | 5000.0000 |
| Datastore/MySQL/all | 858749 | 1 | 1120.0000 |
| Datastore/Redis/all | 1757799 | 1 | 426.0000 |
+-------------------------+------------+-----------------------+-------------------+
35

36. Pantheon.io
Views Isn’t a Kiss of Death
36

37. Pantheon.io
Views Isn’t a Kiss of Death
37

38. Pantheon.io
Views Isn’t a Kiss of Death
38

39. Pantheon.io
SQL Queries vs Avg Page Response
39

40. 40

41. Pantheon.io
External API Calls
41

42. Pantheon.io
External API Calls
42

43. 43

44. 44

45. Pantheon.io
Long Loops and PHP Can Also Kill You
45
● Page responses 30s +
● No significant DB activity
● No web external calls
● ??????
● Stack trace shows lots of
calls to form cache
● One REST API endpoint
rendering ~1500 nodes
(including building edit
forms)

46. Looking Ahead
46

47. Pantheon.io
PHP 7 is Full of Win
47

48. Pantheon.io
PHP 7 is Full of Win
48

49. Pantheon.io
LCache is (potentially) full of win
49

50. Pantheon.io
LCache is (potentially) full of win
50

51. Pantheon.io
● Gather more data on Drupal 8
● Identifying modules associated w/slowness
● Build/measure/learn on core improvements
Future Data Spelunking
51

52. Questions?
52