FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

190 views

Published on

Honza Koudelka präsentiert an der FileMaker Konferenz 2016 einen Performance Test für FileMaker 15

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
190
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
16
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

  1. 1. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 www.filemaker-konferenz.com Every time a new version of the FileMaker platform is released you have to make the decision when it is safe to upgrade and what changes you have to prepare for. One of the areas to consider is performance. To make it easier for you to get ready for the upgrade to FileMaker 15, HOnza and his team have tested the performance of the new version and compared it to the versions 12, 13, and 14 running under the same conditions. Not surprisingly, some things have become faster and some have become slower. Learn the freshest test results, so that you can make well informed decisions about your own projects. FileMaker 15 Performance Test Results
  2. 2. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Co-founder and co-owner of 24U Software,
 FBA Platinum Member • Developing FileMaker solutions since 1991 • FileMaker 8, 10, 11, 12, 13, 14, and 15
 Certified Developer • Winner of the FileMaker DevCon 2015 Developer Cup • FileMaker Mad Dog Award 2011 winner • Mad Optimizer and achiever of the impossible… • Vendor session speaker at FileMaker DevCon, spoke at Pause[x]London and Pause[x]Berlin, and remotely at PauseOnError Portland HOnza Koudelka
  3. 3. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Mac Pro (early 2008) • 2 x 2,8 GHz Intel Xeon • 8 GB RAM • Separate hard drive for data • Mac OS X 10.11.6 El Capitan • Windows Server 2012 R2 • MacBook Pro 15” mid 2012 as client for WAN testing • VDSL 20Mbps/2Mbps for WAN testing • FileMaker Server versions 14, 15v1, 15v2 • FileMaker Pro Advanced 12, 13, 14, 15v1, 15v2 Test Equipment
  4. 4. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Updated WhatIsFaster.fmp12 originally created for FileMaker DevCon 2013 • Automated test scripts running at least three times with the same test data • Unattended computer with disabled screensaver and energy saver • Perform Script On Server for server performance testing • Random generated data o different types and sizes (except for containers) • Random substrings from a 297840 characters long “Lorem Ipsum” test text Test Solution
  5. 5. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Export Records as tab delimited text • Import Records from tab delimited text • Sort Records • by indexed field • by unindexed field • Perform Find • indexed vs unindexed field • small vs large result found set • Position vs PatternCount • Replace Field Contents vs Looped Set Field • Summary fields vs Aggregate functions vs ExecuteSQL • Delete All Records, Truncate Table, Delete All Found Records (leaving one record) • Popup vs Dropdown rendering What was tested 4385 tests this week
  6. 6. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Multiple users • Multiple concurrent tasks • Working with container fields • Exact amounts of data transferred between client and server • FileMaker Go • FileMaker WebDirect • XML / PHP / ODBC / JDBC connections • Two-machine deployment • FileMaker Server with enabled SSL • Server-side schedules, including backup schedules • Different cache sizes and other configuration differences What was NOT tested
  7. 7. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What does FAST look like?
  8. 8. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Which Pro Advanced is the fastest? 12 13 14 15v1 15v2
  9. 9. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What has become faster?
  10. 10. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Same speed since FileMaker 13
  11. 11. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What has become slower?
  12. 12. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What has become slower?
  13. 13. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher The biggest surprise
  14. 14. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Test I did for FileMaker DevCon 2016
  15. 15. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Test I did for FileMaker DevCon 2016
  16. 16. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • All tests conducted for FileMaker Konferenz worked with up to 100 000 records • Test done for FileMaker DevCon worked with 1 000 000 (1 million) records • In both cases I was only modifying 5 000 records Error or shocking truth? Let’s do some more testing!
  17. 17. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher One more thing…
  18. 18. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Which FileMaker Server? 14 15v1 15v2
  19. 19. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What has become faster?
  20. 20. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher What has become slower? Nothing noticeable with the test data and environment I have used
  21. 21. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher The biggest surprise
  22. 22. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • FileMaker Developer since FileMaker II • Former trials rider • Mechanical engineer • Inventor of the Virtual List technique Bruce Robertson
  23. 23. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Game Changer for Virtual List FM14 w/o VL FM14 w/ VL FM15 w/o VL FM15 w/ VL Load local record data Populate portal Interact with layout
  24. 24. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • Some things remained equally fast • Some things became faster • Some things became slower • Something new could become a bottleneck in your solution Conclusion
  25. 25. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher So, should I upgrade or not? What’s your solution’s bottleneck? Is it slower in 15? Upgrade Optimize No Yes Applies if performance is your main or the only concern
  26. 26. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Brain Exercise
  27. 27. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Client or Server?
  28. 28. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Client or Server?
  29. 29. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Client or Server?
  30. 30. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Client or Server?
  31. 31. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Client or Server?
  32. 32. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher When to use Perform Script on Server?
  33. 33. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher When to use Perform Script on Server?
  34. 34. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher When to use Perform Script on Server?
  35. 35. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher When to use Perform Script on Server?
  36. 36. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher When to use Perform Script on Server?
  37. 37. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Found Count vs Total Record Count
  38. 38. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Found Count vs Total Record Count
  39. 39. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Found Count vs Total Record Count
  40. 40. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Field indexing
  41. 41. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Sort Records
  42. 42. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Perform Find
  43. 43. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • This presentation as PDF • Recording of this session • The Test Solution I used (WhatIsFaster.fmp12) • Test Results Database with all 4 385 test results & chart generator • Modified version of 24U FM Bench with my DevCon 2016 reports Available after the conference I will appreciate if you conduct your own tests and send me your results to honza@24uSoftware.com
  44. 44. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher • FileMaker Community > Discussions > Performance • FileMaker DevCon Session Recordings (available on YouTube) • Performance related sessions • Under the Hood sessions • FM Academy & Skeleton Key webinars (FMAcademy.com) • “Designing for WAN Peformance” • FileMaker Optimizers LinkedIn Group (FMOptimizers.com) • 24U FM Bench (FMBench.com) • Big-O Cheat Sheat (bigocheatsheet.com) • A Gentle Introduction to Algorithm Complexity Analysis (discrete.gr/complexity/) More resources
  45. 45. 7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016 Vortrag und Sprecher Vielen Dank unseren Sponsoren Danke für das Bewerten dieses Vortrages

×