FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016
www.filemaker-konferenz.com
Every time a new version of the FileMaker platform is released you have to make the
decision when it is safe to upgrade and what changes you have to prepare for. One of the
areas to consider is performance. To make it easier for you to get ready for the upgrade to
FileMaker 15, HOnza and his team have tested the performance of the new version and
compared it to the versions 12, 13, and 14 running under the same conditions. Not
surprisingly, some things have become faster and some have become slower. Learn the
freshest test results, so that you can make well informed decisions about your own projects.
FileMaker 15 Performance Test Results

Vortrag und Sprecher
• Co-founder and co-owner of 24U Software, 
FBA Platinum Member

• Developing FileMaker solutions since 1991

• FileMaker 8, 10, 11, 12, 13, 14, and 15 
Certified Developer

• Winner of the FileMaker DevCon 2015 Developer Cup

• FileMaker Mad Dog Award 2011 winner

• Mad Optimizer and achiever of the impossible…

• Vendor session speaker at FileMaker DevCon, spoke
at Pause[x]London and Pause[x]Berlin, and remotely
at PauseOnError Portland
HOnza Koudelka

• Mac Pro (early 2008)

• 2 x 2,8 GHz Intel Xeon

• 8 GB RAM

• Separate hard drive for data

• Mac OS X 10.11.6 El Capitan

• Windows Server 2012 R2

• MacBook Pro 15” mid 2012 as client for WAN testing

• VDSL 20Mbps/2Mbps for WAN testing

• FileMaker Server versions 14, 15v1, 15v2

• FileMaker Pro Advanced 12, 13, 14, 15v1, 15v2
Test Equipment

• Updated WhatIsFaster.fmp12 originally
created for FileMaker DevCon 2013

• Automated test scripts running at least
three times with the same test data

• Unattended computer with disabled
screensaver and energy saver

• Perform Script On Server for server
performance testing

• Random generated data o different
types and sizes (except for containers)

• Random substrings from a 297840
characters long “Lorem Ipsum” test text
Test Solution

• Export Records as tab delimited text

• Import Records from tab delimited text

• Sort Records

• by indexed field

• by unindexed field

• Perform Find

• indexed vs unindexed field

• small vs large result found set

• Position vs PatternCount

• Replace Field Contents vs Looped Set Field

• Summary fields vs Aggregate functions vs ExecuteSQL

• Delete All Records, Truncate Table, Delete All Found Records (leaving one record)

• Popup vs Dropdown rendering
What was tested
4385

tests

this week

• Multiple users

• Multiple concurrent tasks

• Working with container fields

• Exact amounts of data transferred between client and server

• FileMaker Go

• FileMaker WebDirect

• XML / PHP / ODBC / JDBC connections

• Two-machine deployment

• FileMaker Server with enabled SSL

• Server-side schedules, including backup schedules

• Different cache sizes and other configuration differences
What was NOT tested

What does FAST look like?

Which Pro Advanced is the fastest?
12 13 14 15v1
15v2

What has become faster?

Same speed since FileMaker 13

What has become slower?

The biggest surprise

Test I did for FileMaker DevCon 2016

• All tests conducted for FileMaker Konferenz worked with up to 100 000 records

• Test done for FileMaker DevCon worked with 1 000 000 (1 million) records

• In both cases I was only modifying 5 000 records
Error or shocking truth?
Let’s do some more testing!

One more thing…

Which FileMaker Server?
14 15v1 15v2

What has become slower?
Nothing noticeable

with the test data

and environment

I have used

• FileMaker Developer since FileMaker II

• Former trials rider

• Mechanical engineer

• Inventor of the Virtual List technique
Bruce Robertson

Game Changer for Virtual List
FM14 w/o VL
FM14 w/ VL
FM15 w/o VL
FM15 w/ VL
Load
local
record
data
Populate
portal
Interact
with
layout

• Some things remained equally fast

• Some things became faster

• Some things became slower

• Something new could become a bottleneck in your solution
Conclusion

So, should I upgrade or not?
What’s your solution’s bottleneck?
Is it
slower in 15?
Upgrade
Optimize No
Yes
Applies if
performance
is your main
or the only
concern

Brain Exercise

Client or Server?

When to use Perform Script on Server?

Found Count vs Total Record Count

Field indexing

Sort Records

Perform Find

• This presentation as PDF

• Recording of this session

• The Test Solution I used (WhatIsFaster.fmp12)

• Test Results Database with all 4 385 test results & chart generator

• Modified version of 24U FM Bench with my DevCon 2016 reports
Available after the conference
I will appreciate if you conduct your own tests

and send me your results to

honza@24uSoftware.com

• FileMaker Community > Discussions > Performance

• FileMaker DevCon Session Recordings (available on YouTube)

• Performance related sessions

• Under the Hood sessions

• FM Academy & Skeleton Key webinars (FMAcademy.com)

• “Designing for WAN Peformance”

• FileMaker Optimizers LinkedIn Group (FMOptimizers.com)

• 24U FM Bench (FMBench.com)

• Big-O Cheat Sheat (bigocheatsheet.com)

• A Gentle Introduction to Algorithm Complexity Analysis (discrete.gr/complexity/)
More resources

Vielen Dank unseren Sponsoren
Danke für das Bewerten dieses Vortrages

FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

Recommended

More Related Content

What's hot

What's hot(13)

Viewers also liked

Viewers also liked(13)

Similar to FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

Similar to FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results(20)

More from Verein FM Konferenz

More from Verein FM Konferenz(20)

Recently uploaded

Recently uploaded(20)

FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results