FirebirdJapanUsersAssociation TsutomuHayashi Firebird2.5 BenchMarks - Performance VS MySQL / PostgreSQL -
DBBench  pgbench(PostgreSQL) port for Firebird/MySQL Delphi + dbExpress Mutli Thread impliment Change dbExpress drivers enables for other RDBMSs Same code/Same binary testing for Firebird/MySQL/PostgreSQL Using GUI for easy use Most easiest Database Benchmark Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
TPC-B TPC is the benchmark tests definition by " Transaction Processing Performanc Counsil" TPC-B is defined at 1990, deplicated 1995 This test assume batch operation with many parallel transactions.  Simulation dealing account between branches in bank. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
TPC-B Usin 4 tables create table branches(bid int not null,bbalance int,filler char(88)); create table tellers(tid int not null,bid int,tbalance int,filler char(84)); create table accounts(aid int not null,bid int,abalance int,filler char(84)); create table history(tid int,bid int,aid int,delta int,mtime timestamp,filler char(22)) Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
TPC-B Processing is update accounts set abalance = abalance + :delta where aid = :aid; select abalance from accounts where aid = :aid; update tellers set tbalance = tbalance + :delta where tid = :tid; update branches set bbalance = bbalance + :delta where bid = :bid; insert into history(tid,bid,aid,delta) values(:tid,:bid,:aid,:delta); Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Scaling Factor Scaling factor is test scale Scaling factor affects Branch count equals scaling factor Teller count is scaling factor * 10 Account count is scaling factor * 100,000 So I use scaling factor 100 Branch is 100, Teller is 1000, Accounts is 10,000,000 Firebird database almost 600MB, MySQL is almost 1.2GB Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Copyright(c) 2009 Tsutomu Hayashi All rights reserved. Benchmark Environment HP  ML115G5 AMD AthlonTM 1640B ( 2.7GHz ) AMD PhenomTM 9350e ( 2.0GHz ) ECC 512MB DDR2-6400 Non-ECC 4GB DDR2-6400 HDD is standard SATA160GB
Firebird 2.1SS vs Firebird 2.5SS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Firebird 2.1CS vs Firebird 2.5CS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Firebird 2.1SS vs Firebird 2.5 SC Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Firebird 2.1SS vs Firebird 2.5SS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux draw Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Firebird 2.1CS vs Firebird 2.5CS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Firebird 2.1SS vs Firebird 2.5SC Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
MySQL 5.1 vs Firebird 2.5SC MySQL5.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
MySQL 5.1 vs Firebird 2.5SC MySQL5.1 vs  Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
MySQL 5.1 vs Firebird 1.5SS MySQL5.1 vs Firebird2.5  Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux draw Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
PostgreSQL 8.4.1 vs Firebird 2.5CS PostgreSQL8.4 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
PostgreSQL 8.4.1 vs Firebird 2.5CS PostgreSQL8.4 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
on Linux, Firebird is very slow!! Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Ext3  vs  XFS I assume Filesystem? Using Fire bird2.5SC Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Linux+XFS is very Fast! Test with XFS for many clients Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Results   Benchmarks are rough estimation at all.   Firebird2.5 is very fast than other RDBMSs.   Normaly running many clients over 500 . Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
Coming Soon Japanese publisher "Shoei-sya" will publish new Firebird book in Japan at December 2009. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Firebird2.5 Benchmarks(English)20091031

  • 1.
    FirebirdJapanUsersAssociation TsutomuHayashi Firebird2.5BenchMarks - Performance VS MySQL / PostgreSQL -
  • 2.
    DBBench pgbench(PostgreSQL)port for Firebird/MySQL Delphi + dbExpress Mutli Thread impliment Change dbExpress drivers enables for other RDBMSs Same code/Same binary testing for Firebird/MySQL/PostgreSQL Using GUI for easy use Most easiest Database Benchmark Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 3.
    TPC-B TPC isthe benchmark tests definition by " Transaction Processing Performanc Counsil" TPC-B is defined at 1990, deplicated 1995 This test assume batch operation with many parallel transactions. Simulation dealing account between branches in bank. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 4.
    TPC-B Usin 4tables create table branches(bid int not null,bbalance int,filler char(88)); create table tellers(tid int not null,bid int,tbalance int,filler char(84)); create table accounts(aid int not null,bid int,abalance int,filler char(84)); create table history(tid int,bid int,aid int,delta int,mtime timestamp,filler char(22)) Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 5.
    TPC-B Processing isupdate accounts set abalance = abalance + :delta where aid = :aid; select abalance from accounts where aid = :aid; update tellers set tbalance = tbalance + :delta where tid = :tid; update branches set bbalance = bbalance + :delta where bid = :bid; insert into history(tid,bid,aid,delta) values(:tid,:bid,:aid,:delta); Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 6.
    Scaling Factor Scalingfactor is test scale Scaling factor affects Branch count equals scaling factor Teller count is scaling factor * 10 Account count is scaling factor * 100,000 So I use scaling factor 100 Branch is 100, Teller is 1000, Accounts is 10,000,000 Firebird database almost 600MB, MySQL is almost 1.2GB Copyright(c) 2008 Tsutomu Hayashi All rights reserved. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 7.
    Copyright(c) 2009 TsutomuHayashi All rights reserved. Benchmark Environment HP ML115G5 AMD AthlonTM 1640B ( 2.7GHz ) AMD PhenomTM 9350e ( 2.0GHz ) ECC 512MB DDR2-6400 Non-ECC 4GB DDR2-6400 HDD is standard SATA160GB
  • 8.
    Firebird 2.1SS vsFirebird 2.5SS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 9.
    Firebird 2.1CS vsFirebird 2.5CS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 10.
    Firebird 2.1SS vsFirebird 2.5 SC Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 11.
    Firebird 2.1SS vsFirebird 2.5SS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux draw Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 12.
    Firebird 2.1CS vsFirebird 2.5CS Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 13.
    Firebird 2.1SS vsFirebird 2.5SC Firebird2.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 14.
    MySQL 5.1 vsFirebird 2.5SC MySQL5.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 15.
    MySQL 5.1 vsFirebird 2.5SC MySQL5.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 16.
    MySQL 5.1 vsFirebird 1.5SS MySQL5.1 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux draw Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 17.
    PostgreSQL 8.4.1 vsFirebird 2.5CS PostgreSQL8.4 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Windows Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 18.
    PostgreSQL 8.4.1 vsFirebird 2.5CS PostgreSQL8.4 vs Firebird2.5 Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 19.
    on Linux, Firebirdis very slow!! Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 20.
    Ext3 vs XFS I assume Filesystem? Using Fire bird2.5SC Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 21.
    Linux+XFS is veryFast! Test with XFS for many clients Copyright(c) 2008 Tsutomu Hayashi All rights reserved. @Linux Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 22.
    Results   Benchmarksare rough estimation at all.   Firebird2.5 is very fast than other RDBMSs.   Normaly running many clients over 500 . Copyright(c) 2009 Tsutomu Hayashi All rights reserved.
  • 23.
    Coming Soon Japanesepublisher "Shoei-sya" will publish new Firebird book in Japan at December 2009. Copyright(c) 2009 Tsutomu Hayashi All rights reserved.