Harry Potter and the Daemons of Berkeley
Alex Chistyakov, Principal Engineer at Git in Sky
Jul 07 2016, PgDay, Saint-Petersburg
Who we are
●
A small consulting company from Spb., Russia
●
Elephant groomers
●
Ops engineers, performance tuners
●
We also walk dogs
Who are you
●
People smart enough to be DBAs?
●
People smart enough to be DBDs?
●
People smart enough to prefer PostgrteSQL?
●
MySQL users, anyone?
Important information
●
Frankly speaking, I am quite dumb
Important information
●
Frankly speaking, I am quite dumb
●
I don’t sleep enough to get even dumber
Important information
●
Frankly speaking, I am quite dumb
●
I don’t sleep enough to get even dumber
●
I can’t cope with elite software, e.g. MS Windows
Important information
●
Frankly speaking, I am quite dumb
●
I don’t sleep enough to get even dumber
●
I can’t cope with elite software, e.g. MS Windows
●
MS Windows is much smarter than me
Important information
●
Frankly speaking, I am quite dumb
●
I don’t sleep enough to get even dumber
●
I can’t cope with elite software, e.g. MS Windows
●
MS Windows is much smarter than me
●
I prefer Linux and open source
Important information
●
Frankly speaking, I am quite dumb
●
I don’t sleep enough to get even dumber
●
I can’t cope with elite software, e.g. MS Windows
●
MS Windows is much smarter than me
●
I prefer Linux and open source
●
At least I can get high and read source code a bit
Enough on me, fight!
●
Ubuntu Linux (dumb as me)
●
FreeBSD (a lot smarter)
●
Gentoo Linux (elite stuff)
Hardware
●
Dell R430
●
192Gb RAM
●
PERC H730 mini
●
Two Edge Boost Pro P SSDs in RAID1
●
2 x Xeon(R) CPU E5-2630 v3 @ 2.40GHz
Software
●
PostgreSQL
●
Minimal tuning (checkpoint-related)
●
As always:
●
pgbench -i -s 1000 --foreign-keys pgbench
●
pgbench -T 300 -P 10 -c N -j N -r pgbench
●
Synchronous commit
●
Asynchronous commit
Ubuntu Linux, sync commit
●
ext4, data=ordered, barrier, relatime (defaults, no
tuning)
●
N=1, 1397 tps
●
N=4, 3928 tps
●
N=8, 6559 tps
●
N=12, 8132 tps
Ubuntu Linux, async commit
●
N=1, 1609 tps
●
N=4, 5432 :) tps
●
N=8, 9068 tps
●
N=12, 10321 tps
FreeBSD (UFS/SU), sync commit
●
N=1, 1196 (Ubuntu: 1397) tps
●
N=4, 2819 (Ubuntu: 3928) tps
●
N=8, 3430 (Ubuntu: 6559) tps
●
N=12, 3785 (Ubuntu: 8132) tps
FreeBSD (UFS/SU), async commit
●
N=1, 1614 (Ubuntu: 1609) tps
●
N=4, 3783 (Ubuntu: 5432) tps
●
N=8, 3981 (Ubuntu: 9068) tps
●
N=12, 4791 (Ubuntu: 10321) tps
FreeBSD (ZFS), async commit
●
Died under load, I lost it
Gentoo is smart!
●
Chicken and egg dilemma
Gentoo is smart!
●
Chicken and egg dilemma
●
Dictionary: “to emerge” means “to install” in Gentoo speak
Gentoo is smart!
●
Chicken and egg dilemma
●
Dictionary: “to emerge” means “to install” in Gentoo speak
●
Well, I have to configure network to “emerge ifenslave”...
Gentoo is smart!
●
Chicken and egg dilemma
●
Dictionary: “to emerge” means “to install” in Gentoo speak
●
Well, I have to configure network to “emerge ifenslave”...
●
...to configure network!
Gentoo is smart!
●
Chicken and egg dilemma
●
Dictionary: “to emerge” means “to install” in Gentoo speak
●
Well, I have to configure network to “emerge ifenslave”...
●
...to configure network!
●
Ever heard of recursion?
Gentoo is smart!
●
Chicken and egg dilemma
●
Dictionary: “to emerge” means “to install” in Gentoo speak
●
Well, I have to configure network to “emerge ifenslave”...
●
...to configure network!
●
Ever heard of recursion?
●
Yes, there is 802.3ad bonding on a switch and it’s mandatory!
Conclusions
●
I’d rather stay on Ubuntu, it suits me best
●
FreeBSD is effectively dead, sorry guys
●
Gentoo is too elite
So long, and thanks for all the fish!
●
Your questions, please?
●
This was your Principal Engineer speaking
●
http://gitinsky.com
●
alex@gitinsky.com
●
http://meetup.com/DevOps-40

Harry Potter and the Daemons of Berkeley

  • 1.
    Harry Potter andthe Daemons of Berkeley Alex Chistyakov, Principal Engineer at Git in Sky Jul 07 2016, PgDay, Saint-Petersburg
  • 2.
    Who we are ● Asmall consulting company from Spb., Russia ● Elephant groomers ● Ops engineers, performance tuners ● We also walk dogs
  • 3.
    Who are you ● Peoplesmart enough to be DBAs? ● People smart enough to be DBDs? ● People smart enough to prefer PostgrteSQL? ● MySQL users, anyone?
  • 4.
  • 5.
    Important information ● Frankly speaking,I am quite dumb ● I don’t sleep enough to get even dumber
  • 6.
    Important information ● Frankly speaking,I am quite dumb ● I don’t sleep enough to get even dumber ● I can’t cope with elite software, e.g. MS Windows
  • 7.
    Important information ● Frankly speaking,I am quite dumb ● I don’t sleep enough to get even dumber ● I can’t cope with elite software, e.g. MS Windows ● MS Windows is much smarter than me
  • 8.
    Important information ● Frankly speaking,I am quite dumb ● I don’t sleep enough to get even dumber ● I can’t cope with elite software, e.g. MS Windows ● MS Windows is much smarter than me ● I prefer Linux and open source
  • 9.
    Important information ● Frankly speaking,I am quite dumb ● I don’t sleep enough to get even dumber ● I can’t cope with elite software, e.g. MS Windows ● MS Windows is much smarter than me ● I prefer Linux and open source ● At least I can get high and read source code a bit
  • 10.
    Enough on me,fight! ● Ubuntu Linux (dumb as me) ● FreeBSD (a lot smarter) ● Gentoo Linux (elite stuff)
  • 11.
    Hardware ● Dell R430 ● 192Gb RAM ● PERCH730 mini ● Two Edge Boost Pro P SSDs in RAID1 ● 2 x Xeon(R) CPU E5-2630 v3 @ 2.40GHz
  • 12.
    Software ● PostgreSQL ● Minimal tuning (checkpoint-related) ● Asalways: ● pgbench -i -s 1000 --foreign-keys pgbench ● pgbench -T 300 -P 10 -c N -j N -r pgbench ● Synchronous commit ● Asynchronous commit
  • 13.
    Ubuntu Linux, synccommit ● ext4, data=ordered, barrier, relatime (defaults, no tuning) ● N=1, 1397 tps ● N=4, 3928 tps ● N=8, 6559 tps ● N=12, 8132 tps
  • 14.
    Ubuntu Linux, asynccommit ● N=1, 1609 tps ● N=4, 5432 :) tps ● N=8, 9068 tps ● N=12, 10321 tps
  • 15.
    FreeBSD (UFS/SU), synccommit ● N=1, 1196 (Ubuntu: 1397) tps ● N=4, 2819 (Ubuntu: 3928) tps ● N=8, 3430 (Ubuntu: 6559) tps ● N=12, 3785 (Ubuntu: 8132) tps
  • 16.
    FreeBSD (UFS/SU), asynccommit ● N=1, 1614 (Ubuntu: 1609) tps ● N=4, 3783 (Ubuntu: 5432) tps ● N=8, 3981 (Ubuntu: 9068) tps ● N=12, 4791 (Ubuntu: 10321) tps
  • 17.
    FreeBSD (ZFS), asynccommit ● Died under load, I lost it
  • 18.
  • 19.
    Gentoo is smart! ● Chickenand egg dilemma ● Dictionary: “to emerge” means “to install” in Gentoo speak
  • 20.
    Gentoo is smart! ● Chickenand egg dilemma ● Dictionary: “to emerge” means “to install” in Gentoo speak ● Well, I have to configure network to “emerge ifenslave”...
  • 21.
    Gentoo is smart! ● Chickenand egg dilemma ● Dictionary: “to emerge” means “to install” in Gentoo speak ● Well, I have to configure network to “emerge ifenslave”... ● ...to configure network!
  • 22.
    Gentoo is smart! ● Chickenand egg dilemma ● Dictionary: “to emerge” means “to install” in Gentoo speak ● Well, I have to configure network to “emerge ifenslave”... ● ...to configure network! ● Ever heard of recursion?
  • 23.
    Gentoo is smart! ● Chickenand egg dilemma ● Dictionary: “to emerge” means “to install” in Gentoo speak ● Well, I have to configure network to “emerge ifenslave”... ● ...to configure network! ● Ever heard of recursion? ● Yes, there is 802.3ad bonding on a switch and it’s mandatory!
  • 24.
    Conclusions ● I’d rather stayon Ubuntu, it suits me best ● FreeBSD is effectively dead, sorry guys ● Gentoo is too elite
  • 25.
    So long, andthanks for all the fish! ● Your questions, please? ● This was your Principal Engineer speaking ● http://gitinsky.com ● alex@gitinsky.com ● http://meetup.com/DevOps-40