Top Banner
Harry Poer and the Daemons of Berkeley Alex Chistyakov, Principal Engineer at Git in Sky Jul 07 2016, PgDay, Saint-Petersburg
25

Harry Potter and the Daemons of Berkeley

Jan 09, 2017

Download

Technology

Alex Chistyakov
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Harry Potter and the Daemons of Berkeley

Harry Potter and the Daemons of Berkeley

Alex Chistyakov, Principal Engineer at Git in SkyJul 07 2016, PgDay, Saint-Petersburg

Page 2: Harry Potter and the Daemons of Berkeley

Who we are

● A small consulting company from Spb., Russia

● Elephant groomers

● Ops engineers, performance tuners

● We also walk dogs

Page 3: Harry Potter and the Daemons of Berkeley

Who are you

● People smart enough to be DBAs?

● People smart enough to be DBDs?

● People smart enough to prefer PostgrteSQL?

● MySQL users, anyone?

Page 4: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

Page 5: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

Page 6: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

Page 7: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

Page 8: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

● I prefer Linux and open source

Page 9: Harry Potter and the Daemons of Berkeley

Important information

● Frankly speaking, I am quite dumb

● I don’t sleep enough to get even dumber

● I can’t cope with elite software, e.g. MS Windows

● MS Windows is much smarter than me

● I prefer Linux and open source

● At least I can get high and read source code a bit

Page 10: Harry Potter and the Daemons of Berkeley

Enough on me, fight!

● Ubuntu Linux (dumb as me)

● FreeBSD (a lot smarter)

● Gentoo Linux (elite stuff)

Page 11: Harry Potter and the Daemons of Berkeley

Hardware

● Dell R430

● 192Gb RAM

● PERC H730 mini

● Two Edge Boost Pro P SSDs in RAID1

● 2 x Xeon(R) CPU E5-2630 v3 @ 2.40GHz

Page 12: Harry Potter and the Daemons of Berkeley

Software

● PostgreSQL

● Minimal tuning (checkpoint-related)

● As always:

● pgbench -i -s 1000 --foreign-keys pgbench

● pgbench -T 300 -P 10 -c N -j N -r pgbench

● Synchronous commit

● Asynchronous commit

Page 13: Harry Potter and the Daemons of Berkeley

Ubuntu Linux, sync commit

● ext4, data=ordered, barrier, relatime (defaults, notuning)

● N=1, 1397 tps

● N=4, 3928 tps

● N=8, 6559 tps

● N=12, 8132 tps

Page 14: Harry Potter and the Daemons of Berkeley

Ubuntu Linux, async commit

● N=1, 1609 tps

● N=4, 5432 :) tps

● N=8, 9068 tps

● N=12, 10321 tps

Page 15: Harry Potter and the Daemons of Berkeley

FreeBSD (UFS/SU), sync commit

● N=1, 1196 (Ubuntu: 1397) tps

● N=4, 2819 (Ubuntu: 3928) tps

● N=8, 3430 (Ubuntu: 6559) tps

● N=12, 3785 (Ubuntu: 8132) tps

Page 16: Harry Potter and the Daemons of Berkeley

FreeBSD (UFS/SU), async commit

● N=1, 1614 (Ubuntu: 1609) tps

● N=4, 3783 (Ubuntu: 5432) tps

● N=8, 3981 (Ubuntu: 9068) tps

● N=12, 4791 (Ubuntu: 10321) tps

Page 17: Harry Potter and the Daemons of Berkeley

FreeBSD (ZFS), async commit

● Died under load, I lost it

Page 18: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

Page 19: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

Page 20: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

Page 21: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

Page 22: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

● Ever heard of recursion?

Page 23: Harry Potter and the Daemons of Berkeley

Gentoo is smart!

● Chicken and egg dilemma

● Dictionary: “to emerge” means “to install” in Gentoo speak

● Well, I have to configure network to “emerge ifenslave”...

● ...to configure network!

● Ever heard of recursion?

● Yes, there is 802.3ad bonding on a switch and it’s mandatory!

Page 24: Harry Potter and the Daemons of Berkeley

Conclusions

● I’d rather stay on Ubuntu, it suits me best

● FreeBSD is effectively dead, sorry guys

● Gentoo is too elite

Page 25: Harry Potter and the Daemons of Berkeley

So long, and thanks for all the fish!

● Your questions, please?

● This was your Principal Engineer speaking

● http://gitinsky.com

[email protected]

● http://meetup.com/DevOps-40