Pg92 HA, LCA 2012, Ballarat

1,007 views

Published on

Postgres has long been a database that easily scales vertically. It has also supported durable and reliable binary replication.
In the last two years, work on HA, clustering and extensions to our MVCC system has produced clustering features that help Postgres efficiently scale across many smaller systems.
This talk will start with a demo of the latest Postgres replication features. Then, we'll walk through open source and commercially-supported stacks that supporting the most demanding applications backed by Postgres.
In version 9.1, Postgres added streaming and synchronous replication that can be configured in about 5 steps. In 9.2 (to be released in 2012), we're adding cascaded replication and optimizations for common developer requests.
These features set the stage for a fast, efficient and distributed SQL cluster -- one that has configurable durability, is easy to administer and supported by "cloud" and virtualization vendors.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Pg92 HA, LCA 2012, Ballarat

  1. 1. Scaling Data: Postgres, The Stack and the Future of Replication Selena Deckelmann selena@postgresql.org @selenamarieSo mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  2. 2. 1ce 1n 10e 2r2 ne 2f N0 OAo CC LeC OmSSo
  3. 3. Postgres disrupts the rest of the commercial relational database industry.So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  4. 4. Disruptive forces Licensing “Enterprise” Web development Proprietary DBA Career PathSo OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  5. 5. Licensing Drop-in replacement for custom application development on proprietary DBs. Cheap Data Warehousing Ecosystem!So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  6. 6. “Enterprise” Web development Postgres is a “Developers database” - Extension is encouraged Database of choice for Django Oracle wants PHP developersSo OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  7. 7. “Visit the Ruby and Python Topic for more information pertaining to Ruby/RoR, Python and other non-PHP scripting languages.”So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  8. 8. DBA Career path Companies can’t hire Postgres DBAs fast enough. Postgres is close enough to Oracle, that Oracle DBAs can jump in. What we do better: Data loading, automation, TUI and GUI admin toolsSo OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  9. 9. And... Stability Support major releases for at least 5 years. Commits to HEAD are stable. Bugs reported are fixed in <48 hrs.So OmS LeC CC OAo N0 2f ne 2r2 10e 1n 1ce
  10. 10. Demo! • Demo here! https://github.com/selenamarie/ pg_replication_demoSo mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  11. 11. Old problems • Replication is hard • Sharding is hard • Slow in “the cloud”So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  12. 12. Solutions • Streaming, cascaded replication new! • Sharding is still hard • Index-only scans new!So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  13. 13. The Good • Community starting to really address Ops/ performance concerns: • AVOIDING REINDEXING ON ALTER TYPE OF INDEXED COLUMN • NOT VALID CHECKS • pg_basebackupSo mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  14. 14. The Bad • Installation of Postgres harder than SQLite • psql is powerful, not very friendly • HA Ops support could be way betterSo mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  15. 15. What’s happening now • Heroku -> postgres.heroku.com 400 million write-transactions/day • VMWare -> for managing lots of instances • More interest in PaaS (like what MySQL support has been for a long time)So mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c
  16. 16. Next in HA? • Continued usability improvements • Cascaded Failover • Multi-master with synchronous repSo mL SeC CA CL Ao E0 2 f1 ne 1r2 0e xn e c

×