Compression

Postgres FM

Nikolay and Michael discuss compression in Postgres — what's available natively, newer algorithms in recent versions, and several extensions with compression features.
Here are some links to things they mentioned:

• wal_compression https://www.postgresql.org/docs/current/runtime-config-wal.html#GUC-WAL-COMPRESSION
• Our episode on WAL and checkpoint tuning https://postgres.fm/episodes/wal-and-checkpoint-tuning
• Synthetic wal_compression and streaming replication wal size test https://gitlab.com/postgres-ai/postgresql-consulting/tests-and-benchmarks/-/issues/11
• default_toast_compression https://www.postgresql.org/docs/current/runtime-config-client.html#GUC-DEFAULT-TOAST-COMPRESSION
• ZFS https://en.wikipedia.org/wiki/ZFS
• Our episode on TOAST https://postgres.fm/episodes/toast
• On compression of everything in Postgres (talk by Andrey Borodin) https://learn.microsoft.com/en-us/shows/cituscon-an-event-for-postgres-2023/on-compression-of-everything-in-postgres-citus-con-2023
• cstore_fdw https://citusdata.github.io/cstore_fdw/
• Using Hydra columnar https://columnar.docs.hydra.so/concepts/using-hydra-columnar
• About compression in Timescale https://docs.timescale.com/use-timescale/latest/compression/about-compression/
• pg_tier https://github.com/tembo-io/pg_tier
• pgBackRest https://pgbackrest.org/
• WAL-G https://github.com/wal-g/wal-g
• pg_dump https://www.postgresql.org/docs/current/app-pgdump.html
• pg_dump compression specifications in PostgreSQL 16 (article by Pablo Glob from Cybertec) https://www.cybertec-postgresql.com/en/pg_dump-compression-specifications-postgresql-16/
• Our episode on pgvector (with Jonathan Katz) https://postgres.fm/episodes/pgvector

~~~

What did you like or not like? What should we discuss next time? Let us know via a YouTube comment, on social media, or by commenting on our Google doc!

~~~

Postgres FM is produced by:

• Michael Christofides, founder of pgMustard
• Nikolay Samokhvalov, founder of Postgres.ai

With special thanks to:

• Jessie Draws for the elephant artwork