Add LZ4 compression in pg_dump

Edit

ID 3571

Title Add LZ4 compression in pg_dump

Topic Clients

Created 2022-02-25 12:08:39

Last modified 2023-02-23 20:23:47 (1 year, 8 months ago)

Latest email 2023-03-31 23:34:16 (1 year, 7 months ago)

Status

2023-03: Committed

2023-01: Moved to next CF

2022-11: Moved to next CF

2022-09: Moved to next CF

2022-07: Moved to next CF

2022-03: Moved to next CF

Target version 16

Authors Georgios Kokolatos (gkokolatos), Rachel Heaton (rheaton)

Reviewers Tomas Vondra (fuzzycz), Justin Pryzby (justinpryzby), Yu Shi (shiy.fnst)Become reviewer

Committer Tomas Vondra (fuzzycz)

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/3571
git checkout commitfest/cf/3571

Emails

Add LZ4 compression in pg_dump: First at 2022-02-25 12:05:31 by Georgios <gkokolatos at protonmail.com>
Latest at 2023-03-31 23:34:16 by Tomas Vondra <tomas.vondra at enterprisedb.com>
Latest attachment (v2-0001-Use-LZ4-frames-in-pg_dump-s-compressor-API.patch) at 2023-03-31 09:19:47 from gkokolatos at pm.me
    Attachment (v2-0001-Use-LZ4-frames-in-pg_dump-s-compressor-API.patch) at 2023-03-31 09:19:47 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v1-0001-Use-LZ4-frames-in-pg_dump-s-compressor-API.patch) at 2023-03-28 16:07:30 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v4-0001-Improve-type-handling-in-pg_dump-s-compress-file-.patch) at 2023-03-20 20:48:58 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v3-0003-Improve-compress_lz4-documentation.patch) at 2023-03-17 15:43:58 from gkokolatos at pm.me (Patch: Yes)
    Attachment (git-diff.txt) at 2023-03-16 22:30:50 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v2-0002-Clean-up-constants-in-pg_dump-s-compression-API.patch) at 2023-03-16 17:04:16 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0004-comment-improvements.patch) at 2023-03-13 20:21:11 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v1-0001-Respect-return-type-of-LZ4File_read_internal.patch) at 2023-03-11 10:50:06 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0001-pg_dump-fix-gzip-compression-of-empty-data.patch) at 2023-03-08 01:45:20 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (0001-Add-test-for-backwards-compatible-Z0-option-in-pg.patch) at 2023-03-02 16:34:23 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0001-Properly-gzip-compress-when-no-data-is-available.patch) at 2023-03-01 13:39:14 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0001-Rename-functions-structures-comments-which-don-t-use.patch) at 2023-02-28 23:58:34 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (0001-f-fixes-for-LZ4.patch) at 2023-02-27 04:49:10 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (0001-f-fixes-for-LZ4.patch) at 2023-02-25 14:05:53 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (0001-f-fixes-for-LZ4.patch) at 2023-02-25 05:02:14 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v30-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-02-20 13:09:22 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0001-Prepare-pg_dump-internals-for-additional-compres-v29.patch) at 2023-02-19 17:10:13 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v28-0003-Add-LZ4-compression-to-pg_dump.patch) at 2023-02-16 11:38:00 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v27-0001-Address-regression-in-pg_dump-s-ReadHead.patch) at 2023-01-26 18:03:59 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v26-0002-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-01-26 11:24:47 from gkokolatos at pm.me (Patch: Yes)
    Attachment (dump-header-compress.patch) at 2023-01-26 05:49:27 from Michael Paquier <michael at paquier.xyz> (Patch: Yes)
    Attachment (v25-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-01-25 15:37:12 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v24-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-01-24 15:56:20 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v23-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-01-23 17:31:55 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v22-0002-Add-LZ4-compression-to-pg_dump.patch) at 2023-01-19 16:42:06 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v21-0002-Introduce-Compressor-API-in-pg_dump.patch) at 2023-01-18 19:05:43 from gkokolatos at pm.me (Patch: Yes)
    Attachment (warnings.log) at 2023-01-18 14:00:34 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v20-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2023-01-16 15:14:43 from gkokolatos at pm.me (Patch: Yes)
    Attachment (0001-pg_dump-pass-pg_compress_specification-as-a-pointer.patch) at 2023-01-15 22:32:11 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (0001-pg_dump-pass-pg_compress_specification-as-a-pointer.patch) at 2023-01-14 21:43:09 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v19-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2022-12-21 10:09:38 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v18-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2022-12-19 17:03:21 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v17-0001-Prepare-pg_dump-internals-for-additional-compres.patch) at 2022-12-06 15:52:01 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v16-0001-Provide-coverage-for-pg_dump-default-compression.patch) at 2022-12-05 12:48:28 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v15-0001-Provide-coverage-for-pg_dump-default-compression.patch) at 2022-12-05 07:05:23 from Michael Paquier <michael at paquier.xyz> (Patch: Yes)
    Attachment (v14-0001-Provide-coverage-for-pg_dump-default-compression.patch) at 2022-12-02 16:15:10 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v13-0001-Teach-pg_dump-about-compress_spec-and-use-it-thr.patch) at 2022-12-01 14:58:35 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v12-0001-Teach-pg_dump-about-compress_spec-and-use-it-thr.patch) at 2022-12-01 02:05:54 from Michael Paquier <michael at paquier.xyz> (Patch: Yes)
    Attachment (v11-0002-Prepare-pg_dump-internals-for-additional-compres.patch) at 2022-11-30 17:11:44 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v10-0001-Make-the-pg_receivewal-compression-parsing-funct.patch) at 2022-11-29 12:10:46 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v9-0001-Make-the-pg_receivewal-compression-parsing-functi.patch) at 2022-11-29 06:19:17 from Michael Paquier <michael at paquier.xyz> (Patch: Yes)
    Attachment (v8-0003-Prepare-pg_dump-for-additional-compression-method.patch) at 2022-11-28 16:32:43 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v7-0002-Introduce-Compressor-API-in-pg_dump.patch) at 2022-07-05 13:22:47 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v6-0001-Extend-compression-coverage-for-pg_dump-pg_restor.patch) at 2022-04-05 01:34:49 from Michael Paquier <michael at paquier.xyz> (Patch: Yes)
    Attachment (v5-0001-Extend-compression-coverage-for-pg_dump-pg_restor.patch) at 2022-04-01 15:06:40 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v4-0002-Remove-unsupported-bitrot-compression-from-pg_dum.patch) at 2022-03-30 15:32:55 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v3-0004-Add-LZ4-compression-in-pg_-dump-restore.patch) at 2022-03-29 09:46:27 from gkokolatos at pm.me (Patch: Yes)
    Attachment (v2-0001-Extend-compression-coverage-for-pg_dump-pg_restor.patch) at 2022-03-25 23:13:08 from Rachel Heaton <rachelmheaton at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Prepare-pg_dump-for-additional-compression-method.patch) at 2022-02-25 12:05:31 from Georgios <gkokolatos at protonmail.com> (Patch: Yes)

History

When	Who	What
2023-02-23 20:23:47	Tomas Vondra (fuzzycz)	Closed in commitfest 2023-03 with status: Committed
2023-02-22 09:43:26	Yu Shi (shiy.fnst)	Added shiy.fnst as reviewer
2023-02-16 14:08:16	Justin Pryzby (justinpryzby)	New status: Needs review
2023-02-02 15:51:14	Tomas Vondra (fuzzycz)	Added fuzzycz as committer
2023-02-02 15:50:55	Tomas Vondra (fuzzycz)	Added fuzzycz as reviewer
2023-01-31 16:36:22	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2023-01 with status: Moved to next CF
2023-01-20 22:35:34	Tomas Vondra (fuzzycz)	New status: Waiting on Author
2023-01-09 01:04:25	Justin Pryzby (justinpryzby)	Changed targetversion to 16
2022-12-21 10:06:55	Georgios Kokolatos (gkokolatos)	New status: Needs review
2022-12-17 23:51:38	Michael Paquier (michael-kun)	Closed in commitfest 2022-11 with status: Moved to next CF
2022-12-17 23:51:34	Michael Paquier (michael-kun)	New status: Waiting on Author
2022-11-20 23:13:37	Michael Paquier (michael-kun)	Closed in commitfest 2022-11 with status: Returned with feedback
2022-09-08 09:25:58	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2022-09 with status: Moved to next CF
2022-08-05 14:23:45	Georgios Kokolatos (gkokolatos)	Posted comment with messageid <165970942594.29780.15623018354659505573.pgcf@coridan.postgresql.org>
2022-08-05 14:19:16	Georgios Kokolatos (gkokolatos)	Closed in commitfest 2022-07 with status: Moved to next CF
2022-08-05 14:19:00	Georgios Kokolatos (gkokolatos)	New status: Waiting on Author
2022-08-02 18:42:01	Jacob Champion (jchampion)	Closed in commitfest 2022-07 with status: Returned with feedback
2022-07-08 20:49:49	Jacob Champion (jchampion)	Changed reviewers to Justin Pryzby (justinpryzby)
2022-04-25 10:36:46	shuli yan (xmasteryanshuli)	Added xmasteryanshuli as reviewer
2022-03-25 13:23:20	Justin Pryzby (justinpryzby)	Closed in commitfest 2022-03 with status: Moved to next CF
2022-03-04 16:19:18	Justin Pryzby (justinpryzby)	Added justinpryzby as reviewer
2022-03-04 16:19:16	Justin Pryzby (justinpryzby)	New status: Waiting on Author
2022-02-25 12:09:11	Georgios Kokolatos (gkokolatos)	Changed authors to Georgios Kokolatos (gkokolatos), Rachel Heaton (rheaton)
2022-02-25 12:08:39	Georgios Kokolatos (gkokolatos)	Attached mail thread faUNEOpts9vunEaLnmxmG-DldLSg_ql137OC3JYDmgrOMHm1RvvWY2IdBkv_CRxm5spCCb_OmKNk2T03TMm0fBEWveFF9wA1WizPuAgB7Ss=@protonmail.com
2022-02-25 12:08:39	Georgios Kokolatos (gkokolatos)	Created patch record

Edit