logical_work_mem limit for reorderbuffer

Edit
ID 1428
Title logical_work_mem limit for reorderbuffer
Topic Replication & Recovery
Created 2017-12-23 05:00:40
Last modified 2018-03-02 20:21:34 (6 years, 8 months ago)
Latest email 2020-09-16 06:01:14 (4 years, 2 months ago)
Status
2018-03: Returned with feedback
2018-01: Moved to next CF
Target version
Authors Tomas Vondra (fuzzycz)
Reviewers Peter Eisentraut (petere)Become reviewer
Committer
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1428
git checkout commitfest/cf/1428
Emails
PATCH: logical_work_mem and logical streaming of large in-progress transactions
First at 2017-12-23 04:57:43 by Tomas Vondra <tomas.vondra at 2ndquadrant.com>
Latest at 2020-09-16 06:01:14 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v2-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-15 04:47:41 from Amit Kapila <amit.kapila16 at gmail.com>
    Attachment (v2-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-15 04:47:41 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-14 11:19:53 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (streaming-fixes.patch) at 2020-09-09 08:43:53 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v61-0001-Add-additional-tests-to-test-streaming-of-in-pro.patch) at 2020-09-05 10:32:23 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v60-0001-Add-support-for-streaming-to-built-in-logical-re.patch) at 2020-09-02 13:49:13 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v59-0002-Additional-test-cases-for-testing-the-streaming-.patch) at 2020-09-02 10:11:25 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v58-0001-Add-support-for-streaming-to-built-in-logical-re.patch) at 2020-09-01 15:03:07 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (test_case) at 2020-08-31 16:57:31 from Neha Sharma <neha.sharma at enterprisedb.com> (Patch: No)
    Attachment (v57-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-31 13:58:38 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v56-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-31 07:54:30 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v55-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-30 09:13:20 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v54-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-29 11:47:46 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (tap_test_for_out_of_order_subxact_abort.patch) at 2020-08-28 08:48:05 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v53-0001-Extend-the-BufFile-interface.patch) at 2020-08-25 12:57:31 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (buffile_changes.patch) at 2020-08-24 16:10:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v52-0004-Add-TAP-test-for-streaming-vs.-DDL.patch) at 2020-08-21 09:43:27 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v51.tar) at 2020-08-20 12:12:40 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v50.tar) at 2020-08-17 12:58:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v49-0001-Extend-the-BufFile-interface.patch) at 2020-08-15 10:02:09 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v48-0001-Extend-the-BufFile-interface.patch) at 2020-08-13 06:38:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v47.tar) at 2020-08-06 09:13:17 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v46.tar) at 2020-08-05 14:07:37 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v46-0001-Implement-streaming-mode-in-ReorderBuffer.patch) at 2020-08-05 12:55:20 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v45.tar) at 2020-08-04 07:11:46 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (streaming_stats_update.patch) at 2020-07-31 09:52:27 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v44.tar) at 2020-07-29 05:16:15 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v43.tar) at 2020-07-26 13:43:28 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v42.tar) at 2020-07-24 13:47:35 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v41.tar) at 2020-07-24 11:35:02 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v40.tar) at 2020-07-22 11:24:52 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v39.tar) at 2020-07-22 04:50:02 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v1_streaming_stats_update.patch) at 2020-07-21 03:37:57 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v38.tar) at 2020-07-20 13:15:52 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v37.tar) at 2020-07-20 11:11:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v36.tar) at 2020-07-20 06:31:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v35.tar) at 2020-07-16 10:55:32 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v34.tar) at 2020-07-15 13:29:33 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v33.tar) at 2020-07-15 03:59:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v32.tar) at 2020-07-14 12:09:54 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v31-0015-TEST-guc-always-streaming-logical.patch) at 2020-07-10 03:51:08 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v31-0015-TEST-guc-always-streaming-logical.patch) at 2020-07-08 14:01:19 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v32-0002-WAL-Log-invalidations-at-command-end-with-wal_le.patch) at 2020-07-05 15:07:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v31.tar) at 2020-07-04 06:04:48 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v31-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-30 11:50:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v30.tar) at 2020-06-28 15:25:21 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (poc_shared_fileset_cleanup_on_procexit_v1.patch) at 2020-06-25 13:40:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (poc_shared_fileset_cleanup_on_procexit.patch) at 2020-06-23 13:30:32 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v28-0001-Immediately-WAL-log-subtransaction-and-top-level.amit.patch) at 2020-06-22 10:56:44 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v29.tar) at 2020-06-22 06:25:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v28.tar) at 2020-06-18 15:31:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v27.tar) at 2020-06-12 06:08:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (buffile_change.patch) at 2020-06-10 09:00:15 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v27-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-08 06:23:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v27-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-05 06:07:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v26.tar) at 2020-05-29 15:00:42 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v25.tar) at 2020-05-27 14:52:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v24.tar) at 2020-05-26 02:15:19 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v24.tar) at 2020-05-25 14:37:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v23-0001-Immediately-WAL-log-assignments.patch) at 2020-05-22 12:51:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Immediately-WAL-log-assignments.patch) at 2020-05-17 07:10:46 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v21-0003-Extend-the-output-plugin-API-with-stream-methods.patch) at 2020-05-15 09:17:27 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v20-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-05-07 12:46:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v19-0005-Implement-streaming-mode-in-ReorderBuffer.patch) at 2020-05-05 13:43:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Immediately-WAL-log-assignments.patch) at 2020-05-05 10:36:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v17-0003-Extend-the-output-plugin-API-with-stream-methods.patch) at 2020-05-01 15:10:51 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (regression.diffs) at 2020-04-29 05:45:36 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v16-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-04-27 10:34:55 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (regression.diffs) at 2020-04-23 08:58:26 from Erik Rijkers <er at xs4all.nl> (Patch: Yes)
    Attachment (v15-0001-Immediately-WAL-log-assignments.patch) at 2020-04-22 14:49:28 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (test.sh) at 2020-04-18 09:10:50 from Erik Rijkers <er at xs4all.nl> (Patch: No)
    Attachment (bugfix_in_schema_sent.patch) at 2020-04-16 09:33:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Immediately-WAL-log-assignments.patch) at 2020-04-14 10:10:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Immediately-WAL-log-assignments.patch) at 2020-04-09 09:10:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (xid-assignment-v13-fix.patch) at 2020-03-30 15:27:58 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (xid-assignment-v12-fix.patch) at 2020-03-03 21:59:11 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v12-0001-Immediately-WAL-log-assignments.patch) at 2020-02-29 05:07:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Immediately-WAL-log-assignments.patch) at 2020-02-13 03:12:21 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v10-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-02-11 03:12:29 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Immediately-WAL-log-assignments.patch) at 2020-02-05 04:12:10 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Dilip-s-original.patch) at 2020-01-22 16:37:36 from Alvaro Herrera <alvherre at 2ndquadrant.com> (Patch: Yes)
    Attachment (v8-0001-Immediately-WAL-log-assignments.patch) at 2020-01-22 05:00:25 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v7-0002-Issue-individual-invalidations-with-wal_level-log.patch) at 2020-01-14 05:26:37 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Immediately-WAL-log-assignments.patch) at 2020-01-10 21:37:07 from Alvaro Herrera <alvherre at 2ndquadrant.com> (Patch: Yes)
    Attachment (v5-0001-Immediately-WAL-log-assignments.patch) at 2020-01-10 04:44:05 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Immediately-WAL-log-assignments.patch) at 2019-12-30 09:40:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Immediately-WAL-log-assignments-v3.patch) at 2019-12-28 16:03:27 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v2-0001-Immediately-WAL-log-assignments.patch) at 2019-12-02 08:31:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Immediately-WAL-log-assignments.patch) at 2019-11-22 07:48:11 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0002-Immediately-WAL-log-assignments.patch) at 2019-11-20 14:52:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.nov16.patch) at 2019-11-16 13:14:23 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-11-07 09:49:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-configuration-for-test.patch) at 2019-11-06 06:03:43 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (mix_data_test.c) at 2019-10-30 04:08:00 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-22 05:00:16 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-14 09:39:02 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0006-Gracefully-handle-concurrent-aborts-of-uncommitted-t.patch) at 2019-10-10 10:27:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-03 07:48:26 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (handle_concurrent_abort_for_in_progress_transaction.patch) at 2019-09-29 04:34:55 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch.gz) at 2019-09-28 19:09:17 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20190926.patch.gz) at 2019-09-26 18:07:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (worker_aborts_perf.zip) at 2019-09-16 16:54:32 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0011-BGWorkers-pool-for-streamed-transactions-apply-witho.patch) at 2019-08-28 17:17:47 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20190114.patch.gz) at 2019-01-14 18:23:31 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0xx_stream_tough_ddl.pl) at 2018-12-19 09:58:58 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20181219.patch.gz) at 2018-12-18 23:56:07 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (logical_repl_worker_text_stream_perf.zip) at 2018-12-18 14:07:08 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (logical_repl_worker_new_perf.svg.zip) at 2018-12-17 16:23:44 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20181216.patch.gz) at 2018-12-16 14:31:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-fixup-Track-statistics-for-streaming-spilling.patch) at 2018-03-09 16:07:55 from Peter Eisentraut <peter.eisentraut at 2ndquadrant.com> (Patch: Yes)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer.patch.gz) at 2018-03-03 14:52:40 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (pg_proc.h.rej) at 2018-03-03 05:19:56 from Erik Rijkers <er at xs4all.nl> (Patch: Yes)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer.patch.gz) at 2018-03-03 00:55:39 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v6.patch.gz) at 2018-01-19 22:08:02 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v5.patch.gz) at 2018-01-19 14:34:05 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v4.patch.gz) at 2018-01-03 20:06:59 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v3.patch.gz) at 2017-12-25 17:40:56 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (test.sh) at 2017-12-23 22:23:57 from Erik Rijkers <er at xs4all.nl> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v2.patch.gz) at 2017-12-23 20:06:05 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-me.patch.gz) at 2017-12-23 04:57:43 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
History
When Who What
2018-03-02 20:21:34 David Steele (dsteele) Closed in commitfest 2018-03 with status: Returned with feedback
2018-03-02 02:38:48 David Steele (dsteele) New status: Waiting on Author
2018-03-01 12:54:48 Tomas Vondra (fuzzycz) Closed in commitfest 2018-01 with status: Moved to next CF
2018-03-01 12:54:42 Tomas Vondra (fuzzycz) New status: Needs review
2018-02-01 14:51:28 Peter Eisentraut (petere) Closed in commitfest 2018-01 with status: Returned with feedback
2018-01-02 15:08:10 Peter Eisentraut (petere) New status: Waiting on Author
2017-12-28 15:29:02 Peter Eisentraut (petere) Added petere as reviewer
2017-12-23 05:00:48 Tomas Vondra (fuzzycz) Changed authors to Tomas Vondra (fuzzycz)
2017-12-23 05:00:40 Tomas Vondra (fuzzycz) Attached mail thread 688b0b7f-2f6c-d827-c27b-216a8e3ea700@2ndquadrant.com
2017-12-23 05:00:40 Tomas Vondra (fuzzycz) Created patch record
Edit