logical streaming for large in-progress transactions

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1429
git checkout commitfest/cf/1429

PATCH: logical_work_mem and logical streaming of large in-progress transactions ×

First at 2017-12-23 04:57:43 by Tomas Vondra <tomas.vondra at 2ndquadrant.com>
Latest at 2020-09-16 06:01:14 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v2-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-15 04:47:41 from Amit Kapila <amit.kapila16 at gmail.com>

    Attachment (v2-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-15 04:47:41 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Fix-initialization-of-RelationSyncEntry-for-strea.patch) at 2020-09-14 11:19:53 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (streaming-fixes.patch) at 2020-09-09 08:43:53 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v61-0001-Add-additional-tests-to-test-streaming-of-in-pro.patch) at 2020-09-05 10:32:23 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v60-0001-Add-support-for-streaming-to-built-in-logical-re.patch) at 2020-09-02 13:49:13 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v59-0002-Additional-test-cases-for-testing-the-streaming-.patch) at 2020-09-02 10:11:25 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v58-0001-Add-support-for-streaming-to-built-in-logical-re.patch) at 2020-09-01 15:03:07 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (test_case) at 2020-08-31 16:57:31 from Neha Sharma <neha.sharma at enterprisedb.com> (Patch: No)
    Attachment (v57-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-31 13:58:38 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v56-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-31 07:54:30 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v55-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-30 09:13:20 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v54-0001-Fix-the-SharedFileSetUnregister-API.patch) at 2020-08-29 11:47:46 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (tap_test_for_out_of_order_subxact_abort.patch) at 2020-08-28 08:48:05 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v53-0001-Extend-the-BufFile-interface.patch) at 2020-08-25 12:57:31 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (buffile_changes.patch) at 2020-08-24 16:10:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v52-0004-Add-TAP-test-for-streaming-vs.-DDL.patch) at 2020-08-21 09:43:27 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v51.tar) at 2020-08-20 12:12:40 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v50.tar) at 2020-08-17 12:58:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v49-0001-Extend-the-BufFile-interface.patch) at 2020-08-15 10:02:09 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v48-0001-Extend-the-BufFile-interface.patch) at 2020-08-13 06:38:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v47.tar) at 2020-08-06 09:13:17 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v46.tar) at 2020-08-05 14:07:37 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v46-0001-Implement-streaming-mode-in-ReorderBuffer.patch) at 2020-08-05 12:55:20 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v45.tar) at 2020-08-04 07:11:46 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (streaming_stats_update.patch) at 2020-07-31 09:52:27 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v44.tar) at 2020-07-29 05:16:15 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v43.tar) at 2020-07-26 13:43:28 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v42.tar) at 2020-07-24 13:47:35 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v41.tar) at 2020-07-24 11:35:02 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v40.tar) at 2020-07-22 11:24:52 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v39.tar) at 2020-07-22 04:50:02 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v1_streaming_stats_update.patch) at 2020-07-21 03:37:57 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v38.tar) at 2020-07-20 13:15:52 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v37.tar) at 2020-07-20 11:11:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v36.tar) at 2020-07-20 06:31:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v35.tar) at 2020-07-16 10:55:32 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v34.tar) at 2020-07-15 13:29:33 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v33.tar) at 2020-07-15 03:59:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v32.tar) at 2020-07-14 12:09:54 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v31-0015-TEST-guc-always-streaming-logical.patch) at 2020-07-10 03:51:08 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v31-0015-TEST-guc-always-streaming-logical.patch) at 2020-07-08 14:01:19 from Ajin Cherian <itsajin at gmail.com> (Patch: Yes)
    Attachment (v32-0002-WAL-Log-invalidations-at-command-end-with-wal_le.patch) at 2020-07-05 15:07:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v31.tar) at 2020-07-04 06:04:48 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (v31-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-30 11:50:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v30.tar) at 2020-06-28 15:25:21 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (poc_shared_fileset_cleanup_on_procexit_v1.patch) at 2020-06-25 13:40:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (poc_shared_fileset_cleanup_on_procexit.patch) at 2020-06-23 13:30:32 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v28-0001-Immediately-WAL-log-subtransaction-and-top-level.amit.patch) at 2020-06-22 10:56:44 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v29.tar) at 2020-06-22 06:25:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v28.tar) at 2020-06-18 15:31:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v27.tar) at 2020-06-12 06:08:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (buffile_change.patch) at 2020-06-10 09:00:15 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v27-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-08 06:23:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v27-0001-Immediately-WAL-log-subtransaction-and-top-level.patch) at 2020-06-05 06:07:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v26.tar) at 2020-05-29 15:00:42 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v25.tar) at 2020-05-27 14:52:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v24.tar) at 2020-05-26 02:15:19 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v24.tar) at 2020-05-25 14:37:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (v23-0001-Immediately-WAL-log-assignments.patch) at 2020-05-22 12:51:36 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Immediately-WAL-log-assignments.patch) at 2020-05-17 07:10:46 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v21-0003-Extend-the-output-plugin-API-with-stream-methods.patch) at 2020-05-15 09:17:27 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v20-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-05-07 12:46:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v19-0005-Implement-streaming-mode-in-ReorderBuffer.patch) at 2020-05-05 13:43:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Immediately-WAL-log-assignments.patch) at 2020-05-05 10:36:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v17-0003-Extend-the-output-plugin-API-with-stream-methods.patch) at 2020-05-01 15:10:51 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (regression.diffs) at 2020-04-29 05:45:36 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v16-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-04-27 10:34:55 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (regression.diffs) at 2020-04-23 08:58:26 from Erik Rijkers <er at xs4all.nl> (Patch: Yes)
    Attachment (v15-0001-Immediately-WAL-log-assignments.patch) at 2020-04-22 14:49:28 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (test.sh) at 2020-04-18 09:10:50 from Erik Rijkers <er at xs4all.nl> (Patch: No)
    Attachment (bugfix_in_schema_sent.patch) at 2020-04-16 09:33:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Immediately-WAL-log-assignments.patch) at 2020-04-14 10:10:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Immediately-WAL-log-assignments.patch) at 2020-04-09 09:10:17 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (xid-assignment-v13-fix.patch) at 2020-03-30 15:27:58 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (xid-assignment-v12-fix.patch) at 2020-03-03 21:59:11 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v12-0001-Immediately-WAL-log-assignments.patch) at 2020-02-29 05:07:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Immediately-WAL-log-assignments.patch) at 2020-02-13 03:12:21 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v10-0002-Issue-individual-invalidations-with-wal_level-lo.patch) at 2020-02-11 03:12:29 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Immediately-WAL-log-assignments.patch) at 2020-02-05 04:12:10 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Dilip-s-original.patch) at 2020-01-22 16:37:36 from Alvaro Herrera <alvherre at 2ndquadrant.com> (Patch: Yes)
    Attachment (v8-0001-Immediately-WAL-log-assignments.patch) at 2020-01-22 05:00:25 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v7-0002-Issue-individual-invalidations-with-wal_level-log.patch) at 2020-01-14 05:26:37 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Immediately-WAL-log-assignments.patch) at 2020-01-10 21:37:07 from Alvaro Herrera <alvherre at 2ndquadrant.com> (Patch: Yes)
    Attachment (v5-0001-Immediately-WAL-log-assignments.patch) at 2020-01-10 04:44:05 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Immediately-WAL-log-assignments.patch) at 2019-12-30 09:40:47 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Immediately-WAL-log-assignments-v3.patch) at 2019-12-28 16:03:27 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v2-0001-Immediately-WAL-log-assignments.patch) at 2019-12-02 08:31:50 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Immediately-WAL-log-assignments.patch) at 2019-11-22 07:48:11 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0002-Immediately-WAL-log-assignments.patch) at 2019-11-20 14:52:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.nov16.patch) at 2019-11-16 13:14:23 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-11-07 09:49:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-configuration-for-test.patch) at 2019-11-06 06:03:43 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (mix_data_test.c) at 2019-10-30 04:08:00 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-22 05:00:16 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-14 09:39:02 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0006-Gracefully-handle-concurrent-aborts-of-uncommitted-t.patch) at 2019-10-10 10:27:49 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch) at 2019-10-03 07:48:26 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (handle_concurrent_abort_for_in_progress_transaction.patch) at 2019-09-29 04:34:55 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Add-logical_decoding_work_mem-to-limit-ReorderBuffer.patch.gz) at 2019-09-28 19:09:17 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20190926.patch.gz) at 2019-09-26 18:07:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (worker_aborts_perf.zip) at 2019-09-16 16:54:32 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0011-BGWorkers-pool-for-streamed-transactions-apply-witho.patch) at 2019-08-28 17:17:47 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20190114.patch.gz) at 2019-01-14 18:23:31 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0xx_stream_tough_ddl.pl) at 2018-12-19 09:58:58 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20181219.patch.gz) at 2018-12-18 23:56:07 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (logical_repl_worker_text_stream_perf.zip) at 2018-12-18 14:07:08 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (logical_repl_worker_new_perf.svg.zip) at 2018-12-17 16:23:44 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (0001-Add-logical_work_mem-to-limit-ReorderBuffer-20181216.patch.gz) at 2018-12-16 14:31:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-fixup-Track-statistics-for-streaming-spilling.patch) at 2018-03-09 16:07:55 from Peter Eisentraut <peter.eisentraut at 2ndquadrant.com> (Patch: Yes)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer.patch.gz) at 2018-03-03 14:52:40 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (pg_proc.h.rej) at 2018-03-03 05:19:56 from Erik Rijkers <er at xs4all.nl> (Patch: Yes)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer.patch.gz) at 2018-03-03 00:55:39 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v6.patch.gz) at 2018-01-19 22:08:02 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v5.patch.gz) at 2018-01-19 14:34:05 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v4.patch.gz) at 2018-01-03 20:06:59 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v3.patch.gz) at 2017-12-25 17:40:56 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (test.sh) at 2017-12-23 22:23:57 from Erik Rijkers <er at xs4all.nl> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-v2.patch.gz) at 2017-12-23 20:06:05 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (0001-Introduce-logical_work_mem-to-limit-ReorderBuffer-me.patch.gz) at 2017-12-23 04:57:43 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)