Perform streaming logical transactions by background workers

Edit
Title Perform streaming logical transactions by background workers
Topic Replication & Recovery
Created 2022-04-14 09:03:36
Last modified 2022-10-12 07:01:39 (1 month, 2 weeks ago)
Latest email 2022-11-25 02:53:37 (1 day, 7 hours ago)
Status
2022-11: Waiting on Author
2022-09: Moved to next CF
2022-07: Moved to next CF
Target version
Authors Hou Zhijie (houzj)
Reviewers Peter Smith (smithpb2250)Become reviewer
Committer
Links
Emails
Perform streaming logical transactions by background workers and parallel apply
First at 2022-04-06 05:19:40 by Amit Kapila <amit.kapila16 at gmail.com>
Latest at 2022-11-25 02:53:37 by Peter Smith <smithpb2250 at gmail.com>
Latest attachment (v51-0004-Retry-to-apply-streaming-xact-only-in-apply-work.patch) at 2022-11-22 12:42:24 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com>
    Attachment (v51-0004-Retry-to-apply-streaming-xact-only-in-apply-work.patch) at 2022-11-22 12:42:24 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v50-0004-Retry-to-apply-streaming-xact-only-in-apply-work.patch) at 2022-11-22 02:00:05 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v49-0003-Test-streaming-parallel-option-in-tap-test.patch) at 2022-11-21 12:34:02 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v48-changes_amit_1.patch) at 2022-11-19 10:48:57 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v48-0004-Retry-to-apply-streaming-xact-only-in-apply-work.patch) at 2022-11-16 08:19:48 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v47-0002-Serialize-partial-changes-to-disk-if-the-shm_mq-.patch) at 2022-11-15 11:57:38 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v46-0002-Test-streaming-parallel-option-in-tap-test.patch) at 2022-11-11 08:42:25 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v45-0002-Test-streaming-parallel-option-in-tap-test.patch) at 2022-11-10 15:09:37 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (case1.txt) at 2022-11-09 02:54:19 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: No)
    Attachment (v44-0002-Test-streaming-parallel-option-in-tap-test.patch) at 2022-11-08 03:56:43 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v43-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-11-07 13:19:25 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: No)
    Attachment (0001-fix-wrong-message-length-estimation.patch) at 2022-11-04 09:46:55 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (repro.sh) at 2022-11-04 07:45:18 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: No)
    Attachment (v42-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-11-03 13:06:35 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: No)
    Attachment (0001-Allow-streaming-every-change-instead-of-waiting-till_patch) at 2022-10-28 09:34:16 from "shiy.fnst at fujitsu.com" <shiy.fnst at fujitsu.com> (Patch: Yes)
    Attachment (script.zip) at 2022-10-27 02:34:24 from "shiy.fnst at fujitsu.com" <shiy.fnst at fujitsu.com> (Patch: No)
    Attachment (v41-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-10-25 06:55:35 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v40-0006-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-10-21 09:32:20 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v39-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-10-19 06:46:46 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: No)
    Attachment (v38-0006-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-10-14 09:08:13 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v37-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-10-12 02:10:59 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v36-0002-Test-streaming-parallel-option-in-tap-test.patch) at 2022-10-07 06:18:09 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v35-0003-Add-some-checks-before-using-parallel-apply-work.patch) at 2022-09-27 12:26:44 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v34-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-26 03:09:55 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (changes_atop_v33_1_amit.patch) at 2022-09-24 11:40:06 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-22 03:29:13 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v32-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-21 08:27:58 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v31-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-21 02:09:27 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v30-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-19 03:25:31 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (changed_comments_amit_v29.patch) at 2022-09-15 11:39:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (rollback-50%.png) at 2022-09-15 06:03:13 from "shiy.fnst at fujitsu.com" <shiy.fnst at fujitsu.com> (Patch: No)
    Attachment (v29-0001-Perform-streaming-logical-transactions-by-parall.patch) at 2022-09-15 05:15:24 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (change_parallel_apply_comments_amit_1.patch) at 2022-09-08 11:24:38 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v28-0005-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-09-05 13:04:33 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v28-0005-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-09-05 12:40:34 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v27-0005-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-09-01 11:23:22 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v26-0005-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-08-31 09:55:45 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v25-0005-Add-a-main_worker_pid-to-pg_stat_subscription.patch) at 2022-08-29 11:31:42 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (details.txt) at 2022-08-24 15:05:29 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: No)
    Attachment (v24-0004-Retry-to-apply-streaming-xact-only-in-apply-work.patch) at 2022-08-24 13:47:15 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v23-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-08-17 06:28:21 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v22-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-08-16 07:33:04 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: No)
    Attachment (v21-0003-Add-some-checks-before-using-apply-background-wo.patch) at 2022-08-11 08:04:40 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v21-0003-Add-some-checks-before-using-apply-background-wo.patch) at 2022-08-11 07:47:59 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v20-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-08-04 06:35:45 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (deadlock_example.txt) at 2022-08-02 11:46:21 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: No)
    Attachment (logicalrep_rel_mark_parallel_apply-with-goto.txt) at 2022-07-27 03:37:06 from Peter Smith <smithpb2250 at gmail.com> (Patch: No)
    Attachment (v19-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-07-22 02:56:39 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v18-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-07-19 02:28:43 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v17-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-07-13 05:48:45 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v16-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-07-07 10:20:45 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v15-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-07-07 03:44:04 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v14-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-06-28 03:21:33 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v13-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-06-23 07:21:43 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (improve_comments_1.patch) at 2022-06-20 02:59:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-06-17 07:17:10 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v11-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-06-15 08:26:40 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v10-0001-Perform-streaming-logical-transactions-by-backgr.patch) at 2022-06-14 03:37:04 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v9-0001-Perform-streaming-logical-transactions-by-backgro.patch) at 2022-06-08 07:12:30 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v8-0001-Perform-streaming-logical-transactions-by-backgro.patch) at 2022-06-02 10:01:37 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v7-0001-Perform-streaming-logical-transactions-by-backgro.patch) at 2022-05-30 08:51:59 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v6-0001-Perform-streaming-logical-transactions-by-backgro.patch) at 2022-05-25 02:24:59 from "wangw.fnst at fujitsu.com" <wangw.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v6-0001-Perform-streaming-logical-transactions-by-backgro.patch) at 2022-05-13 09:57:15 from "shiy.fnst at fujitsu.com" <shiy.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v6-0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-05-13 08:48:33 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v5-0002-Test-streaming-apply-option-in-tap-test.patch) at 2022-04-29 05:22:41 from "shiy.fnst at fujitsu.com" <shiy.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v5-0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-04-29 02:06:48 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v4-0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-04-20 12:22:12 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v3-0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-04-20 08:57:02 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (v2-0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-04-14 03:42:39 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (0001-Perform-streaming-logical-transactions-by-background.patch) at 2022-04-08 09:14:08 from "houzj.fnst at fujitsu.com" <houzj.fnst at fujitsu.com> (Patch: Yes)
History
When Who What
2022-11-03 22:28:31 Peter Smith (smithpb2250) Added smithpb2250 as reviewer
2022-10-12 07:01:39 Michael Paquier (michael-kun) New status: Waiting on Author
2022-10-12 07:01:22 Michael Paquier (michael-kun) Closed in commitfest 2022-09 with status: Moved to next CF
2022-08-01 21:35:44 Jacob Champion (jchampion) Closed in commitfest 2022-07 with status: Moved to next CF
2022-04-14 09:03:58 Hou Zhijie (houzj) Changed authors to Hou Zhijie (houzj)
2022-04-14 09:03:36 Hou Zhijie (houzj) Attached mail thread CAA4eK1+wyN6zpaHUkCLorEWNx75MG0xhMwcFhvjqm2KURZEAGw@mail.gmail.com
2022-04-14 09:03:36 Hou Zhijie (houzj) Created patch record
Edit