data loss bug in initial sync of logical replication

Edit
ID 4766
Title data loss bug in initial sync of logical replication
Topic Bug Fixes
Created 2024-01-08 15:41:14
Last modified 2024-10-04 11:20:49 (1 month, 4 weeks ago)
Latest email 2024-10-08 09:51:38 (1 month, 3 weeks ago)
Status
2024-11: Needs review
2024-09: Moved to next CF
2024-07: Moved to next CF
2024-03: Moved to next CF
Target version
Authors Tomas Vondra (fuzzycz)
Reviewers Nitin Motiani (nitinmotiani)Become reviewer
Committer
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/4766
git checkout commitfest/cf/4766
Emails
long-standing data loss bug in initial sync of logical replication
First at 2023-11-17 14:36:25 by Tomas Vondra <tomas.vondra at enterprisedb.com>
Latest at 2024-10-08 09:51:38 by Shlok Kyal <shlok.kyal.oss at gmail.com>
Latest attachment (v14-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-08 05:41:12 from Shlok Kyal <shlok.kyal.oss at gmail.com>
    Attachment (v14-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-08 05:41:12 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (minor_fix.diffs) at 2024-10-08 03:11:35 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v13-0002-Selective-Invalidation-of-Cache.patch) at 2024-10-07 11:15:03 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-04 07:22:51 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (add_invalidations.diffs) at 2024-10-03 10:15:38 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v11-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-03 05:42:47 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (performance_comparison.PNG) at 2024-09-30 04:58:17 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (v10-0002-Selective-Invalidation-of-Cache.patch) at 2024-09-27 11:24:46 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-09-26 06:09:33 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (0001-test-invalidation-distribution.patch.txt) at 2024-09-10 04:25:24 from "Zhijie Hou (Fujitsu)" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (test3.pl) at 2024-09-09 05:21:43 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test2.pl) at 2024-09-09 05:11:36 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (os_info.txt) at 2024-08-30 09:35:48 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test_issue_reproduce.patch) at 2024-08-15 16:00:32 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-09 11:20:31 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-08 10:54:22 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v6-topup-amit.patch.txt) at 2024-07-17 06:24:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-16 13:24:07 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-15 18:12:45 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alter_pub_for_schema.patch) at 2024-07-11 12:49:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: Yes)
    Attachment (deadlock.txt) at 2024-07-10 17:52:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: No)
    Attachment (v4-0001-Fix-data-loss-during-initial-sync-in-logical-repl_HEAD.patch) at 2024-07-10 16:37:29 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-10 06:58:41 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Fix-random-data-loss-during-logical-replication.patch) at 2024-07-09 14:43:42 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alternate_lock_HEAD.patch) at 2024-07-01 05:20:52 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (err_logical_replication.zip) at 2024-01-16 10:24:02 from Vadim Lakt <vadim.lakt at gmail.com> (Patch: No)
    Attachment (0001-debug-logging.patch) at 2023-11-17 14:36:25 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
History
When Who What
2024-10-04 11:20:49 Shlok Kyal (shlokkyal) Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-01 06:22:11 Corey Huinker (coreyh) Closed in commitfest 2024-07 with status: Moved to next CF
2024-07-15 18:33:48 Nitin Motiani (nitinmotiani) Added nitinmotiani as reviewer
2024-04-21 07:03:40 Peter Eisentraut (petere) Changed authors to Tomas Vondra (fuzzycz)
2024-04-08 14:02:15 Andrey Borodin (x4m) Closed in commitfest 2024-03 with status: Moved to next CF
2024-01-08 15:41:14 Tomas Vondra (fuzzycz) Attached mail thread de52b282-1166-1180-45a2-8d8917ca74c6@enterprisedb.com
2024-01-08 15:41:14 Tomas Vondra (fuzzycz) Created patch record
Edit