data loss bug in initial sync of logical replication

Edit
ID 4766
Title data loss bug in initial sync of logical replication
CI (CFBot) Needs rebase! Needs rebase since 3 months. Failing since 3 months.
Additional links previous successfully applied patch (outdated):
Summary
Stats (from CFBot) Unknown
Topic Bug Fixes
Tags
Created 2024-01-08 15:41:14
Last modified 2025-08-01 04:43:29 (2 months ago)
Latest email 2025-04-25 09:08:51 (6 months ago)
Status
PG19-2 (2025-09-01 – 2025-09-30): Committed
2025-03 (2025-03-01 – 2025-04-08): Moved to different CF
2025-01 (2025-01-01 – 2025-01-31): Moved to different CF
2024-11 (2024-11-01 – 2024-11-30): Moved to different CF
2024-09 (2024-09-01 – 2024-09-30): Moved to different CF
2024-07 (2024-07-01 – 2024-07-31): Moved to different CF
2024-03 (2024-03-01 – 2024-04-08): Moved to different CF
Target version
Authors Tomas Vondra (fuzzycz)
Reviewers Nitin Motiani (nitinmotiani), work nsandeepkumar (nsandeepk)Become reviewer
Committer Amit Kapila (amitkapila)
Links
Emails
long-standing data loss bug in initial sync of logical replication
First at 2023-11-17 14:36:25 by Tomas Vondra <tomas.vondra at enterprisedb.com>
Latest at 2025-04-25 09:08:51 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v1_HEAD-0001-Fix-spelling-for-file-names.patch) at 2025-04-25 05:15:39 from Shlok Kyal <shlok.kyal.oss at gmail.com>
    Attachment (v1_HEAD-0001-Fix-spelling-for-file-names.patch) at 2025-04-25 05:15:39 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v20_REL_13-0001-Fix-data-loss-in-logical-replication.txt) at 2025-03-18 04:20:20 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v19_REL_13-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 11:26:34 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v19_REL_14-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 08:37:33 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v18-0001-amit.diff.txt) at 2025-03-17 05:41:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v18_REL_14-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 01:22:59 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (A.pl.txt) at 2025-03-13 08:02:50 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: No)
    Attachment (v18-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-03-13 05:29:30 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (cache_inval_bug_v1.ods) at 2025-02-28 08:28:13 from Benoit Lobréau <benoit.lobreau at dalibo.com> (Patch: No)
    Attachment (v17-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-02-28 06:42:12 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-add-comments-for-txns-without-base-snapshot.patch) at 2025-02-27 08:14:01 from "Zhijie Hou (Fujitsu)" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (101_tests.pl) at 2025-02-26 03:51:29 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (v16-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-02-24 11:18:50 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-12-11 03:43:32 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-08 05:41:12 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (minor_fix.diffs) at 2024-10-08 03:11:35 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v13-0002-Selective-Invalidation-of-Cache.patch) at 2024-10-07 11:15:03 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-04 07:22:51 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (add_invalidations.diffs) at 2024-10-03 10:15:38 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v11-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-03 05:42:47 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (performance_comparison.PNG) at 2024-09-30 04:58:17 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (v10-0002-Selective-Invalidation-of-Cache.patch) at 2024-09-27 11:24:46 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-09-26 06:09:33 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (0001-test-invalidation-distribution.patch.txt) at 2024-09-10 04:25:24 from "Zhijie Hou (Fujitsu)" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (test3.pl) at 2024-09-09 05:21:43 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test2.pl) at 2024-09-09 05:11:36 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (os_info.txt) at 2024-08-30 09:35:48 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test_issue_reproduce.patch) at 2024-08-15 16:00:32 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-09 11:20:31 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-08 10:54:22 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v6-topup-amit.patch.txt) at 2024-07-17 06:24:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-16 13:24:07 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-15 18:12:45 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alter_pub_for_schema.patch) at 2024-07-11 12:49:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: Yes)
    Attachment (deadlock.txt) at 2024-07-10 17:52:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: No)
    Attachment (v4-0001-Fix-data-loss-during-initial-sync-in-logical-repl_HEAD.patch) at 2024-07-10 16:37:29 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-10 06:58:41 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Fix-random-data-loss-during-logical-replication.patch) at 2024-07-09 14:43:42 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alternate_lock_HEAD.patch) at 2024-07-01 05:20:52 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (err_logical_replication.zip) at 2024-01-16 10:24:02 from Vadim Lakt <vadim.lakt at gmail.com> (Patch: No)
    Attachment (0001-debug-logging.patch) at 2023-11-17 14:36:25 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
History
When Who What
2025-08-01 04:43:29 Hayato Kuroda (ha-kun) Closed in commitfest PG19-2 with status: Committed
2025-08-01 04:43:29 Hayato Kuroda (ha-kun) Changed committer to amitkapila
2025-07-24 16:54:21 CFbot Patch needs rebase
2025-07-24 15:44:07 Álvaro Herrera (alvherre) Moved from CF 2025-03 to CF PG19-2
2025-03-18 04:31:46 CFbot Patch does not need rebase anymore
2025-03-17 01:31:42 CFbot Patch needs rebase
2025-02-12 16:03:57 Álvaro Herrera (alvherre) Closed in commitfest 2025-01 with status: Moved to next CF
2025-01-26 06:17:17 work nsandeepkumar (nsandeepk) Added nsandeepk as reviewer
2024-12-10 06:27:35 Michael Paquier (michael-kun) Closed in commitfest 2024-11 with status: Moved to next CF
2024-10-04 11:20:49 Shlok Kyal (shlokkyal) Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-01 06:22:11 Corey Huinker (coreyh) Closed in commitfest 2024-07 with status: Moved to next CF
2024-07-15 18:33:48 Nitin Motiani (nitinmotiani) Added nitinmotiani as reviewer
2024-04-21 07:03:40 Peter Eisentraut (petere) Changed authors to Tomas Vondra (fuzzycz)
2024-04-08 14:02:15 Andrey Borodin (x4m) Closed in commitfest 2024-03 with status: Moved to next CF
2024-01-08 15:41:14 Tomas Vondra (fuzzycz) Attached mail thread de52b282-1166-1180-45a2-8d8917ca74c6@enterprisedb.com
2024-01-08 15:41:14 Tomas Vondra (fuzzycz) Created patch record
Edit