data loss bug in initial sync of logical replication

Title

CI (CFBot)

Needs rebase! Needs rebase since 2 weeks. Failing since 2 weeks.
Additional links previous successfully applied patch (outdated):

Summary

Stats (from CFBot)

Unknown

Topic

Bug Fixes

Tags

Created

2024-01-08 15:41:14

Last modified

2025-08-01 04:43:29 (1 week ago)

Latest email

2025-04-25 09:08:51 (3 months ago)

Status

PG19-2 (2025-09-01 - 2025-09-30): Committed

2025-03 (2025-03-01 - 2025-04-08): Moved to different CF

2025-01 (2025-01-01 - 2025-01-31): Moved to different CF

2024-11 (2024-11-01 - 2024-11-30): Moved to different CF

2024-09 (2024-09-01 - 2024-09-30): Moved to different CF

2024-07 (2024-07-01 - 2024-07-31): Moved to different CF

2024-03 (2024-03-01 - 2024-04-08): Moved to different CF

Target version

Authors

Tomas Vondra (fuzzycz)

Reviewers

Nitin Motiani (nitinmotiani), work nsandeepkumar (nsandeepk)Become reviewer

Committer

Amit Kapila (amitkapila)

Links

Emails

long-standing data loss bug in initial sync of logical replication: First at 2023-11-17 14:36:25 by Tomas Vondra <tomas.vondra at enterprisedb.com>
Latest at 2025-04-25 09:08:51 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v1_HEAD-0001-Fix-spelling-for-file-names.patch) at 2025-04-25 05:15:39 from Shlok Kyal <shlok.kyal.oss at gmail.com>
    Attachment (v1_HEAD-0001-Fix-spelling-for-file-names.patch) at 2025-04-25 05:15:39 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v20_REL_13-0001-Fix-data-loss-in-logical-replication.txt) at 2025-03-18 04:20:20 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v19_REL_13-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 11:26:34 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v19_REL_14-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 08:37:33 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v18-0001-amit.diff.txt) at 2025-03-17 05:41:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v18_REL_14-0001-Distribute-invalidatons-if-change-in-cata.patch) at 2025-03-17 01:22:59 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (A.pl.txt) at 2025-03-13 08:02:50 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: No)
    Attachment (v18-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-03-13 05:29:30 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (cache_inval_bug_v1.ods) at 2025-02-28 08:28:13 from Benoit Lobréau <benoit.lobreau at dalibo.com> (Patch: No)
    Attachment (v17-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-02-28 06:42:12 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-add-comments-for-txns-without-base-snapshot.patch) at 2025-02-27 08:14:01 from "Zhijie Hou (Fujitsu)" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (101_tests.pl) at 2025-02-26 03:51:29 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (v16-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2025-02-24 11:18:50 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-12-11 03:43:32 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-08 05:41:12 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (minor_fix.diffs) at 2024-10-08 03:11:35 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v13-0002-Selective-Invalidation-of-Cache.patch) at 2024-10-07 11:15:03 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-04 07:22:51 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (add_invalidations.diffs) at 2024-10-03 10:15:38 from "Hayato Kuroda (Fujitsu)" <kuroda.hayato at fujitsu.com> (Patch: Yes)
    Attachment (v11-0001-Distribute-invalidatons-if-change-in-catalog-tab.patch) at 2024-10-03 05:42:47 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (performance_comparison.PNG) at 2024-09-30 04:58:17 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (v10-0002-Selective-Invalidation-of-Cache.patch) at 2024-09-27 11:24:46 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-09-26 06:09:33 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (0001-test-invalidation-distribution.patch.txt) at 2024-09-10 04:25:24 from "Zhijie Hou (Fujitsu)" <houzj.fnst at fujitsu.com> (Patch: Yes)
    Attachment (test3.pl) at 2024-09-09 05:21:43 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test2.pl) at 2024-09-09 05:11:36 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (os_info.txt) at 2024-08-30 09:35:48 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: No)
    Attachment (test_issue_reproduce.patch) at 2024-08-15 16:00:32 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-09 11:20:31 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Distribute-invalidatons-if-change-in-catalog-tabl.patch) at 2024-08-08 10:54:22 from Shlok Kyal <shlok.kyal.oss at gmail.com> (Patch: Yes)
    Attachment (v6-topup-amit.patch.txt) at 2024-07-17 06:24:45 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-16 13:24:07 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-15 18:12:45 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alter_pub_for_schema.patch) at 2024-07-11 12:49:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: Yes)
    Attachment (deadlock.txt) at 2024-07-10 17:52:36 from Nitin Motiani <nitinmotiani at google.com> (Patch: No)
    Attachment (v4-0001-Fix-data-loss-during-initial-sync-in-logical-repl_HEAD.patch) at 2024-07-10 16:37:29 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Fix-data-loss-during-initial-sync-in-logical-repl.patch) at 2024-07-10 06:58:41 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Fix-random-data-loss-during-logical-replication.patch) at 2024-07-09 14:43:42 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (alternate_lock_HEAD.patch) at 2024-07-01 05:20:52 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (err_logical_replication.zip) at 2024-01-16 10:24:02 from Vadim Lakt <vadim.lakt at gmail.com> (Patch: No)
    Attachment (0001-debug-logging.patch) at 2023-11-17 14:36:25 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)

History

When	Who	What
2025-08-01 04:43:29	Hayato Kuroda (ha-kun)	Closed in commitfest PG19-2 with status: Committed
2025-08-01 04:43:29	Hayato Kuroda (ha-kun)	Changed committer to amitkapila
2025-07-24 16:54:21	CFbot	Patch needs rebase
2025-07-24 15:44:07	Álvaro Herrera (alvherre)	Moved from CF 2025-03 to CF PG19-2
2025-03-18 04:31:46	CFbot	Patch does not need rebase anymore
2025-03-17 01:31:42	CFbot	Patch needs rebase
2025-02-12 16:03:57	Álvaro Herrera (alvherre)	Closed in commitfest 2025-01 with status: Moved to next CF
2025-01-26 06:17:17	work nsandeepkumar (nsandeepk)	Added nsandeepk as reviewer
2024-12-10 06:27:35	Michael Paquier (michael-kun)	Closed in commitfest 2024-11 with status: Moved to next CF
2024-10-04 11:20:49	Shlok Kyal (shlokkyal)	Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-01 06:22:11	Corey Huinker (coreyh)	Closed in commitfest 2024-07 with status: Moved to next CF
2024-07-15 18:33:48	Nitin Motiani (nitinmotiani)	Added nitinmotiani as reviewer
2024-04-21 07:03:40	Peter Eisentraut (petere)	Changed authors to Tomas Vondra (fuzzycz)
2024-04-08 14:02:15	Andrey Borodin (x4m)	Closed in commitfest 2024-03 with status: Moved to next CF
2024-01-08 15:41:14	Tomas Vondra (fuzzycz)	Attached mail thread de52b282-1166-1180-45a2-8d8917ca74c6@enterprisedb.com
2024-01-08 15:41:14	Tomas Vondra (fuzzycz)	Created patch record

Edit