Improve WALRead() to suck data directly from WAL buffers when possible

Edit

Title

Topic

Replication & Recovery

Created

2022-12-10 13:45:51

Last modified

2024-04-11 01:01:43 (1 week, 6 days ago)

Latest email

2024-04-09 06:33:49 (2 weeks, 1 day ago)

Status

2024-03: Committed

2024-01: Moved to next CF

2023-11: Moved to next CF

2023-09: Moved to next CF

2023-07: Moved to next CF

2023-03: Moved to next CF

2023-01: Moved to next CF

Target version

Authors

Bharath Rupireddy (bharathrupireddy)

Reviewers

Nathan Bossart (bossartn)Become reviewer

Committer

Jeff Davis (jdavis)

Links

Emails

Improve WALRead() to suck data directly from WAL buffers when possible: First at 2022-12-09 09:03:39 by Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com>
Latest at 2024-04-09 06:33:49 by "Andrey M. Borodin" <x4mmm at yandex-team.ru>
Latest attachment (v27-0001-Add-test-module-to-demonstrate-reading-from-WAL.patch) at 2024-04-08 05:17:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com>
    Attachment (v27-0001-Add-test-module-to-demonstrate-reading-from-WAL.patch) at 2024-04-08 05:17:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Add-check-in-WALReadFromBuffers-against-requeste.patch) at 2024-03-21 18:03:12 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Add-check-in-WALReadFromBuffers-against-requeste.patch) at 2024-02-20 06:10:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v24-0004-Demonstrate-reading-unflushed-WAL-directly-from-.patch) at 2024-02-17 04:57:20 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v23-0002-Add-test-module-for-verifying-read-from-WAL-buff.patch) at 2024-02-16 07:38:45 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Add-assert-to-WALReadFromBuffers.patch) at 2024-02-14 01:29:47 from Jeff Davis <pgsql at j-davis.com> (Patch: Yes)
    Attachment (v22-0004-Use-WALReadFromBuffers-in-more-places.patch) at 2024-01-31 09:00:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v21-0001-Add-XLogReadFromBuffers.patch) at 2024-01-27 08:00:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v20-0001-Add-XLogReadFromBuffers.patch) at 2024-01-25 09:05:30 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v19j-0001-Add-XLogReadFromBuffers.patch) at 2024-01-23 04:07:03 from Jeff Davis <pgsql at j-davis.com> (Patch: Yes)
    Attachment (v19-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2024-01-10 14:29:29 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-12-20 10:06:06 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-12-07 10:29:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-11-08 07:40:34 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-11-04 15:25:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Track-oldest-initialized-WAL-buffer-page.patch) at 2023-11-02 17:08:38 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-26 22:16:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-21 18:29:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-20 16:49:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v10-0001-Improve-WALRead-to-suck-data-directly-from-WAL-b.patch) at 2023-03-14 07:58:42 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-14 03:32:23 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v8-0003-Don-t-clear-the-WAL-buffers-in-XLogBackgroundFlush.patch) at 2023-03-11 19:22:00 from Nitin Jadhav <nitinjadhavpostgres at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-07 07:09:13 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-03 13:30:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-02 11:43:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-01 09:09:54 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-02-08 14:30:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-02-08 04:27:27 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (test_case_1.png) at 2023-01-27 09:35:01 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (WALDIO&WALBUFFERSREADCOMPARISON.png) at 2023-01-26 05:33:28 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (USE-ON-HEAD-Collect-WAL-read-from-file-stats.txt) at 2022-12-26 08:50:07 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2022-12-09 09:03:39 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)

History

When	Who	What
2024-04-11 01:01:43	Michael Paquier (michael-kun)	Closed in commitfest 2024-03 with status: Committed
2024-04-10 19:14:15	Andrey Borodin (x4m)	New status: Waiting on Author
2024-02-24 21:18:58	Nathan Bossart (bossartn)	Changed committer to jdavis
2024-02-01 17:59:50	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2024-01 with status: Moved to next CF
2023-12-04 09:58:26	John Naylor (john.naylor)	Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 11:06:47	Peter Eisentraut (petere)	Closed in commitfest 2023-09 with status: Moved to next CF
2023-08-03 08:13:14	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2023-07 with status: Moved to next CF
2023-04-09 03:09:12	Greg Stark (stark)	Closed in commitfest 2023-03 with status: Moved to next CF
2023-02-28 00:45:01	Nathan Bossart (bossartn)	Added bossartn as reviewer
2023-01-31 16:21:05	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2023-01 with status: Moved to next CF
2022-12-10 13:46:00	Bharath Rupireddy (bharathrupireddy)	Changed authors to Bharath Rupireddy (bharathrupireddy)
2022-12-10 13:45:51	Bharath Rupireddy (bharathrupireddy)	Attached mail thread CALj2ACXKKK=wbiG5_t6dGao5GoecMwRkhr7GjVBM_jg54+Na=Q@mail.gmail.com
2022-12-10 13:45:51	Bharath Rupireddy (bharathrupireddy)	Created patch record

Edit