Improve WALRead() to suck data directly from WAL buffers when possible

Edit
ID 4060
Title Improve WALRead() to suck data directly from WAL buffers when possible
Topic Replication & Recovery
Created 2022-12-10 13:45:51
Last modified 2024-04-11 01:01:43 (7 months, 4 weeks ago)
Latest email 2024-04-09 06:33:49 (8 months ago)
Status
2024-03: Committed
2024-01: Moved to next CF
2023-11: Moved to next CF
2023-09: Moved to next CF
2023-07: Moved to next CF
2023-03: Moved to next CF
2023-01: Moved to next CF
Target version
Authors Bharath Rupireddy (bharathrupireddy)
Reviewers Nathan Bossart (bossartn)Become reviewer
Committer Jeff Davis (jdavis)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/4060
git checkout commitfest/cf/4060
Emails
Improve WALRead() to suck data directly from WAL buffers when possible
First at 2022-12-09 09:03:39 by Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com>
Latest at 2024-04-09 06:33:49 by "Andrey M. Borodin" <x4mmm at yandex-team.ru>
Latest attachment (v27-0001-Add-test-module-to-demonstrate-reading-from-WAL.patch) at 2024-04-08 05:17:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com>
    Attachment (v27-0001-Add-test-module-to-demonstrate-reading-from-WAL.patch) at 2024-04-08 05:17:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Add-check-in-WALReadFromBuffers-against-requeste.patch) at 2024-03-21 18:03:12 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Add-check-in-WALReadFromBuffers-against-requeste.patch) at 2024-02-20 06:10:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v24-0004-Demonstrate-reading-unflushed-WAL-directly-from-.patch) at 2024-02-17 04:57:20 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v23-0002-Add-test-module-for-verifying-read-from-WAL-buff.patch) at 2024-02-16 07:38:45 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Add-assert-to-WALReadFromBuffers.patch) at 2024-02-14 01:29:47 from Jeff Davis <pgsql at j-davis.com> (Patch: Yes)
    Attachment (v22-0004-Use-WALReadFromBuffers-in-more-places.patch) at 2024-01-31 09:00:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v21-0001-Add-XLogReadFromBuffers.patch) at 2024-01-27 08:00:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v20-0001-Add-XLogReadFromBuffers.patch) at 2024-01-25 09:05:30 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v19j-0001-Add-XLogReadFromBuffers.patch) at 2024-01-23 04:07:03 from Jeff Davis <pgsql at j-davis.com> (Patch: Yes)
    Attachment (v19-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2024-01-10 14:29:29 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-12-20 10:06:06 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-12-07 10:29:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-11-08 07:40:34 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Use-64-bit-atomics-for-xlblocks-array-elements.patch) at 2023-11-04 15:25:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v14-0001-Track-oldest-initialized-WAL-buffer-page.patch) at 2023-11-02 17:08:38 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-26 22:16:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-21 18:29:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Allow-WAL-reading-from-WAL-buffers.patch) at 2023-10-20 16:49:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v10-0001-Improve-WALRead-to-suck-data-directly-from-WAL-b.patch) at 2023-03-14 07:58:42 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-14 03:32:23 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v8-0003-Don-t-clear-the-WAL-buffers-in-XLogBackgroundFlush.patch) at 2023-03-11 19:22:00 from Nitin Jadhav <nitinjadhavpostgres at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-07 07:09:13 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-03 13:30:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-02 11:43:32 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-03-01 09:09:54 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-02-08 14:30:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2023-02-08 04:27:27 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (test_case_1.png) at 2023-01-27 09:35:01 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (WALDIO&WALBUFFERSREADCOMPARISON.png) at 2023-01-26 05:33:28 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (USE-ON-HEAD-Collect-WAL-read-from-file-stats.txt) at 2022-12-26 08:50:07 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v1-0001-Improve-WALRead-to-suck-data-directly-from-WAL-bu.patch) at 2022-12-09 09:03:39 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
History
When Who What
2024-04-11 01:01:43 Michael Paquier (michael-kun) Closed in commitfest 2024-03 with status: Committed
2024-04-10 19:14:15 Andrey Borodin (x4m) New status: Waiting on Author
2024-02-24 21:18:58 Nathan Bossart (bossartn) Changed committer to jdavis
2024-02-01 17:59:50 vigneshwaran C (vignesh.postgres) Closed in commitfest 2024-01 with status: Moved to next CF
2023-12-04 09:58:26 John Naylor (john.naylor) Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 11:06:47 Peter Eisentraut (petere) Closed in commitfest 2023-09 with status: Moved to next CF
2023-08-03 08:13:14 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2023-07 with status: Moved to next CF
2023-04-09 03:09:12 Greg Stark (stark) Closed in commitfest 2023-03 with status: Moved to next CF
2023-02-28 00:45:01 Nathan Bossart (bossartn) Added bossartn as reviewer
2023-01-31 16:21:05 vigneshwaran C (vignesh.postgres) Closed in commitfest 2023-01 with status: Moved to next CF
2022-12-10 13:46:00 Bharath Rupireddy (bharathrupireddy) Changed authors to Bharath Rupireddy (bharathrupireddy)
2022-12-10 13:45:51 Bharath Rupireddy (bharathrupireddy) Attached mail thread CALj2ACXKKK=wbiG5_t6dGao5GoecMwRkhr7GjVBM_jg54+Na=Q@mail.gmail.com
2022-12-10 13:45:51 Bharath Rupireddy (bharathrupireddy) Created patch record
Edit