Prefetching in recovery, take II

Edit
ID 3397
Title Prefetching in recovery, take II
Topic Replication & Recovery
Created 2021-11-01 05:07:18
Last modified 2022-04-08 02:26:59 (2 years, 7 months ago)
Latest email 2022-04-08 01:46:49 (2 years, 7 months ago)
Status
2022-03: Committed
2022-01: Moved to next CF
2021-11: Moved to next CF
Target version 15
Authors Thomas Munro (macdice)
Reviewers Julien Rouhaud (rjuju)Become reviewer
Committer Thomas Munro (macdice)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/3397
git checkout commitfest/cf/3397
Emails
WIP: WAL prefetch (another approach)
First at 2020-01-01 13:39:04 by Thomas Munro <thomas.munro at gmail.com>
Latest at 2022-04-27 00:10:40 by Thomas Munro <thomas.munro at gmail.com>
Latest attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com>
    Attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-20 04:36:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v23-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-14 05:15:59 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (change-after-juliens-review.txt) at 2022-03-11 05:35:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-11 05:31:13 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v21-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-08 05:15:43 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v20-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-12-29 04:29:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (prefetching.png) at 2021-11-25 22:32:07 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v19-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-11-23 10:13:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (fix-xlogfindnext.diff) at 2021-04-29 02:25:53 from Andres Freund <andres at anarazel.de> (Patch: Yes)
    Attachment (pg_stat_prefetch_recovery_doc_v1.diff) at 2021-04-13 02:33:12 from "Shinoda, Noriyoshi (PN Japan FSIP)" <noriyoshi.shinoda at hpe.com> (Patch: Yes)
    Attachment (v17-0001-Move-callback-call-from-ReadPageInternal-to-XLog.patch) at 2021-04-07 11:24:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Provide-ReadRecentBuffer-to-re-pin-buffers-by-ID.patch) at 2021-03-18 00:54:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetching.png) at 2021-02-04 00:40:26 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v15-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-12-24 03:06:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (tidseq-without-FPW-4kTPS_cpuOverSize.csv.png) at 2020-12-11 12:24:29 from Jakub Wartak <Jakub.Wartak at tomtom.com> (Patch: No)
    Attachment (v14-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-18 05:10:31 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-13 02:20:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme.png) at 2020-10-10 11:29:35 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v12-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-10-06 05:04:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-09-23 23:38:45 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (000000010000001600000081.log.gz) at 2020-09-01 13:14:26 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v10-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-08-13 06:57:20 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme-prefetch.png) at 2020-06-05 15:20:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v9-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-05-28 11:12:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-04-08 21:55:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Rationalize-GetWalRcv-Write-Flush-RecPtr.patch) at 2020-04-08 11:27:56 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela.patch) at 2020-04-07 16:24:21 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v5.patch) at 2020-03-18 05:18:44 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v4.patch) at 2020-03-17 06:32:55 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRelatio.patch) at 2020-03-02 05:43:23 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v2.patch) at 2020-02-12 06:52:42 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetch-another-approach-v1.tgz) at 2020-01-01 13:39:04 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
History
When Who What
2022-04-08 02:26:59 Thomas Munro (macdice) Closed in commitfest 2022-03 with status: Committed
2022-04-08 02:26:59 Thomas Munro (macdice) Changed committer to macdice
2022-04-06 16:11:02 Julien Rouhaud (rjuju) New status: Waiting on Author
2022-03-31 12:09:29 Julien Rouhaud (rjuju) New status: Needs review
2022-03-09 06:55:12 Julien Rouhaud (rjuju) New status: Waiting on Author
2022-03-08 12:55:08 Julien Rouhaud (rjuju) Added rjuju as reviewer
2022-02-02 16:38:06 Julien Rouhaud (rjuju) Closed in commitfest 2022-01 with status: Moved to next CF
2022-01-13 11:02:16 Thomas Munro (macdice) New status: Needs review
2021-12-02 10:39:43 Thomas Munro (macdice) Closed in commitfest 2021-11 with status: Moved to next CF
2021-11-03 14:02:17 Thomas Munro (macdice) New status: Waiting on Author
2021-11-01 05:08:16 Thomas Munro (macdice) Changed targetversion to 15
2021-11-01 05:07:47 Thomas Munro (macdice) Changed authors to Thomas Munro (macdice)
2021-11-01 05:07:18 Thomas Munro (macdice) Attached mail thread CA+hUKGJ4VJN8ttxScUFM8dOKX0BrBiboo5uz1cq=AovOddfHpA@mail.gmail.com
2021-11-01 05:07:18 Thomas Munro (macdice) Created patch record
Edit