WAL prefetch (another approach)

Edit
ID 2410
Title WAL prefetch (another approach)
Topic Replication & Recovery
Created 2020-01-01 13:41:18
Last modified 2021-04-08 14:21:40 (3 years, 6 months ago)
Latest email 2022-04-08 01:46:49 (2 years, 6 months ago)
Status
2021-03: Committed
2021-01: Moved to next CF
2020-11: Moved to next CF
2020-09: Moved to next CF
2020-07: Moved to next CF
2020-03: Moved to next CF
2020-01: Moved to next CF
Target version
Authors Thomas Munro (macdice)
Reviewers David Kimura (dgkimura)Become reviewer
Committer Thomas Munro (macdice)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2410
git checkout commitfest/cf/2410
Emails
WIP: WAL prefetch (another approach)
First at 2020-01-01 13:39:04 by Thomas Munro <thomas.munro at gmail.com>
Latest at 2022-04-27 00:10:40 by Thomas Munro <thomas.munro at gmail.com>
Latest attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com>
    Attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-20 04:36:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v23-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-14 05:15:59 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (change-after-juliens-review.txt) at 2022-03-11 05:35:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-11 05:31:13 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v21-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-08 05:15:43 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v20-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-12-29 04:29:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (prefetching.png) at 2021-11-25 22:32:07 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v19-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-11-23 10:13:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (fix-xlogfindnext.diff) at 2021-04-29 02:25:53 from Andres Freund <andres at anarazel.de> (Patch: Yes)
    Attachment (pg_stat_prefetch_recovery_doc_v1.diff) at 2021-04-13 02:33:12 from "Shinoda, Noriyoshi (PN Japan FSIP)" <noriyoshi.shinoda at hpe.com> (Patch: Yes)
    Attachment (v17-0001-Move-callback-call-from-ReadPageInternal-to-XLog.patch) at 2021-04-07 11:24:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Provide-ReadRecentBuffer-to-re-pin-buffers-by-ID.patch) at 2021-03-18 00:54:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetching.png) at 2021-02-04 00:40:26 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v15-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-12-24 03:06:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (tidseq-without-FPW-4kTPS_cpuOverSize.csv.png) at 2020-12-11 12:24:29 from Jakub Wartak <Jakub.Wartak at tomtom.com> (Patch: No)
    Attachment (v14-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-18 05:10:31 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-13 02:20:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme.png) at 2020-10-10 11:29:35 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v12-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-10-06 05:04:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-09-23 23:38:45 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (000000010000001600000081.log.gz) at 2020-09-01 13:14:26 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v10-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-08-13 06:57:20 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme-prefetch.png) at 2020-06-05 15:20:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v9-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-05-28 11:12:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-04-08 21:55:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Rationalize-GetWalRcv-Write-Flush-RecPtr.patch) at 2020-04-08 11:27:56 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela.patch) at 2020-04-07 16:24:21 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v5.patch) at 2020-03-18 05:18:44 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v4.patch) at 2020-03-17 06:32:55 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRelatio.patch) at 2020-03-02 05:43:23 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v2.patch) at 2020-02-12 06:52:42 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetch-another-approach-v1.tgz) at 2020-01-01 13:39:04 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
History
When Who What
2021-04-08 14:21:41 Thomas Munro (macdice) Closed in commitfest 2021-03 with status: Committed
2021-04-08 14:21:40 Thomas Munro (macdice) Changed committer to macdice
2021-02-01 12:42:22 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-01 11:07:23 Anastasia Lubennikova (lubennikovaav) Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-01 04:07:35 Michael Paquier (michael-kun) Closed in commitfest 2020-09 with status: Moved to next CF
2020-07-29 03:39:08 Thomas Munro (macdice) Closed in commitfest 2020-07 with status: Moved to next CF
2020-04-08 21:57:56 Thomas Munro (macdice) New status: Needs review
2020-04-08 12:31:45 David Steele (dsteele) New status: Waiting on Author
2020-04-08 12:30:51 David Steele (dsteele) Closed in commitfest 2020-03 with status: Moved to next CF
2020-02-01 12:54:51 Tomas Vondra (fuzzycz) Closed in commitfest 2020-01 with status: Moved to next CF
2020-01-07 23:28:32 David Kimura (dgkimura) Added dgkimura as reviewer
2020-01-01 13:43:59 Thomas Munro (macdice) Changed authors to Thomas Munro (macdice)
2020-01-01 13:41:18 Thomas Munro (macdice) Attached mail thread CA+hUKGJ4VJN8ttxScUFM8dOKX0BrBiboo5uz1cq=AovOddfHpA@mail.gmail.com
2020-01-01 13:41:18 Thomas Munro (macdice) Created patch record
Edit