WAL prefetch (another approach)

Edit

ID 2410

Title WAL prefetch (another approach)

Topic Replication & Recovery

Created 2020-01-01 13:41:18

Last modified 2021-04-08 14:21:40 (3 years, 7 months ago)

Latest email 2022-04-08 01:46:49 (2 years, 7 months ago)

Status

2021-03: Committed

2021-01: Moved to next CF

2020-11: Moved to next CF

2020-09: Moved to next CF

2020-07: Moved to next CF

2020-03: Moved to next CF

2020-01: Moved to next CF

Target version

Authors Thomas Munro (macdice)

Reviewers David Kimura (dgkimura)Become reviewer

Committer Thomas Munro (macdice)

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2410
git checkout commitfest/cf/2410

Emails

WIP: WAL prefetch (another approach): First at 2020-01-01 13:39:04 by Thomas Munro <thomas.munro at gmail.com>
Latest at 2022-04-27 00:10:40 by Thomas Munro <thomas.munro at gmail.com>
Latest attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com>
    Attachment (v25-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-31 09:49:32 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Prefetch-referenced-data-in-recovery-take-II.patch) at 2022-03-20 04:36:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v23-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-14 05:15:59 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (change-after-juliens-review.txt) at 2022-03-11 05:35:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-11 05:31:13 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v21-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2022-03-08 05:15:43 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v20-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-12-29 04:29:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (prefetching.png) at 2021-11-25 22:32:07 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v19-0001-Add-circular-WAL-decoding-buffer-take-II.patch) at 2021-11-23 10:13:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (fix-xlogfindnext.diff) at 2021-04-29 02:25:53 from Andres Freund <andres at anarazel.de> (Patch: Yes)
    Attachment (pg_stat_prefetch_recovery_doc_v1.diff) at 2021-04-13 02:33:12 from "Shinoda, Noriyoshi (PN Japan FSIP)" <noriyoshi.shinoda at hpe.com> (Patch: Yes)
    Attachment (v17-0001-Move-callback-call-from-ReadPageInternal-to-XLog.patch) at 2021-04-07 11:24:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Provide-ReadRecentBuffer-to-re-pin-buffers-by-ID.patch) at 2021-03-18 00:54:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetching.png) at 2021-02-04 00:40:26 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (v15-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-12-24 03:06:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (tidseq-without-FPW-4kTPS_cpuOverSize.csv.png) at 2020-12-11 12:24:29 from Jakub Wartak <Jakub.Wartak at tomtom.com> (Patch: No)
    Attachment (v14-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-18 05:10:31 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-11-13 02:20:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme.png) at 2020-10-10 11:29:35 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v12-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-10-06 05:04:57 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-09-23 23:38:45 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (000000010000001600000081.log.gz) at 2020-09-01 13:14:26 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v10-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-08-13 06:57:20 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (nvme-prefetch.png) at 2020-06-05 15:20:52 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: No)
    Attachment (v9-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-05-28 11:12:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Add-pg_atomic_unlocked_add_fetch_XXX.patch) at 2020-04-08 21:55:25 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Rationalize-GetWalRcv-Write-Flush-RecPtr.patch) at 2020-04-08 11:27:56 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela.patch) at 2020-04-07 16:24:21 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v5.patch) at 2020-03-18 05:18:44 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v4.patch) at 2020-03-17 06:32:55 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRelatio.patch) at 2020-03-02 05:43:23 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-PrefetchBuffer-to-be-called-with-a-SMgrRela-v2.patch) at 2020-02-12 06:52:42 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (wal-prefetch-another-approach-v1.tgz) at 2020-01-01 13:39:04 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)

History

When	Who	What
2021-04-08 14:21:41	Thomas Munro (macdice)	Closed in commitfest 2021-03 with status: Committed
2021-04-08 14:21:40	Thomas Munro (macdice)	Changed committer to macdice
2021-02-01 12:42:22	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-01 11:07:23	Anastasia Lubennikova (lubennikovaav)	Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-01 04:07:35	Michael Paquier (michael-kun)	Closed in commitfest 2020-09 with status: Moved to next CF
2020-07-29 03:39:08	Thomas Munro (macdice)	Closed in commitfest 2020-07 with status: Moved to next CF
2020-04-08 21:57:56	Thomas Munro (macdice)	New status: Needs review
2020-04-08 12:31:45	David Steele (dsteele)	New status: Waiting on Author
2020-04-08 12:30:51	David Steele (dsteele)	Closed in commitfest 2020-03 with status: Moved to next CF
2020-02-01 12:54:51	Tomas Vondra (fuzzycz)	Closed in commitfest 2020-01 with status: Moved to next CF
2020-01-07 23:28:32	David Kimura (dgkimura)	Added dgkimura as reviewer
2020-01-01 13:43:59	Thomas Munro (macdice)	Changed authors to Thomas Munro (macdice)
2020-01-01 13:41:18	Thomas Munro (macdice)	Attached mail thread CA+hUKGJ4VJN8ttxScUFM8dOKX0BrBiboo5uz1cq=AovOddfHpA@mail.gmail.com
2020-01-01 13:41:18	Thomas Munro (macdice)	Created patch record

Edit