Index Prefetching

Edit
ID 4351
Title Index Prefetching
CI (CFBot) Summary
Stats (from CFBot) Patch version: v25, Patch count: 8, First patch: +705−526, All patches: +5310−2413
Tags Performance
Created 2023-06-08 15:40:45
Last modified 2026-04-10 00:00:02 (1 month ago)
Latest email 2026-05-27 19:11:52 (2 days ago)
Status
PG20-1 (2026-07-01 – 2026-07-31): Needs review
PG19-Final (2026-03-01 – 2026-04-09): Moved to different CF
PG19-4 (2026-01-01 – 2026-01-31): Moved to different CF
PG19-3 (2025-11-01 – 2025-11-30): Moved to different CF
PG19-1 (2025-07-01 – 2025-07-31): Moved to different CF
2025-03 (2025-03-01 – 2025-04-08): Moved to different CF
2025-01 (2025-01-01 – 2025-01-31): Moved to different CF
2024-11 (2024-11-01 – 2024-11-30): Moved to different CF
2024-09 (2024-09-01 – 2024-09-30): Moved to different CF
2024-07 (2024-07-01 – 2024-07-31): Moved to different CF
2024-03 (2024-03-01 – 2024-04-08): Moved to different CF
2024-01 (2024-01-01 – 2024-01-31): Moved to different CF
2023-11 (2023-11-01 – 2023-12-04): Moved to different CF
2023-09 (2023-09-01 – 2023-09-30): Moved to different CF
2023-07 (2023-07-01 – 2023-07-31): Moved to different CF
Target version
Authors Peter Geoghegan (pgeoghegan), Tomas Vondra (fuzzycz)
Reviewers Jerry Zhang (xingtanzjr) Become reviewer
Committer
Links
Emails
index prefetching
First at 2023-06-08 15:40:12 by Tomas Vondra <tomas.vondra at enterprisedb.com>
Latest at 2026-05-27 19:11:52 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v25-0001-Add-slot-based-table-AM-index-scan-interface.patch) at 2026-05-27 19:11:52 from Peter Geoghegan <pg at bowt.ie>
    Attachment (v25-0001-Add-slot-based-table-AM-index-scan-interface.patch) at 2026-05-27 19:11:52 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v24-0007-aio-Fix-pgaio_io_wait-for-staged-IOs-B.patch) at 2026-04-06 15:39:39 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v23-0004-heapam-Optimize-pin-transfers-during-index-scans.patch) at 2026-04-05 05:37:02 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v22-0014-aio-Fix-pgaio_io_wait-for-staged-IOs-B.patch) at 2026-04-04 04:16:37 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v21-0012-Hacky-implementation-of-making-read_stream_reset.patch) at 2026-04-03 05:17:14 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20-0016-aio-Fix-pgaio_io_wait-for-staged-IOs-B.patch) at 2026-04-01 22:50:15 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v19-0014-read_stream-Only-increase-distance-when-waiting-.patch) at 2026-03-31 17:39:30 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v18-0017-Dirty-hack-to-make-read_stream_reset-end-not-wai.patch) at 2026-03-28 00:35:24 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v17-0001-Track-index-only-scan-heap-fetches-using-IndexSc.patch) at 2026-03-23 01:14:23 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v16-0015-WIP-aio-io_uring-Use-IO-size-not-IO-queue-to-tri.patch) at 2026-03-19 17:44:16 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v15-0017-Make-hash-index-AM-use-amgetbatch-interface.patch) at 2026-03-17 17:37:34 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v14-0016-Make-hash-index-AM-use-amgetbatch-interface.patch) at 2026-03-14 00:50:50 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v13-0019-Make-hash-index-AM-use-amgetbatch-interface.patch) at 2026-03-12 19:44:32 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v12-0021-Conditional-locking-in-pgaio_worker_submit_inter.patch) at 2026-03-10 20:57:35 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (multi-client-experiment.ipynb.gz) at 2026-03-08 06:16:00 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (single-client.pdf) at 2026-03-01 15:03:36 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (v11-docker-instrumentation.zip) at 2026-02-27 08:51:19 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (v11-0011-Add-fake-LSN-support-to-hash-index-AM.patch) at 2026-02-24 18:13:25 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (generate_benchmark_data.sql) at 2026-02-17 20:16:06 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (plans-yield-noyield.txt) at 2026-02-17 17:16:23 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (distance-tracking.txt) at 2026-02-17 03:22:41 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: Yes)
    Attachment (drop_cache.c) at 2026-02-16 23:05:26 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (hdd-linux-psql-128MB.png) at 2026-02-16 05:30:00 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (purge_cache.sh) at 2026-02-15 08:00:23 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (psycopg.png) at 2026-02-15 00:13:39 from Alexandre Felipe <o.alexandre.felipe at gmail.com> (Patch: No)
    Attachment (v10-0011-Make-hash-index-AM-use-amgetbatch-interface.patch) at 2026-02-09 22:44:11 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v9-0008-Don-t-wait-for-already-in-progress-IO.patch) at 2026-01-31 00:18:02 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v8-0006-bufmgr-aio-Prototype-for-not-waiting-for-already-.patch) at 2026-01-18 23:51:58 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v7-0004-Make-hash-index-AM-use-amgetbatch-interface.patch) at 2026-01-13 20:36:28 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v6-0003-bufmgr-aio-Prototype-for-not-waiting-for-already-.patch) at 2026-01-07 18:50:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (read_stream_threshold_v2.patch) at 2025-12-29 16:34:47 from Konstantin Knizhnik <knizhnik at garret.ru> (Patch: Yes)
    Attachment (results-prefetch-v5.pdf) at 2025-12-28 18:08:12 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (read_stream_threshold.patch) at 2025-12-25 15:39:24 from Konstantin Knizhnik <knizhnik at garret.ru> (Patch: Yes)
    Attachment (v5-0002-Add-prefetching-to-index-scans-using-batch-interf.patch) at 2025-12-21 17:55:40 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v4-0003-bufmgr-aio-Prototype-for-not-waiting-for-already-.patch) at 2025-12-11 02:21:39 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v3-0003-bufmgr-aio-Prototype-for-not-waiting-for-already-.patch) at 2025-12-10 22:41:37 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v2-0004-Add-amgetbatch-support-to-hash-index-AM.patch) at 2025-12-08 20:50:56 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v1-0004-Add-amgetbatch-support-to-hash-index-AM.patch) at 2025-12-01 01:23:56 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20251109-0001-bufmgr-aio-Prototype-for-not-waiting-for-a.patch) at 2025-11-09 20:13:22 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20251106-0002-Add-amgetbatch-interface-for-index-scan-pr.patch) at 2025-11-06 04:55:50 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20251102-0001-bufmgr-aio-Prototype-for-not-waiting-for-a.patch) at 2025-11-02 23:49:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20251012-0002-Add-amgetbatch-interface-for-index-scan-pr.patch) at 2025-10-12 18:52:11 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (ryzen-nvme.png) at 2025-09-15 13:00:42 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (v20250910-0001-bufmgr-aio-Prototype-for-not-waiting-for-a.patch) at 2025-09-10 22:24:16 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (vmunro-0001-aio-Improve-read_stream.c-look-ahead-heuristi.patch) at 2025-08-29 00:38:02 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (repro.sql) at 2025-08-28 23:52:29 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (signal-echo.c) at 2025-08-28 12:45:24 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (ryzen-cold.pdf) at 2025-08-27 14:36:53 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (readstream-adaptive-distance-v2-fixed.patch) at 2025-08-26 12:56:44 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (readstream-adaptive-distance-v2.patch) at 2025-08-25 14:18:00 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v1-0001-bufmgr-aio-Prototype-for-not-waiting-for-already-.patch.txt) at 2025-08-15 15:09:41 from Andres Freund <andres at anarazel.de> (Patch: Yes)
    Attachment (seqscan.pdf) at 2025-08-14 22:24:37 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (sequential_vs_random.svg) at 2025-08-14 17:57:42 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (stats.py) at 2025-08-13 12:15:37 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (v1-0001-Add-amgetbatch-interface-for-index-scan-prefetchi.patch) at 2025-08-12 22:50:58 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (create.sql) at 2025-08-12 16:53:13 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (0001-Add-AutoReadStream.txt) at 2025-08-07 05:25:17 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (ryzen-nvme-cold-10000000-20-16-scaled.pdf) at 2025-08-05 14:52:44 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (v2-0001-pgstattuple-analyze-TIDs-on-btree-leaf-pages.patch) at 2025-07-24 23:52:22 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v1-0001-pgstattuple-analyze-TIDs-on-btree-leaf-pages.patch) at 2025-07-24 11:19:07 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (batches-64.log) at 2025-07-23 16:55:02 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (prefetch-distance-explain.patch) at 2025-07-23 12:50:15 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (0003-aio-Improve-read_stream.c-look-ahead-heuristics-C.txt) at 2025-07-23 01:19:58 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (create-tables.sql) at 2025-07-22 20:50:00 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (leafkeyspace.sql) at 2025-07-22 17:50:16 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (pgbench_accounts_pkey_nhblks.txt) at 2025-07-22 17:35:14 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (d16-rows-cold-32GB-16-unscaled-log.pdf) at 2025-07-22 13:06:46 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (0001-aio-Refactor-read_stream.c-end-of-stream-state.txt) at 2025-07-21 12:39:48 from Thomas Munro <thomas.munro at gmail.com> (Patch: Yes)
    Attachment (0001-read_stream-restore-prefetch-distance-after-reset.patch) at 2025-07-18 18:31:37 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (d16-rows-cold-32GB-16-unscaled.pdf) at 2025-07-16 08:40:29 from Tomas Vondra <tomas at vondra.me> (Patch: No)
    Attachment (v20250709-0001-index-prefetch-infrastructure.patch) at 2025-07-09 22:55:08 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20250501-0001-WIP-index-prefetching.patch) at 2025-05-01 23:02:06 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20250422-0001-WIP-index-prefetching.patch) at 2025-04-22 10:45:55 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20241106-0001-WIP-index-batching-prefetching.patch) at 2024-11-06 17:25:41 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20240930-0001-WIP-index-batching-prefetching.patch) at 2024-09-30 21:16:25 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20240906-0001-WIP-index-batching-prefetching.patch) at 2024-09-06 21:49:43 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v20240831-0001-WIP-index-batching-prefetching.patch) at 2024-08-31 20:37:31 from Tomas Vondra <tomas at vondra.me> (Patch: Yes)
    Attachment (v4-0001-Streaming-Read-API.patch) at 2024-02-07 21:48:18 from Melanie Plageman <melanieplageman at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Streaming-Read-API.txt) at 2024-01-24 20:20:28 from Melanie Plageman <melanieplageman at gmail.com> (Patch: Yes)
    Attachment (v20240124-0001-Prefetch-heap-pages-during-index-scans.patch) at 2024-01-24 18:13:24 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v2-0002-use-streaming-reads-in-index-scan.nocfbot) at 2024-01-24 00:51:24 from Melanie Plageman <melanieplageman at gmail.com> (Patch: Yes)
    Attachment (0002-use-streaming-reads-in-index-scan.txt) at 2024-01-19 21:43:37 from Melanie Plageman <melanieplageman at gmail.com> (Patch: Yes)
    Attachment (v20240112-0001-Prefetch-heap-pages-during-index-scans.patch) at 2024-01-12 16:42:39 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v20240103-0001-prefetch-2023-12-09.patch) at 2024-01-04 14:55:01 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v20231209-0001-prefetch-2023-11-24.patch) at 2023-12-09 18:08:20 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v20231124-0001-prefetch-2023-10-16.patch) at 2023-11-24 16:25:52 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (index-prefetch.pdf) at 2023-10-16 15:34:44 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (index-prefetch-v5.patch) at 2023-07-14 20:31:57 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (index-prefetch-v4.patch) at 2023-06-30 11:38:06 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0003-ignore-seq-patterns-add-stats-v3.patch) at 2023-06-19 19:27:46 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (pg_type_typname_nsp_index_index_example_log.txt) at 2023-06-08 23:38:13 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (index-prefetch-poc.patch) at 2023-06-08 15:40:12 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
History
When Who What
2026-05-27 19:35:44 CFbot Patch does not need rebase anymore
2026-04-28 11:09:54 Jerry Zhang (xingtanzjr) Added xingtanzjr as reviewer
2026-04-10 00:00:02 CFbot Moved from CF PG19-Final to CF PG20-1
2026-04-07 20:11:40 CFbot Patch needs rebase
2026-03-31 18:04:03 CFbot Patch does not need rebase anymore
2026-03-31 04:09:38 CFbot Patch needs rebase
2026-03-28 01:14:40 CFbot Patch does not need rebase anymore
2026-03-27 01:39:42 CFbot Patch needs rebase
2026-03-19 18:02:48 CFbot Patch does not need rebase anymore
2026-03-19 14:58:43 CFbot Patch needs rebase
2026-03-17 18:03:46 CFbot Patch does not need rebase anymore
2026-03-17 13:05:37 CFbot Patch needs rebase
2026-03-12 20:10:47 CFbot Patch does not need rebase anymore
2026-03-12 18:57:56 CFbot Patch needs rebase
2026-03-10 21:02:10 CFbot Patch does not need rebase anymore
2026-03-06 14:10:29 Alexandre Felipe (afelipe) Removed afelipe from reviewers
2026-02-27 09:04:37 CFbot Patch needs rebase
2026-02-24 18:36:02 Peter Geoghegan (pgeoghegan) New status: Needs review
2026-02-12 22:15:12 Alexandre Felipe (afelipe) Added afelipe as reviewer
2026-02-01 00:00:08 CFbot Moved from CF PG19-4 to CF PG19-Final
2026-01-13 21:06:36 CFbot Patch does not need rebase anymore
2026-01-13 17:39:27 CFbot Patch needs rebase
2026-01-07 19:05:36 CFbot Patch does not need rebase anymore
2025-12-25 16:13:24 CFbot Patch needs rebase
2025-12-10 23:08:30 CFbot Patch does not need rebase anymore
2025-12-10 10:13:25 CFbot Patch needs rebase
2025-12-02 00:42:27 Peter Geoghegan (pgeoghegan) Moved from CF PG19-3 to CF PG19-4
2025-11-06 05:02:51 CFbot Patch does not need rebase anymore
2025-11-05 00:48:28 CFbot Patch needs rebase
2025-11-03 00:13:34 CFbot Patch does not need rebase anymore
2025-10-31 23:35:28 CFbot Patch needs rebase
2025-10-12 19:04:27 CFbot Patch does not need rebase anymore
2025-10-12 10:46:34 CFbot Patch needs rebase
2025-09-10 22:43:28 CFbot Patch does not need rebase anymore
2025-09-10 21:36:22 CFbot Patch needs rebase
2025-09-10 21:25:09 Peter Geoghegan (pgeoghegan) Changed authors to Peter Geoghegan (pgeoghegan), Tomas Vondra (fuzzycz)
2025-09-10 21:23:36 Tomas Vondra (fuzzycz) Moved from CF PG19-1 to CF PG19-3
2025-07-24 11:35:28 CFbot Patch does not need rebase anymore
2025-07-23 14:56:20 CFbot Patch needs rebase
2025-04-22 11:01:45 CFbot Patch does not need rebase anymore
2025-04-02 18:15:42 Tomas Vondra (fuzzycz) Closed in commitfest 2025-03 with status: Moved to next CF
2025-03-11 04:13:43 vigneshwaran C (vignesh.postgres) New status: Waiting on Author
2025-02-17 18:26:35 CFbot Patch needs rebase
2025-02-06 22:06:06 Tomas Vondra (fuzzycz) Closed in commitfest 2025-01 with status: Moved to next CF
2024-12-01 19:06:13 Dmitry Dolgov (erthalion) Closed in commitfest 2024-11 with status: Moved to next CF
2024-10-05 09:44:09 Andrey Borodin (x4m) Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-01 01:45:54 Corey Huinker (coreyh) Closed in commitfest 2024-07 with status: Moved to next CF
2024-04-08 15:00:14 Andrey Borodin (x4m) Closed in commitfest 2024-03 with status: Moved to next CF
2024-02-01 17:45:36 vigneshwaran C (vignesh.postgres) Closed in commitfest 2024-01 with status: Moved to next CF
2023-12-04 09:22:54 John Naylor (john.naylor) Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 09:46:50 Peter Eisentraut (petere) Closed in commitfest 2023-09 with status: Moved to next CF
2023-08-01 21:07:51 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2023-07 with status: Moved to next CF
2023-06-10 12:08:00 James Coleman (jcole1989) Changed authors to Tomas Vondra (fuzzycz)
2023-06-08 15:40:45 Tomas Vondra (fuzzycz) Attached mail thread cf85f46f-b02f-05b2-5248-5000b894ebab@enterprisedb.com
2023-06-08 15:40:45 Tomas Vondra (fuzzycz) Created patch record
Edit