Reducing planning time when tables have many partitions

Edit
ID 3701
Title Reducing planning time when tables have many partitions
CI (CFBot) Summary
Stats (from CFBot) Patch version: v42, Patch count: 1, First patch: +446−120, All patches: +446−120
Topic Performance
Tags
Created 2022-06-22 08:41:43
Last modified 2025-04-08 20:06:11 (6 months ago)
Latest email 2025-04-08 09:04:16 (6 months ago)
Status
2025-03 (2025-03-01 – 2025-04-08): Committed
2025-01 (2025-01-01 – 2025-01-31): Moved to different CF
2024-11 (2024-11-01 – 2024-11-30): Moved to different CF
2024-09 (2024-09-01 – 2024-09-30): Moved to different CF
2024-07 (2024-07-01 – 2024-07-31): Moved to different CF
2024-03 (2024-03-01 – 2024-04-08): Moved to different CF
2024-01 (2024-01-01 – 2024-01-31): Moved to different CF
2023-11 (2023-11-01 – 2023-12-04): Moved to different CF
2023-09 (2023-09-01 – 2023-09-30): Moved to different CF
2023-07 (2023-07-01 – 2023-07-31): Moved to different CF
2023-03 (2023-03-01 – 2023-04-08): Moved to different CF
2023-01 (2023-01-01 – 2023-01-31): Moved to different CF
2022-11 (2022-11-01 – 2022-11-30): Moved to different CF
2022-09 (2022-09-01 – 2022-09-30): Moved to different CF
2022-07 (2022-07-01 – 2022-07-31): Moved to different CF
Target version
Authors Yuya Watari (watari)
Reviewers Andrei Lepikhov (lepikhov), Thom Brown (thom), Ashutosh Bapat (ashutoshbapat), Tom Lane (tgl), newtglobal postgresql_contributors (newtpostgrescontributors)Become reviewer
Committer David Rowley (davidrowley)
Links
Emails
[PoC] Reducing planning time when tables have many partitions
First at 2022-03-18 10:24:56 by Yuya Watari <watari.yuya at gmail.com>
Latest at 2025-04-08 09:04:16 by Yuya Watari <watari.yuya at gmail.com>
Latest attachment (bench_results_v42.sql.bz2) at 2025-04-08 06:31:16 from David Rowley <dgrowleyml at gmail.com>
    Attachment (bench_results_v42.sql.bz2) at 2025-04-08 06:31:16 from David Rowley <dgrowleyml at gmail.com> (Patch: No)
    Attachment (some_edits.txt) at 2025-04-08 05:41:11 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (v42-0001-Speedup-child-EquivalenceMember-lookup-in-planne.patch) at 2025-04-08 03:00:32 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (eq_member_find_duplicates.patch.txt) at 2025-04-06 23:04:29 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v40-0001-Speedup-child-EquivalenceMember-lookup-in-planne.patch) at 2025-04-05 03:55:12 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v39-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-04-04 15:05:05 from Tom Lane <tgl at sss.pgh.pa.us> (Patch: Yes)
    Attachment (v38-0001-Add-the-PlannerInfo-context-to-the-parameter-of-.patch) at 2025-04-04 14:30:46 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2025-04-04 08:42:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (partbench.sh.txt) at 2025-04-04 06:04:42 from David Rowley <dgrowleyml at gmail.com> (Patch: No)
    Attachment (v36-0001-Add-the-PlannerInfo-context-to-the-parameter-of-.patch) at 2025-04-03 11:34:02 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (0003-Resolve-conflict-with-commit-66c0185-20250327.patch) at 2025-03-27 05:10:17 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (diff-v34-v35.txt) at 2025-03-23 23:23:44 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v33-v34.txt) at 2025-03-14 10:09:38 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-03-01 10:06:38 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v32-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2025-02-19 07:33:32 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v30-v31.txt) at 2025-02-11 23:29:33 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (diff-v29-v30.txt) at 2025-01-07 06:56:53 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-20 05:26:27 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (Report-memory-used-for-planning-a-query-in-EXPLAIN-A.txt) at 2024-12-11 03:16:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-02 08:51:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v27-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-15 03:20:04 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-01 02:35:05 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-08-29 05:34:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-02-28 11:18:18 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (sanity-check.txt) at 2024-01-17 09:33:42 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (poc-alias-reloptinfo.txt) at 2023-12-13 06:21:57 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v21-0001-PATCH-PATCH-1-2-Speed-up-searches-for-child-Equivale.patch) at 2023-11-18 23:57:34 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (solved_conflict_with_self_join_removal.diff) at 2023-11-17 21:04:12 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (v20-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2023-08-25 07:39:16 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (planning time measurement.ods) at 2023-07-28 09:50:57 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: No)
    Attachment (2-Yuya-kernel.svg) at 2023-07-28 04:27:40 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (parts-problem.sql) at 2023-07-27 07:58:16 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (v19-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-07-05 09:57:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-03-10 08:38:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-17 08:31:45 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-06 01:47:33 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-01-30 12:14:28 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-30 10:02:37 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-27 03:48:30 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-12 04:50:09 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-12-07 11:30:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v10-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-04 00:34:44 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-29 08:58:25 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-02 09:27:52 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-10-24 04:12:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure-1.png) at 2022-09-21 09:43:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v4-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-08-26 00:39:32 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup_v3.patch) at 2022-08-16 08:26:41 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (0002-Fix-bugs.patch) at 2022-08-08 11:27:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup.patch) at 2022-07-27 21:35:10 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-07-05 08:57:14 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v2-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-06-22 09:05:43 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v1-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-03-18 10:24:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
History
When Who What
2025-04-08 20:06:11 David Rowley (davidrowley) Closed in commitfest 2025-03 with status: Committed
2025-04-08 20:06:11 David Rowley (davidrowley) Changed committer to davidrowley
2025-04-07 03:03:40 David Rowley (davidrowley) New status: Ready for Committer
2025-04-07 02:32:14 David Rowley (davidrowley) New status: Needs review
2025-03-31 05:48:44 Yuya Watari (watari) New status: Waiting on Author
2025-03-12 07:23:32 newtglobal postgresql_contributors (newtpostgrescontributors) Posted review with messageid <174176421219.294105.3395783202038263246.pgcf@coridan.postgresql.org>
2025-03-10 07:03:59 newtglobal postgresql_contributors (newtpostgrescontributors) Added newtpostgrescontributors as reviewer
2025-03-01 10:31:45 CFbot Patch does not need rebase anymore
2025-02-28 09:34:40 CFbot Patch needs rebase
2025-02-19 08:01:45 CFbot Patch does not need rebase anymore
2025-02-17 13:10:30 CFbot Patch needs rebase
2025-02-04 16:23:44 Tom Lane (tgl) Closed in commitfest 2025-01 with status: Moved to next CF
2025-02-04 16:23:36 Tom Lane (tgl) Added tgl as reviewer
2024-12-27 00:23:10 Yuya Watari (watari) New status: Needs review
2024-12-01 19:04:35 Dmitry Dolgov (erthalion) Closed in commitfest 2024-11 with status: Moved to next CF
2024-12-01 19:04:32 Dmitry Dolgov (erthalion) New status: Waiting on Author
2024-10-05 09:43:47 Andrey Borodin (x4m) Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-29 05:37:22 Yuya Watari (watari) New status: Needs review
2024-08-01 01:58:48 Corey Huinker (coreyh) Closed in commitfest 2024-07 with status: Moved to next CF
2024-05-16 02:50:28 Yuya Watari (watari) New status: Waiting on Author
2024-04-08 15:00:28 Andrey Borodin (x4m) Closed in commitfest 2024-03 with status: Moved to next CF
2024-02-28 11:19:40 Yuya Watari (watari) New status: Needs review
2024-02-01 18:42:28 vigneshwaran C (vignesh.postgres) Closed in commitfest 2024-01 with status: Moved to next CF
2023-11-30 04:15:26 Yuya Watari (watari) Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 10:56:22 Peter Eisentraut (petere) Closed in commitfest 2023-09 with status: Moved to next CF
2023-09-20 09:52:02 Yuya Watari (watari) New status: Waiting on Author
2023-09-12 06:20:09 David Rowley (davidrowley) Changed authors to Yuya Watari (watari)
2023-08-04 10:56:39 Ashutosh Bapat (ashutoshbapat) Added ashutoshbapat as reviewer
2023-08-01 20:57:38 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2023-07 with status: Moved to next CF
2023-04-09 02:31:47 Greg Stark (stark) Closed in commitfest 2023-03 with status: Moved to next CF
2023-02-07 23:35:44 David Rowley (davidrowley) Changed authors to David Rowley (davidrowley), Yuya Watari (watari)
2023-01-31 16:16:27 vigneshwaran C (vignesh.postgres) Closed in commitfest 2023-01 with status: Moved to next CF
2022-12-14 00:04:56 Ian Barwick (barwick) Closed in commitfest 2022-11 with status: Moved to next CF
2022-12-05 15:53:20 Thom Brown (thom) Added thom as reviewer
2022-10-24 04:16:48 Yuya Watari (watari) New status: Needs review
2022-10-12 07:48:06 Michael Paquier (michael-kun) Closed in commitfest 2022-09 with status: Moved to next CF
2022-10-12 07:48:04 Michael Paquier (michael-kun) New status: Waiting on Author
2022-08-09 04:21:20 Yuya Watari (watari) New status: Needs review
2022-08-02 18:02:47 Jacob Champion (jchampion) Closed in commitfest 2022-07 with status: Moved to next CF
2022-07-21 11:36:20 Andrei Lepikhov (lepikhov) Added lepikhov as reviewer
2022-07-21 11:35:58 Andrei Lepikhov (lepikhov) New status: Waiting on Author
2022-06-22 08:42:46 Yuya Watari (watari) Changed authors to Yuya Watari (watari)
2022-06-22 08:41:43 Yuya Watari (watari) Attached mail thread CAJ2pMkZNCgoUKSE+_5LthD+KbXKvq6h2hQN8Esxpxd+cxmgomg@mail.gmail.com
2022-06-22 08:41:43 Yuya Watari (watari) Created patch record
Edit