Reducing planning time when tables have many partitions

Edit

ID 3701

Title Reducing planning time when tables have many partitions

Topic Performance

Created 2022-06-22 08:41:43

Last modified 2024-12-27 00:23:10 (3 weeks, 1 day ago)

Latest email 2025-01-07 06:56:53 (1 week, 3 days ago)

Status

2025-01: Needs review

2024-11: Moved to next CF

2024-09: Moved to next CF

2024-07: Moved to next CF

2024-03: Moved to next CF

2024-01: Moved to next CF

2023-11: Moved to next CF

2023-09: Moved to next CF

2023-07: Moved to next CF

2023-03: Moved to next CF

2023-01: Moved to next CF

2022-11: Moved to next CF

2022-09: Moved to next CF

2022-07: Moved to next CF

Target version

Authors Yuya Watari (watari)

Reviewers Thom Brown (thom), Ashutosh Bapat (ashutoshbapat), Andrei Lepikhov (lepikhov)Become reviewer

Committer

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/3701
git checkout commitfest/cf/3701

Emails

[PoC] Reducing planning time when tables have many partitions: First at 2022-03-18 10:24:56 by Yuya Watari <watari.yuya at gmail.com>
Latest at 2025-01-07 06:56:53 by Yuya Watari <watari.yuya at gmail.com>
Latest attachment (diff-v29-v30.txt) at 2025-01-07 06:56:53 from Yuya Watari <watari.yuya at gmail.com>
    Attachment (diff-v29-v30.txt) at 2025-01-07 06:56:53 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-20 05:26:27 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (Report-memory-used-for-planning-a-query-in-EXPLAIN-A.txt) at 2024-12-11 03:16:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2024-12-02 08:51:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v27-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-15 03:20:04 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-10-01 02:35:05 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-08-29 05:34:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v24-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2024-02-28 11:18:18 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (sanity-check.txt) at 2024-01-17 09:33:42 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (poc-alias-reloptinfo.txt) at 2023-12-13 06:21:57 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v21-0001-PATCH-PATCH-1-2-Speed-up-searches-for-child-Equivale.patch) at 2023-11-18 23:57:34 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (solved_conflict_with_self_join_removal.diff) at 2023-11-17 21:04:12 from Alena Rybakina <lena.ribackina at yandex.ru> (Patch: Yes)
    Attachment (v20-0001-Speed-up-searches-for-child-EquivalenceMembers.patch) at 2023-08-25 07:39:16 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (planning time measurement.ods) at 2023-07-28 09:50:57 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: No)
    Attachment (2-Yuya-kernel.svg) at 2023-07-28 04:27:40 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (parts-problem.sql) at 2023-07-27 07:58:16 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: No)
    Attachment (v19-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-07-05 09:57:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v18-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-03-10 08:38:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-17 08:31:45 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-02-06 01:47:33 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Adjust-bms_int_members-so-that-it-shortens-the-l.patch) at 2023-01-30 12:14:28 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-30 10:02:37 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2023-01-27 03:48:30 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-12 04:50:09 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-12-07 11:30:24 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v10-0001-Add-Bitmapset-indexes-for-faster-lookup-of-Equiv.patch) at 2022-12-04 00:34:44 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-29 08:58:25 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-11-02 09:27:52 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-10-24 04:12:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (figure-1.png) at 2022-09-21 09:43:51 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v4-0001-Apply-eclass_member_speedup_v3.patch.patch) at 2022-08-26 00:39:32 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup_v3.patch) at 2022-08-16 08:26:41 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (0002-Fix-bugs.patch) at 2022-08-08 11:27:46 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (eclass_member_speedup.patch) at 2022-07-27 21:35:10 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (figure.png) at 2022-07-05 08:57:14 from Yuya Watari <watari.yuya at gmail.com> (Patch: No)
    Attachment (v2-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-06-22 09:05:43 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)
    Attachment (v1-reducing-planning-time-when-tables-have-many-partitions.patch) at 2022-03-18 10:24:56 from Yuya Watari <watari.yuya at gmail.com> (Patch: Yes)

History

When	Who	What
2024-12-27 00:23:10	Yuya Watari (watari)	New status: Needs review
2024-12-01 19:04:35	Dmitry Dolgov (erthalion)	Closed in commitfest 2024-11 with status: Moved to next CF
2024-12-01 19:04:32	Dmitry Dolgov (erthalion)	New status: Waiting on Author
2024-10-05 09:43:47	Andrey Borodin (x4m)	Closed in commitfest 2024-09 with status: Moved to next CF
2024-08-29 05:37:22	Yuya Watari (watari)	New status: Needs review
2024-08-01 01:58:48	Corey Huinker (coreyh)	Closed in commitfest 2024-07 with status: Moved to next CF
2024-05-16 02:50:28	Yuya Watari (watari)	New status: Waiting on Author
2024-04-08 15:00:28	Andrey Borodin (x4m)	Closed in commitfest 2024-03 with status: Moved to next CF
2024-02-28 11:19:40	Yuya Watari (watari)	New status: Needs review
2024-02-01 18:42:28	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2024-01 with status: Moved to next CF
2023-11-30 04:15:26	Yuya Watari (watari)	Closed in commitfest 2023-11 with status: Moved to next CF
2023-10-02 10:56:22	Peter Eisentraut (petere)	Closed in commitfest 2023-09 with status: Moved to next CF
2023-09-20 09:52:02	Yuya Watari (watari)	New status: Waiting on Author
2023-09-12 06:20:09	David Rowley (davidrowley)	Changed authors to Yuya Watari (watari)
2023-08-04 10:56:39	Ashutosh Bapat (ashutoshbapat)	Added ashutoshbapat as reviewer
2023-08-01 20:57:38	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2023-07 with status: Moved to next CF
2023-04-09 02:31:47	Greg Stark (stark)	Closed in commitfest 2023-03 with status: Moved to next CF
2023-02-07 23:35:44	David Rowley (davidrowley)	Changed authors to David Rowley (davidrowley), Yuya Watari (watari)
2023-01-31 16:16:27	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2023-01 with status: Moved to next CF
2022-12-14 00:04:56	Ian Barwick (barwick)	Closed in commitfest 2022-11 with status: Moved to next CF
2022-12-05 15:53:20	Thom Brown (thom)	Added thom as reviewer
2022-10-24 04:16:48	Yuya Watari (watari)	New status: Needs review
2022-10-12 07:48:06	Michael Paquier (michael-kun)	Closed in commitfest 2022-09 with status: Moved to next CF
2022-10-12 07:48:04	Michael Paquier (michael-kun)	New status: Waiting on Author
2022-08-09 04:21:20	Yuya Watari (watari)	New status: Needs review
2022-08-02 18:02:47	Jacob Champion (jchampion)	Closed in commitfest 2022-07 with status: Moved to next CF
2022-07-21 11:36:20	Andrei Lepikhov (lepikhov)	Added lepikhov as reviewer
2022-07-21 11:35:58	Andrei Lepikhov (lepikhov)	New status: Waiting on Author
2022-06-22 08:42:46	Yuya Watari (watari)	Changed authors to Yuya Watari (watari)
2022-06-22 08:41:43	Yuya Watari (watari)	Attached mail thread CAJ2pMkZNCgoUKSE+_5LthD+KbXKvq6h2hQN8Esxpxd+cxmgomg@mail.gmail.com
2022-06-22 08:41:43	Yuya Watari (watari)	Created patch record

Edit