GROUP BY optimization

Edit

ID 1651

Title GROUP BY optimization

Topic Performance

Created 2018-05-30 11:42:10

Last modified 2022-03-30 23:19:52 (2 years, 7 months ago)

Latest email 2024-01-26 15:41:05 (9 months, 3 weeks ago)

Status

2022-03: Committed

2022-01: Moved to next CF

2021-11: Moved to next CF

2021-09: Moved to next CF

2021-07: Moved to next CF

2021-03: Moved to next CF

2021-01: Moved to next CF

2020-11: Moved to next CF

2019-01: Moved to next CF

2018-11: Moved to next CF

2018-09: Moved to next CF

2018-07: Moved to next CF

Target version 15

Authors Fedor Sigaev (sigaev), Pavel Borisov (pborisov)

Reviewers Tomas Vondra (fuzzycz)Become reviewer

Committer Tomas Vondra (fuzzycz)

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1651
git checkout commitfest/cf/1651

Emails

POC: GROUP BY optimization: First at 2018-05-29 23:07:50 by Teodor Sigaev <teodor at sigaev.ru>
Latest at 2024-01-26 15:41:05 by Robert Haas <robertmhaas at gmail.com>
Latest attachment (0002-Explore-alternative-orderings-of-group-by-p-20240119.patch) at 2024-01-19 14:21:48 from Alexander Korotkov <aekorotkov at gmail.com>
    Attachment (0002-Explore-alternative-orderings-of-group-by-p-20240119.patch) at 2024-01-19 14:21:48 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (step2.txt) at 2024-01-18 14:18:34 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (step1.txt) at 2024-01-18 09:48:54 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240116.patch) at 2024-01-16 15:05:33 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (group_by.diff) at 2024-01-15 13:21:05 from Alena Rybakina <a.rybakina at postgrespro.ru> (Patch: Yes)
    Attachment (0002-Explore-alternative-orderings-of-group-by-p-20240115.patch) at 2024-01-15 00:19:41 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (details-2.txt) at 2024-01-14 12:14:13 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240113.patch) at 2024-01-13 15:00:03 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (details.txt) at 2024-01-13 09:08:59 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240111.patch) at 2024-01-11 11:30:29 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (0002-Explore-alternative-orderings-of-group-by-pathkeys-d-20240109.patch) at 2024-01-09 11:07:19 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-before-generat.patch) at 2024-01-09 09:01:43 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Explore-alternative-orderings-of-group-by-pathkeys-d-20231228.patch) at 2023-12-28 08:22:47 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Explore-alternative-orderings-of-group-by-pathkeys-d-20231001.patch) at 2023-10-01 06:32:23 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-When-evaluating-a-query-with-a-multi-column-GROUP-BY-20230913.patch) at 2023-09-13 05:21:32 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-When-evaluating-a-query-with-a-multi-column-GROUP-BY-20230720.patch) at 2023-07-20 06:37:24 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (fix_partitionwise_aggregate_test_master.patch) at 2022-08-18 01:32:14 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (plans-14.log) at 2022-08-17 14:46:16 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220329.patch) at 2022-03-29 18:00:29 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220328.patch) at 2022-03-29 00:48:50 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220315.patch) at 2022-03-15 08:26:47 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0002-Use-default-restriction-for-number-of-groups.txt) at 2022-02-10 09:00:37 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (bounded_heap_sort_fix.txt) at 2022-02-01 09:48:11 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v20220121-0001-GROUP-BY-reordering.patch) at 2022-01-21 20:34:43 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (guard_tuplesPerPrevGroup.txt) at 2022-01-21 11:09:01 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (fixes.txt) at 2022-01-20 05:05:57 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (group-by-reorder-20210722.patch) at 2021-07-21 22:58:44 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (group-by-reorder-20210720.patch) at 2021-07-20 13:12:38 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-v12-20210309.patch) at 2021-03-09 23:05:55 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v12-0001-GROUP-BY-optimization-made-compatible-with-chang.patch) at 2021-03-05 11:37:30 from Ibrar Ahmed <ibrar.ahmad at gmail.com> (Patch: Yes)
    Attachment (v11-0001-GROUP-BY-optimization-made-compatible-with-chang.patch) at 2020-10-26 08:44:58 from Pavel Borisov <pashkin.elfe at gmail.com> (Patch: Yes)
    Attachment (wip-group-by-incremental-sort-v1.patch) at 2020-05-16 14:56:09 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v12-0001-Add-tests-for-group-by-optimization.patch) at 2019-05-03 20:28:21 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-tests-for-group-by-optimization.patch) at 2019-04-04 15:11:09 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)
    Attachment (0002-opt_group_by_index_and_order-v10.patch) at 2018-06-13 16:41:20 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0001-opt_group_by_index-v9.patch) at 2018-06-07 16:22:13 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0001-opt_group_by_index-v8.patch) at 2018-06-06 18:04:09 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0002-opt_group_by_index_and_order-v7.patch) at 2018-06-05 17:56:19 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (opt_group_by-v6.patch) at 2018-05-30 16:17:42 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (opt_group_by-v5.patch) at 2018-05-29 23:07:50 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
Group by reordering optimization: First at 2020-09-01 11:15:31 by Dmitry Dolgov <9erthalion6 at gmail.com>
Latest at 2021-12-28 08:47:35 by "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru>
Latest attachment (cleanup.txt) at 2021-12-28 08:47:35 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru>
Attachment (cleanup.txt) at 2021-12-28 08:47:35 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
Attachment (0001-Group-by-optimization.patch) at 2020-09-01 11:15:31 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)

History

When	Who	What
2022-03-30 23:19:52	Tomas Vondra (fuzzycz)	Closed in commitfest 2022-03 with status: Committed
2022-03-30 23:19:52	Tomas Vondra (fuzzycz)	Changed committer to fuzzycz
2022-03-29 18:37:21	Justin Pryzby (justinpryzby)	Changed targetversion to 15
2022-02-02 16:29:50	Julien Rouhaud (rjuju)	Closed in commitfest 2022-01 with status: Moved to next CF
2021-12-02 11:06:41	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2021-11 with status: Moved to next CF
2021-10-06 03:08:19	Jaime Casanova (jcasanov)	Closed in commitfest 2021-09 with status: Moved to next CF
2021-08-03 02:26:45	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-07 with status: Moved to next CF
2021-07-20 13:15:16	Tomas Vondra (fuzzycz)	New status: Needs review
2021-07-13 11:35:12	Ibrar Ahmed (ibrar)	New status: Waiting on Author
2021-04-08 15:41:16	David Steele (dsteele)	Closed in commitfest 2021-03 with status: Moved to next CF
2021-02-01 12:32:44	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-23 01:41:35	Tomas Vondra (fuzzycz)	Attached mail thread CA+q6zcW_4o2NC0zutLkOJPsFt80megSpX_dVRo6GK9PC-Jx_Ag@mail.gmail.com
2020-12-01 10:58:05	Anastasia Lubennikova (lubennikovaav)	Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-26 08:57:32	Pavel Borisov (pborisov)	Attached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2020-10-26 08:57:25	Pavel Borisov (pborisov)	Detached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2020-10-26 08:57:03	Pavel Borisov (pborisov)	Changed authors to Fedor Sigaev (sigaev), Pavel Borisov (pborisov)
2020-10-26 08:53:04	Pavel Borisov (pborisov)	Closed in commitfest 2019-01 with status: Moved to next CF
2020-10-26 08:48:10	Pavel Borisov (pborisov)	New status: Needs review
2019-01-31 11:24:14	Andres Freund (andresfreund)	Closed in commitfest 2019-01 with status: Returned with feedback
2018-11-29 16:55:44	Dmitry Dolgov (erthalion)	New status: Waiting on Author
2018-11-29 16:55:35	Dmitry Dolgov (erthalion)	Closed in commitfest 2018-11 with status: Moved to next CF
2018-11-29 16:55:31	Dmitry Dolgov (erthalion)	New status: Needs review
2018-10-02 02:16:42	Michael Paquier (michael-kun)	New status: Waiting on Author
2018-10-02 02:16:36	Michael Paquier (michael-kun)	Closed in commitfest 2018-09 with status: Moved to next CF
2018-08-10 22:18:38	Andrew Dunstan (adunstan)	Closed in commitfest 2018-07 with status: Moved to next CF
2018-06-02 19:29:28	Tomas Vondra (fuzzycz)	Added fuzzycz as reviewer
2018-05-30 11:42:29	Fedor Sigaev (sigaev)	Changed authors to Fedor Sigaev (sigaev)
2018-05-30 11:42:11	Fedor Sigaev (sigaev)	Attached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2018-05-30 11:42:10	Fedor Sigaev (sigaev)	Created patch record

Edit