GROUP BY optimization

Edit
ID 1651
Title GROUP BY optimization
Topic Performance
Created 2018-05-30 11:42:10
Last modified 2022-03-30 23:19:52 (2 years, 8 months ago)
Latest email 2024-01-26 15:41:05 (10 months, 1 week ago)
Status
2022-03: Committed
2022-01: Moved to next CF
2021-11: Moved to next CF
2021-09: Moved to next CF
2021-07: Moved to next CF
2021-03: Moved to next CF
2021-01: Moved to next CF
2020-11: Moved to next CF
2019-01: Moved to next CF
2018-11: Moved to next CF
2018-09: Moved to next CF
2018-07: Moved to next CF
Target version 15
Authors Fedor Sigaev (sigaev), Pavel Borisov (pborisov)
Reviewers Tomas Vondra (fuzzycz)Become reviewer
Committer Tomas Vondra (fuzzycz)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1651
git checkout commitfest/cf/1651
Emails
POC: GROUP BY optimization
First at 2018-05-29 23:07:50 by Teodor Sigaev <teodor at sigaev.ru>
Latest at 2024-01-26 15:41:05 by Robert Haas <robertmhaas at gmail.com>
Latest attachment (0002-Explore-alternative-orderings-of-group-by-p-20240119.patch) at 2024-01-19 14:21:48 from Alexander Korotkov <aekorotkov at gmail.com>
    Attachment (0002-Explore-alternative-orderings-of-group-by-p-20240119.patch) at 2024-01-19 14:21:48 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (step2.txt) at 2024-01-18 14:18:34 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (step1.txt) at 2024-01-18 09:48:54 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240116.patch) at 2024-01-16 15:05:33 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (group_by.diff) at 2024-01-15 13:21:05 from Alena Rybakina <a.rybakina at postgrespro.ru> (Patch: Yes)
    Attachment (0002-Explore-alternative-orderings-of-group-by-p-20240115.patch) at 2024-01-15 00:19:41 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (details-2.txt) at 2024-01-14 12:14:13 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240113.patch) at 2024-01-13 15:00:03 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (details.txt) at 2024-01-13 09:08:59 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-befor-20240111.patch) at 2024-01-11 11:30:29 from Alexander Korotkov <aekorotkov at gmail.com> (Patch: Yes)
    Attachment (0002-Explore-alternative-orderings-of-group-by-pathkeys-d-20240109.patch) at 2024-01-09 11:07:19 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Generalize-common-code-of-adding-sort-before-generat.patch) at 2024-01-09 09:01:43 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Explore-alternative-orderings-of-group-by-pathkeys-d-20231228.patch) at 2023-12-28 08:22:47 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Explore-alternative-orderings-of-group-by-pathkeys-d-20231001.patch) at 2023-10-01 06:32:23 from Andrei Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-When-evaluating-a-query-with-a-multi-column-GROUP-BY-20230913.patch) at 2023-09-13 05:21:32 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-When-evaluating-a-query-with-a-multi-column-GROUP-BY-20230720.patch) at 2023-07-20 06:37:24 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (fix_partitionwise_aggregate_test_master.patch) at 2022-08-18 01:32:14 from David Rowley <dgrowleyml at gmail.com> (Patch: Yes)
    Attachment (plans-14.log) at 2022-08-17 14:46:16 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: No)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220329.patch) at 2022-03-29 18:00:29 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220328.patch) at 2022-03-29 00:48:50 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-Optimize-order-of-GROUP-BY-keys-20220315.patch) at 2022-03-15 08:26:47 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0002-Use-default-restriction-for-number-of-groups.txt) at 2022-02-10 09:00:37 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (bounded_heap_sort_fix.txt) at 2022-02-01 09:48:11 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v20220121-0001-GROUP-BY-reordering.patch) at 2022-01-21 20:34:43 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (guard_tuplesPerPrevGroup.txt) at 2022-01-21 11:09:01 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (fixes.txt) at 2022-01-20 05:05:57 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (group-by-reorder-20210722.patch) at 2021-07-21 22:58:44 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (group-by-reorder-20210720.patch) at 2021-07-20 13:12:38 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (0001-v12-20210309.patch) at 2021-03-09 23:05:55 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v12-0001-GROUP-BY-optimization-made-compatible-with-chang.patch) at 2021-03-05 11:37:30 from Ibrar Ahmed <ibrar.ahmad at gmail.com> (Patch: Yes)
    Attachment (v11-0001-GROUP-BY-optimization-made-compatible-with-chang.patch) at 2020-10-26 08:44:58 from Pavel Borisov <pashkin.elfe at gmail.com> (Patch: Yes)
    Attachment (wip-group-by-incremental-sort-v1.patch) at 2020-05-16 14:56:09 from Tomas Vondra <tomas.vondra at 2ndquadrant.com> (Patch: Yes)
    Attachment (v12-0001-Add-tests-for-group-by-optimization.patch) at 2019-05-03 20:28:21 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-tests-for-group-by-optimization.patch) at 2019-04-04 15:11:09 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)
    Attachment (0002-opt_group_by_index_and_order-v10.patch) at 2018-06-13 16:41:20 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0001-opt_group_by_index-v9.patch) at 2018-06-07 16:22:13 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0001-opt_group_by_index-v8.patch) at 2018-06-06 18:04:09 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (0002-opt_group_by_index_and_order-v7.patch) at 2018-06-05 17:56:19 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (opt_group_by-v6.patch) at 2018-05-30 16:17:42 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
    Attachment (opt_group_by-v5.patch) at 2018-05-29 23:07:50 from Teodor Sigaev <teodor at sigaev.ru> (Patch: Yes)
Group by reordering optimization
First at 2020-09-01 11:15:31 by Dmitry Dolgov <9erthalion6 at gmail.com>
Latest at 2021-12-28 08:47:35 by "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru>
Latest attachment (cleanup.txt) at 2021-12-28 08:47:35 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru>
    Attachment (cleanup.txt) at 2021-12-28 08:47:35 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Group-by-optimization.patch) at 2020-09-01 11:15:31 from Dmitry Dolgov <9erthalion6 at gmail.com> (Patch: Yes)
History
When Who What
2022-03-30 23:19:52 Tomas Vondra (fuzzycz) Closed in commitfest 2022-03 with status: Committed
2022-03-30 23:19:52 Tomas Vondra (fuzzycz) Changed committer to fuzzycz
2022-03-29 18:37:21 Justin Pryzby (justinpryzby) Changed targetversion to 15
2022-02-02 16:29:50 Julien Rouhaud (rjuju) Closed in commitfest 2022-01 with status: Moved to next CF
2021-12-02 11:06:41 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2021-11 with status: Moved to next CF
2021-10-06 03:08:19 Jaime Casanova (jcasanov) Closed in commitfest 2021-09 with status: Moved to next CF
2021-08-03 02:26:45 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-07 with status: Moved to next CF
2021-07-20 13:15:16 Tomas Vondra (fuzzycz) New status: Needs review
2021-07-13 11:35:12 Ibrar Ahmed (ibrar) New status: Waiting on Author
2021-04-08 15:41:16 David Steele (dsteele) Closed in commitfest 2021-03 with status: Moved to next CF
2021-02-01 12:32:44 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-23 01:41:35 Tomas Vondra (fuzzycz) Attached mail thread CA+q6zcW_4o2NC0zutLkOJPsFt80megSpX_dVRo6GK9PC-Jx_Ag@mail.gmail.com
2020-12-01 10:58:05 Anastasia Lubennikova (lubennikovaav) Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-26 08:57:32 Pavel Borisov (pborisov) Attached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2020-10-26 08:57:25 Pavel Borisov (pborisov) Detached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2020-10-26 08:57:03 Pavel Borisov (pborisov) Changed authors to Fedor Sigaev (sigaev), Pavel Borisov (pborisov)
2020-10-26 08:53:04 Pavel Borisov (pborisov) Closed in commitfest 2019-01 with status: Moved to next CF
2020-10-26 08:48:10 Pavel Borisov (pborisov) New status: Needs review
2019-01-31 11:24:14 Andres Freund (andresfreund) Closed in commitfest 2019-01 with status: Returned with feedback
2018-11-29 16:55:44 Dmitry Dolgov (erthalion) New status: Waiting on Author
2018-11-29 16:55:35 Dmitry Dolgov (erthalion) Closed in commitfest 2018-11 with status: Moved to next CF
2018-11-29 16:55:31 Dmitry Dolgov (erthalion) New status: Needs review
2018-10-02 02:16:42 Michael Paquier (michael-kun) New status: Waiting on Author
2018-10-02 02:16:36 Michael Paquier (michael-kun) Closed in commitfest 2018-09 with status: Moved to next CF
2018-08-10 22:18:38 Andrew Dunstan (adunstan) Closed in commitfest 2018-07 with status: Moved to next CF
2018-06-02 19:29:28 Tomas Vondra (fuzzycz) Added fuzzycz as reviewer
2018-05-30 11:42:29 Fedor Sigaev (sigaev) Changed authors to Fedor Sigaev (sigaev)
2018-05-30 11:42:11 Fedor Sigaev (sigaev) Attached mail thread 7c79e6a5-8597-74e8-0671-1c39d124c9d6@sigaev.ru
2018-05-30 11:42:10 Fedor Sigaev (sigaev) Created patch record
Edit