Block level parallel vacuum

Edit

ID 1774

Title Block level parallel vacuum

Topic Performance

Created 2018-08-27 09:39:40

Last modified 2020-01-30 02:45:06 (4 years, 9 months ago)

Latest email 2020-01-30 02:47:51 (4 years, 9 months ago)

Status

2020-01: Committed

2019-11: Moved to next CF

2019-09: Moved to next CF

2019-07: Moved to next CF

2019-03: Moved to next CF

2019-01: Moved to next CF

2018-11: Moved to next CF

2018-09: Moved to next CF

Target version

Authors Masahiko Sawada (masahikosawada)

Reviewers Dilip Kumar (dilip.kumar), Sergei Kornilov (melkij)Become reviewer

Committer Amit Kapila (amitkapila)

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1774
git checkout commitfest/cf/1774

Emails

Re: [HACKERS] Block level parallel vacuum

First at 2018-08-14 00:31:23 by Masahiko Sawada <sawada.mshk at gmail.com>
Latest at 2020-01-30 02:47:51 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v38-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-28 09:47:08 from Amit Kapila <amit.kapila16 at gmail.com>

    Attachment (v38-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-28 09:47:08 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v37-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-25 06:40:59 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v36-0001-Add-paralell-P-option-to-vacuumdb-command.patch) at 2020-01-22 07:17:48 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples_v3.patch) at 2020-01-21 09:16:15 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples_v2.patch) at 2020-01-21 07:20:46 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples.patch) at 2020-01-21 06:40:48 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v50-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-17 09:17:44 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v49-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-16 12:04:38 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v48-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-15 11:57:37 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (review_v47_masahiko.patch) at 2020-01-15 04:34:33 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v47-0001-Introduce-IndexAM-fields-for-parallel-vacuum.patch) at 2020-01-14 12:43:22 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v46-0001-Introduce-IndexAM-fields-for-parallel-vacuum.patch) at 2020-01-13 10:09:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-11 04:18:40 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v44-0002-delta_Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-10 11:54:44 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-10 07:50:58 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-09 10:33:30 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-08 13:16:38 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-04 13:18:09 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v41-0004-Add-ability-to-disable-leader-participation-in-p.patch) at 2019-12-29 13:06:23 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v40-0004-Add-ability-to-disable-leader-participation-in-p.patch) at 2019-12-25 12:17:16 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2019-12-23 10:41:32 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v38-0003-Add-FAST-option-to-vacuum-command.patch) at 2019-12-20 06:43:22 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v37-0003-Add-FAST-option-to-vacuum-command.patch) at 2019-12-19 05:41:05 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v36-0002-Add-parallel-option-to-VACUUM-command.diff.amit.patch) at 2019-12-18 10:06:05 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v36-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-12-17 12:37:10 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v35-0003-Add-parallel-option-to-VACUUM-command.patch) at 2019-12-03 10:55:10 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (test_16_indexes.sql) at 2019-11-30 21:10:47 from Mahendra Singh <mahi6run at gmail.com> (Patch: No)
    Attachment (v35-0002-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-27 17:43:25 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v34-0002-delta-amit.patch) at 2019-11-27 12:25:55 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v34-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-11-26 19:21:27 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v33-0002-delta2-fix-stats-issue.patch) at 2019-11-26 12:34:47 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-11-25 12:06:04 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-22 09:19:06 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-20 05:30:25 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (Force_all_vacuum_to_use_parallel_vacuum_v2.patch) at 2019-11-08 10:03:12 from Mahendra Singh <mahi6run at gmail.com> (Patch: Yes)
    Attachment (Force_all_vacuum_to_use_parallel_vacuum_v1.patch) at 2019-11-06 08:31:02 from Mahendra Singh <mahi6run at gmail.com> (Patch: Yes)
    Attachment (PoC-delay-stats.patch) at 2019-10-29 08:28:55 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v32-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-10-29 07:06:57 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (0001-POC-compute-total-cost-delay.patch) at 2019-10-28 05:13:06 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v31-0002-Add-an-index-AM-callback-to-estimate-DSM-for-par.patch) at 2019-10-25 15:48:44 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (POC-v1-0001-divide-vacuum-cost-limit.patch) at 2019-10-24 06:21:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v30-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-10-16 01:19:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (fix_comments_amit_1.patch) at 2019-10-12 11:20:55 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v29-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-12 05:59:16 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (Fix-memory-allocation-for-copying-the-stats.patch) at 2019-10-12 03:33:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v28-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-10 07:47:11 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v27-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-04 04:57:58 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-10-02 13:58:26 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-06-07 06:26:25 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v24-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-04-05 21:47:32 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v23-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-04-05 04:59:36 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-04-04 10:23:32 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v21-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-29 02:26:53 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v20-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-26 14:31:10 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v19-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-22 05:02:36 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum_fix.patch) at 2019-03-19 11:22:33 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Make-vacuum-options-a-Node.patch) at 2019-03-18 02:54:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum-grammer.patch) at 2019-03-14 07:33:18 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum-options-into-params.patch) at 2019-03-13 21:41:36 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Make-vacuum-options-a-Node.patch) at 2019-03-06 06:22:59 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-02-14 10:14:38 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v14-0002-Add-P-option-to-vacuumdb-command.patch) at 2019-02-02 15:07:53 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-01-24 02:14:12 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v12-0002-Add-P-option-to-vacuumdb-command.patch) at 2019-01-18 12:41:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-01-15 06:59:15 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v10-0002-Add-P-option-to-vacuumdb-command.patch) at 2018-12-28 02:43:44 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v9-0002-Add-P-option-to-vacuumdb-command.patch) at 2018-12-18 07:59:05 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (parallel_vacuum.png) at 2018-11-02 09:26:02 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: No)
    Attachment (v8-0001-Publish-some-parallel-heap-scan-functions.patch) at 2018-10-31 00:23:18 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Publish-some-parallel-heap-scan-functions.patch) at 2018-08-14 00:31:23 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)

Annotations

When	Who	Mail	Annotation
2018-08-27 09:41:06	Masahiko Sawada (masahikosawada)	From Masahiko Sawada <sawada.mshk@gmail.com> at 2018-08-14 00:31:23	This patch requires the relation extension lock patch.
2018-12-18 08:01:45	Masahiko Sawada (masahikosawada)	From Masahiko Sawada <sawada.mshk@gmail.com> at 2018-11-26 08:33:55	The scope of this feature is shrinked and now it doesn't matter the relation extension lock problem.
2020-01-10 12:57:24	Sergei Kornilov (melkij)	From Masahiko Sawada <masahiko.sawada@2ndquadrant.com> at 2020-01-10 05:13:20	summary of current status

History

When	Who	What
2020-01-30 02:45:06	Amit Kapila (amitkapila)	Closed in commitfest 2020-01 with status: Committed
2020-01-11 04:20:56	Amit Kapila (amitkapila)	Changed committer to amitkapila
2020-01-10 13:06:11	Sergei Kornilov (melkij)	New status: Ready for Committer
2020-01-10 12:57:24	Sergei Kornilov (melkij)	Added annotation "summary of current status" to CA+fd4k4Gi1yrrSbfb_8gbOLYeMOi7ZaKv1n0c9aUFn8nJo4Wng@mail.gmail.com
2019-12-01 02:53:48	Michael Paquier (michael-kun)	New status: Waiting on Author
2019-12-01 02:53:43	Michael Paquier (michael-kun)	Closed in commitfest 2019-11 with status: Moved to next CF
2019-10-12 10:20:08	Masahiko Sawada (masahikosawada)	New status: Needs review
2019-10-04 10:14:57	Dilip Kumar (dilip.kumar)	Changed reviewers to dilip kumar (dilip.kumar), Sergei Kornilov (melkij)
2019-09-30 19:10:43	Álvaro Herrera (alvherre)	New status: Waiting on Author
2019-09-30 19:09:01	Álvaro Herrera (alvherre)	Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:29	Álvaro Herrera (alvherre)	New status: Needs review
2019-09-23 09:18:51	Amit Kapila (amitkapila)	New status: Waiting on Author
2019-09-19 14:30:53	Haribabu Kommi (haribabu)	Removed haribabu from reviewers
2019-08-01 22:27:34	Thomas Munro (macdice)	Closed in commitfest 2019-07 with status: Moved to next CF
2019-07-20 16:44:57	Sergei Kornilov (melkij)	Added melkij as reviewer
2019-07-20 16:44:53	Sergei Kornilov (melkij)	Posted review with messageid <156364109388.1365.17875067226835232117.pgcf@coridan.postgresql.org>
2019-04-09 03:37:55	Michael Paquier (michael-kun)	Closed in commitfest 2019-03 with status: Moved to next CF
2019-04-08 07:29:58	Kyotaro Horiguchi (horiguti)	New status: Needs review
2019-03-27 05:42:03	Haribabu Kommi (haribabu)	New status: Ready for Committer
2019-02-02 03:02:22	Amit Kapila (amitkapila)	Closed in commitfest 2019-01 with status: Moved to next CF
2019-01-18 05:37:47	Haribabu Kommi (haribabu)	Added haribabu as reviewer
2018-12-18 12:19:36	Dongming Liu (inferyes)	Removed inferyes from reviewers
2018-12-18 12:19:31	Dongming Liu (inferyes)	Added inferyes as reviewer
2018-12-18 08:01:45	Masahiko Sawada (masahikosawada)	Added annotation "The scope of this feature is shrinked and now it doesn't matter the relation extension lock problem." to CAD21AoDhAutvKbQ37Btf4taMVbQaOaSvOpxpLgu814T1-OqYGg@mail.gmail.com
2018-12-18 07:59:38	Masahiko Sawada (masahikosawada)	New status: Needs review
2018-12-01 12:51:25	Dmitry Dolgov (erthalion)	New status: Waiting on Author
2018-12-01 12:51:19	Dmitry Dolgov (erthalion)	Closed in commitfest 2018-11 with status: Moved to next CF
2018-10-01 10:38:53	Michael Paquier (michael-kun)	Closed in commitfest 2018-09 with status: Moved to next CF
2018-09-12 10:00:13	Fabien Coelho (calvin)	Changed name to Block level parallel vacuum
2018-08-27 09:41:06	Masahiko Sawada (masahikosawada)	Added annotation "This patch requires the relation extension lock patch." to CAD21AoDTPMgzSkV4E3SFo1CH_x50bf5PqZFQf4jmqjk-C03BWg@mail.gmail.com
2018-08-27 09:39:51	Masahiko Sawada (masahikosawada)	Changed authors to Masahiko Sawada (masahikosawada)
2018-08-27 09:39:40	Masahiko Sawada (masahikosawada)	Attached mail thread CAD21AoDTPMgzSkV4E3SFo1CH_x50bf5PqZFQf4jmqjk-C03BWg@mail.gmail.com
2018-08-27 09:39:40	Masahiko Sawada (masahikosawada)	Created patch record

Edit