Block level parallel vacuum

Edit

Title

Topic

Performance

Created

2018-08-27 09:39:40

Last modified

2020-01-30 02:45:06 (3 years, 8 months ago)

Latest email

2020-01-30 02:47:51 (3 years, 8 months ago)

Status

2020-01: Committed

2019-11: Moved to next CF

2019-09: Moved to next CF

2019-07: Moved to next CF

2019-03: Moved to next CF

2019-01: Moved to next CF

2018-11: Moved to next CF

2018-09: Moved to next CF

Target version

Authors

Masahiko Sawada (masahikosawada)

Reviewers

Dilip Kumar (dilip.kumar), Sergei Kornilov (melkij)Become reviewer

Committer

Amit Kapila (amitkapila)

Links

Emails

Re: [HACKERS] Block level parallel vacuum

First at 2018-08-14 00:31:23 by Masahiko Sawada <sawada.mshk at gmail.com>
Latest at 2020-01-30 02:47:51 by Amit Kapila <amit.kapila16 at gmail.com>
Latest attachment (v38-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-28 09:47:08 from Amit Kapila <amit.kapila16 at gmail.com>

    Attachment (v38-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-28 09:47:08 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v37-0001-Add-parallel-option-to-vacuumdb-command.patch) at 2020-01-25 06:40:59 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v36-0001-Add-paralell-P-option-to-vacuumdb-command.patch) at 2020-01-22 07:17:48 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples_v3.patch) at 2020-01-21 09:16:15 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples_v2.patch) at 2020-01-21 07:20:46 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (fix_max_dead_tuples.patch) at 2020-01-21 06:40:48 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v50-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-17 09:17:44 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v49-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-16 12:04:38 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v48-0001-Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-15 11:57:37 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (review_v47_masahiko.patch) at 2020-01-15 04:34:33 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v47-0001-Introduce-IndexAM-fields-for-parallel-vacuum.patch) at 2020-01-14 12:43:22 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v46-0001-Introduce-IndexAM-fields-for-parallel-vacuum.patch) at 2020-01-13 10:09:39 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-11 04:18:40 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v44-0002-delta_Allow-vacuum-command-to-process-indexes-in-parallel.patch) at 2020-01-10 11:54:44 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-10 07:50:58 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-09 10:33:30 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-08 13:16:38 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2020-01-04 13:18:09 from Mahendra Singh Thalor <mahi6run at gmail.com> (Patch: Yes)
    Attachment (v41-0004-Add-ability-to-disable-leader-participation-in-p.patch) at 2019-12-29 13:06:23 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v40-0004-Add-ability-to-disable-leader-participation-in-p.patch) at 2019-12-25 12:17:16 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v4-0001-Delete-empty-pages-in-each-pass-during-GIST-VACUUM.patch) at 2019-12-23 10:41:32 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v38-0003-Add-FAST-option-to-vacuum-command.patch) at 2019-12-20 06:43:22 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v37-0003-Add-FAST-option-to-vacuum-command.patch) at 2019-12-19 05:41:05 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v36-0002-Add-parallel-option-to-VACUUM-command.diff.amit.patch) at 2019-12-18 10:06:05 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v36-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-12-17 12:37:10 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v35-0003-Add-parallel-option-to-VACUUM-command.patch) at 2019-12-03 10:55:10 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (test_16_indexes.sql) at 2019-11-30 21:10:47 from Mahendra Singh <mahi6run at gmail.com> (Patch: No)
    Attachment (v35-0002-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-27 17:43:25 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v34-0002-delta-amit.patch) at 2019-11-27 12:25:55 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v34-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-11-26 19:21:27 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (v33-0002-delta2-fix-stats-issue.patch) at 2019-11-26 12:34:47 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-11-25 12:06:04 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-22 09:19:06 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v33-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-11-20 05:30:25 from Masahiko Sawada <masahiko.sawada at 2ndquadrant.com> (Patch: Yes)
    Attachment (Force_all_vacuum_to_use_parallel_vacuum_v2.patch) at 2019-11-08 10:03:12 from Mahendra Singh <mahi6run at gmail.com> (Patch: Yes)
    Attachment (Force_all_vacuum_to_use_parallel_vacuum_v1.patch) at 2019-11-06 08:31:02 from Mahendra Singh <mahi6run at gmail.com> (Patch: Yes)
    Attachment (PoC-delay-stats.patch) at 2019-10-29 08:28:55 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v32-0001-Add-index-AM-field-and-callback-for-parallel-ind.patch) at 2019-10-29 07:06:57 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (0001-POC-compute-total-cost-delay.patch) at 2019-10-28 05:13:06 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v31-0002-Add-an-index-AM-callback-to-estimate-DSM-for-par.patch) at 2019-10-25 15:48:44 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (POC-v1-0001-divide-vacuum-cost-limit.patch) at 2019-10-24 06:21:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (v30-0002-Add-parallel-option-to-VACUUM-command.patch) at 2019-10-16 01:19:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (fix_comments_amit_1.patch) at 2019-10-12 11:20:55 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v29-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-12 05:59:16 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (Fix-memory-allocation-for-copying-the-stats.patch) at 2019-10-12 03:33:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (v28-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-10 07:47:11 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v27-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-10-04 04:57:58 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v26-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-10-02 13:58:26 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v25-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-06-07 06:26:25 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v24-0002-Add-paralell-P-option-to-vacuumdb-command.patch) at 2019-04-05 21:47:32 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v23-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-04-05 04:59:36 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v22-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-04-04 10:23:32 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v21-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-29 02:26:53 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v20-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-26 14:31:10 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v19-0001-All-VACUUM-command-options-allow-an-argument.patch) at 2019-03-22 05:02:36 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum_fix.patch) at 2019-03-19 11:22:33 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v17-0001-Make-vacuum-options-a-Node.patch) at 2019-03-18 02:54:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum-grammer.patch) at 2019-03-14 07:33:18 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (vacuum-options-into-params.patch) at 2019-03-13 21:41:36 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (v16-0001-Make-vacuum-options-a-Node.patch) at 2019-03-06 06:22:59 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v15-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-02-14 10:14:38 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v14-0002-Add-P-option-to-vacuumdb-command.patch) at 2019-02-02 15:07:53 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v13-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-01-24 02:14:12 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v12-0002-Add-P-option-to-vacuumdb-command.patch) at 2019-01-18 12:41:42 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Add-parallel-option-to-VACUUM-command.patch) at 2019-01-15 06:59:15 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v10-0002-Add-P-option-to-vacuumdb-command.patch) at 2018-12-28 02:43:44 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v9-0002-Add-P-option-to-vacuumdb-command.patch) at 2018-12-18 07:59:05 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (parallel_vacuum.png) at 2018-11-02 09:26:02 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: No)
    Attachment (v8-0001-Publish-some-parallel-heap-scan-functions.patch) at 2018-10-31 00:23:18 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)
    Attachment (v7-0001-Publish-some-parallel-heap-scan-functions.patch) at 2018-08-14 00:31:23 from Masahiko Sawada <sawada.mshk at gmail.com> (Patch: Yes)

Annotations

When	Who	Mail	Annotation
2018-08-27 09:41:06	Masahiko Sawada (masahikosawada)	From Masahiko Sawada <sawada.mshk@gmail.com> at 2018-08-14 00:31:23	This patch requires the relation extension lock patch.
2018-12-18 08:01:45	Masahiko Sawada (masahikosawada)	From Masahiko Sawada <sawada.mshk@gmail.com> at 2018-11-26 08:33:55	The scope of this feature is shrinked and now it doesn't matter the relation extension lock problem.
2020-01-10 12:57:24	Sergei Kornilov (melkij)	From Masahiko Sawada <masahiko.sawada@2ndquadrant.com> at 2020-01-10 05:13:20	summary of current status

History

When	Who	What
2020-01-30 02:45:06	Amit Kapila (amitkapila)	Closed in commitfest 2020-01 with status: Committed
2020-01-11 04:20:56	Amit Kapila (amitkapila)	Changed committer to amitkapila
2020-01-10 13:06:11	Sergei Kornilov (melkij)	New status: Ready for Committer
2020-01-10 12:57:24	Sergei Kornilov (melkij)	Added annotation "summary of current status" to CA+fd4k4Gi1yrrSbfb_8gbOLYeMOi7ZaKv1n0c9aUFn8nJo4Wng@mail.gmail.com
2019-12-01 02:53:48	Michael Paquier (michael-kun)	New status: Waiting on Author
2019-12-01 02:53:43	Michael Paquier (michael-kun)	Closed in commitfest 2019-11 with status: Moved to next CF
2019-10-12 10:20:08	Masahiko Sawada (masahikosawada)	New status: Needs review
2019-10-04 10:14:57	Dilip Kumar (dilip.kumar)	Changed reviewers to dilip kumar (dilip.kumar), Sergei Kornilov (melkij)
2019-09-30 19:10:43	Álvaro Herrera (alvherre)	New status: Waiting on Author
2019-09-30 19:09:01	Álvaro Herrera (alvherre)	Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:29	Álvaro Herrera (alvherre)	New status: Needs review
2019-09-23 09:18:51	Amit Kapila (amitkapila)	New status: Waiting on Author
2019-09-19 14:30:53	Haribabu Kommi (haribabu)	Removed haribabu from reviewers
2019-08-01 22:27:34	Thomas Munro (macdice)	Closed in commitfest 2019-07 with status: Moved to next CF
2019-07-20 16:44:57	Sergei Kornilov (melkij)	Added melkij as reviewer
2019-07-20 16:44:53	Sergei Kornilov (melkij)	Posted review with messageid <156364109388.1365.17875067226835232117.pgcf@coridan.postgresql.org>
2019-04-09 03:37:55	Michael Paquier (michael-kun)	Closed in commitfest 2019-03 with status: Moved to next CF
2019-04-08 07:29:58	Kyotaro Horiguchi (horiguti)	New status: Needs review
2019-03-27 05:42:03	Haribabu Kommi (haribabu)	New status: Ready for Committer
2019-02-02 03:02:22	Amit Kapila (amitkapila)	Closed in commitfest 2019-01 with status: Moved to next CF
2019-01-18 05:37:47	Haribabu Kommi (haribabu)	Added haribabu as reviewer
2018-12-18 12:19:36	Dongming Liu (inferyes)	Removed inferyes from reviewers
2018-12-18 12:19:31	Dongming Liu (inferyes)	Added inferyes as reviewer
2018-12-18 08:01:45	Masahiko Sawada (masahikosawada)	Added annotation "The scope of this feature is shrinked and now it doesn't matter the relation extension lock problem." to CAD21AoDhAutvKbQ37Btf4taMVbQaOaSvOpxpLgu814T1-OqYGg@mail.gmail.com
2018-12-18 07:59:38	Masahiko Sawada (masahikosawada)	New status: Needs review
2018-12-01 12:51:25	Dmitry Dolgov (erthalion)	New status: Waiting on Author
2018-12-01 12:51:19	Dmitry Dolgov (erthalion)	Closed in commitfest 2018-11 with status: Moved to next CF
2018-10-01 10:38:53	Michael Paquier (michael-kun)	Closed in commitfest 2018-09 with status: Moved to next CF
2018-09-12 10:00:13	Fabien Coelho (calvin)	Changed name to Block level parallel vacuum
2018-08-27 09:41:06	Masahiko Sawada (masahikosawada)	Added annotation "This patch requires the relation extension lock patch." to CAD21AoDTPMgzSkV4E3SFo1CH_x50bf5PqZFQf4jmqjk-C03BWg@mail.gmail.com
2018-08-27 09:39:51	Masahiko Sawada (masahikosawada)	Changed authors to Masahiko Sawada (masahikosawada)
2018-08-27 09:39:40	Masahiko Sawada (masahikosawada)	Attached mail thread CAD21AoDTPMgzSkV4E3SFo1CH_x50bf5PqZFQf4jmqjk-C03BWg@mail.gmail.com
2018-08-27 09:39:40	Masahiko Sawada (masahikosawada)	Created patch record

Edit