Support parallelism for copy command

Edit
ID 2610
Title Support parallelism for copy command
Topic Performance
Created 2020-06-22 04:53:45
Last modified 2021-03-01 05:40:37 (3 years, 9 months ago)
Latest email 2020-12-28 09:44:43 (3 years, 11 months ago)
Status
2021-03: Withdrawn
2021-01: Moved to next CF
2020-11: Moved to next CF
2020-09: Moved to next CF
2020-07: Moved to next CF
Target version
Authors vigneshwaran C (vignesh.postgres), Bharath Rupireddy (bharathrupireddy)
Reviewers Amit Kapila (amitkapila), Greg Nancarrow (gregn1234), Hou Zhijie (houzj)Become reviewer
Committer Amit Kapila (amitkapila)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2610
git checkout commitfest/cf/2610
Emails
Parallel copy
First at 2020-02-14 08:11:54 by Amit Kapila <amit.kapila16 at gmail.com>
Latest at 2020-12-28 09:44:43 by vignesh C <vignesh21 at gmail.com>
Latest attachment (v12-0007-Parallel-copy-based-on-workers-identifying-line-.patch) at 2020-12-28 09:44:43 from vignesh C <vignesh21 at gmail.com>
    Attachment (v12-0007-Parallel-copy-based-on-workers-identifying-line-.patch) at 2020-12-28 09:44:43 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-12-07 08:32:22 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v10-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-11-18 09:56:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (WIP-Check-if-parallel-copy-can-be-performed.patch) at 2020-11-10 13:42:46 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-WIP-Find-all-line-endings-in-COPY-in-chunks.patch) at 2020-10-30 16:52:37 from Heikki Linnakangas <hlinnaka at iki.fi> (Patch: Yes)
    Attachment (v9-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-27 13:36:15 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-21 06:37:55 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (wal_dump.tar) at 2020-10-19 12:35:53 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (v7-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-14 09:53:57 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-09 09:22:22 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-07 18:44:00 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (testing_patch_results.tar.gz) at 2020-09-24 02:56:09 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (v1-0001-Parallel-Copy-Exec-Time-Capture.patch) at 2020-09-22 10:38:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-09-22 09:14:21 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (table_data_generation_files_to_share.zip) at 2020-09-16 07:50:03 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (testcase.rtf) at 2020-09-15 13:49:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (insert_data_gen.txt) at 2020-09-02 05:39:55 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (parallel_copy_perf_summary_5GB_csv.txt) at 2020-08-27 02:33:27 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (v4-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-19 06:21:29 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-14 15:48:13 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-03 07:03:48 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-01 04:24:54 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-22 14:17:57 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-17 08:39:28 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-16 17:13:51 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-12 12:18:02 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-11 06:55:07 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-06 09:27:55 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-01 09:16:19 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-26 09:04:23 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-25 03:00:14 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0006-Parallel-Copy-For-Binary-Format-Files.patch) at 2020-06-24 08:10:29 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-23 06:52:02 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-23 02:37:48 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0005-Tests-for-parallel-copy.patch) at 2020-06-17 04:10:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (config.txt) at 2020-06-15 11:09:04 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-12 05:30:59 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (config.txt) at 2020-06-03 10:23:24 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (copy_execution_time_v2.patch) at 2020-03-12 13:09:07 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (simdcopy.c) at 2020-02-21 12:54:31 from Ants Aasma <ants at cybertec.at> (Patch: No)
    Attachment (simdcsv-find-only-lineendings.diff) at 2020-02-18 12:29:20 from Ants Aasma <ants at cybertec.at> (Patch: Yes)
History
When Who What
2021-03-01 05:40:37 vigneshwaran C (vignesh.postgres) Closed in commitfest 2021-03 with status: Withdrawn
2021-02-01 12:34:56 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-01 11:01:14 Anastasia Lubennikova (lubennikovaav) Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-28 08:37:56 Amit Kapila (amitkapila) Added amitkapila as committer
2020-10-28 08:37:47 Amit Kapila (amitkapila) Added amitkapila as reviewer
2020-10-18 02:24:20 Hou Zhijie (houzj) Added houzj as reviewer
2020-10-01 04:07:23 Michael Paquier (michael-kun) Closed in commitfest 2020-09 with status: Moved to next CF
2020-08-12 03:39:12 Greg Nancarrow (gregn1234) Posted review with messageid <159720355283.790.16098219619754504834.pgcf@coridan.postgresql.org>
2020-08-07 01:32:58 Greg Nancarrow (gregn1234) Added gregn1234 as reviewer
2020-08-01 20:55:44 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2020-07 with status: Moved to next CF
2020-06-22 05:14:54 Bharath Rupireddy (bharathrupireddy) Changed authors to vignesh C (vignesh.postgres), Bharath Rupireddy (bharathrupireddy)
2020-06-22 04:54:37 vigneshwaran C (vignesh.postgres) Changed authors to vignesh C (vignesh.postgres)
2020-06-22 04:53:45 vigneshwaran C (vignesh.postgres) Attached mail thread CAA4eK1+kpddvvLxWm4BuG_AhVvYz8mKAEa7osxp_X0d4ZEiV=g@mail.gmail.com
2020-06-22 04:53:45 vigneshwaran C (vignesh.postgres) Created patch record
Edit