Support parallelism for copy command

Edit

Title

Topic

Performance

Created

2020-06-22 04:53:45

Last modified

2021-03-01 05:40:37 (3 years, 6 months ago)

Latest email

2020-12-28 09:44:43 (3 years, 8 months ago)

Status

2021-03: Withdrawn

2021-01: Moved to next CF

2020-11: Moved to next CF

2020-09: Moved to next CF

2020-07: Moved to next CF

Target version

Authors

vigneshwaran C (vignesh.postgres), Bharath Rupireddy (bharathrupireddy)

Reviewers

Amit Kapila (amitkapila), Greg Nancarrow (gregn1234), Hou Zhijie (houzj)Become reviewer

Committer

Amit Kapila (amitkapila)

Links

Emails

Parallel copy: First at 2020-02-14 08:11:54 by Amit Kapila <amit.kapila16 at gmail.com>
Latest at 2020-12-28 09:44:43 by vignesh C <vignesh21 at gmail.com>
Latest attachment (v12-0007-Parallel-copy-based-on-workers-identifying-line-.patch) at 2020-12-28 09:44:43 from vignesh C <vignesh21 at gmail.com>
    Attachment (v12-0007-Parallel-copy-based-on-workers-identifying-line-.patch) at 2020-12-28 09:44:43 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v11-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-12-07 08:32:22 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v10-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-11-18 09:56:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (WIP-Check-if-parallel-copy-can-be-performed.patch) at 2020-11-10 13:42:46 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-WIP-Find-all-line-endings-in-COPY-in-chunks.patch) at 2020-10-30 16:52:37 from Heikki Linnakangas <hlinnaka at iki.fi> (Patch: Yes)
    Attachment (v9-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-27 13:36:15 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v8-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-21 06:37:55 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (wal_dump.tar) at 2020-10-19 12:35:53 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (v7-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-14 09:53:57 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-09 09:22:22 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-10-07 18:44:00 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (testing_patch_results.tar.gz) at 2020-09-24 02:56:09 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (v1-0001-Parallel-Copy-Exec-Time-Capture.patch) at 2020-09-22 10:38:46 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v5-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-09-22 09:14:21 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (table_data_generation_files_to_share.zip) at 2020-09-16 07:50:03 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (testcase.rtf) at 2020-09-15 13:49:00 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (insert_data_gen.txt) at 2020-09-02 05:39:55 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (parallel_copy_perf_summary_5GB_csv.txt) at 2020-08-27 02:33:27 from Greg Nancarrow <gregn4422 at gmail.com> (Patch: No)
    Attachment (v4-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-19 06:21:29 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-14 15:48:13 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-03 07:03:48 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-08-01 04:24:54 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v2-0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-22 14:17:57 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-17 08:39:28 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-16 17:13:51 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-12 12:18:02 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-11 06:55:07 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-06 09:27:55 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-07-01 09:16:19 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-26 09:04:23 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-25 03:00:14 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0006-Parallel-Copy-For-Binary-Format-Files.patch) at 2020-06-24 08:10:29 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-23 06:52:02 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-23 02:37:48 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (0005-Tests-for-parallel-copy.patch) at 2020-06-17 04:10:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (config.txt) at 2020-06-15 11:09:04 from Bharath Rupireddy <bharath.rupireddyforpostgres at gmail.com> (Patch: No)
    Attachment (0001-Copy-code-readjustment-to-support-parallel-copy.patch) at 2020-06-12 05:30:59 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (config.txt) at 2020-06-03 10:23:24 from vignesh C <vignesh21 at gmail.com> (Patch: No)
    Attachment (copy_execution_time_v2.patch) at 2020-03-12 13:09:07 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (simdcopy.c) at 2020-02-21 12:54:31 from Ants Aasma <ants at cybertec.at> (Patch: No)
    Attachment (simdcsv-find-only-lineendings.diff) at 2020-02-18 12:29:20 from Ants Aasma <ants at cybertec.at> (Patch: Yes)

History

When	Who	What
2021-03-01 05:40:37	vigneshwaran C (vignesh.postgres)	Closed in commitfest 2021-03 with status: Withdrawn
2021-02-01 12:34:56	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-01 with status: Moved to next CF
2020-12-01 11:01:14	Anastasia Lubennikova (lubennikovaav)	Closed in commitfest 2020-11 with status: Moved to next CF
2020-10-28 08:37:56	Amit Kapila (amitkapila)	Added amitkapila as committer
2020-10-28 08:37:47	Amit Kapila (amitkapila)	Added amitkapila as reviewer
2020-10-18 02:24:20	Hou Zhijie (houzj)	Added houzj as reviewer
2020-10-01 04:07:23	Michael Paquier (michael-kun)	Closed in commitfest 2020-09 with status: Moved to next CF
2020-08-12 03:39:12	Greg Nancarrow (gregn1234)	Posted review with messageid <159720355283.790.16098219619754504834.pgcf@coridan.postgresql.org>
2020-08-07 01:32:58	Greg Nancarrow (gregn1234)	Added gregn1234 as reviewer
2020-08-01 20:55:44	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2020-07 with status: Moved to next CF
2020-06-22 05:14:54	Bharath Rupireddy (bharathrupireddy)	Changed authors to vignesh C (vignesh.postgres), Bharath Rupireddy (bharathrupireddy)
2020-06-22 04:54:37	vigneshwaran C (vignesh.postgres)	Changed authors to vignesh C (vignesh.postgres)
2020-06-22 04:53:45	vigneshwaran C (vignesh.postgres)	Attached mail thread CAA4eK1+kpddvvLxWm4BuG_AhVvYz8mKAEa7osxp_X0d4ZEiV=g@mail.gmail.com
2020-06-22 04:53:45	vigneshwaran C (vignesh.postgres)	Created patch record

Edit