Fast COPY FROM command for the foreign tables

Edit

Title

Topic

Performance

Created

2020-06-17 06:35:40

Last modified

2022-10-31 08:40:37 (11 months ago)

Latest email

2022-10-31 08:50:02 (11 months ago)

Status

2022-11: Committed

2022-09: Moved to next CF

2022-07: Moved to next CF

2022-03: Moved to next CF

2022-01: Moved to next CF

2021-11: Moved to next CF

2021-09: Moved to next CF

2021-07: Moved to next CF

2021-03: Moved to next CF

2021-01: Moved to next CF

2020-11: Moved to next CF

2020-09: Moved to next CF

2020-07: Moved to next CF

Target version

Authors

Andrei Lepikhov (lepikhov)

Reviewers

Etsuro Fujita (efujita), Amit Langote (amitlan), Takayuki Tsunakawa (maumau), Justin Pryzby (justinpryzby), Ian Barwick (barwick)Become reviewer

Committer

Etsuro Fujita (efujita)

Links

Emails

[POC] Fast COPY FROM command for the table with foreign partitions: First at 2020-06-01 09:29:23 by Andrey Lepikhov <a.lepikhov at postgrespro.ru>
Latest at 2022-10-31 08:50:02 by Etsuro Fujita <etsuro.fujita at gmail.com>
Latest attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-5.patch) at 2022-10-12 02:56:17 from Etsuro Fujita <etsuro.fujita at gmail.com>
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-5.patch) at 2022-10-12 02:56:17 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-4.patch) at 2022-10-07 06:18:59 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-3.patch) at 2022-09-27 09:03:51 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-2.patch) at 2022-08-09 11:44:59 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-1.patch) at 2022-07-18 08:22:49 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2022-07-11 03:54:08 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (flush_nonzero_buffer.txt) at 2022-07-08 15:09:35 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (data.pl) at 2022-07-08 02:12:28 from Ian Barwick <ian.barwick at enterprisedb.com> (Patch: No)
    Attachment (v3-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2022-03-24 06:43:37 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v2-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2021-06-07 11:16:58 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2021-06-04 08:26:29 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-04-09 00:49:56 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v22-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-23 05:05:48 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v21-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-23 02:01:56 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v20-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-12 05:54:29 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v19-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-05 16:54:17 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v18-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-04 07:39:55 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v17-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-04 02:24:24 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (0001-language-fixen.pxtch) at 2021-03-03 20:27:03 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v16-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-16 05:39:57 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v15-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-15 04:54:00 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v14-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-09 04:35:03 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v13_3-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-01-12 04:13:05 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (test_copy_from.sql) at 2021-01-11 11:59:13 from "Tang, Haiying" <tanghy.fnst at cn.fujitsu.com> (Patch: No)
    Attachment (v13_2-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-12-30 07:16:07 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v13_1-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-12-23 09:00:18 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v13-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-12-14 09:06:12 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v12-0001-Move-multi-insert-decision-logic-into-execu-20201110.patch) at 2020-11-10 18:17:53 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v11-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-10-19 14:58:34 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v10-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-09-20 09:12:08 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-delta.patch) at 2020-09-16 09:10:36 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-09-10 09:57:43 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v8-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-09-09 09:38:20 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (alternative.patch) at 2020-09-09 08:45:26 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v7-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-09-07 10:31:09 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v6-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-08-24 07:18:36 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-08-21 12:19:06 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (ri_usesMultiInsert.patch) at 2020-08-07 09:14:41 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (setup2.sh) at 2020-07-27 16:34:46 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (v5-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-07-23 06:23:42 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (pgfdw-copy-buffering-amit-suggests.patch) at 2020-07-16 09:14:04 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-07-12 17:46:16 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v3-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-22 06:13:30 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v2-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-17 06:24:48 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-15 05:26:12 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-02 05:51:22 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-01 09:29:23 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)

History

When	Who	What
2022-10-31 08:40:37	Etsuro Fujita (efujita)	Closed in commitfest 2022-11 with status: Committed
2022-10-12 06:55:28	Michael Paquier (michael-kun)	Closed in commitfest 2022-09 with status: Moved to next CF
2022-10-12 06:55:25	Michael Paquier (michael-kun)	New status: Ready for Committer
2022-08-01 16:50:12	Jacob Champion (jchampion)	Closed in commitfest 2022-07 with status: Moved to next CF
2022-07-07 01:12:06	Ian Barwick (barwick)	Added barwick as reviewer
2022-05-26 14:58:48	Justin Pryzby (justinpryzby)	Changed targetversion to None
2022-04-08 13:46:45	Greg Stark (stark)	Closed in commitfest 2022-03 with status: Moved to next CF
2022-03-24 06:44:26	Andrei Lepikhov (lepikhov)	New status: Needs review
2022-03-21 23:58:05	Andres Freund (andresfreund)	New status: Waiting on Author
2022-02-02 16:29:54	Julien Rouhaud (rjuju)	Closed in commitfest 2022-01 with status: Moved to next CF
2021-12-01 10:27:26	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2021-11 with status: Moved to next CF
2021-10-05 14:29:16	Jaime Casanova (jcasanov)	Closed in commitfest 2021-09 with status: Moved to next CF
2021-09-07 00:56:10	Justin Pryzby (justinpryzby)	Changed targetversion to 15
2021-08-03 02:16:57	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-07 with status: Moved to next CF
2021-06-30 06:38:38	Etsuro Fujita (efujita)	Added efujita as committer
2021-04-08 15:41:45	David Steele (dsteele)	Closed in commitfest 2021-03 with status: Moved to next CF
2021-04-08 15:27:25	David Steele (dsteele)	Changed targetversion to None
2021-03-05 16:59:11	Takayuki Tsunakawa (maumau)	New status: Ready for Committer
2021-03-04 22:20:08	Justin Pryzby (justinpryzby)	Added justinpryzby as reviewer
2021-03-04 11:02:36	Ibrar Ahmed (ibrar)	New status: Waiting on Author
2021-02-12 07:36:12	Takayuki Tsunakawa (maumau)	New status: Ready for Committer
2021-02-01 12:34:28	Masahiko Sawada (masahikosawada)	Closed in commitfest 2021-01 with status: Moved to next CF
2021-01-22 13:15:27	Masahiko Sawada (masahikosawada)	New status: Needs review
2021-01-11 18:19:01	Tomas Vondra (fuzzycz)	New status: Waiting on Author
2021-01-06 06:12:02	Andrei Lepikhov (lepikhov)	New status: Needs review
2020-12-01 12:23:46	Anastasia Lubennikova (lubennikovaav)	New status: Waiting on Author
2020-12-01 12:23:36	Anastasia Lubennikova (lubennikovaav)	Closed in commitfest 2020-11 with status: Moved to next CF
2020-12-01 12:23:29	Anastasia Lubennikova (lubennikovaav)	New status: Needs review
2020-10-19 04:42:10	Takayuki Tsunakawa (maumau)	New status: Waiting on Author
2020-10-08 03:24:25	Takayuki Tsunakawa (maumau)	Added maumau as reviewer
2020-09-30 06:58:21	Michael Paquier (michael-kun)	Closed in commitfest 2020-09 with status: Moved to next CF
2020-09-30 06:58:17	Michael Paquier (michael-kun)	New status: Needs review
2020-09-07 07:26:15	Michael Paquier (michael-kun)	New status: Waiting on Author
2020-08-02 22:38:16	Daniel Gustafsson (d_gustafsson)	Closed in commitfest 2020-07 with status: Moved to next CF
2020-07-17 02:22:39	Amit Langote (amitlan)	Added amitlan as reviewer
2020-06-19 14:58:24	Etsuro Fujita (efujita)	Added efujita as reviewer
2020-06-17 06:37:02	Andrei Lepikhov (lepikhov)	Changed authors to Andrey Lepikhov (lepikhov)
2020-06-17 06:37:02	Andrei Lepikhov (lepikhov)	Changed targetversion to 14
2020-06-17 06:35:40	Andrei Lepikhov (lepikhov)	Attached mail thread 3d0909dc-3691-a576-208a-90986e55489f@postgrespro.ru
2020-06-17 06:35:40	Andrei Lepikhov (lepikhov)	Created patch record

Edit