Fast COPY FROM command for the foreign tables

Edit
Comment/Review
Change Status
ID 2601
Title Fast COPY FROM command for the foreign tables
Topic Performance
Created 2020-06-17 06:35:40
Last modified 2022-10-31 08:40:37 (2 years ago)
Latest email 2022-10-31 08:50:02 (2 years ago)
Status
2022-11: Committed
2022-09: Moved to next CF
2022-07: Moved to next CF
2022-03: Moved to next CF
2022-01: Moved to next CF
2021-11: Moved to next CF
2021-09: Moved to next CF
2021-07: Moved to next CF
2021-03: Moved to next CF
2021-01: Moved to next CF
2020-11: Moved to next CF
2020-09: Moved to next CF
2020-07: Moved to next CF
Target version
Authors Andrei Lepikhov (lepikhov)
Reviewers Etsuro Fujita (efujita), Amit Langote (amitlan), Takayuki Tsunakawa (maumau), Justin Pryzby (justinpryzby), Ian Barwick (barwick)Become reviewer
Committer Etsuro Fujita (efujita)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run: 
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2601
git checkout commitfest/cf/2601
Emails
[POC] Fast COPY FROM command for the table with foreign partitions
First at 2020-06-01 09:29:23 by Andrey Lepikhov <a.lepikhov at postgrespro.ru>
Latest at 2022-10-31 08:50:02 by Etsuro Fujita <etsuro.fujita at gmail.com>
Latest attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-5.patch) at 2022-10-12 02:56:17 from Etsuro Fujita <etsuro.fujita at gmail.com>
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-5.patch) at 2022-10-12 02:56:17 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-4.patch) at 2022-10-07 06:18:59 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-3.patch) at 2022-09-27 09:03:51 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-2.patch) at 2022-08-09 11:44:59 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM-efujita-1.patch) at 2022-07-18 08:22:49 from Etsuro Fujita <etsuro.fujita at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2022-07-11 03:54:08 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (flush_nonzero_buffer.txt) at 2022-07-08 15:09:35 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (data.pl) at 2022-07-08 02:12:28 from Ian Barwick <ian.barwick at enterprisedb.com> (Patch: No)
    Attachment (v3-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2022-03-24 06:43:37 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v2-0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2021-06-07 11:16:58 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Implementation-of-a-Bulk-COPY-FROM.patch) at 2021-06-04 08:26:29 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-04-09 00:49:56 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v22-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-23 05:05:48 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v21-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-23 02:01:56 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v20-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-12 05:54:29 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v19-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-05 16:54:17 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v18-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-04 07:39:55 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v17-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-03-04 02:24:24 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (0001-language-fixen.pxtch) at 2021-03-03 20:27:03 from Justin Pryzby <pryzby at telsasoft.com> (Patch: Yes)
    Attachment (v16-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-16 05:39:57 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v15-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-15 04:54:00 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v14-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-02-09 04:35:03 from "tsunakawa.takay at fujitsu.com" <tsunakawa.takay at fujitsu.com> (Patch: Yes)
    Attachment (v13_3-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2021-01-12 04:13:05 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (test_copy_from.sql) at 2021-01-11 11:59:13 from "Tang, Haiying" <tanghy.fnst at cn.fujitsu.com> (Patch: No)
    Attachment (v13_2-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-12-30 07:16:07 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v13_1-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-12-23 09:00:18 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v13-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-12-14 09:06:12 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v12-0001-Move-multi-insert-decision-logic-into-execu-20201110.patch) at 2020-11-10 18:17:53 from Tomas Vondra <tomas.vondra at enterprisedb.com> (Patch: Yes)
    Attachment (v11-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-10-19 14:58:34 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v10-0002-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-09-20 09:12:08 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-delta.patch) at 2020-09-16 09:10:36 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v9-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-09-10 09:57:43 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v8-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-09-09 09:38:20 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (alternative.patch) at 2020-09-09 08:45:26 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v7-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-09-07 10:31:09 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v6-0001-Move-multi-insert-decision-logic-into-executor.patch) at 2020-08-24 07:18:36 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v6-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-08-21 12:19:06 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (ri_usesMultiInsert.patch) at 2020-08-07 09:14:41 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (setup2.sh) at 2020-07-27 16:34:46 from Alexey Kondratov <a.kondratov at postgrespro.ru> (Patch: No)
    Attachment (v5-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-07-23 06:23:42 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (pgfdw-copy-buffering-amit-suggests.patch) at 2020-07-16 09:14:04 from Amit Langote <amitlangote09 at gmail.com> (Patch: Yes)
    Attachment (v4-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-07-12 17:46:16 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v3-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-22 06:13:30 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (v2-0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-17 06:24:48 from "Andrey V. Lepikhov" <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-15 05:26:12 from Ashutosh Bapat <ashutosh.bapat.oss at gmail.com> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-02 05:51:22 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
    Attachment (0001-Fast-COPY-FROM-into-the-foreign-or-sharded-table.patch) at 2020-06-01 09:29:23 from Andrey Lepikhov <a.lepikhov at postgrespro.ru> (Patch: Yes)
History
When Who What
2022-10-31 08:40:37 Etsuro Fujita (efujita) Closed in commitfest 2022-11 with status: Committed
2022-10-12 06:55:28 Michael Paquier (michael-kun) Closed in commitfest 2022-09 with status: Moved to next CF
2022-10-12 06:55:25 Michael Paquier (michael-kun) New status: Ready for Committer
2022-08-01 16:50:12 Jacob Champion (jchampion) Closed in commitfest 2022-07 with status: Moved to next CF
2022-07-07 01:12:06 Ian Barwick (barwick) Added barwick as reviewer
2022-05-26 14:58:48 Justin Pryzby (justinpryzby) Changed targetversion to None
2022-04-08 13:46:45 Greg Stark (stark) Closed in commitfest 2022-03 with status: Moved to next CF
2022-03-24 06:44:26 Andrei Lepikhov (lepikhov) New status: Needs review
2022-03-21 23:58:05 Andres Freund (andresfreund) New status: Waiting on Author
2022-02-02 16:29:54 Julien Rouhaud (rjuju) Closed in commitfest 2022-01 with status: Moved to next CF
2021-12-01 10:27:26 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2021-11 with status: Moved to next CF
2021-10-05 14:29:16 Jaime Casanova (jcasanov) Closed in commitfest 2021-09 with status: Moved to next CF
2021-09-07 00:56:10 Justin Pryzby (justinpryzby) Changed targetversion to 15
2021-08-03 02:16:57 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-07 with status: Moved to next CF
2021-06-30 06:38:38 Etsuro Fujita (efujita) Added efujita as committer
2021-04-08 15:41:45 David Steele (dsteele) Closed in commitfest 2021-03 with status: Moved to next CF
2021-04-08 15:27:25 David Steele (dsteele) Changed targetversion to None
2021-03-05 16:59:11 Takayuki Tsunakawa (maumau) New status: Ready for Committer
2021-03-04 22:20:08 Justin Pryzby (justinpryzby) Added justinpryzby as reviewer
2021-03-04 11:02:36 Ibrar Ahmed (ibrar) New status: Waiting on Author
2021-02-12 07:36:12 Takayuki Tsunakawa (maumau) New status: Ready for Committer
2021-02-01 12:34:28 Masahiko Sawada (masahikosawada) Closed in commitfest 2021-01 with status: Moved to next CF
2021-01-22 13:15:27 Masahiko Sawada (masahikosawada) New status: Needs review
2021-01-11 18:19:01 Tomas Vondra (fuzzycz) New status: Waiting on Author
2021-01-06 06:12:02 Andrei Lepikhov (lepikhov) New status: Needs review
2020-12-01 12:23:46 Anastasia Lubennikova (lubennikovaav) New status: Waiting on Author
2020-12-01 12:23:36 Anastasia Lubennikova (lubennikovaav) Closed in commitfest 2020-11 with status: Moved to next CF
2020-12-01 12:23:29 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2020-10-19 04:42:10 Takayuki Tsunakawa (maumau) New status: Waiting on Author
2020-10-08 03:24:25 Takayuki Tsunakawa (maumau) Added maumau as reviewer
2020-09-30 06:58:21 Michael Paquier (michael-kun) Closed in commitfest 2020-09 with status: Moved to next CF
2020-09-30 06:58:17 Michael Paquier (michael-kun) New status: Needs review
2020-09-07 07:26:15 Michael Paquier (michael-kun) New status: Waiting on Author
2020-08-02 22:38:16 Daniel Gustafsson (d_gustafsson) Closed in commitfest 2020-07 with status: Moved to next CF
2020-07-17 02:22:39 Amit Langote (amitlan) Added amitlan as reviewer
2020-06-19 14:58:24 Etsuro Fujita (efujita) Added efujita as reviewer
2020-06-17 06:37:02 Andrei Lepikhov (lepikhov) Changed authors to Andrey Lepikhov (lepikhov)
2020-06-17 06:37:02 Andrei Lepikhov (lepikhov) Changed targetversion to 14
2020-06-17 06:35:40 Andrei Lepikhov (lepikhov) Attached mail thread 3d0909dc-3691-a576-208a-90986e55489f@postgrespro.ru
2020-06-17 06:35:40 Andrei Lepikhov (lepikhov) Created patch record
Edit
Comment/Review
Change Status