New "single" COPY format

Edit
ID 5300
Title New "single" COPY format
Topic Server Features
Created 2024-10-14 08:11:48
Last modified 2024-12-16 15:09:59 (1 week, 3 days ago)
Latest email 2024-12-21 08:56:38 (5 days, 9 hours ago)
Status
2025-01: Withdrawn
2024-11: Moved to next CF
Target version
Authors Joel Jacobson (joeljacobson)
Reviewers Masahiko Sawada (masahikosawada), newtglobal postgresql_contributors (newtpostgrescontributors)Become reviewer
Committer
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/5300
git checkout commitfest/cf/5300
Emails
New "raw" COPY format
First at 2024-10-11 20:29:15 by "Joel Jacobson" <joel at compiler.org>
Latest at 2024-11-07 16:19:50 by "Joel Jacobson" <joel at compiler.org>
Latest attachment (plot_bench.py) at 2024-10-30 08:14:41 from "Joel Jacobson" <joel at compiler.org>
    Attachment (plot_bench.py) at 2024-10-30 08:14:41 from "Joel Jacobson" <joel at compiler.org> (Patch: No)
    Attachment (v16-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-10-29 16:48:27 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v15-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-10-28 10:20:57 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v14-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-10-28 08:30:15 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v13-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-10-24 06:30:03 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v12-0001-make-the-ProcessCopyOptions-option-aligned-wi.no-cfbot) at 2024-10-21 14:35:00 from jian he <jian.universality at gmail.com> (Patch: Yes)
    Attachment (v12-0001-Refactor-ProcessCopyOptions-introduce-CopyFormat-enu.patch) at 2024-10-19 15:32:49 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v11-0001-Refactor-ProcessCopyOptions-introduce-CopyFormat-enu.patch) at 2024-10-18 17:24:34 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v10-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-16 06:37:24 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v9-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-15 12:49:25 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v8-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-15 07:54:42 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v7-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-15 01:35:46 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v6-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-14 19:59:01 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v5-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-14 08:51:44 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v4-0001-Fix-thinko-in-tests-for-COPY-options-force_not_null-.patch) at 2024-10-14 08:07:50 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v3-0001-Replace-binary-flags-binary-and-csv_mode-with-format.patch) at 2024-10-12 06:52:50 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v2-0001-Replace-binary-flags-binary-and-csv_mode-with-format.patch) at 2024-10-11 21:01:10 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v1-0001-Replace-binary-flags-binary-and-csv_mode-with-format.patch) at 2024-10-11 20:29:15 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
New "single" COPY format
First at 2024-11-07 16:15:10 by "Joel Jacobson" <joel at compiler.org>
Latest at 2024-12-21 08:56:38 by "Joel Jacobson" <joel at compiler.org>
Latest attachment (v21-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-11-10 07:05:54 from "Joel Jacobson" <joel at compiler.org>
    Attachment (v21-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-11-10 07:05:54 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v20-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-11-09 19:29:01 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v19-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-11-09 07:07:33 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)
    Attachment (v18-0001-Introduce-CopyFormat-and-replace-csv_mode-and-binary.patch) at 2024-11-07 16:15:10 from "Joel Jacobson" <joel at compiler.org> (Patch: Yes)

Annotations

When Who Mail Annotation
2024-12-12 09:58:11 newtglobal postgresql_contributors (newtpostgrescontributors) From "Joel Jacobson" <joel@compiler.org>
at 2024-11-07 16:15:10
After testing the patch, I observed that for single-column tables, the format evolved from SINGLE to RAW and finally to LIST to handle diverse data more flexibly. For example, the command: \COPY test.foo2 FROM '/home/newtdba/postgres-cf-5300/testfiles/testname.txt' WITH (FORMAT LIST); works with CSV, TXT, and RAW files without specifying column names. This LIST format is effective for copying data to/from single-column tables but requires specifying the correct format.
History
When Who What
2024-12-16 15:09:59 Joel Jacobson (joeljacobson) Closed in commitfest 2025-01 with status: Withdrawn
2024-12-12 09:58:11 newtglobal postgresql_contributors (newtpostgrescontributors) Added annotation "After testing the patch, I observed that for single-column tables, the format evolved from [...]" to 1db18e33-f1cf-4f2c-9d52-b6d7ff242295@app.fastmail.com
2024-12-11 04:14:51 Michael Paquier (michael-kun) Closed in commitfest 2024-11 with status: Moved to next CF
2024-12-11 04:14:49 Michael Paquier (michael-kun) New status: Waiting on Author
2024-12-09 06:40:38 newtglobal postgresql_contributors (newtpostgrescontributors) Added newtpostgrescontributors as reviewer
2024-11-07 16:20:23 Joel Jacobson (joeljacobson) Changed name to New "single" COPY format
2024-11-07 16:20:13 Joel Jacobson (joeljacobson) Attached mail thread 1db18e33-f1cf-4f2c-9d52-b6d7ff242295@app.fastmail.com
2024-10-25 00:56:06 Masahiko Sawada (masahikosawada) Added masahikosawada as reviewer
2024-10-14 08:12:42 Joel Jacobson (joeljacobson) Changed topic to Server Features
2024-10-14 08:11:58 Joel Jacobson (joeljacobson) Changed authors to Joel Jacobson (joeljacobson)
2024-10-14 08:11:48 Joel Jacobson (joeljacobson) Attached mail thread c12516b1-77dc-4ad3-94a7-88527360aee0@app.fastmail.com
2024-10-14 08:11:48 Joel Jacobson (joeljacobson) Created patch record
Edit