B-tree deduplication

Edit

ID 2202

Title B-tree deduplication

Topic Performance

Created 2019-07-04 15:29:26

Last modified 2020-02-26 21:09:30 (4 years, 8 months ago)

Latest email 2020-03-06 19:01:19 (4 years, 8 months ago)

Status

2020-03: Committed

2020-01: Moved to next CF

2019-11: Moved to next CF

2019-09: Moved to next CF

Target version

Authors Anastasia Lubennikova (lubennikovaav)

Reviewers Peter Geoghegan (pgeoghegan), Antonin Houska (a.houska)Become reviewer

Committer Peter Geoghegan (pgeoghegan)

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2202
git checkout commitfest/cf/2202

Emails

[PROPOSAL] Effective storage of duplicates in B-tree index.: First at 2015-08-31 07:41:15 by Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
Latest at 2020-03-06 19:01:19 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie>
    Attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v33-0001-Add-equalimage-B-Tree-opclass-support-functions.patch) at 2020-02-14 02:57:47 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v32-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-07 02:18:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v31-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-29 01:29:05 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v30-0005-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-15 02:08:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v29-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-10 21:36:00 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v28-0001-Add-deduplication-to-nbtree.patch-with-heikki-comments) at 2020-01-08 13:56:23 from Heikki Linnakangas <hlinnaka at iki.fi> (Patch: No)
    Attachment (v28-0003-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-04 01:47:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v27-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-12-20 02:55:52 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v26-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-12-13 02:21:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (overnight-benchmark.tar.gz) at 2019-12-05 00:54:58 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v25-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-11-27 01:28:50 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v24-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-11-19 01:26:37 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v23-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-11-12 23:21:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v22-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-08 18:35:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v21-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-04 19:52:14 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-10-01 02:39:34 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v19-0001-Add-deduplication-to-nbtree.patch) at 2019-09-27 16:43:08 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v18-0001-Add-deduplication-to-nbtree.patch) at 2019-09-25 15:05:03 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v17-0005-Reintroduce-unique-index-support.patch) at 2019-09-24 19:41:04 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v17-0001-Add-deduplication-to-nbtree.patch) at 2019-09-24 00:13:32 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v16-0001-Add-deduplication-to-nbtree.patch) at 2019-09-19 02:25:23 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v15-0001-Add-deduplication-to-nbtree.patch) at 2019-09-17 16:43:35 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v141-0002-Add-_bt_split-style-WAL-optimization.patch) at 2019-09-16 21:11:29 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v14-0001-Add-deduplication-to-nbtree.patch) at 2019-09-16 15:48:44 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v13-0002-Stop-deduplicating-when-a-page-split-is-avoided.patch) at 2019-09-13 01:04:25 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (0001-Save-original-new-heap-TID-in-insert-WAL-record.patch) at 2019-09-12 00:56:44 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (nbtree_wal_test.sql) at 2019-09-11 21:04:59 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v12-0001-Add-deduplication-to-nbtree.patch) at 2019-09-11 12:37:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v11-0001-Add-deduplication-to-nbtree.patch) at 2019-09-09 19:54:08 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v10-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-09-03 01:53:09 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v9-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-29 12:13:39 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v8-0001-Deduplication-in-nbtree.patch) at 2019-08-21 17:19:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v7-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-16 15:56:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v6-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-13 15:45:15 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v5-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-06 01:28:18 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v4-0001-Compression-deduplication-in-nbtree.patch) at 2019-07-31 16:22:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0003-Account-for-posting-list-overhead-during-splits.patch) at 2019-07-24 22:06:13 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v3-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-07-24 01:22:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (amcheck-compress-test.sql) at 2019-07-20 02:24:48 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-19 17:53:22 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-17 16:36:27 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v1.patch-with-pg_indent-run.patch) at 2019-07-06 23:08:21 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (btree_compression_pg12_v1.patch) at 2019-07-04 12:06:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_4.0.patch) at 2016-03-18 17:19:37 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:29:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:18:25 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btree_compression_2.0.patch) at 2016-01-29 16:50:46 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0(rebased).patch) at 2016-01-28 16:12:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0.patch) at 2016-01-28 14:06:57 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
Building infrastructure for B-Tree deduplication that recognizes when opclass equality is also equivalence: First at 2019-08-25 20:29:09 by Peter Geoghegan <pg at bowt.ie>
Latest at 2020-02-14 03:04:14 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
    Attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v4-Opclass-bitwise-equality-0001.patch) at 2019-12-24 12:29:23 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v3-Opclass-bitwise-equality-0002.patch) at 2019-11-15 12:03:13 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v2-Opclass-bitwise-equality-0002.patch) at 2019-10-28 18:11:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v1-Opclass-bitwise-equality.patch) at 2019-09-30 17:03:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)

History

When	Who	What
2020-02-26 21:09:30	Peter Geoghegan (pgeoghegan)	Closed in commitfest 2020-03 with status: Committed
2020-02-07 02:21:29	Peter Geoghegan (pgeoghegan)	Added pgeoghegan as committer
2020-02-01 12:51:23	Tomas Vondra (fuzzycz)	Closed in commitfest 2020-01 with status: Moved to next CF
2019-12-24 13:22:54	Anastasia Lubennikova (lubennikovaav)	New status: Needs review
2019-12-19 15:19:09	Antonin Houska (a.houska)	Added a.houska as reviewer
2019-11-25 08:09:59	Michael Paquier (michael-kun)	New status: Waiting on Author
2019-11-25 08:09:52	Michael Paquier (michael-kun)	Closed in commitfest 2019-11 with status: Moved to next CF
2019-11-25 08:09:49	Michael Paquier (michael-kun)	New status: Needs review
2019-09-30 19:10:52	Álvaro Herrera (alvherre)	New status: Waiting on Author
2019-09-30 19:09:13	Álvaro Herrera (alvherre)	Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:40	Álvaro Herrera (alvherre)	New status: Needs review
2019-09-20 16:37:28	Peter Geoghegan (pgeoghegan)	New status: Waiting on Author
2019-09-18 15:01:17	Álvaro Herrera (alvherre)	New status: Needs review
2019-09-13 01:16:42	Peter Geoghegan (pgeoghegan)	Deleted annotation "Drive-by review" from CAM3SWZQ3_PLQCH4w7uQ8q_f2t4HEseKTr2n0rQ5pxA18OeRTJw@mail.gmail.com
2019-09-03 18:27:26	Peter Geoghegan (pgeoghegan)	Attached mail thread CAH2-Wzn3Ee49Gmxb7V1VJ3-AC8fWn-Fr8pfWQebHe8rYRxt5OQ@mail.gmail.com
2019-09-03 17:41:47	Peter Geoghegan (pgeoghegan)	New status: Waiting on Author
2019-08-29 12:14:10	Anastasia Lubennikova (lubennikovaav)	New status: Needs review
2019-08-28 17:18:58	Peter Geoghegan (pgeoghegan)	New status: Waiting on Author
2019-08-16 15:56:35	Anastasia Lubennikova (lubennikovaav)	New status: Needs review
2019-08-06 02:17:01	Peter Geoghegan (pgeoghegan)	Changed name to B-tree deduplication
2019-08-06 02:06:01	Peter Geoghegan (pgeoghegan)	New status: Waiting on Author
2019-07-19 18:10:10	Anastasia Lubennikova (lubennikovaav)	New status: Needs review
2019-07-15 23:32:56	Peter Geoghegan (pgeoghegan)	New status: Waiting on Author
2019-07-15 23:32:52	Peter Geoghegan (pgeoghegan)	Added pgeoghegan as reviewer
2019-07-04 15:29:40	Anastasia Lubennikova (lubennikovaav)	Changed authors to Anastasia Lubennikova (lubennikovaav)
2019-07-04 15:29:26	Anastasia Lubennikova (lubennikovaav)	Attached mail thread 55E4051B.7020209@postgrespro.ru
2019-07-04 15:29:26	Anastasia Lubennikova (lubennikovaav)	Created patch record

Edit