B-tree deduplication

Edit
ID 2202
Title B-tree deduplication
Topic Performance
Created 2019-07-04 15:29:26
Last modified 2020-02-26 21:09:30 (4 years, 7 months ago)
Latest email 2020-03-06 19:01:19 (4 years, 7 months ago)
Status
2020-03: Committed
2020-01: Moved to next CF
2019-11: Moved to next CF
2019-09: Moved to next CF
Target version
Authors Anastasia Lubennikova (lubennikovaav)
Reviewers Peter Geoghegan (pgeoghegan), Antonin Houska (a.houska)Become reviewer
Committer Peter Geoghegan (pgeoghegan)
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/2202
git checkout commitfest/cf/2202
Emails
[PROPOSAL] Effective storage of duplicates in B-tree index.
First at 2015-08-31 07:41:15 by Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
Latest at 2020-03-06 19:01:19 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie>
    Attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v33-0001-Add-equalimage-B-Tree-opclass-support-functions.patch) at 2020-02-14 02:57:47 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v32-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-07 02:18:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v31-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-29 01:29:05 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v30-0005-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-15 02:08:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v29-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-10 21:36:00 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v28-0001-Add-deduplication-to-nbtree.patch-with-heikki-comments) at 2020-01-08 13:56:23 from Heikki Linnakangas <hlinnaka at iki.fi> (Patch: No)
    Attachment (v28-0003-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-04 01:47:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v27-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-12-20 02:55:52 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v26-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-12-13 02:21:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (overnight-benchmark.tar.gz) at 2019-12-05 00:54:58 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v25-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-11-27 01:28:50 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v24-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-11-19 01:26:37 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v23-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-11-12 23:21:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v22-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-08 18:35:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v21-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-04 19:52:14 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-10-01 02:39:34 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v19-0001-Add-deduplication-to-nbtree.patch) at 2019-09-27 16:43:08 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v18-0001-Add-deduplication-to-nbtree.patch) at 2019-09-25 15:05:03 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v17-0005-Reintroduce-unique-index-support.patch) at 2019-09-24 19:41:04 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v17-0001-Add-deduplication-to-nbtree.patch) at 2019-09-24 00:13:32 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v16-0001-Add-deduplication-to-nbtree.patch) at 2019-09-19 02:25:23 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v15-0001-Add-deduplication-to-nbtree.patch) at 2019-09-17 16:43:35 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v141-0002-Add-_bt_split-style-WAL-optimization.patch) at 2019-09-16 21:11:29 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v14-0001-Add-deduplication-to-nbtree.patch) at 2019-09-16 15:48:44 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v13-0002-Stop-deduplicating-when-a-page-split-is-avoided.patch) at 2019-09-13 01:04:25 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (0001-Save-original-new-heap-TID-in-insert-WAL-record.patch) at 2019-09-12 00:56:44 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (nbtree_wal_test.sql) at 2019-09-11 21:04:59 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v12-0001-Add-deduplication-to-nbtree.patch) at 2019-09-11 12:37:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v11-0001-Add-deduplication-to-nbtree.patch) at 2019-09-09 19:54:08 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v10-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-09-03 01:53:09 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v9-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-29 12:13:39 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v8-0001-Deduplication-in-nbtree.patch) at 2019-08-21 17:19:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v7-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-16 15:56:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v6-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-13 15:45:15 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v5-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-06 01:28:18 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v4-0001-Compression-deduplication-in-nbtree.patch) at 2019-07-31 16:22:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0003-Account-for-posting-list-overhead-during-splits.patch) at 2019-07-24 22:06:13 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v3-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-07-24 01:22:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (amcheck-compress-test.sql) at 2019-07-20 02:24:48 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-19 17:53:22 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-17 16:36:27 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v1.patch-with-pg_indent-run.patch) at 2019-07-06 23:08:21 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (btree_compression_pg12_v1.patch) at 2019-07-04 12:06:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_4.0.patch) at 2016-03-18 17:19:37 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:29:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:18:25 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btree_compression_2.0.patch) at 2016-01-29 16:50:46 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0(rebased).patch) at 2016-01-28 16:12:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0.patch) at 2016-01-28 14:06:57 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
Building infrastructure for B-Tree deduplication that recognizes when opclass equality is also equivalence
First at 2019-08-25 20:29:09 by Peter Geoghegan <pg at bowt.ie>
Latest at 2020-02-14 03:04:14 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
    Attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v4-Opclass-bitwise-equality-0001.patch) at 2019-12-24 12:29:23 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v3-Opclass-bitwise-equality-0002.patch) at 2019-11-15 12:03:13 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v2-Opclass-bitwise-equality-0002.patch) at 2019-10-28 18:11:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v1-Opclass-bitwise-equality.patch) at 2019-09-30 17:03:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
History
When Who What
2020-02-26 21:09:30 Peter Geoghegan (pgeoghegan) Closed in commitfest 2020-03 with status: Committed
2020-02-07 02:21:29 Peter Geoghegan (pgeoghegan) Added pgeoghegan as committer
2020-02-01 12:51:23 Tomas Vondra (fuzzycz) Closed in commitfest 2020-01 with status: Moved to next CF
2019-12-24 13:22:54 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-12-19 15:19:09 Antonin Houska (a.houska) Added a.houska as reviewer
2019-11-25 08:09:59 Michael Paquier (michael-kun) New status: Waiting on Author
2019-11-25 08:09:52 Michael Paquier (michael-kun) Closed in commitfest 2019-11 with status: Moved to next CF
2019-11-25 08:09:49 Michael Paquier (michael-kun) New status: Needs review
2019-09-30 19:10:52 Álvaro Herrera (alvherre) New status: Waiting on Author
2019-09-30 19:09:13 Álvaro Herrera (alvherre) Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:40 Álvaro Herrera (alvherre) New status: Needs review
2019-09-20 16:37:28 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-09-18 15:01:17 Álvaro Herrera (alvherre) New status: Needs review
2019-09-13 01:16:42 Peter Geoghegan (pgeoghegan) Deleted annotation "Drive-by review" from CAM3SWZQ3_PLQCH4w7uQ8q_f2t4HEseKTr2n0rQ5pxA18OeRTJw@mail.gmail.com
2019-09-03 18:27:26 Peter Geoghegan (pgeoghegan) Attached mail thread CAH2-Wzn3Ee49Gmxb7V1VJ3-AC8fWn-Fr8pfWQebHe8rYRxt5OQ@mail.gmail.com
2019-09-03 17:41:47 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-08-29 12:14:10 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-08-28 17:18:58 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-08-16 15:56:35 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-08-06 02:17:01 Peter Geoghegan (pgeoghegan) Changed name to B-tree deduplication
2019-08-06 02:06:01 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-07-19 18:10:10 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-07-15 23:32:56 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-07-15 23:32:52 Peter Geoghegan (pgeoghegan) Added pgeoghegan as reviewer
2019-07-04 15:29:40 Anastasia Lubennikova (lubennikovaav) Changed authors to Anastasia Lubennikova (lubennikovaav)
2019-07-04 15:29:26 Anastasia Lubennikova (lubennikovaav) Attached mail thread 55E4051B.7020209@postgrespro.ru
2019-07-04 15:29:26 Anastasia Lubennikova (lubennikovaav) Created patch record
Edit