B-tree deduplication

Edit
ID 2202
Title B-tree deduplication
CI (CFBot) Not processed
Stats (from CFBot) Unknown
Topic Performance
Tags
Created 2019-07-04 15:29:26
Last modified 2020-02-26 21:09:30 (5 years ago)
Latest email 2020-03-06 19:01:19 (5 years ago)
Status
2020-03 (2020-03-01 – 2020-03-31): Committed
2020-01 (2020-01-01 – 2020-01-31): Moved to different CF
2019-11 (2019-11-01 – 2019-11-30): Moved to different CF
2019-09 (2019-09-01 – 2019-09-30): Moved to different CF
Target version
Authors Anastasia Lubennikova (lubennikovaav)
Reviewers Peter Geoghegan (pgeoghegan), Antonin Houska (a.houska)Become reviewer
Committer Peter Geoghegan (pgeoghegan)
Links
Emails
[PROPOSAL] Effective storage of duplicates in B-tree index.
First at 2015-08-31 07:41:15 by Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
Latest at 2020-03-06 19:01:19 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie>
    Attachment (v34-0003-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-25 00:54:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v33-0001-Add-equalimage-B-Tree-opclass-support-functions.patch) at 2020-02-14 02:57:47 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v32-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-02-07 02:18:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v31-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-29 01:29:05 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v30-0005-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-15 02:08:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v29-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2020-01-10 21:36:00 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v28-0001-Add-deduplication-to-nbtree.patch-with-heikki-comments) at 2020-01-08 13:56:23 from Heikki Linnakangas <hlinnaka at iki.fi> (Patch: No)
    Attachment (v28-0003-DEBUG-Show-index-values-in-pageinspect.patch) at 2020-01-04 01:47:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v27-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-12-20 02:55:52 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v26-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-12-13 02:21:20 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (overnight-benchmark.tar.gz) at 2019-12-05 00:54:58 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v25-0001-Remove-dead-pin-scan-code-from-nbtree-VACUUM.patch) at 2019-11-27 01:28:50 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v24-0002-Teach-pageinspect-about-nbtree-posting-lists.patch) at 2019-11-19 01:26:37 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v23-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-11-12 23:21:53 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v22-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-08 18:35:57 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v21-0001-Teach-datum_image_eq-about-cstring-datums.patch) at 2019-11-04 19:52:14 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v20-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-10-01 02:39:34 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v19-0001-Add-deduplication-to-nbtree.patch) at 2019-09-27 16:43:08 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v18-0001-Add-deduplication-to-nbtree.patch) at 2019-09-25 15:05:03 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v17-0005-Reintroduce-unique-index-support.patch) at 2019-09-24 19:41:04 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v17-0001-Add-deduplication-to-nbtree.patch) at 2019-09-24 00:13:32 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v16-0001-Add-deduplication-to-nbtree.patch) at 2019-09-19 02:25:23 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v15-0001-Add-deduplication-to-nbtree.patch) at 2019-09-17 16:43:35 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v141-0002-Add-_bt_split-style-WAL-optimization.patch) at 2019-09-16 21:11:29 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v14-0001-Add-deduplication-to-nbtree.patch) at 2019-09-16 15:48:44 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v13-0002-Stop-deduplicating-when-a-page-split-is-avoided.patch) at 2019-09-13 01:04:25 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (0001-Save-original-new-heap-TID-in-insert-WAL-record.patch) at 2019-09-12 00:56:44 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (nbtree_wal_test.sql) at 2019-09-11 21:04:59 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (v12-0001-Add-deduplication-to-nbtree.patch) at 2019-09-11 12:37:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v11-0001-Add-deduplication-to-nbtree.patch) at 2019-09-09 19:54:08 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v10-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-09-03 01:53:09 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v9-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-29 12:13:39 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v8-0001-Deduplication-in-nbtree.patch) at 2019-08-21 17:19:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v7-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-16 15:56:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v6-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-13 15:45:15 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v5-0001-Compression-deduplication-in-nbtree.patch) at 2019-08-06 01:28:18 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v4-0001-Compression-deduplication-in-nbtree.patch) at 2019-07-31 16:22:59 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0003-Account-for-posting-list-overhead-during-splits.patch) at 2019-07-24 22:06:13 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (v3-0002-DEBUG-Add-pageinspect-instrumentation.patch) at 2019-07-24 01:22:01 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (amcheck-compress-test.sql) at 2019-07-20 02:24:48 from Peter Geoghegan <pg at bowt.ie> (Patch: No)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-19 17:53:22 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v2.patch) at 2019-07-17 16:36:27 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (0001-btree_compression_pg12_v1.patch-with-pg_indent-run.patch) at 2019-07-06 23:08:21 from Peter Geoghegan <pg at bowt.ie> (Patch: Yes)
    Attachment (btree_compression_pg12_v1.patch) at 2019-07-04 12:06:38 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_4.0.patch) at 2016-03-18 17:19:37 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:29:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btc_readme_1.0.patch) at 2016-02-18 17:18:25 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: No)
    Attachment (btree_compression_2.0.patch) at 2016-01-29 16:50:46 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0(rebased).patch) at 2016-01-28 16:12:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (btree_compression_1.0.patch) at 2016-01-28 14:06:57 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
Building infrastructure for B-Tree deduplication that recognizes when opclass equality is also equivalence
First at 2019-08-25 20:29:09 by Peter Geoghegan <pg at bowt.ie>
Latest at 2020-02-14 03:04:14 by Peter Geoghegan <pg at bowt.ie>
Latest attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru>
    Attachment (v5-WIP-Opclass-bitwise-equality-0001.patch) at 2020-01-13 20:49:36 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v4-Opclass-bitwise-equality-0001.patch) at 2019-12-24 12:29:23 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v3-Opclass-bitwise-equality-0002.patch) at 2019-11-15 12:03:13 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v2-Opclass-bitwise-equality-0002.patch) at 2019-10-28 18:11:12 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
    Attachment (v1-Opclass-bitwise-equality.patch) at 2019-09-30 17:03:54 from Anastasia Lubennikova <a.lubennikova at postgrespro.ru> (Patch: Yes)
History
When Who What
2020-02-26 21:09:30 Peter Geoghegan (pgeoghegan) Closed in commitfest 2020-03 with status: Committed
2020-02-07 02:21:29 Peter Geoghegan (pgeoghegan) Added pgeoghegan as committer
2020-02-01 12:51:23 Tomas Vondra (fuzzycz) Closed in commitfest 2020-01 with status: Moved to next CF
2019-12-24 13:22:54 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-12-19 15:19:09 Antonin Houska (a.houska) Added a.houska as reviewer
2019-11-25 08:09:59 Michael Paquier (michael-kun) New status: Waiting on Author
2019-11-25 08:09:52 Michael Paquier (michael-kun) Closed in commitfest 2019-11 with status: Moved to next CF
2019-11-25 08:09:49 Michael Paquier (michael-kun) New status: Needs review
2019-09-30 19:10:52 Álvaro Herrera (alvherre) New status: Waiting on Author
2019-09-30 19:09:13 Álvaro Herrera (alvherre) Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:40 Álvaro Herrera (alvherre) New status: Needs review
2019-09-20 16:37:28 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-09-18 15:01:17 Álvaro Herrera (alvherre) New status: Needs review
2019-09-13 01:16:42 Peter Geoghegan (pgeoghegan) Deleted annotation "Drive-by review" from CAM3SWZQ3_PLQCH4w7uQ8q_f2t4HEseKTr2n0rQ5pxA18OeRTJw@mail.gmail.com
2019-09-03 18:27:26 Peter Geoghegan (pgeoghegan) Attached mail thread CAH2-Wzn3Ee49Gmxb7V1VJ3-AC8fWn-Fr8pfWQebHe8rYRxt5OQ@mail.gmail.com
2019-09-03 17:41:47 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-08-29 12:14:10 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-08-28 17:18:58 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-08-16 15:56:35 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-08-06 02:17:01 Peter Geoghegan (pgeoghegan) Changed name to B-tree deduplication
2019-08-06 02:06:01 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-07-19 18:10:10 Anastasia Lubennikova (lubennikovaav) New status: Needs review
2019-07-15 23:32:56 Peter Geoghegan (pgeoghegan) New status: Waiting on Author
2019-07-15 23:32:52 Peter Geoghegan (pgeoghegan) Added pgeoghegan as reviewer
2019-07-04 15:29:40 Anastasia Lubennikova (lubennikovaav) Changed authors to Anastasia Lubennikova (lubennikovaav)
2019-07-04 15:29:26 Anastasia Lubennikova (lubennikovaav) Attached mail thread 55E4051B.7020209@postgrespro.ru
2019-07-04 15:29:26 Anastasia Lubennikova (lubennikovaav) Created patch record
Edit