Cleaning up orphaned files using undo logs

Edit
ID 1863
Title Cleaning up orphaned files using undo logs
Topic Server Features
Created 2018-11-01 03:26:00
Last modified 2019-11-28 02:45:27 (4 years, 11 months ago)
Latest email 2022-01-12 08:27:26 (2 years, 9 months ago)
Status
2019-11: Returned with feedback
2019-09: Moved to next CF
2019-07: Moved to next CF
2019-01: Moved to next CF
2018-11: Moved to next CF
Target version
Authors Thomas Munro (macdice)
Reviewers Become reviewer
Committer
Links CFbot results (CirrusCI) CFbot GitHub
Checkout latest CFbot patchset Go to your local checkout of the PostgreSQL repository and run:
git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1863
git checkout commitfest/cf/1863
Emails
POC: Cleaning up orphaned files using undo logs
First at 2018-11-01 03:22:51 by Thomas Munro <thomas.munro at enterprisedb.com>
Latest at 2022-01-12 08:27:26 by Julien Rouhaud <rjuju123 at gmail.com>
Latest attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at>
    Attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (sync_comment.patch) at 2021-09-29 06:09:34 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (sync.patch) at 2021-09-21 07:02:02 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (undo-20210914.tgz) at 2021-09-14 08:51:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210909.tgz) at 2021-09-09 15:04:21 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210831.tgz) at 2021-08-31 12:46:30 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210630.tgz) at 2021-06-30 07:04:51 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210129.tgz) at 2021-01-29 17:30:15 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20201204.tgz) at 2020-12-04 09:22:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (Infrastructure-to-execute-pending-undo-actions.patch) at 2020-11-15 06:54:54 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (Allow-execution-and-discard-of-undo-by-background-wo.patch) at 2020-11-15 05:56:01 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20201112.tgz) at 2020-11-12 10:17:36 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (0001-FailedAssertion-logno-context-recovery_logno-fix.patch) at 2019-09-06 03:31:30 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-New-undo-request-manager-now-with-some-xact.c-int.patch) at 2019-08-24 14:19:19 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (v2-0001-New-undo-request-manager-now-with-UndoRequestMana.patch) at 2019-08-21 02:56:35 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (undo-20190820.tgz) at 2019-08-20 09:02:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (undo_13_08_2019.tar.gz) at 2019-08-13 04:01:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-08-09 08:21:04 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Draft-of-new-undo-request-manager.patch) at 2019-08-08 20:27:16 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (test_undo_worker_load_balancing.py) at 2019-08-07 11:35:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-07-31 13:14:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-pg_upgrade-failure-fix.patch) at 2019-07-25 11:26:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (undolog_20190716.tar.gz) at 2019-07-16 08:50:11 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190709.tar.gz) at 2019-07-09 10:28:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190706.tar.gz) at 2019-07-06 14:56:29 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (lookahead-failure-chance.pl) at 2019-07-05 20:16:51 from Robert Haas <robertmhaas at gmail.com> (Patch: No)
    Attachment (undo-20190701.tgz) at 2019-07-01 07:53:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-SmgrId-to-smgropen-and-BufferTag.patch) at 2019-06-25 19:59:57 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-Add-prefetch-support-for-the-undo-log.patch) at 2019-06-18 11:30:48 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20190614.tgz) at 2019-06-14 02:55:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Extend-binary-heap-functionality.patch) at 2019-05-27 09:58:58 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Provide-interfaces-to-store-and-fetch-undo-records_v7.patch) at 2019-05-15 14:44:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0002-Provide-interfaces-to-store-and-fetch-undo-records_v6.patch) at 2019-05-12 06:15:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-11.tgz) at 2019-05-11 09:49:49 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-missing-file-in-pg_buffercache.patch) at 2019-05-10 10:46:09 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-10.tgz) at 2019-05-10 06:18:16 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Update-oldest_data-on-startup_v5.patch) at 2019-05-09 06:34:16 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0005-undo-page-consistency-checker_v4_WIP.patch) at 2019-05-06 12:13:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-undo-actions-to-be-applied-on-rollbacks-and-di.v2.patch) at 2019-05-05 04:58:21 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-undo-page-consistency-checker_WIP_v3.patch) at 2019-05-02 04:00:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undoprocessing_1.patch) at 2019-05-01 04:38:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-25 11:15:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-19 10:15:43 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-smgr-v2.tgz) at 2019-03-12 13:20:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Fix-shared-memory-size-for-rollback-hash-table.patch) at 2018-11-05 11:42:40 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (undo-smgr-v1.tgz) at 2018-11-01 03:22:51 from Thomas Munro <thomas.munro at enterprisedb.com> (Patch: No)
History
When Who What
2019-11-28 02:45:27 Michael Paquier (michael-kun) Closed in commitfest 2019-11 with status: Returned with feedback
2019-09-30 19:11:01 Álvaro Herrera (alvherre) New status: Waiting on Author
2019-09-30 19:09:24 Álvaro Herrera (alvherre) Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:48 Álvaro Herrera (alvherre) New status: Needs review
2019-09-12 01:56:50 Álvaro Herrera (alvherre) New status: Waiting on Author
2019-08-01 22:28:17 Thomas Munro (macdice) Closed in commitfest 2019-07 with status: Moved to next CF
2019-03-08 23:02:49 Thomas Munro (macdice) Closed in commitfest 2019-01 with status: Moved to next CF
2019-03-08 23:02:41 Thomas Munro (macdice) New status: Needs review
2019-02-03 10:09:50 Andres Freund (andresfreund) Closed in commitfest 2019-01 with status: Returned with feedback
2019-01-04 15:21:50 Peter Eisentraut (petere) New status: Waiting on Author
2018-11-30 16:12:24 Dmitry Dolgov (erthalion) Closed in commitfest 2018-11 with status: Moved to next CF
2018-11-01 03:26:07 Thomas Munro (macdice) Changed authors to Thomas Munro (macdice)
2018-11-01 03:26:00 Thomas Munro (macdice) Attached mail thread CAEepm=0ULqYgM2aFeOnrx6YrtBg3xUdxALoyCG+XpssKqmezug@mail.gmail.com
2018-11-01 03:26:00 Thomas Munro (macdice) Created patch record
Edit