Cleaning up orphaned files using undo logs

Edit

ID 1863

Title Cleaning up orphaned files using undo logs

Topic Server Features

Created 2018-11-01 03:26:00

Last modified 2019-11-28 02:45:27 (4 years, 11 months ago)

Latest email 2022-01-12 08:27:26 (2 years, 10 months ago)

Status

2019-11: Returned with feedback

2019-09: Moved to next CF

2019-07: Moved to next CF

2019-01: Moved to next CF

2018-11: Moved to next CF

Target version

Authors Thomas Munro (macdice)

Reviewers Become reviewer

Committer

Links CFbot results (CirrusCI) CFbot GitHub

Checkout latest CFbot patchset

Go to your local checkout of the PostgreSQL repository and run:

git remote add commitfest https://github.com/postgresql-cfbot/postgresql.git
git fetch commitfest cf/1863
git checkout commitfest/cf/1863

Emails

POC: Cleaning up orphaned files using undo logs: First at 2018-11-01 03:22:51 by Thomas Munro <thomas.munro at enterprisedb.com>
Latest at 2022-01-12 08:27:26 by Julien Rouhaud <rjuju123 at gmail.com>
Latest attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at>
    Attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (sync_comment.patch) at 2021-09-29 06:09:34 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (sync.patch) at 2021-09-21 07:02:02 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (undo-20210914.tgz) at 2021-09-14 08:51:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210909.tgz) at 2021-09-09 15:04:21 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210831.tgz) at 2021-08-31 12:46:30 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210630.tgz) at 2021-06-30 07:04:51 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210129.tgz) at 2021-01-29 17:30:15 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20201204.tgz) at 2020-12-04 09:22:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (Infrastructure-to-execute-pending-undo-actions.patch) at 2020-11-15 06:54:54 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (Allow-execution-and-discard-of-undo-by-background-wo.patch) at 2020-11-15 05:56:01 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20201112.tgz) at 2020-11-12 10:17:36 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (0001-FailedAssertion-logno-context-recovery_logno-fix.patch) at 2019-09-06 03:31:30 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-New-undo-request-manager-now-with-some-xact.c-int.patch) at 2019-08-24 14:19:19 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (v2-0001-New-undo-request-manager-now-with-UndoRequestMana.patch) at 2019-08-21 02:56:35 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (undo-20190820.tgz) at 2019-08-20 09:02:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (undo_13_08_2019.tar.gz) at 2019-08-13 04:01:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-08-09 08:21:04 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Draft-of-new-undo-request-manager.patch) at 2019-08-08 20:27:16 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (test_undo_worker_load_balancing.py) at 2019-08-07 11:35:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-07-31 13:14:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-pg_upgrade-failure-fix.patch) at 2019-07-25 11:26:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (undolog_20190716.tar.gz) at 2019-07-16 08:50:11 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190709.tar.gz) at 2019-07-09 10:28:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190706.tar.gz) at 2019-07-06 14:56:29 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (lookahead-failure-chance.pl) at 2019-07-05 20:16:51 from Robert Haas <robertmhaas at gmail.com> (Patch: No)
    Attachment (undo-20190701.tgz) at 2019-07-01 07:53:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-SmgrId-to-smgropen-and-BufferTag.patch) at 2019-06-25 19:59:57 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-Add-prefetch-support-for-the-undo-log.patch) at 2019-06-18 11:30:48 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20190614.tgz) at 2019-06-14 02:55:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Extend-binary-heap-functionality.patch) at 2019-05-27 09:58:58 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Provide-interfaces-to-store-and-fetch-undo-records_v7.patch) at 2019-05-15 14:44:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0002-Provide-interfaces-to-store-and-fetch-undo-records_v6.patch) at 2019-05-12 06:15:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-11.tgz) at 2019-05-11 09:49:49 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-missing-file-in-pg_buffercache.patch) at 2019-05-10 10:46:09 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-10.tgz) at 2019-05-10 06:18:16 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Update-oldest_data-on-startup_v5.patch) at 2019-05-09 06:34:16 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0005-undo-page-consistency-checker_v4_WIP.patch) at 2019-05-06 12:13:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-undo-actions-to-be-applied-on-rollbacks-and-di.v2.patch) at 2019-05-05 04:58:21 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-undo-page-consistency-checker_WIP_v3.patch) at 2019-05-02 04:00:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undoprocessing_1.patch) at 2019-05-01 04:38:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-25 11:15:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-19 10:15:43 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-smgr-v2.tgz) at 2019-03-12 13:20:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Fix-shared-memory-size-for-rollback-hash-table.patch) at 2018-11-05 11:42:40 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (undo-smgr-v1.tgz) at 2018-11-01 03:22:51 from Thomas Munro <thomas.munro at enterprisedb.com> (Patch: No)

History

When	Who	What
2019-11-28 02:45:27	Michael Paquier (michael-kun)	Closed in commitfest 2019-11 with status: Returned with feedback
2019-09-30 19:11:01	Álvaro Herrera (alvherre)	New status: Waiting on Author
2019-09-30 19:09:24	Álvaro Herrera (alvherre)	Closed in commitfest 2019-09 with status: Moved to next CF
2019-09-30 19:08:48	Álvaro Herrera (alvherre)	New status: Needs review
2019-09-12 01:56:50	Álvaro Herrera (alvherre)	New status: Waiting on Author
2019-08-01 22:28:17	Thomas Munro (macdice)	Closed in commitfest 2019-07 with status: Moved to next CF
2019-03-08 23:02:49	Thomas Munro (macdice)	Closed in commitfest 2019-01 with status: Moved to next CF
2019-03-08 23:02:41	Thomas Munro (macdice)	New status: Needs review
2019-02-03 10:09:50	Andres Freund (andresfreund)	Closed in commitfest 2019-01 with status: Returned with feedback
2019-01-04 15:21:50	Peter Eisentraut (petere)	New status: Waiting on Author
2018-11-30 16:12:24	Dmitry Dolgov (erthalion)	Closed in commitfest 2018-11 with status: Moved to next CF
2018-11-01 03:26:07	Thomas Munro (macdice)	Changed authors to Thomas Munro (macdice)
2018-11-01 03:26:00	Thomas Munro (macdice)	Attached mail thread CAEepm=0ULqYgM2aFeOnrx6YrtBg3xUdxALoyCG+XpssKqmezug@mail.gmail.com
2018-11-01 03:26:00	Thomas Munro (macdice)	Created patch record

Edit