postgresql/src/include/access
Alvaro Herrera d372cb173e Fix handling of multixacts predating pg_upgrade
After pg_upgrade, it is possible that some tuples' Xmax have multixacts
corresponding to the old installation; such multixacts cannot have
running members anymore.  In many code sites we already know not to read
them and clobber them silently, but at least when VACUUM tries to freeze
a multixact or determine whether one needs freezing, there's an attempt
to resolve it to its member transactions by calling GetMultiXactIdMembers,
and if the multixact value is "in the future" with regards to the
current valid multixact range, an error like this is raised:
    ERROR:  MultiXactId 123 has not been created yet -- apparent wraparound
and vacuuming fails.  Per discussion with Andrew Gierth, it is completely
bogus to try to resolve multixacts coming from before a pg_upgrade,
regardless of where they stand with regards to the current valid
multixact range.

It's possible to get from under this problem by doing SELECT FOR UPDATE
of the problem tuples, but if tables are large, this is slow and
tedious, so a more thorough solution is desirable.

To fix, we realize that multixacts in xmax created in 9.2 and previous
have a specific bit pattern that is never used in 9.3 and later (we
already knew this, per comments and infomask tests sprinkled in various
places, but we weren't leveraging this knowledge appropriately).
Whenever the infomask of the tuple matches that bit pattern, we just
ignore the multixact completely as if Xmax wasn't set; or, in the case
of tuple freezing, we act as if an unwanted value is set and clobber it
without decoding.  This guarantees that no errors will be raised, and
that the values will be progressively removed until all tables are
clean.  Most callers of GetMultiXactIdMembers are patched to recognize
directly that the value is a removable "empty" multixact and avoid
calling GetMultiXactIdMembers altogether.

To avoid changing the signature of GetMultiXactIdMembers() in back
branches, we keep the "allow_old" boolean flag but rename it to
"from_pgupgrade"; if the flag is true, we always return an empty set
instead of looking up the multixact.  (I suppose we could remove the
argument in the master branch, but I chose not to do so in this commit).

This was broken all along, but the error-facing message appeared first
because of commit 8e9a16ab8f and was partially fixed in a25c2b7c4d.
This fix, backpatched all the way back to 9.3, goes approximately in the
same direction as a25c2b7c4d but should cover all cases.

Bug analysis by Andrew Gierth and Álvaro Herrera.

A number of public reports match this bug:
  https://www.postgresql.org/message-id/20140330040029.GY4582@tamriel.snowman.net
  https://www.postgresql.org/message-id/538F3D70.6080902@publicrelay.com
  https://www.postgresql.org/message-id/556439CF.7070109@pscs.co.uk
  https://www.postgresql.org/message-id/SG2PR06MB0760098A111C88E31BD4D96FB3540@SG2PR06MB0760.apcprd06.prod.outlook.com
  https://www.postgresql.org/message-id/20160615203829.5798.4594@wrigleys.postgresql.org
2016-06-24 18:29:28 -04:00
..
attnum.h Fix various typos and grammar errors in comments. 2015-04-26 18:42:31 +02:00
brin.h Fix BRIN to use SnapshotAny during summarization 2015-08-05 16:20:50 -03:00
brin_internal.h Add BRIN infrastructure for "inclusion" opclasses 2015-05-15 18:05:22 -03:00
brin_page.h Close some holes in BRIN page assignment 2015-08-12 14:20:38 -03:00
brin_pageops.h Close some holes in BRIN page assignment 2015-08-12 14:20:38 -03:00
brin_revmap.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
brin_tuple.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
brin_xlog.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
clog.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
commit_ts.h Rename (new|old)estCommitTs to (new|old)estCommitTsXid 2015-12-28 12:35:16 -08:00
genam.h More fixes for lossy-GiST-distance-functions patch. 2015-05-21 19:47:48 -04:00
gin.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
gin_private.h Fix memory leak and other bugs in ginPlaceToPage() & subroutines. 2016-04-20 14:25:15 -04:00
gist.h Move strategy numbers to include/access/stratnum.h 2015-05-15 17:03:16 -03:00
gist_private.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
gistscan.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
hash.h Fix building of large (bigger than shared_buffers) hash indexes. 2016-06-24 16:57:36 -04:00
heapam.h Redesign tablesample method API, and do extensive code review. 2015-07-25 14:39:00 -04:00
heapam_xlog.h Add support for INSERT ... ON CONFLICT DO NOTHING/UPDATE. 2015-05-08 05:43:10 +02:00
hio.h Add support for INSERT ... ON CONFLICT DO NOTHING/UPDATE. 2015-05-08 05:43:10 +02:00
htup.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
htup_details.h Fix handling of multixacts predating pg_upgrade 2016-06-24 18:29:28 -04:00
itup.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
multixact.h Remove legacy multixact truncation support. 2015-09-26 19:04:25 +02:00
nbtree.h Revert buggy optimization of index scans 2016-03-03 09:50:38 +00:00
parallel.h Fix a problem with parallel workers being unable to restore role. 2015-10-16 11:40:03 -04:00
printtup.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
reloptions.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
relscan.h Fix some oversights in BRIN patch. 2015-07-21 13:38:24 -04:00
rewriteheap.h Collection of typo fixes. 2015-05-20 16:56:22 +03:00
rmgr.h Add rmgr callback to name xlog record types for display purposes. 2014-09-19 16:20:29 +02:00
rmgrlist.h Collection of typo fixes. 2015-05-20 16:56:22 +03:00
sdir.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
skey.h Move strategy numbers to include/access/stratnum.h 2015-05-15 17:03:16 -03:00
slru.h Rework the way multixact truncations work. 2015-09-26 19:04:25 +02:00
spgist.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
spgist_private.h Don't assume that 'char' is signed. 2015-07-27 21:51:49 +03:00
stratnum.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
subtrans.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
sysattr.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
timeline.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
transam.h Rename (new|old)estCommitTs to (new|old)estCommitTsXid 2015-12-28 12:35:16 -08:00
tsmapi.h Redesign tablesample method API, and do extensive code review. 2015-07-25 14:39:00 -04:00
tupconvert.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
tupdesc.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
tupmacs.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
tuptoaster.h Use FLEXIBLE_ARRAY_MEMBER for HeapTupleHeaderData.t_bits[]. 2015-02-21 15:13:06 -05:00
twophase.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
twophase_rmgr.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
valid.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
visibilitymap.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
xact.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
xlog.h Remove files signaling a standby promotion request at postmaster startup 2015-09-09 22:52:28 +09:00
xlog_fn.h Update copyright for 2015 2015-01-06 11:43:47 -05:00
xlog_internal.h Remove trailing commas in enums. 2016-04-14 19:25:41 -07:00
xlogdefs.h Introduce replication progress tracking infrastructure. 2015-04-29 19:30:53 +02:00
xloginsert.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
xlogreader.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
xlogrecord.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00
xlogutils.h pgindent run for 9.5 2015-05-23 21:35:49 -04:00