postgresql/src/include/replication
Masahiko Sawada f7d3caf9dd Fix possibility of logical decoding partial transaction changes.
When creating and initializing a logical slot, the restart_lsn is set
to the latest WAL insertion point (or the latest replay point on
standbys). Subsequently, WAL records are decoded from that point to
find the start point for extracting changes in the
DecodingContextFindStartpoint() function. Since the initial
restart_lsn could be in the middle of a transaction, the start point
must be a consistent point where we won't see the data for partial
transactions.

Previously, when not building a full snapshot, serialized snapshots
were restored, and the SnapBuild jumps to the consistent state even
while finding the start point. Consequently, the slot's restart_lsn
and confirmed_flush could be set to the middle of a transaction. This
could lead to various unexpected consequences. Specifically, there
were reports of logical decoding decoding partial transactions, and
assertion failures occurred because only subtransactions were decoded
without decoding their top-level transaction until decoding the commit
record.

To resolve this issue, the changes prevent restoring the serialized
snapshot and jumping to the consistent state while finding the start
point.

On v17 and HEAD, a flag indicating whether snapshot restores should be
skipped has been added to the SnapBuild struct, and SNAPBUILD_VERSION
has been bumpded.

On backbranches, the flag is stored in the LogicalDecodingContext
instead, preserving on-disk compatibility.

Backpatch to all supported versions.

Reported-by: Drew Callahan
Reviewed-by: Amit Kapila, Hayato Kuroda
Discussion: https://postgr.es/m/2444AA15-D21B-4CCE-8052-52C7C2DAFE5C%40amazon.com
Backpatch-through: 12
2024-07-11 22:48:13 +09:00
..
backup_manifest.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
basebackup.h Code review for server's handling of "tablespace map" files. 2021-03-17 16:18:46 -04:00
decode.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
logical.h Fix possibility of logical decoding partial transaction changes. 2024-07-11 22:48:13 +09:00
logicallauncher.h Allow multiple xacts during table sync in logical replication. 2021-02-12 07:41:51 +05:30
logicalproto.h Allow pgoutput to send logical decoding messages. 2021-04-06 08:40:47 +05:30
logicalrelation.h Fix data inconsistency between publisher and subscriber. 2022-06-16 08:32:10 +05:30
logicalworker.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
message.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
origin.h Add some const decorations 2021-06-10 16:21:48 +02:00
output_plugin.h Add a xid argument to the filter_prepare callback for output plugins. 2021-03-30 10:34:43 +05:30
pgoutput.h Allow pgoutput to send logical decoding messages. 2021-04-06 08:40:47 +05:30
reorderbuffer.h Fix decoding of speculative aborts. 2021-06-15 08:28:36 +05:30
slot.h Advance old-segment horizon properly after slot invalidation 2021-07-16 12:07:30 -04:00
snapbuild.h Fix catalog lookup with the wrong snapshot during logical decoding. 2022-08-11 09:45:04 +05:30
syncrep.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
walreceiver.h Add condition variable for walreceiver shutdown. 2021-03-12 19:45:42 +13:00
walsender.h Update copyright for 2021 2021-01-02 13:06:25 -05:00
walsender_private.h Fix limitations on what SQL commands can be issued to a walsender. 2022-01-24 15:33:34 -05:00
worker_internal.h Rename the logical replication global "wrconn" 2021-05-12 19:13:54 -04:00