Package io.debezium.pipeline.txmetadata

Class TransactionMonitor

java.lang.Object

io.debezium.pipeline.txmetadata.TransactionMonitor

@NotThreadSafe
public class TransactionMonitor
extends Object

The class has externalized its state in TransactionContext context class so it can be stored in and recovered from offsets. The class receives all processed events and keeps the transaction tracking depending on transaction id. Upon transaction change the metadata events are delivered to a dedicated topic informing about START/END of the transaction, including transaction id and in case of END event the amount of events generated by the transaction.

Every event seen has its source block enriched to contain

• transaction id
• the total event order in the transaction
• the order of event per table/collection source in the transaction

Author:

Jiri Pechanec

Field Summary

Fields

Modifier and Type	Field	Description
private final CommonConnectorConfig	connectorConfig
protected final String	DEBEZIUM_TRANSACTION_ID_KEY
private final EventMetadataProvider	eventMetadataProvider
private static final org.slf4j.Logger	LOGGER
private final BlockingConsumer<org.apache.kafka.connect.source.SourceRecord>	sender
private final String	topicName
static final org.apache.kafka.connect.data.Schema	TRANSACTION_BLOCK_SCHEMA
protected final org.apache.kafka.connect.data.Schema	transactionKeySchema
private final TransactionStructMaker	transactionStructMaker

Constructor Summary

Constructors

Constructor	Description
TransactionMonitor(CommonConnectorConfig connectorConfig, EventMetadataProvider eventMetadataProvider, SchemaNameAdjuster schemaNameAdjuster, BlockingConsumer<org.apache.kafka.connect.source.SourceRecord> sender, String topicName)

Method Summary

Modifier and Type	Method	Description
private void	beginTransaction(Partition partition, OffsetContext offsetContext, Instant timestamp)
void	dataEvent(Partition partition, DataCollectionId source, OffsetContext offset, Object key, org.apache.kafka.connect.data.Struct value)
private void	endTransaction(Partition partition, OffsetContext offsetContext, Instant timestamp)
protected org.apache.kafka.connect.data.Struct	prepareTxBeginValue(OffsetContext offsetContext, Instant timestamp)
protected org.apache.kafka.connect.data.Struct	prepareTxEndValue(OffsetContext offsetContext, Instant timestamp)
protected org.apache.kafka.connect.data.Struct	prepareTxKey(OffsetContext offsetContext)
protected org.apache.kafka.connect.data.Struct	prepareTxStruct(OffsetContext offsetContext, long dataCollectionEventOrder, org.apache.kafka.connect.data.Struct value)
void	transactionComittedEvent(Partition partition, OffsetContext offset, Instant timestamp)
private void	transactionEvent(OffsetContext offsetContext, DataCollectionId source, org.apache.kafka.connect.data.Struct value)
void	transactionStartedEvent(Partition partition, TransactionInfo transactionInfo, OffsetContext offset, Instant timestamp)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

TRANSACTION_BLOCK_SCHEMA

public static final org.apache.kafka.connect.data.Schema TRANSACTION_BLOCK_SCHEMA

eventMetadataProvider

private final EventMetadataProvider eventMetadataProvider

topicName

private final String topicName

sender

private final BlockingConsumer<org.apache.kafka.connect.source.SourceRecord> sender

connectorConfig

private final CommonConnectorConfig connectorConfig

transactionStructMaker

private final TransactionStructMaker transactionStructMaker

transactionKeySchema

protected final org.apache.kafka.connect.data.Schema transactionKeySchema

DEBEZIUM_TRANSACTION_ID_KEY

protected final String DEBEZIUM_TRANSACTION_ID_KEY

See Also:

• Constant Field Values

Constructor Details

TransactionMonitor

public TransactionMonitor(CommonConnectorConfig connectorConfig,
 EventMetadataProvider eventMetadataProvider,
 SchemaNameAdjuster schemaNameAdjuster,
 BlockingConsumer<org.apache.kafka.connect.source.SourceRecord> sender,
 String topicName)

Method Details

dataEvent

public void dataEvent(Partition partition,
 DataCollectionId source,
 OffsetContext offset,
 Object key,
 org.apache.kafka.connect.data.Struct value)
               throws InterruptedException

Throws:

InterruptedException

transactionComittedEvent

public void transactionComittedEvent(Partition partition,
 OffsetContext offset,
 Instant timestamp)
                              throws InterruptedException

Throws:

InterruptedException

transactionStartedEvent

public void transactionStartedEvent(Partition partition,
 TransactionInfo transactionInfo,
 OffsetContext offset,
 Instant timestamp)
                             throws InterruptedException

Throws:

InterruptedException

prepareTxKey

protected org.apache.kafka.connect.data.Struct prepareTxKey(OffsetContext offsetContext)

prepareTxBeginValue

protected org.apache.kafka.connect.data.Struct prepareTxBeginValue(OffsetContext offsetContext,
 Instant timestamp)

prepareTxEndValue

protected org.apache.kafka.connect.data.Struct prepareTxEndValue(OffsetContext offsetContext,
 Instant timestamp)

prepareTxStruct

protected org.apache.kafka.connect.data.Struct prepareTxStruct(OffsetContext offsetContext,
 long dataCollectionEventOrder,
 org.apache.kafka.connect.data.Struct value)

transactionEvent

private void transactionEvent(OffsetContext offsetContext,
 DataCollectionId source,
 org.apache.kafka.connect.data.Struct value)

beginTransaction

private void beginTransaction(Partition partition,
 OffsetContext offsetContext,
 Instant timestamp)
                       throws InterruptedException

Throws:

InterruptedException

endTransaction

private void endTransaction(Partition partition,
 OffsetContext offsetContext,
 Instant timestamp)
                     throws InterruptedException

Throws:

InterruptedException