Package io.debezium.connector.oracle.logminer.processor.infinispan

Class AbstractInfinispanLogMinerEventProcessor

java.lang.Object

io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor<InfinispanTransaction>

io.debezium.connector.oracle.logminer.processor.infinispan.AbstractInfinispanLogMinerEventProcessor

All Implemented Interfaces:

CacheProvider, LogMinerEventProcessor, AutoCloseable

Direct Known Subclasses:

EmbeddedInfinispanLogMinerEventProcessor, RemoteInfinispanLogMinerEventProcessor

public abstract class AbstractInfinispanLogMinerEventProcessor
extends AbstractLogMinerEventProcessor<InfinispanTransaction>
implements CacheProvider

An implementation of LogMinerEventProcessor that uses Infinispan to persist the transaction cache across restarts on disk.

Author:

Chris Cranford

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

AbstractLogMinerEventProcessor.Counters

Field Summary

Fields

Modifier and Type	Field	Description
private final EventDispatcher<OraclePartition,TableId>	dispatcher
private final OracleConnection	jdbcConnection
private static final org.slf4j.Logger	LOGGER
private final OracleStreamingChangeEventSourceMetrics	metrics
private final OracleOffsetContext	offsetContext
private final OraclePartition	partition

Fields inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

counters

Fields inherited from interface io.debezium.connector.oracle.logminer.processor.infinispan.CacheProvider

EVENTS_CACHE_NAME, PROCESSED_TRANSACTIONS_CACHE_NAME, SCHEMA_CHANGES_CACHE_NAME, TRANSACTIONS_CACHE_NAME

Constructor Summary

Constructors

Constructor	Description
AbstractInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context, OracleConnectorConfig connectorConfig, OracleConnection jdbcConnection, EventDispatcher<OraclePartition,TableId> dispatcher, OraclePartition partition, OracleOffsetContext offsetContext, OracleDatabaseSchema schema, OracleStreamingChangeEventSourceMetrics metrics)

Method Summary

Modifier and Type	Method	Description
void	abandonTransactions(Duration retention)	A callback for the event processor to abandon long running transactions.
protected void	addToTransaction(String transactionId, LogMinerEventRow row, Supplier<LogMinerEvent> eventSupplier)	Add a transaction to the transaction map if allowed.
protected Scn	calculateNewStartScn(Scn endScn, Scn maxCommittedScn)	Calculates the new starting system change number based on the current processing range.
protected PreparedStatement	createQueryStatement()	Create the JDBC query that will be used to fetch the mining result set.
protected InfinispanTransaction	createTransaction(LogMinerEventRow row)	Creates a new transaction based on the supplied START event.
void	displayCacheStatistics()	Displays cache statistics
protected void	finalizeTransactionCommit(String transactionId, Scn commitScn)	Finalizes the commit of a transaction.
protected void	finalizeTransactionRollback(String transactionId, Scn rollbackScn)	Finalizes the rollback the specified transaction
protected InfinispanTransaction	getAndRemoveTransactionFromCache(String transactionId)	Gets a transaction instance from the transaction cache while also removing its cache entry.
protected int	getTransactionEventCount(InfinispanTransaction transaction)	Returns the number of events associated with the specified transaction.
protected Iterator<LogMinerEvent>	getTransactionEventIterator(InfinispanTransaction transaction)	Get an iterator over the events that are part of the specified transaction.
private List<String>	getTransactionKeysWithPrefix(String prefix)
protected void	handleSchemaChange(LogMinerEventRow row)	Handle processing a LogMinerEventRow for a DDL event.
protected boolean	hasSchemaChangeBeenSeen(LogMinerEventRow row)	Checks whether the LogMinerEvent row for a schema change can be emitted.
protected boolean	isRecentlyProcessed(String transactionId)	Check whether a transaction has been recently processed through either a commit or rollback.
protected void	processRow(OraclePartition partition, LogMinerEventRow row)	Processes a single LogMinerEventRow.
private void	removeEventsWithTransaction(InfinispanTransaction transaction)
protected void	removeEventWithRowId(LogMinerEventRow row)	Removes a specific transaction event by database row identifier.
protected void	removeTransactionAndEventsFromCache(InfinispanTransaction transaction)	Removes the transaction and all its associated event entries from the connector's caches.

Methods inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

abandonTransactionOverEventThreshold, getConfig, getLastProcessedScn, getSchema, getTransactionCache, getTransactionCacheMinimumScn, getTransactionIdPrefix, handleCommit, handleDataEvent, handleLobWrite, handleMissingScn, handleRollback, handleSelectLobLocator, handleStart, handleUnsupportedEvent, isTransactionIdWithNoSequence, isTransactionOverEventThreshold, isTransactionUserExcluded, isTrxIdRawValue, process, processResults, warnPotentiallyStuckScn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.AutoCloseable

close

Methods inherited from interface io.debezium.connector.oracle.logminer.processor.infinispan.CacheProvider

getEventCache, getProcessedTransactionsCache, getSchemaChangesCache, getTransactionCache

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

jdbcConnection

private final OracleConnection jdbcConnection

metrics

private final OracleStreamingChangeEventSourceMetrics metrics

partition

private final OraclePartition partition

offsetContext

private final OracleOffsetContext offsetContext

dispatcher

private final EventDispatcher<OraclePartition,TableId> dispatcher

Constructor Details

AbstractInfinispanLogMinerEventProcessor

public AbstractInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context,
 OracleConnectorConfig connectorConfig,
 OracleConnection jdbcConnection,
 EventDispatcher<OraclePartition,TableId> dispatcher,
 OraclePartition partition,
 OracleOffsetContext offsetContext,
 OracleDatabaseSchema schema,
 OracleStreamingChangeEventSourceMetrics metrics)

Method Details

displayCacheStatistics

public void displayCacheStatistics()

Description copied from interface: CacheProvider

Displays cache statistics

Specified by:

displayCacheStatistics in interface CacheProvider

isRecentlyProcessed

protected boolean isRecentlyProcessed(String transactionId)

Description copied from class: AbstractLogMinerEventProcessor

Check whether a transaction has been recently processed through either a commit or rollback.

Overrides:

isRecentlyProcessed in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transactionId - the unique transaction id

Returns:

true if the transaction has been recently processed, false otherwise

createTransaction

protected InfinispanTransaction createTransaction(LogMinerEventRow row)

Description copied from class: AbstractLogMinerEventProcessor

Creates a new transaction based on the supplied START event.

Specified by:

createTransaction in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

row - the event row, must not be null

Returns:

the implementation-specific Transaction instance

removeEventWithRowId

protected void removeEventWithRowId(LogMinerEventRow row)

Description copied from class: AbstractLogMinerEventProcessor

Removes a specific transaction event by database row identifier.

Specified by:

removeEventWithRowId in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

row - the event row that contains the row identifier, must not be null

getTransactionKeysWithPrefix

private List<String> getTransactionKeysWithPrefix(String prefix)

processRow

protected void processRow(OraclePartition partition,
 LogMinerEventRow row)
                   throws SQLException,
InterruptedException

Description copied from class: AbstractLogMinerEventProcessor

Processes a single LogMinerEventRow.

Overrides:

processRow in class AbstractLogMinerEventProcessor<InfinispanTransaction>

row - the event row, must not be null

Throws:

SQLException - if a database exception occurred

InterruptedException - if the dispatcher was interrupted sending an event

abandonTransactions

public void abandonTransactions(Duration retention)
                         throws InterruptedException

Description copied from interface: LogMinerEventProcessor

A callback for the event processor to abandon long running transactions.

Specified by:

abandonTransactions in interface LogMinerEventProcessor

Parameters:

retention - the maximum duration in which long running transactions are allowed.

Throws:

InterruptedException

hasSchemaChangeBeenSeen

protected boolean hasSchemaChangeBeenSeen(LogMinerEventRow row)

Description copied from class: AbstractLogMinerEventProcessor

Checks whether the LogMinerEvent row for a schema change can be emitted.

Overrides:

hasSchemaChangeBeenSeen in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

row - the result set row

Returns:

true if the schema change has been seen, false otherwise.

getAndRemoveTransactionFromCache

protected InfinispanTransaction getAndRemoveTransactionFromCache(String transactionId)

Description copied from class: AbstractLogMinerEventProcessor

Gets a transaction instance from the transaction cache while also removing its cache entry.

Specified by:

getAndRemoveTransactionFromCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transactionId - the transaction's unique identifier, should not be null

Returns:

the transaction instance if found, null if the transaction wasn't found

removeTransactionAndEventsFromCache

protected void removeTransactionAndEventsFromCache(InfinispanTransaction transaction)

Description copied from class: AbstractLogMinerEventProcessor

Removes the transaction and all its associated event entries from the connector's caches.

Specified by:

removeTransactionAndEventsFromCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transaction - the transaction instance, should never be null

getTransactionEventIterator

protected Iterator<LogMinerEvent> getTransactionEventIterator(InfinispanTransaction transaction)

Description copied from class: AbstractLogMinerEventProcessor

Get an iterator over the events that are part of the specified transaction.

Specified by:

getTransactionEventIterator in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transaction - the transaction instance, should never be null

Returns:

an iterator over the transaction's events, never null

finalizeTransactionCommit

protected void finalizeTransactionCommit(String transactionId,
 Scn commitScn)

Description copied from class: AbstractLogMinerEventProcessor

Finalizes the commit of a transaction.

Specified by:

finalizeTransactionCommit in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transactionId - the transaction's unique identifier, should not be null

commitScn - the transaction's system change number, should not be null

finalizeTransactionRollback

protected void finalizeTransactionRollback(String transactionId,
 Scn rollbackScn)

Description copied from class: AbstractLogMinerEventProcessor

Finalizes the rollback the specified transaction

Specified by:

finalizeTransactionRollback in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transactionId - the unique transaction identifier, never null

rollbackScn - the rollback transaction's system change number, never null

handleSchemaChange

protected void handleSchemaChange(LogMinerEventRow row)
                           throws InterruptedException

Description copied from class: AbstractLogMinerEventProcessor

Handle processing a LogMinerEventRow for a DDL event.

Overrides:

handleSchemaChange in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

row - the result set row

Throws:

InterruptedException - if the event dispatcher is interrupted sending the event

addToTransaction

protected void addToTransaction(String transactionId,
 LogMinerEventRow row,
 Supplier<LogMinerEvent> eventSupplier)

Description copied from class: AbstractLogMinerEventProcessor

Add a transaction to the transaction map if allowed.

Specified by:

addToTransaction in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transactionId - the unqiue transaction id

row - the LogMiner event row

eventSupplier - the supplier of the event to create if the event is allowed to be added

getTransactionEventCount

protected int getTransactionEventCount(InfinispanTransaction transaction)

Description copied from class: AbstractLogMinerEventProcessor

Returns the number of events associated with the specified transaction.

Specified by:

getTransactionEventCount in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

transaction - the transaction, must not be null

Returns:

the number of events in the transaction

createQueryStatement

protected PreparedStatement createQueryStatement()
                                          throws SQLException

Description copied from class: AbstractLogMinerEventProcessor

Create the JDBC query that will be used to fetch the mining result set.

Specified by:

createQueryStatement in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

a prepared query statement, never null

Throws:

SQLException - if a database exception occurred creating the statement

calculateNewStartScn

protected Scn calculateNewStartScn(Scn endScn,
 Scn maxCommittedScn)
                            throws InterruptedException

Description copied from class: AbstractLogMinerEventProcessor

Calculates the new starting system change number based on the current processing range.

Specified by:

calculateNewStartScn in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Parameters:

endScn - the end system change number for the previously mined range, never null

maxCommittedScn - the maximum committed system change number, never null

Returns:

the system change number to start then next mining iteration from, never null

Throws:

InterruptedException - if the current thread is interrupted

removeEventsWithTransaction

private void removeEventsWithTransaction(InfinispanTransaction transaction)