Package io.debezium.connector.oracle.logminer.processor.infinispan

Class RemoteInfinispanLogMinerEventProcessor

java.lang.Object

io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor<InfinispanTransaction>

io.debezium.connector.oracle.logminer.processor.infinispan.AbstractInfinispanLogMinerEventProcessor

io.debezium.connector.oracle.logminer.processor.infinispan.RemoteInfinispanLogMinerEventProcessor

All Implemented Interfaces:

CacheProvider, LogMinerEventProcessor, AutoCloseable

public class RemoteInfinispanLogMinerEventProcessor
extends AbstractInfinispanLogMinerEventProcessor

A concrete implementation of AbstractInfinispanLogMinerEventProcessor that uses Infinispan with the Hotrod client to store transaction and mined event data in caches. The cache configurations are supplied via connector configurations and are expected to be valid XML that represents parseable distributed cache setups for Infinispan.

Author:

Chris Cranford

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

AbstractLogMinerEventProcessor.Counters

Field Summary

Fields

Modifier and Type	Field	Description
private final org.infinispan.client.hotrod.RemoteCacheManager	cacheManager
private final boolean	dropBufferOnStop
private final org.infinispan.client.hotrod.RemoteCache<String,LogMinerEvent>	eventCache
private static final String	HOTROD_CLIENT_LOOKUP_PREFIX
private static final String	HOTROD_CLIENT_PREFIX
static final String	HOTROD_SERVER_LIST
private static final org.slf4j.Logger	LOGGER
private final org.infinispan.client.hotrod.RemoteCache<String,String>	processedTransactionsCache
private final org.infinispan.client.hotrod.RemoteCache<String,String>	schemaChangesCache
private final org.infinispan.client.hotrod.RemoteCache<String,InfinispanTransaction>	transactionCache

Fields inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

counters, sqlQuery

Fields inherited from interface io.debezium.connector.oracle.logminer.processor.infinispan.CacheProvider

EVENTS_CACHE_NAME, PROCESSED_TRANSACTIONS_CACHE_NAME, SCHEMA_CHANGES_CACHE_NAME, TRANSACTIONS_CACHE_NAME

Constructor Summary

Constructors

Constructor	Description
RemoteInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context, OracleConnectorConfig connectorConfig, OracleConnection jdbcConnection, EventDispatcher<OraclePartition,TableId> dispatcher, OraclePartition partition, OracleOffsetContext offsetContext, OracleDatabaseSchema schema, LogMinerStreamingChangeEventSourceMetrics metrics)

Method Summary

Modifier and Type	Method	Description
void	close()
private <C, V> org.infinispan.client.hotrod.RemoteCache<C,V>	createCache(String cacheName, OracleConnectorConfig connectorConfig, Field field)
org.infinispan.commons.api.BasicCache<String,LogMinerEvent>	getEventCache()	Get the LogMiner events cache Key - The event id, in the format of transactionId-eventSequence Value - The raw LogMinerEvent object instance
protected String	getFirstActiveTransactionKey()	Returns only the first transaction id in the transaction buffer.
private Properties	getHotrodClientProperties(OracleConnectorConfig connectorConfig)
protected Optional<InfinispanTransaction>	getOldestTransactionInCache()	Get the oldest transaction in the cache.
org.infinispan.commons.api.BasicCache<String,String>	getProcessedTransactionsCache()	Get the processed transactions cache Key - The unique transaction id Value - The transaction's commit or rollback system change number
org.infinispan.commons.api.BasicCache<String,String>	getSchemaChangesCache()	Get the Schema Changes cache Key - The system change number of the schema change Value - The table the schema change is related to
org.infinispan.commons.api.BasicCache<String,InfinispanTransaction>	getTransactionCache()	Returns the TransactionCache implementation.
protected Scn	getTransactionCacheMinimumScn()	Gets the minimum system change number stored in the transaction cache.
protected void	purgeCache(Scn minCacheScn)	Purge the necessary caches with all entries that occurred prior to the specified change number.

Methods inherited from class io.debezium.connector.oracle.logminer.processor.infinispan.AbstractInfinispanLogMinerEventProcessor

addToTransaction, calculateNewStartScn, cleanupAfterTransactionRemovedFromCache, createQueryStatement, createTransaction, displayCacheStatistics, finalizeTransactionCommit, finalizeTransactionRollback, getAndRemoveTransactionFromCache, getTransactionEventCount, getTransactionEventIterator, handleSchemaChange, hasSchemaChangeBeenSeen, isRecentlyProcessed, logCacheStats, processRow, reCreateInMemoryCache, removeEventWithRowId, removeIf, resetTransactionToStart

Methods inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

abandonTransactionOverEventThreshold, abandonTransactions, getAbandonedTransactionsCache, getConfig, getLastProcessedScn, getLastProcessedScnChangeTime, getLastScnToAbandon, getQueryString, getSchema, getTransactionIdPrefix, handleCommit, handleCommitNotFoundInBuffer, handleDataEvent, handleLobWrite, handleMissingScn, handleRollback, handleRollbackNotFoundInBuffer, handleSelectLobLocator, handleStart, handleUnsupportedEvent, isTransactionIdWithNoSequence, isTransactionOverEventThreshold, isTransactionUserExcluded, isTrxIdRawValue, process, processResults, warnPotentiallyStuckScn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

HOTROD_CLIENT_LOOKUP_PREFIX

private static final String HOTROD_CLIENT_LOOKUP_PREFIX

See Also:

• Constant Field Values

HOTROD_CLIENT_PREFIX

private static final String HOTROD_CLIENT_PREFIX

See Also:

• Constant Field Values

HOTROD_SERVER_LIST

public static final String HOTROD_SERVER_LIST

See Also:

• Constant Field Values

cacheManager

private final org.infinispan.client.hotrod.RemoteCacheManager cacheManager

dropBufferOnStop

private final boolean dropBufferOnStop

transactionCache

private final org.infinispan.client.hotrod.RemoteCache<String,InfinispanTransaction> transactionCache

eventCache

private final org.infinispan.client.hotrod.RemoteCache<String,LogMinerEvent> eventCache

processedTransactionsCache

private final org.infinispan.client.hotrod.RemoteCache<String,String> processedTransactionsCache

schemaChangesCache

private final org.infinispan.client.hotrod.RemoteCache<String,String> schemaChangesCache

Constructor Details

RemoteInfinispanLogMinerEventProcessor

public RemoteInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context,
 OracleConnectorConfig connectorConfig,
 OracleConnection jdbcConnection,
 EventDispatcher<OraclePartition,TableId> dispatcher,
 OraclePartition partition,
 OracleOffsetContext offsetContext,
 OracleDatabaseSchema schema,
 LogMinerStreamingChangeEventSourceMetrics metrics)

Method Details

close

public void close()
           throws Exception

Throws:

Exception

getTransactionCache

public org.infinispan.commons.api.BasicCache<String,InfinispanTransaction> getTransactionCache()

Description copied from class: AbstractLogMinerEventProcessor

Returns the TransactionCache implementation.

Specified by:

getTransactionCache in interface CacheProvider

Specified by:

getTransactionCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the transaction cache, never null

getEventCache

public org.infinispan.commons.api.BasicCache<String,LogMinerEvent> getEventCache()

Description copied from interface: CacheProvider

Get the LogMiner events cache

• Key - The event id, in the format of transactionId-eventSequence
• Value - The raw LogMinerEvent object instance

Returns:

the evnts cache, never null

getSchemaChangesCache

public org.infinispan.commons.api.BasicCache<String,String> getSchemaChangesCache()

Description copied from interface: CacheProvider

Get the Schema Changes cache

• Key - The system change number of the schema change
• Value - The table the schema change is related to

Returns:

the schema changes cache, never null

getProcessedTransactionsCache

public org.infinispan.commons.api.BasicCache<String,String> getProcessedTransactionsCache()

Description copied from interface: CacheProvider

Get the processed transactions cache

• Key - The unique transaction id
• Value - The transaction's commit or rollback system change number

Returns:

the processed transactions cache, never null

getTransactionCacheMinimumScn

protected Scn getTransactionCacheMinimumScn()

Description copied from class: AbstractLogMinerEventProcessor

Gets the minimum system change number stored in the transaction cache.

Specified by:

getTransactionCacheMinimumScn in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the minimum system change number, never null but could be Scn.NULL.

getOldestTransactionInCache

protected Optional<InfinispanTransaction> getOldestTransactionInCache()

Description copied from class: AbstractLogMinerEventProcessor

Get the oldest transaction in the cache.

Specified by:

getOldestTransactionInCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the oldest transaction in the cache or maybe null if cache is empty

getFirstActiveTransactionKey

protected String getFirstActiveTransactionKey()

Description copied from class: AbstractLogMinerEventProcessor

Returns only the first transaction id in the transaction buffer.

Specified by:

getFirstActiveTransactionKey in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the first active transaction in the buffer, or null if there is none.

purgeCache

protected void purgeCache(Scn minCacheScn)

Description copied from class: AbstractInfinispanLogMinerEventProcessor

Purge the necessary caches with all entries that occurred prior to the specified change number. NOTE: This method is abstract despite the code used by both all implementations being identical. This is because the method needed entrySet() is made available on two different concrete interfaces between the embedded and remote cache implementations, and therefore we need to access this method from the concrete implementation classes (RemoteCache and Cache) rather than from the common class used by CacheProvider (BasicCache).

Specified by:

purgeCache in class AbstractInfinispanLogMinerEventProcessor

Parameters:

minCacheScn - the minimum system change number to keep entries until

getHotrodClientProperties

private Properties getHotrodClientProperties(OracleConnectorConfig connectorConfig)

createCache

private <C,
V>
org.infinispan.client.hotrod.RemoteCache<C,V> createCache(String cacheName,
 OracleConnectorConfig connectorConfig,
 Field field)