Package io.debezium.connector.oracle.logminer.processor.infinispan

Class EmbeddedInfinispanLogMinerEventProcessor

java.lang.Object

io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor<InfinispanTransaction>

io.debezium.connector.oracle.logminer.processor.infinispan.AbstractInfinispanLogMinerEventProcessor

io.debezium.connector.oracle.logminer.processor.infinispan.EmbeddedInfinispanLogMinerEventProcessor

All Implemented Interfaces:

CacheProvider, LogMinerEventProcessor, AutoCloseable

public class EmbeddedInfinispanLogMinerEventProcessor
extends AbstractInfinispanLogMinerEventProcessor

A concrete implementation of AbstractInfinispanLogMinerEventProcessor that uses Infinispan in embedded mode to store transaction and mined event data in caches. The cache configurations are supplied via connector configurations and are expected to be valid XML that represent parseable local cache setups for Infinispan.

Author:

Chris Cranford

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

AbstractLogMinerEventProcessor.Counters

Field Summary

Fields

Modifier and Type	Field	Description
private final org.infinispan.manager.EmbeddedCacheManager	cacheManager
private final boolean	dropBufferOnStop
private final org.infinispan.Cache<String,LogMinerEvent>	eventCache
private static final org.slf4j.Logger	LOGGER
private final org.infinispan.Cache<String,String>	processedTransactionsCache
private final org.infinispan.Cache<String,String>	schemaChangesCache
private final org.infinispan.Cache<String,InfinispanTransaction>	transactionCache

Fields inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

counters, sqlQuery

Fields inherited from interface io.debezium.connector.oracle.logminer.processor.infinispan.CacheProvider

EVENTS_CACHE_NAME, PROCESSED_TRANSACTIONS_CACHE_NAME, SCHEMA_CHANGES_CACHE_NAME, TRANSACTIONS_CACHE_NAME

Constructor Summary

Constructors

Constructor	Description
EmbeddedInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context, OracleConnectorConfig connectorConfig, OracleConnection jdbcConnection, EventDispatcher<OraclePartition,TableId> dispatcher, OraclePartition partition, OracleOffsetContext offsetContext, OracleDatabaseSchema schema, OracleStreamingChangeEventSourceMetrics metrics)

Method Summary

Modifier and Type	Method	Description
void	close()
private <K, V> org.infinispan.Cache<K,V>	createCache(String cacheName, OracleConnectorConfig connectorConfig, Field field)
org.infinispan.commons.api.BasicCache<String,LogMinerEvent>	getEventCache()	Get the LogMiner events cache Key - The event id, in the format of transactionId-eventSequence Value - The raw LogMinerEvent object instance
protected String	getFirstActiveTransactionKey()	Returns only the first transaction id in the transaction buffer.
protected Optional<InfinispanTransaction>	getOldestTransactionInCache()	Get the oldest transaction in the cache.
org.infinispan.commons.api.BasicCache<String,String>	getProcessedTransactionsCache()	Get the processed transactions cache Key - The unique transaction id Value - The transaction's commit or rollback system change number
org.infinispan.commons.api.BasicCache<String,String>	getSchemaChangesCache()	Get the Schema Changes cache Key - The system change number of the schema change Value - The table the schema change is related to
org.infinispan.commons.api.BasicCache<String,InfinispanTransaction>	getTransactionCache()	Returns the TransactionCache implementation.
protected Scn	getTransactionCacheMinimumScn()	Gets the minimum system change number stored in the transaction cache.
private org.infinispan.configuration.cache.Configuration	parseAndGetConfiguration(String cacheName, String configuration)
private org.infinispan.configuration.global.GlobalConfiguration	parseAndGetGlobalConfiguration(OracleConnectorConfig connectorConfig)
protected void	purgeCache(Scn minCacheScn)	Purge the necessary caches with all entries that occurred prior to the specified change number.

Methods inherited from class io.debezium.connector.oracle.logminer.processor.infinispan.AbstractInfinispanLogMinerEventProcessor

abandonTransactions, addToTransaction, calculateNewStartScn, createQueryStatement, createTransaction, displayCacheStatistics, finalizeTransactionCommit, finalizeTransactionRollback, getAndRemoveTransactionFromCache, getTransactionEventCount, getTransactionEventIterator, handleSchemaChange, hasSchemaChangeBeenSeen, isRecentlyProcessed, processRow, removeEventWithRowId, removeIf, removeTransactionAndEventsFromCache, resetTransactionToStart

Methods inherited from class io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor

abandonTransactionOverEventThreshold, getConfig, getLastProcessedScn, getLastProcessedScnChangeTime, getQueryString, getSchema, getTransactionIdPrefix, handleCommit, handleCommitNotFoundInBuffer, handleDataEvent, handleLobWrite, handleMissingScn, handleRollback, handleRollbackNotFoundInBuffer, handleSelectLobLocator, handleStart, handleUnsupportedEvent, isTransactionIdWithNoSequence, isTransactionOverEventThreshold, isTransactionUserExcluded, isTrxIdRawValue, process, processResults, warnPotentiallyStuckScn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

cacheManager

private final org.infinispan.manager.EmbeddedCacheManager cacheManager

dropBufferOnStop

private final boolean dropBufferOnStop

transactionCache

private final org.infinispan.Cache<String,InfinispanTransaction> transactionCache

eventCache

private final org.infinispan.Cache<String,LogMinerEvent> eventCache

processedTransactionsCache

private final org.infinispan.Cache<String,String> processedTransactionsCache

schemaChangesCache

private final org.infinispan.Cache<String,String> schemaChangesCache

Constructor Details

EmbeddedInfinispanLogMinerEventProcessor

public EmbeddedInfinispanLogMinerEventProcessor(ChangeEventSource.ChangeEventSourceContext context,
 OracleConnectorConfig connectorConfig,
 OracleConnection jdbcConnection,
 EventDispatcher<OraclePartition,TableId> dispatcher,
 OraclePartition partition,
 OracleOffsetContext offsetContext,
 OracleDatabaseSchema schema,
 OracleStreamingChangeEventSourceMetrics metrics)

Method Details

close

public void close()
           throws Exception

Throws:

Exception

getTransactionCache

public org.infinispan.commons.api.BasicCache<String,InfinispanTransaction> getTransactionCache()

Description copied from class: AbstractLogMinerEventProcessor

Returns the TransactionCache implementation.

Specified by:

getTransactionCache in interface CacheProvider

Specified by:

getTransactionCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the transaction cache, never null

getEventCache

public org.infinispan.commons.api.BasicCache<String,LogMinerEvent> getEventCache()

Description copied from interface: CacheProvider

Get the LogMiner events cache

• Key - The event id, in the format of transactionId-eventSequence
• Value - The raw LogMinerEvent object instance

Returns:

the evnts cache, never null

getSchemaChangesCache

public org.infinispan.commons.api.BasicCache<String,String> getSchemaChangesCache()

Description copied from interface: CacheProvider

Get the Schema Changes cache

• Key - The system change number of the schema change
• Value - The table the schema change is related to

Returns:

the schema changes cache, never null

getProcessedTransactionsCache

public org.infinispan.commons.api.BasicCache<String,String> getProcessedTransactionsCache()

Description copied from interface: CacheProvider

Get the processed transactions cache

• Key - The unique transaction id
• Value - The transaction's commit or rollback system change number

Returns:

the processed transactions cache, never null

getTransactionCacheMinimumScn

protected Scn getTransactionCacheMinimumScn()

Description copied from class: AbstractLogMinerEventProcessor

Gets the minimum system change number stored in the transaction cache.

Specified by:

getTransactionCacheMinimumScn in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the minimum system change number, never null but could be Scn.NULL.

getOldestTransactionInCache

protected Optional<InfinispanTransaction> getOldestTransactionInCache()

Description copied from class: AbstractLogMinerEventProcessor

Get the oldest transaction in the cache.

Specified by:

getOldestTransactionInCache in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the oldest transaction in the cache or maybe null if cache is empty

getFirstActiveTransactionKey

protected String getFirstActiveTransactionKey()

Description copied from class: AbstractLogMinerEventProcessor

Returns only the first transaction id in the transaction buffer.

Specified by:

getFirstActiveTransactionKey in class AbstractLogMinerEventProcessor<InfinispanTransaction>

Returns:

the first active transaction in the buffer, or null if there is none.

purgeCache

protected void purgeCache(Scn minCacheScn)

Description copied from class: AbstractInfinispanLogMinerEventProcessor

Purge the necessary caches with all entries that occurred prior to the specified change number. NOTE: This method is abstract despite the code used by both all implementations being identical. This is because the method needed entrySet() is made available on two different concrete interfaces between the embedded and remote cache implementations, and therefore we need to access this method from the concrete implementation classes (RemoteCache and Cache) rather than from the common class used by CacheProvider (BasicCache).

Specified by:

purgeCache in class AbstractInfinispanLogMinerEventProcessor

Parameters:

minCacheScn - the minimum system change number to keep entries until

createCache

private <K,
V> org.infinispan.Cache<K,V> createCache(String cacheName,
 OracleConnectorConfig connectorConfig,
 Field field)

parseAndGetConfiguration

private org.infinispan.configuration.cache.Configuration parseAndGetConfiguration(String cacheName,
 String configuration)

parseAndGetGlobalConfiguration

private org.infinispan.configuration.global.GlobalConfiguration parseAndGetGlobalConfiguration(OracleConnectorConfig connectorConfig)