io.debezium.connector.oracle.logminer

Class LogMinerStreamingChangeEventSource

java.lang.Object

io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource

All Implemented Interfaces:

io.debezium.pipeline.source.spi.ChangeEventSource, io.debezium.pipeline.source.spi.StreamingChangeEventSource

public class LogMinerStreamingChangeEventSource
extends Object
implements io.debezium.pipeline.source.spi.StreamingChangeEventSource

A StreamingChangeEventSource based on Oracle's LogMiner utility. The event handler loop is executed in a separate executor.

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.pipeline.source.spi.ChangeEventSource

io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext

Field Summary

Fields

Modifier and Type	Field and Description
private Duration	archiveLogRetention
private String	catalogName
private io.debezium.util.Clock	clock
private OracleConnectorConfig	connectorConfig
private io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId>	dispatcher
private SimpleDmlParser	dmlParser
private long	endScn
private io.debezium.pipeline.ErrorHandler	errorHandler
private boolean	isContinuousMining
private boolean	isRac
private io.debezium.jdbc.JdbcConfiguration	jdbcConfiguration
private OracleConnection	jdbcConnection
private static int	LOG_MINING_VIEW_FETCH_SIZE
private static org.slf4j.Logger	LOGGER
private LogMinerMetrics	logMinerMetrics
private OracleOffsetContext	offsetContext
private Set<String>	racHosts
private OracleDatabaseSchema	schema
private long	startScn
private OracleConnectorConfig.LogMiningStrategy	strategy
private OracleTaskContext	taskContext
private TransactionalBuffer	transactionalBuffer
private TransactionalBufferMetrics	transactionalBufferMetrics

Constructor Summary

Constructors

Constructor and Description
LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig, OracleOffsetContext offsetContext, OracleConnection jdbcConnection, io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher, io.debezium.pipeline.ErrorHandler errorHandler, io.debezium.util.Clock clock, OracleDatabaseSchema schema, OracleTaskContext taskContext)

Method Summary

Modifier and Type	Method and Description
private void	abandonOldTransactionsIfExist(Connection connection)
void	commitOffset(Map<String,?> offset)
void	execute(io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext context) This is the loop to get changes from LogMiner
private void	initializeRedoLogsForMining(Connection connection, boolean postEndMiningSession, Duration archiveLogRetention)
private void	pauseBetweenMiningSessions()
private void	registerLogMinerMetrics()
private void	registerTransactionalBuffer()
private void	unregisterLogMinerMetrics()
private void	unregisterTransactionalBuffer()
private void	updateStartScn()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

LOG_MINING_VIEW_FETCH_SIZE

private static final int LOG_MINING_VIEW_FETCH_SIZE

See Also:

Constant Field Values

jdbcConnection

private final OracleConnection jdbcConnection

dispatcher

private final io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher

clock

private final io.debezium.util.Clock clock

schema

private final OracleDatabaseSchema schema

offsetContext

private final OracleOffsetContext offsetContext

dmlParser

private final SimpleDmlParser dmlParser

catalogName

private final String catalogName

isRac

private final boolean isRac

racHosts

private final Set<String> racHosts

jdbcConfiguration

private final io.debezium.jdbc.JdbcConfiguration jdbcConfiguration

strategy

private final OracleConnectorConfig.LogMiningStrategy strategy

taskContext

private final OracleTaskContext taskContext

errorHandler

private final io.debezium.pipeline.ErrorHandler errorHandler

isContinuousMining

private final boolean isContinuousMining

connectorConfig

private OracleConnectorConfig connectorConfig

transactionalBufferMetrics

private TransactionalBufferMetrics transactionalBufferMetrics

logMinerMetrics

private LogMinerMetrics logMinerMetrics

transactionalBuffer

private TransactionalBuffer transactionalBuffer

startScn

private long startScn

endScn

private long endScn

archiveLogRetention

private Duration archiveLogRetention

Constructor Detail

LogMinerStreamingChangeEventSource

public LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig,
                                          OracleOffsetContext offsetContext,
                                          OracleConnection jdbcConnection,
                                          io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher,
                                          io.debezium.pipeline.ErrorHandler errorHandler,
                                          io.debezium.util.Clock clock,
                                          OracleDatabaseSchema schema,
                                          OracleTaskContext taskContext)

Method Detail

execute

public void execute(io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext context)

This is the loop to get changes from LogMiner

Specified by:

execute in interface io.debezium.pipeline.source.spi.StreamingChangeEventSource

Parameters:

context - change event source context

registerTransactionalBuffer

private void registerTransactionalBuffer()

unregisterTransactionalBuffer

private void unregisterTransactionalBuffer()

registerLogMinerMetrics

private void registerLogMinerMetrics()

unregisterLogMinerMetrics

private void unregisterLogMinerMetrics()

abandonOldTransactionsIfExist

private void abandonOldTransactionsIfExist(Connection connection)

updateStartScn

private void updateStartScn()

initializeRedoLogsForMining

private void initializeRedoLogsForMining(Connection connection,
                                         boolean postEndMiningSession,
                                         Duration archiveLogRetention)
                                  throws SQLException

Throws:

SQLException

pauseBetweenMiningSessions

private void pauseBetweenMiningSessions()
                                 throws InterruptedException

Throws:

InterruptedException

commitOffset

public void commitOffset(Map<String,?> offset)

Specified by:

commitOffset in interface io.debezium.pipeline.source.spi.StreamingChangeEventSource