io.debezium.connector.oracle.logminer

Class LogMinerStreamingChangeEventSource

java.lang.Object

io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource

All Implemented Interfaces:

ChangeEventSource, StreamingChangeEventSource

public class LogMinerStreamingChangeEventSource
extends Object
implements StreamingChangeEventSource

A StreamingChangeEventSource based on Oracle's LogMiner utility. The event handler loop is executed in a separate executor.

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.pipeline.source.spi.ChangeEventSource

ChangeEventSource.ChangeEventSourceContext

Field Summary

Fields

Modifier and Type	Field and Description
private Duration	archiveLogRetention
private Clock	clock
private OracleConnectorConfig	connectorConfig
private List<BigInteger>	currentRedoLogSequences
private EventDispatcher<TableId>	dispatcher
private Scn	endScn
private ErrorHandler	errorHandler
private boolean	isContinuousMining
private boolean	isRac
private JdbcConfiguration	jdbcConfiguration
private OracleConnection	jdbcConnection
private static org.slf4j.Logger	LOGGER
private OracleOffsetContext	offsetContext
private Set<String>	racHosts
private OracleDatabaseSchema	schema
private Scn	startScn
private OracleConnectorConfig.LogMiningStrategy	strategy
private OracleStreamingChangeEventSourceMetrics	streamingMetrics
private OracleTaskContext	taskContext

Constructor Summary

Constructors

Constructor and Description
LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig, OracleOffsetContext offsetContext, OracleConnection jdbcConnection, EventDispatcher<TableId> dispatcher, ErrorHandler errorHandler, Clock clock, OracleDatabaseSchema schema, OracleTaskContext taskContext, Configuration jdbcConfig, OracleStreamingChangeEventSourceMetrics streamingMetrics)

Method Summary

Modifier and Type	Method and Description
private void	abandonOldTransactionsIfExist(OracleConnection connection, TransactionalBuffer transactionalBuffer)
void	commitOffset(Map<String,?> offset)
void	execute(ChangeEventSource.ChangeEventSourceContext context) This is the loop to get changes from LogMiner
private List<BigInteger>	getCurrentRedoLogSequences() Get the current redo log sequence(s).
private boolean	hasLogSwitchOccurred() Checks whether a database log switch has occurred and updates metrics if so.
private void	initializeRedoLogsForMining(OracleConnection connection, boolean postEndMiningSession, Duration archiveLogRetention)
private void	pauseBetweenMiningSessions()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

jdbcConnection

private final OracleConnection jdbcConnection

dispatcher

private final EventDispatcher<TableId> dispatcher

clock

private final Clock clock

schema

private final OracleDatabaseSchema schema

offsetContext

private final OracleOffsetContext offsetContext

isRac

private final boolean isRac

racHosts

private final Set<String> racHosts

jdbcConfiguration

private final JdbcConfiguration jdbcConfiguration

strategy

private final OracleConnectorConfig.LogMiningStrategy strategy

taskContext

private final OracleTaskContext taskContext

errorHandler

private final ErrorHandler errorHandler

isContinuousMining

private final boolean isContinuousMining

streamingMetrics

private final OracleStreamingChangeEventSourceMetrics streamingMetrics

connectorConfig

private final OracleConnectorConfig connectorConfig

archiveLogRetention

private final Duration archiveLogRetention

startScn

private Scn startScn

endScn

private Scn endScn

currentRedoLogSequences

private List<BigInteger> currentRedoLogSequences

Constructor Detail

LogMinerStreamingChangeEventSource

public LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig,
                                          OracleOffsetContext offsetContext,
                                          OracleConnection jdbcConnection,
                                          EventDispatcher<TableId> dispatcher,
                                          ErrorHandler errorHandler,
                                          Clock clock,
                                          OracleDatabaseSchema schema,
                                          OracleTaskContext taskContext,
                                          Configuration jdbcConfig,
                                          OracleStreamingChangeEventSourceMetrics streamingMetrics)

Method Detail

execute

public void execute(ChangeEventSource.ChangeEventSourceContext context)

This is the loop to get changes from LogMiner

Specified by:

execute in interface StreamingChangeEventSource

Parameters:

context - change event source context

abandonOldTransactionsIfExist

private void abandonOldTransactionsIfExist(OracleConnection connection,
                                           TransactionalBuffer transactionalBuffer)

initializeRedoLogsForMining

private void initializeRedoLogsForMining(OracleConnection connection,
                                         boolean postEndMiningSession,
                                         Duration archiveLogRetention)
                                  throws SQLException

Throws:

SQLException

hasLogSwitchOccurred

private boolean hasLogSwitchOccurred()
                              throws SQLException

Checks whether a database log switch has occurred and updates metrics if so.

Returns:

true if a log switch was detected, otherwise false

Throws:

SQLException - if a database exception occurred

getCurrentRedoLogSequences

private List<BigInteger> getCurrentRedoLogSequences()
                                             throws SQLException

Get the current redo log sequence(s). In an Oracle RAC environment, there are multiple current redo logs and therefore this method returns multiple values, each relating to a single RAC node in the Oracle cluster.

Returns:

list of sequence numbers

Throws:

SQLException - if a database exception occurred

pauseBetweenMiningSessions

private void pauseBetweenMiningSessions()
                                 throws InterruptedException

Throws:

InterruptedException

commitOffset

public void commitOffset(Map<String,?> offset)

Specified by:

commitOffset in interface StreamingChangeEventSource