Package io.debezium.connector.oracle.logminer

Class LogMinerStreamingChangeEventSource

java.lang.Object

io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource

All Implemented Interfaces:

ChangeEventSource, StreamingChangeEventSource<OracleOffsetContext>

public class LogMinerStreamingChangeEventSource
extends Object
implements StreamingChangeEventSource<OracleOffsetContext>

A StreamingChangeEventSource based on Oracle's LogMiner utility. The event handler loop is executed in a separate executor.

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.pipeline.source.spi.ChangeEventSource

ChangeEventSource.ChangeEventSourceContext

Field Summary

Fields

Modifier and Type	Field	Description
private String	archiveDestinationName
private boolean	archiveLogOnlyMode
private Duration	archiveLogRetention
private Clock	clock
private OracleConnectorConfig	connectorConfig
private List<BigInteger>	currentRedoLogSequences
private EventDispatcher<TableId>	dispatcher
private Scn	endScn
private ErrorHandler	errorHandler
private boolean	isContinuousMining
private boolean	isRac
private JdbcConfiguration	jdbcConfiguration
private OracleConnection	jdbcConnection
private static org.slf4j.Logger	LOGGER
private Set<String>	racHosts
private OracleDatabaseSchema	schema
private Scn	startScn
private OracleConnectorConfig.LogMiningStrategy	strategy
private OracleStreamingChangeEventSourceMetrics	streamingMetrics

Constructor Summary

Constructors

Constructor	Description
LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig, OracleConnection jdbcConnection, EventDispatcher<TableId> dispatcher, ErrorHandler errorHandler, Clock clock, OracleDatabaseSchema schema, Configuration jdbcConfig, OracleStreamingChangeEventSourceMetrics streamingMetrics)

Method Summary

Modifier and Type	Method	Description
private void	abandonOldTransactionsIfExist(OracleConnection connection, OracleOffsetContext offsetContext, TransactionalBuffer transactionalBuffer)
void	commitOffset(Map<String,?> offset)
void	execute(ChangeEventSource.ChangeEventSourceContext context, OracleOffsetContext offsetContext)	This is the loop to get changes from LogMiner
private List<BigInteger>	getCurrentRedoLogSequences()	Get the current redo log sequence(s).
private boolean	hasLogSwitchOccurred()	Checks whether a database log switch has occurred and updates metrics if so.
private void	initializeRedoLogsForMining(OracleConnection connection, boolean postEndMiningSession, Scn startScn)
private boolean	isStartScnInArchiveLogs(Scn startScn)	Returns whether the starting system change number is in the archive logs.
private void	pauseBetweenMiningSessions()
private boolean	waitForStartScnInArchiveLogs(ChangeEventSource.ChangeEventSourceContext context, Scn startScn)	Waits for the starting system change number to exist in the archive logs before returning.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.pipeline.source.spi.StreamingChangeEventSource

init

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

jdbcConnection

private final OracleConnection jdbcConnection

dispatcher

private final EventDispatcher<TableId> dispatcher

clock

private final Clock clock

schema

private final OracleDatabaseSchema schema

isRac

private final boolean isRac

racHosts

private final Set<String> racHosts

jdbcConfiguration

private final JdbcConfiguration jdbcConfiguration

strategy

private final OracleConnectorConfig.LogMiningStrategy strategy

errorHandler

private final ErrorHandler errorHandler

isContinuousMining

private final boolean isContinuousMining

streamingMetrics

private final OracleStreamingChangeEventSourceMetrics streamingMetrics

connectorConfig

private final OracleConnectorConfig connectorConfig

archiveLogRetention

private final Duration archiveLogRetention

archiveLogOnlyMode

private final boolean archiveLogOnlyMode

archiveDestinationName

private final String archiveDestinationName

startScn

private Scn startScn

endScn

private Scn endScn

currentRedoLogSequences

private List<BigInteger> currentRedoLogSequences

Constructor Detail

LogMinerStreamingChangeEventSource

public LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig,
                                          OracleConnection jdbcConnection,
                                          EventDispatcher<TableId> dispatcher,
                                          ErrorHandler errorHandler,
                                          Clock clock,
                                          OracleDatabaseSchema schema,
                                          Configuration jdbcConfig,
                                          OracleStreamingChangeEventSourceMetrics streamingMetrics)

Method Detail

execute

public void execute(ChangeEventSource.ChangeEventSourceContext context,
                    OracleOffsetContext offsetContext)

This is the loop to get changes from LogMiner

Specified by:

execute in interface StreamingChangeEventSource<OracleOffsetContext>

Parameters:

context - change event source context

abandonOldTransactionsIfExist

private void abandonOldTransactionsIfExist(OracleConnection connection,
                                           OracleOffsetContext offsetContext,
                                           TransactionalBuffer transactionalBuffer)

initializeRedoLogsForMining

private void initializeRedoLogsForMining(OracleConnection connection,
                                         boolean postEndMiningSession,
                                         Scn startScn)
                                  throws SQLException

Throws:

SQLException

hasLogSwitchOccurred

private boolean hasLogSwitchOccurred()
                              throws SQLException

Checks whether a database log switch has occurred and updates metrics if so.

Returns:

true if a log switch was detected, otherwise false

Throws:

SQLException - if a database exception occurred

getCurrentRedoLogSequences

private List<BigInteger> getCurrentRedoLogSequences()
                                             throws SQLException

Get the current redo log sequence(s). In an Oracle RAC environment, there are multiple current redo logs and therefore this method returns multiple values, each relating to a single RAC node in the Oracle cluster.

Returns:

list of sequence numbers

Throws:

SQLException - if a database exception occurred

pauseBetweenMiningSessions

private void pauseBetweenMiningSessions()
                                 throws InterruptedException

Throws:

InterruptedException

waitForStartScnInArchiveLogs

private boolean waitForStartScnInArchiveLogs(ChangeEventSource.ChangeEventSourceContext context,
                                             Scn startScn)
                                      throws SQLException,
                                             InterruptedException

Waits for the starting system change number to exist in the archive logs before returning.

Parameters:

context - the change event source context

startScn - the starting system change number

Returns:

true if the code should continue, false if the code should end.

Throws:

SQLException - if a database exception occurred

InterruptedException - if the pause between checks is interrupted

isStartScnInArchiveLogs

private boolean isStartScnInArchiveLogs(Scn startScn)
                                 throws SQLException

Returns whether the starting system change number is in the archive logs.

Parameters:

startScn - the starting system change number

Returns:

true if the starting system change number is in the archive logs; false otherwise.

Throws:

SQLException - if a database exception occurred

commitOffset

public void commitOffset(Map<String,?> offset)

Specified by:

commitOffset in interface StreamingChangeEventSource<OracleOffsetContext>