Package io.debezium.connector.oracle.logminer

Class LogMinerAdapter

java.lang.Object

io.debezium.connector.oracle.AbstractStreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

io.debezium.connector.oracle.logminer.LogMinerAdapter

All Implemented Interfaces:

StreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

public class LogMinerAdapter
extends AbstractStreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

Author:

Chris Cranford

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.connector.oracle.StreamingAdapter

StreamingAdapter.TableNameCaseSensitivity

Field Summary

Fields

Modifier and Type	Field	Description
private static final int	GET_TRANSACTION_SCN_ATTEMPTS
private static final Duration	GET_TRANSACTION_SCN_PAUSE
private static final org.slf4j.Logger	LOGGER
static final String	TYPE

Fields inherited from class io.debezium.connector.oracle.AbstractStreamingAdapter

connectorConfig

Constructor Summary

Constructors

Constructor	Description
LogMinerAdapter(OracleConnectorConfig connectorConfig)

Method Summary

Modifier and Type	Method	Description
private void	addLogsToSession(List<LogFile> logs, OracleConnection connection)
OracleOffsetContext	copyOffset(OracleConnectorConfig connectorConfig, OracleOffsetContext offsetContext)	Creates a copy of the existing offsets.
private OracleOffsetContext	determineSnapshotOffset(OracleConnectorConfig connectorConfig, OracleConnection connection, Scn currentScn, Map<String,Scn> pendingTransactions, String transactionTableName)
OracleOffsetContext	determineSnapshotOffset(RelationalSnapshotChangeEventSource.RelationalSnapshotContext<OraclePartition,OracleOffsetContext> ctx, OracleConnectorConfig connectorConfig, OracleConnection connection)	Returns the offset context based on the snapshot state.
private Optional<Scn>	getCurrentScn(Scn latestTableDdlScn, OracleConnection connection)
HistoryRecordComparator	getHistoryRecordComparator()
private List<LogFile>	getMostRecentLogFilesForSearch(List<LogFile> allLogFiles)
OffsetContext.Loader<OracleOffsetContext>	getOffsetContextLoader()
Scn	getOffsetScn(OracleOffsetContext offsetContext)	Returns the Scn stored in the offset.
private Scn	getOldestScnAvailableInLogs(OracleConnectorConfig config, OracleConnection connection)
private List<LogFile>	getOrderedLogsFromScn(OracleConnectorConfig config, Scn sinceScn, OracleConnection connection)
private Optional<Scn>	getPendingTransactions(Scn latestTableDdlScn, OracleConnection connection, Map<String,Scn> transactions, String transactionTableName)
private void	getPendingTransactionsFromLogs(OracleConnection connection, Scn currentScn, Map<String,Scn> pendingTransactions)
StreamingChangeEventSource<OraclePartition,OracleOffsetContext>	getSource(OracleConnection connection, EventDispatcher<OraclePartition,TableId> dispatcher, ErrorHandler errorHandler, Clock clock, OracleDatabaseSchema schema, OracleTaskContext taskContext, Configuration jdbcConfig, LogMinerStreamingChangeEventSourceMetrics streamingMetrics, SnapshotterService snapshotterService)
LogMinerStreamingChangeEventSourceMetrics	getStreamingMetrics(OracleTaskContext taskContext, ChangeEventQueueMetrics changeEventQueueMetrics, EventMetadataProvider metadataProvider, OracleConnectorConfig connectorConfig)
private static String	getTransactionTableName(OracleConnectorConfig config)	Under Oracle RAC, the V$ tables are specific the node that the JDBC connection is established to and not every V$ is synchronized across the cluster.
String	getType()
private boolean	isPendingTransactionSkip(OracleConnectorConfig config)
boolean	isPendingTransactionViewOnly(OracleConnectorConfig config)
private void	startSession(OracleConnection connection)
private void	stopSession(OracleConnection connection)

Methods inherited from class io.debezium.connector.oracle.AbstractStreamingAdapter

areSameTimestamp, getLatestTableDdlScn, resolveScn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.connector.oracle.StreamingAdapter

getTableNameCaseSensitivity, getValueConverter

Field Details

GET_TRANSACTION_SCN_PAUSE

private static final Duration GET_TRANSACTION_SCN_PAUSE

GET_TRANSACTION_SCN_ATTEMPTS

private static final int GET_TRANSACTION_SCN_ATTEMPTS

See Also:

• Constant Field Values

LOGGER

private static final org.slf4j.Logger LOGGER

TYPE

public static final String TYPE

See Also:

• Constant Field Values

Constructor Details

LogMinerAdapter

public LogMinerAdapter(OracleConnectorConfig connectorConfig)

Method Details

getType

public String getType()

getHistoryRecordComparator

public HistoryRecordComparator getHistoryRecordComparator()

getOffsetContextLoader

public OffsetContext.Loader<OracleOffsetContext> getOffsetContextLoader()

getSource

public StreamingChangeEventSource<OraclePartition,OracleOffsetContext> getSource(OracleConnection connection,
 EventDispatcher<OraclePartition,TableId> dispatcher,
 ErrorHandler errorHandler,
 Clock clock,
 OracleDatabaseSchema schema,
 OracleTaskContext taskContext,
 Configuration jdbcConfig,
 LogMinerStreamingChangeEventSourceMetrics streamingMetrics,
 SnapshotterService snapshotterService)

getStreamingMetrics

public LogMinerStreamingChangeEventSourceMetrics getStreamingMetrics(OracleTaskContext taskContext,
 ChangeEventQueueMetrics changeEventQueueMetrics,
 EventMetadataProvider metadataProvider,
 OracleConnectorConfig connectorConfig)

determineSnapshotOffset

public OracleOffsetContext determineSnapshotOffset(RelationalSnapshotChangeEventSource.RelationalSnapshotContext<OraclePartition,OracleOffsetContext> ctx,
 OracleConnectorConfig connectorConfig,
 OracleConnection connection)
                                            throws SQLException

Description copied from interface: StreamingAdapter

Returns the offset context based on the snapshot state.

Parameters:

ctx - the relational snapshot context, should never be null

connectorConfig - the connector configuration, should never be null

connection - the database connection, should never be null

Returns:

the offset context, never null

Throws:

SQLException - if a database error occurred

getOffsetScn

public Scn getOffsetScn(OracleOffsetContext offsetContext)

Description copied from interface: StreamingAdapter

Returns the Scn stored in the offset.

Parameters:

offsetContext - the connector offset context

Returns:

the Scn stored in the offset

copyOffset

public OracleOffsetContext copyOffset(OracleConnectorConfig connectorConfig,
 OracleOffsetContext offsetContext)

Description copied from interface: StreamingAdapter

Creates a copy of the existing offsets.

Parameters:

connectorConfig - the connector configuration, should never be null

offsetContext - the current offset context, should never be null

Returns:

a copy of the offset context for this adapter

getCurrentScn

private Optional<Scn> getCurrentScn(Scn latestTableDdlScn,
 OracleConnection connection)
                             throws SQLException

Throws:

SQLException

getPendingTransactions

private Optional<Scn> getPendingTransactions(Scn latestTableDdlScn,
 OracleConnection connection,
 Map<String,Scn> transactions,
 String transactionTableName)
                                      throws SQLException

Throws:

SQLException

determineSnapshotOffset

private OracleOffsetContext determineSnapshotOffset(OracleConnectorConfig connectorConfig,
 OracleConnection connection,
 Scn currentScn,
 Map<String,Scn> pendingTransactions,
 String transactionTableName)
                                             throws SQLException

Throws:

SQLException

addLogsToSession

private void addLogsToSession(List<LogFile> logs,
 OracleConnection connection)
                       throws SQLException

Throws:

SQLException

startSession

private void startSession(OracleConnection connection)
                   throws SQLException

Throws:

SQLException

stopSession

private void stopSession(OracleConnection connection)
                  throws SQLException

Throws:

SQLException

getOldestScnAvailableInLogs

private Scn getOldestScnAvailableInLogs(OracleConnectorConfig config,
 OracleConnection connection)
                                 throws SQLException

Throws:

SQLException

getOrderedLogsFromScn

private List<LogFile> getOrderedLogsFromScn(OracleConnectorConfig config,
 Scn sinceScn,
 OracleConnection connection)
                                     throws SQLException

Throws:

SQLException

getPendingTransactionsFromLogs

private void getPendingTransactionsFromLogs(OracleConnection connection,
 Scn currentScn,
 Map<String,Scn> pendingTransactions)
                                     throws SQLException

Throws:

SQLException

getMostRecentLogFilesForSearch

private List<LogFile> getMostRecentLogFilesForSearch(List<LogFile> allLogFiles)

isPendingTransactionSkip

private boolean isPendingTransactionSkip(OracleConnectorConfig config)

isPendingTransactionViewOnly

public boolean isPendingTransactionViewOnly(OracleConnectorConfig config)

getTransactionTableName

private static String getTransactionTableName(OracleConnectorConfig config)

Under Oracle RAC, the V$ tables are specific the node that the JDBC connection is established to and not every V$ is synchronized across the cluster. Therefore, when Oracle RAC is in play, we should use the GV$ tables instead.

Parameters:

config - the connector configuration, should not be null

Returns:

the pending transaction table name