Package io.debezium.connector.oracle.logminer

Class LogMinerAdapter

java.lang.Object

io.debezium.connector.oracle.AbstractStreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

io.debezium.connector.oracle.logminer.LogMinerAdapter

All Implemented Interfaces:

StreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

public class LogMinerAdapter
extends AbstractStreamingAdapter<LogMinerStreamingChangeEventSourceMetrics>

Author:

Chris Cranford

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.connector.oracle.StreamingAdapter

StreamingAdapter.TableNameCaseSensitivity

Field Summary

Fields

Modifier and Type	Field	Description
private static final int	GET_TRANSACTION_SCN_ATTEMPTS
private static final Duration	GET_TRANSACTION_SCN_PAUSE
private static final org.slf4j.Logger	LOGGER
static final String	TYPE

Fields inherited from class io.debezium.connector.oracle.AbstractStreamingAdapter

connectorConfig

Constructor Summary

Constructors

Constructor	Description
LogMinerAdapter(OracleConnectorConfig connectorConfig)

Method Summary

Modifier and Type	Method	Description
private void	addLogsToSession(List<LogFile> logs, OracleConnection connection)
private OracleOffsetContext	determineSnapshotOffset(OracleConnectorConfig connectorConfig, OracleConnection connection, Scn currentScn, Map<String,Scn> pendingTransactions, String transactionTableName)
OracleOffsetContext	determineSnapshotOffset(RelationalSnapshotChangeEventSource.RelationalSnapshotContext<OraclePartition,OracleOffsetContext> ctx, OracleConnectorConfig connectorConfig, OracleConnection connection)	Returns the offset context based on the snapshot state.
private Optional<Scn>	getCurrentScn(Scn latestTableDdlScn, OracleConnection connection)
HistoryRecordComparator	getHistoryRecordComparator()
private List<LogFile>	getMostRecentLogFilesForSearch(List<LogFile> allLogFiles)
OffsetContext.Loader<OracleOffsetContext>	getOffsetContextLoader()
private Scn	getOldestScnAvailableInLogs(OracleConnectorConfig config, OracleConnection connection)
private List<LogFile>	getOrderedLogsFromScn(OracleConnectorConfig config, Scn sinceScn, OracleConnection connection)
private Optional<Scn>	getPendingTransactions(Scn latestTableDdlScn, OracleConnection connection, Map<String,Scn> transactions, String transactionTableName)
private void	getPendingTransactionsFromLogs(OracleConnection connection, Scn currentScn, Map<String,Scn> pendingTransactions)
StreamingChangeEventSource<OraclePartition,OracleOffsetContext>	getSource(OracleConnection connection, EventDispatcher<OraclePartition,TableId> dispatcher, ErrorHandler errorHandler, Clock clock, OracleDatabaseSchema schema, OracleTaskContext taskContext, Configuration jdbcConfig, LogMinerStreamingChangeEventSourceMetrics streamingMetrics)
LogMinerStreamingChangeEventSourceMetrics	getStreamingMetrics(OracleTaskContext taskContext, ChangeEventQueueMetrics changeEventQueueMetrics, EventMetadataProvider metadataProvider, OracleConnectorConfig connectorConfig)
private static String	getTransactionTableName(OracleConnectorConfig config)	Under Oracle RAC, the V$ tables are specific the node that the JDBC connection is established to and not every V$ is synchronized across the cluster.
String	getType()
private boolean	isPendingTransactionSkip(OracleConnectorConfig config)
boolean	isPendingTransactionViewOnly(OracleConnectorConfig config)
private void	startSession(OracleConnection connection)
private void	stopSession(OracleConnection connection)

Methods inherited from class io.debezium.connector.oracle.AbstractStreamingAdapter

areSameTimestamp, getLatestTableDdlScn, resolveScn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.connector.oracle.StreamingAdapter

getTableNameCaseSensitivity, getValueConverter

Field Details

GET_TRANSACTION_SCN_PAUSE

private static final Duration GET_TRANSACTION_SCN_PAUSE

GET_TRANSACTION_SCN_ATTEMPTS

private static final int GET_TRANSACTION_SCN_ATTEMPTS

See Also:

• Constant Field Values

LOGGER

private static final org.slf4j.Logger LOGGER

TYPE

public static final String TYPE

See Also:

• Constant Field Values

Constructor Details

LogMinerAdapter

public LogMinerAdapter(OracleConnectorConfig connectorConfig)

Method Details

getType

public String getType()

getHistoryRecordComparator

public HistoryRecordComparator getHistoryRecordComparator()

getOffsetContextLoader

public OffsetContext.Loader<OracleOffsetContext> getOffsetContextLoader()

getSource

public StreamingChangeEventSource<OraclePartition,OracleOffsetContext> getSource(OracleConnection connection,
 EventDispatcher<OraclePartition,TableId> dispatcher,
 ErrorHandler errorHandler,
 Clock clock,
 OracleDatabaseSchema schema,
 OracleTaskContext taskContext,
 Configuration jdbcConfig,
 LogMinerStreamingChangeEventSourceMetrics streamingMetrics)

getStreamingMetrics

public LogMinerStreamingChangeEventSourceMetrics getStreamingMetrics(OracleTaskContext taskContext,
 ChangeEventQueueMetrics changeEventQueueMetrics,
 EventMetadataProvider metadataProvider,
 OracleConnectorConfig connectorConfig)

determineSnapshotOffset

public OracleOffsetContext determineSnapshotOffset(RelationalSnapshotChangeEventSource.RelationalSnapshotContext<OraclePartition,OracleOffsetContext> ctx,
 OracleConnectorConfig connectorConfig,
 OracleConnection connection)
                                            throws SQLException

Description copied from interface: StreamingAdapter

Returns the offset context based on the snapshot state.

Parameters:

ctx - the relational snapshot context, should never be null

connectorConfig - the connector configuration, should never be null

connection - the database connection, should never be null

Returns:

the offset context, never null

Throws:

SQLException - if a database error occurred

getCurrentScn

private Optional<Scn> getCurrentScn(Scn latestTableDdlScn,
 OracleConnection connection)
                             throws SQLException

Throws:

SQLException

getPendingTransactions

private Optional<Scn> getPendingTransactions(Scn latestTableDdlScn,
 OracleConnection connection,
 Map<String,Scn> transactions,
 String transactionTableName)
                                      throws SQLException

Throws:

SQLException

determineSnapshotOffset

private OracleOffsetContext determineSnapshotOffset(OracleConnectorConfig connectorConfig,
 OracleConnection connection,
 Scn currentScn,
 Map<String,Scn> pendingTransactions,
 String transactionTableName)
                                             throws SQLException

Throws:

SQLException

addLogsToSession

private void addLogsToSession(List<LogFile> logs,
 OracleConnection connection)
                       throws SQLException

Throws:

SQLException

startSession

private void startSession(OracleConnection connection)
                   throws SQLException

Throws:

SQLException

stopSession

private void stopSession(OracleConnection connection)
                  throws SQLException

Throws:

SQLException

getOldestScnAvailableInLogs

private Scn getOldestScnAvailableInLogs(OracleConnectorConfig config,
 OracleConnection connection)
                                 throws SQLException

Throws:

SQLException

getOrderedLogsFromScn

private List<LogFile> getOrderedLogsFromScn(OracleConnectorConfig config,
 Scn sinceScn,
 OracleConnection connection)
                                     throws SQLException

Throws:

SQLException

getPendingTransactionsFromLogs

private void getPendingTransactionsFromLogs(OracleConnection connection,
 Scn currentScn,
 Map<String,Scn> pendingTransactions)
                                     throws SQLException

Throws:

SQLException

getMostRecentLogFilesForSearch

private List<LogFile> getMostRecentLogFilesForSearch(List<LogFile> allLogFiles)

isPendingTransactionSkip

private boolean isPendingTransactionSkip(OracleConnectorConfig config)

isPendingTransactionViewOnly

public boolean isPendingTransactionViewOnly(OracleConnectorConfig config)

getTransactionTableName

private static String getTransactionTableName(OracleConnectorConfig config)

Under Oracle RAC, the V$ tables are specific the node that the JDBC connection is established to and not every V$ is synchronized across the cluster. Therefore, when Oracle RAC is in play, we should use the GV$ tables instead.

Parameters:

config - the connector configuration, should not be null

Returns:

the pending transaction table name