io.debezium.connector.oracle.logminer

Class SqlUtils

java.lang.Object

io.debezium.connector.oracle.logminer.SqlUtils

public class SqlUtils
extends Object

This utility class contains SQL statements to configure, manage and query Oracle LogMiner todo handle INVALID file member (report somehow and continue to work with valid file), handle adding multiplexed files, todo SELECT name, value FROM v$sysstat WHERE name = 'redo wastage'; todo SELECT GROUP#, STATUS, MEMBER FROM V$LOGFILE WHERE STATUS='INVALID'; (drop and recreate? or do it manually?) todo table level supplemental logging todo When you use the SKIP_CORRUPTION option to DBMS_LOGMNR.START_LOGMNR, any corruptions in the redo log files are skipped during select operations from the V$LOGMNR_CONTENTS view. todo if file is compressed? // For every corrupt redo record encountered, // a row is returned that contains the value CORRUPTED_BLOCKS in the OPERATION column, 1343 in the STATUS column, and the number of blocks skipped in the INFO column.

Field Summary

Fields

Modifier and Type	Field and Description
private static String	ALL_LOG_GROUPS
private static String	ARCHIVE_DEST_STATUS_VIEW
private static String	ARCHIVED_LOG_VIEW
(package private) static String	BUILD_DICTIONARY
(package private) static String	CREATE_FLUSH_TABLE
private static String	DATABASE_VIEW
(package private) static String	END_LOGMNR
(package private) static String	FILES_FOR_MINING Querying V$LOGMNR_LOGS After a successful call to DBMS_LOGMNR.START_LOGMNR, the STATUS column of the V$LOGMNR_LOGS view contains one of the following values: 0 Indicates that the redo log file will be processed during a query of the V$LOGMNR_CONTENTS view.
(package private) static String	FLUSH_TABLE_NOT_EMPTY
(package private) static String	INSERT_FLUSH_TABLE
private static String	LOG_VIEW
private static String	LOGFILE_VIEW
private static org.slf4j.Logger	LOGGER
private static String	LOGMNR_CONTENTS_VIEW
static String	LOGMNR_FLUSH_TABLE
(package private) static String	NLS_SESSION_PARAMETERS
(package private) static String	SELECT_SYSTIMESTAMP
(package private) static String	UPDATE_FLUSH_TABLE

Constructor Summary

Constructors

Constructor and Description
SqlUtils()

Method Summary

Modifier and Type	Method and Description
(package private) static String	addLogFileStatement(String option, String fileName)
static String	allOnlineLogsQuery()
static String	archiveLogsQuery(Scn scn, Duration archiveLogRetention) Obtain the query to be used to fetch archive logs.
private static String	buildSchemaPredicate(OracleConnectorConfig connectorConfig)
private static String	buildTablePredicate(OracleConnectorConfig connectorConfig)
static boolean	connectionProblem(Throwable e)
(package private) static String	currentRedoLogSequenceQuery()
(package private) static String	currentRedoNameQuery()
(package private) static String	currentScnQuery()
(package private) static String	databaseSupplementalLoggingAllCheckQuery()
(package private) static String	databaseSupplementalLoggingMinCheckQuery()
(package private) static String	deleteLogFileStatement(String fileName)
static String	diffInDaysQuery(Scn scn) This method return query which converts given SCN in days and deduct from the current day
(package private) static String	dropTableStatement(String tableName)
private static String	getExcludedUsers(String logMinerUser)
private static String	listOfPatternsToSql(List<Pattern> patterns, String columnName, boolean applyNot)
private static String	localArchiveLogDestinationsOnlyQuery() Returns a SQL predicate clause that should be applied to any ARCHIVED_LOG_VIEW queries so that the results are filtered to only include the local destinations and not those that may be generated by tools such as Oracle Data Guard.
(package private) static String	logMinerContentsQuery(OracleConnectorConfig connectorConfig, String logMinerUser) This is the query from the LogMiner view to get changes.
(package private) static String	logMiningHistoryDdl(String tableName)
(package private) static String	oldestFirstChangeQuery(Duration archiveLogRetention)
static long	parseRetentionFromName(String historyTableName)
(package private) static String	redoLogStatusQuery()
private static String	resolveRegExpLikePattern(Pattern pattern)
(package private) static void	setRac(boolean isRac)
(package private) static String	startLogMinerStatement(Scn startScn, Scn endScn, OracleConnectorConfig.LogMiningStrategy strategy, boolean isContinuousMining) This returns statement to build LogMiner view for online redo log files
(package private) static String	switchHistoryQuery()
(package private) static String	tableExistsQuery(String tableName)
(package private) static String	tableSupplementalLoggingCheckQuery(TableId tableId)
(package private) static String	truncateTableStatement(String tableName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATABASE_VIEW

private static final String DATABASE_VIEW

See Also:

Constant Field Values

LOG_VIEW

private static final String LOG_VIEW

See Also:

Constant Field Values

LOGFILE_VIEW

private static final String LOGFILE_VIEW

See Also:

Constant Field Values

ARCHIVED_LOG_VIEW

private static final String ARCHIVED_LOG_VIEW

See Also:

Constant Field Values

ARCHIVE_DEST_STATUS_VIEW

private static final String ARCHIVE_DEST_STATUS_VIEW

See Also:

Constant Field Values

LOGMNR_CONTENTS_VIEW

private static final String LOGMNR_CONTENTS_VIEW

See Also:

Constant Field Values

ALL_LOG_GROUPS

private static final String ALL_LOG_GROUPS

See Also:

Constant Field Values

BUILD_DICTIONARY

static final String BUILD_DICTIONARY

See Also:

Constant Field Values

SELECT_SYSTIMESTAMP

static final String SELECT_SYSTIMESTAMP

See Also:

Constant Field Values

END_LOGMNR

static final String END_LOGMNR

See Also:

Constant Field Values

FILES_FOR_MINING

static final String FILES_FOR_MINING

Querying V$LOGMNR_LOGS After a successful call to DBMS_LOGMNR.START_LOGMNR, the STATUS column of the V$LOGMNR_LOGS view contains one of the following values: 0 Indicates that the redo log file will be processed during a query of the V$LOGMNR_CONTENTS view. 1 Indicates that this will be the first redo log file to be processed by LogMiner during a select operation against the V$LOGMNR_CONTENTS view. 2 Indicates that the redo log file has been pruned and therefore will not be processed by LogMiner during a query of the V$LOGMNR_CONTENTS view. It has been pruned because it is not needed to satisfy your requested time or SCN range. 4 Indicates that a redo log file (based on sequence number) is missing from the LogMiner redo log file list.

See Also:

Constant Field Values

LOGMNR_FLUSH_TABLE

public static final String LOGMNR_FLUSH_TABLE

See Also:

Constant Field Values

FLUSH_TABLE_NOT_EMPTY

static final String FLUSH_TABLE_NOT_EMPTY

See Also:

Constant Field Values

CREATE_FLUSH_TABLE

static final String CREATE_FLUSH_TABLE

See Also:

Constant Field Values

INSERT_FLUSH_TABLE

static final String INSERT_FLUSH_TABLE

See Also:

Constant Field Values

UPDATE_FLUSH_TABLE

static final String UPDATE_FLUSH_TABLE

See Also:

Constant Field Values

NLS_SESSION_PARAMETERS

static final String NLS_SESSION_PARAMETERS

See Also:

Constant Field Values

LOGGER

private static final org.slf4j.Logger LOGGER

Constructor Detail

SqlUtils

public SqlUtils()

Method Detail

setRac

static void setRac(boolean isRac)

redoLogStatusQuery

static String redoLogStatusQuery()

switchHistoryQuery

static String switchHistoryQuery()

currentRedoNameQuery

static String currentRedoNameQuery()

currentRedoLogSequenceQuery

static String currentRedoLogSequenceQuery()

databaseSupplementalLoggingAllCheckQuery

static String databaseSupplementalLoggingAllCheckQuery()

databaseSupplementalLoggingMinCheckQuery

static String databaseSupplementalLoggingMinCheckQuery()

tableSupplementalLoggingCheckQuery

static String tableSupplementalLoggingCheckQuery(TableId tableId)

currentScnQuery

static String currentScnQuery()

oldestFirstChangeQuery

static String oldestFirstChangeQuery(Duration archiveLogRetention)

allOnlineLogsQuery

public static String allOnlineLogsQuery()

archiveLogsQuery

public static String archiveLogsQuery(Scn scn,
                                      Duration archiveLogRetention)

Obtain the query to be used to fetch archive logs.

Parameters:

scn - oldest scn to search for

archiveLogRetention - duration archive logs will be mined

Returns:

query

localArchiveLogDestinationsOnlyQuery

private static String localArchiveLogDestinationsOnlyQuery()

Returns a SQL predicate clause that should be applied to any ARCHIVED_LOG_VIEW queries so that the results are filtered to only include the local destinations and not those that may be generated by tools such as Oracle Data Guard.

startLogMinerStatement

static String startLogMinerStatement(Scn startScn,
                                     Scn endScn,
                                     OracleConnectorConfig.LogMiningStrategy strategy,
                                     boolean isContinuousMining)

This returns statement to build LogMiner view for online redo log files

Parameters:

startScn - mine from

endScn - mine till

strategy - Log Mining strategy

Returns:

statement todo: handle corruption. STATUS (Double) — value of 0 indicates it is executable

logMinerContentsQuery

static String logMinerContentsQuery(OracleConnectorConfig connectorConfig,
                                    String logMinerUser)

This is the query from the LogMiner view to get changes. The query uses the following columns from the view:

 SCN - The SCN at which a change was made
 SQL_REDO Reconstructed SQL statement that is equivalent to the original SQL statement that made the change
 OPERATION_CODE - Number of the operation code
 TIMESTAMP - Timestamp when the database change was made
 XID - Transaction Identifier
 CSF - Continuation SQL flag, identifies rows that should be processed together as a single row (0=no,1=yes)
 TABLE_NAME - Name of the modified table
 SEG_OWNER - Schema/Tablespace name
 OPERATION - Database operation type
 USERNAME - Name of the user who executed the transaction
 

Parameters:

connectorConfig - the connector configuration

logMinerUser - log mining session user name

Returns:

the query

getExcludedUsers

private static String getExcludedUsers(String logMinerUser)

buildSchemaPredicate

private static String buildSchemaPredicate(OracleConnectorConfig connectorConfig)

buildTablePredicate

private static String buildTablePredicate(OracleConnectorConfig connectorConfig)

listOfPatternsToSql

private static String listOfPatternsToSql(List<Pattern> patterns,
                                          String columnName,
                                          boolean applyNot)

resolveRegExpLikePattern

private static String resolveRegExpLikePattern(Pattern pattern)

addLogFileStatement

static String addLogFileStatement(String option,
                                  String fileName)

deleteLogFileStatement

static String deleteLogFileStatement(String fileName)

tableExistsQuery

static String tableExistsQuery(String tableName)

dropTableStatement

static String dropTableStatement(String tableName)

logMiningHistoryDdl

static String logMiningHistoryDdl(String tableName)

truncateTableStatement

static String truncateTableStatement(String tableName)

diffInDaysQuery

public static String diffInDaysQuery(Scn scn)

This method return query which converts given SCN in days and deduct from the current day

connectionProblem

public static boolean connectionProblem(Throwable e)

parseRetentionFromName

public static long parseRetentionFromName(String historyTableName)