io.debezium.connector.oracle.logminer

Class SqlUtils

java.lang.Object

io.debezium.connector.oracle.logminer.SqlUtils

public class SqlUtils
extends Object

This utility class contains SQL statements to configure, manage and query Oracle LogMiner todo handle INVALID file member (report somehow and continue to work with valid file), handle adding multiplexed files, todo SELECT name, value FROM v$sysstat WHERE name = 'redo wastage'; todo SELECT GROUP#, STATUS, MEMBER FROM V$LOGFILE WHERE STATUS='INVALID'; (drop and recreate? or do it manually?) todo table level supplemental logging todo When you use the SKIP_CORRUPTION option to DBMS_LOGMNR.START_LOGMNR, any corruptions in the redo log files are skipped during select operations from the V$LOGMNR_CONTENTS view. todo if file is compressed? // For every corrupt redo record encountered, // a row is returned that contains the value CORRUPTED_BLOCKS in the OPERATION column, 1343 in the STATUS column, and the number of blocks skipped in the INFO column.

Field Summary

Fields

Modifier and Type	Field and Description
private static String	ALL_LOG_GROUPS
private static String	ARCHIVE_DEST_STATUS_VIEW
private static String	ARCHIVED_LOG_VIEW
(package private) static String	BUILD_DICTIONARY
(package private) static String	CREATE_FLUSH_TABLE
(package private) static String	CREATE_LOGMINING_HISTORY_SEQUENCE
(package private) static String	CURRENT_TIMESTAMP
private static String	DATABASE_VIEW
(package private) static String	END_LOGMNR
(package private) static String	FILES_FOR_MINING Querying V$LOGMNR_LOGS After a successful call to DBMS_LOGMNR.START_LOGMNR, the STATUS column of the V$LOGMNR_LOGS view contains one of the following values: 0 Indicates that the redo log file will be processed during a query of the V$LOGMNR_CONTENTS view.
(package private) static String	FLUSH_TABLE_NOT_EMPTY
(package private) static String	INSERT_FLUSH_TABLE
(package private) static String	INSERT_INTO_TEMP_HISTORY_TABLE_STMT
private static String	LOG_VIEW
private static String	LOGFILE_VIEW
private static org.slf4j.Logger	LOGGER
(package private) static String	LOGMINING_HISTORY_SEQUENCE_EXISTS
private static String	LOGMNR_CONTENTS_VIEW
static String	LOGMNR_FLUSH_TABLE
private static String	LOGMNR_HISTORY_SEQUENCE
(package private) static String	LOGMNR_HISTORY_TABLE_PREFIX
(package private) static String	LOGMNR_HISTORY_TEMP_TABLE
(package private) static String	NLS_SESSION_PARAMETERS
(package private) static String	UPDATE_FLUSH_TABLE

Constructor Summary

Constructors

Constructor and Description
SqlUtils()

Method Summary

Modifier and Type	Method and Description
(package private) static String	addLogFileStatement(String option, String fileName)
static String	allOnlineLogsQuery()
static String	archiveLogsQuery(Scn scn, Duration archiveLogRetention) Obtain the query to be used to fetch archive logs.
static String	buildHistoryTableName(LocalDateTime now)
private static String	buildSchemaPredicate(OracleConnectorConfig connectorConfig)
private static String	buildTablePredicate(OracleConnectorConfig connectorConfig)
(package private) static String	bulkHistoryInsertStmt(String currentHistoryTableName)
static boolean	connectionProblem(Throwable e)
(package private) static String	currentRedoNameQuery()
(package private) static String	currentScnQuery()
(package private) static String	databaseSupplementalLoggingAllCheckQuery()
(package private) static String	databaseSupplementalLoggingMinCheckQuery()
(package private) static String	deleteLogFileStatement(String fileName)
static String	diffInDaysQuery(Long scn) This method return query which converts given SCN in days and deduct from the current day
(package private) static String	dropHistoryTableStatement(String tableName)
(package private) static String	getHistoryTableNamesQuery()
private static String	listOfPatternsToSql(List<Pattern> patterns, String columnName, boolean applyNot)
(package private) static String	logMinerContentsQuery(OracleConnectorConfig connectorConfig, String logMinerUser) This is the query from the LogMiner view to get changes.
(package private) static String	logMiningHistoryDdl(String tableName)
(package private) static String	oldestFirstChangeQuery(Duration archiveLogRetention)
static long	parseRetentionFromName(String historyTableName)
(package private) static String	redoLogStatusQuery()
private static String	resolveRegExpLikePattern(Pattern pattern)
(package private) static void	setRac(boolean isRac)
(package private) static String	startLogMinerStatement(Scn startScn, Scn endScn, OracleConnectorConfig.LogMiningStrategy strategy, boolean isContinuousMining) This returns statement to build LogMiner view for online redo log files
(package private) static String	switchHistoryQuery()
(package private) static String	tableExistsQuery(String tableName)
(package private) static String	tableSupplementalLoggingCheckQuery(TableId tableId)
(package private) static String	truncateTableStatement(String tableName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DATABASE_VIEW

private static final String DATABASE_VIEW

See Also:

Constant Field Values

LOG_VIEW

private static final String LOG_VIEW

See Also:

Constant Field Values

LOGFILE_VIEW

private static final String LOGFILE_VIEW

See Also:

Constant Field Values

ARCHIVED_LOG_VIEW

private static final String ARCHIVED_LOG_VIEW

See Also:

Constant Field Values

ARCHIVE_DEST_STATUS_VIEW

private static final String ARCHIVE_DEST_STATUS_VIEW

See Also:

Constant Field Values

LOGMNR_CONTENTS_VIEW

private static final String LOGMNR_CONTENTS_VIEW

See Also:

Constant Field Values

ALL_LOG_GROUPS

private static final String ALL_LOG_GROUPS

See Also:

Constant Field Values

BUILD_DICTIONARY

static final String BUILD_DICTIONARY

See Also:

Constant Field Values

CURRENT_TIMESTAMP

static final String CURRENT_TIMESTAMP

See Also:

Constant Field Values

END_LOGMNR

static final String END_LOGMNR

See Also:

Constant Field Values

FILES_FOR_MINING

static final String FILES_FOR_MINING

Querying V$LOGMNR_LOGS After a successful call to DBMS_LOGMNR.START_LOGMNR, the STATUS column of the V$LOGMNR_LOGS view contains one of the following values: 0 Indicates that the redo log file will be processed during a query of the V$LOGMNR_CONTENTS view. 1 Indicates that this will be the first redo log file to be processed by LogMiner during a select operation against the V$LOGMNR_CONTENTS view. 2 Indicates that the redo log file has been pruned and therefore will not be processed by LogMiner during a query of the V$LOGMNR_CONTENTS view. It has been pruned because it is not needed to satisfy your requested time or SCN range. 4 Indicates that a redo log file (based on sequence number) is missing from the LogMiner redo log file list.

See Also:

Constant Field Values

LOGMNR_FLUSH_TABLE

public static final String LOGMNR_FLUSH_TABLE

See Also:

Constant Field Values

FLUSH_TABLE_NOT_EMPTY

static final String FLUSH_TABLE_NOT_EMPTY

See Also:

Constant Field Values

CREATE_FLUSH_TABLE

static final String CREATE_FLUSH_TABLE

See Also:

Constant Field Values

INSERT_FLUSH_TABLE

static final String INSERT_FLUSH_TABLE

See Also:

Constant Field Values

UPDATE_FLUSH_TABLE

static final String UPDATE_FLUSH_TABLE

See Also:

Constant Field Values

LOGMNR_HISTORY_TEMP_TABLE

static final String LOGMNR_HISTORY_TEMP_TABLE

See Also:

Constant Field Values

LOGMNR_HISTORY_TABLE_PREFIX

static final String LOGMNR_HISTORY_TABLE_PREFIX

See Also:

Constant Field Values

LOGMNR_HISTORY_SEQUENCE

private static final String LOGMNR_HISTORY_SEQUENCE

See Also:

Constant Field Values

CREATE_LOGMINING_HISTORY_SEQUENCE

static final String CREATE_LOGMINING_HISTORY_SEQUENCE

See Also:

Constant Field Values

LOGMINING_HISTORY_SEQUENCE_EXISTS

static final String LOGMINING_HISTORY_SEQUENCE_EXISTS

See Also:

Constant Field Values

INSERT_INTO_TEMP_HISTORY_TABLE_STMT

static final String INSERT_INTO_TEMP_HISTORY_TABLE_STMT

See Also:

Constant Field Values

NLS_SESSION_PARAMETERS

static final String NLS_SESSION_PARAMETERS

See Also:

Constant Field Values

LOGGER

private static final org.slf4j.Logger LOGGER

Constructor Detail

SqlUtils

public SqlUtils()

Method Detail

setRac

static void setRac(boolean isRac)

redoLogStatusQuery

static String redoLogStatusQuery()

switchHistoryQuery

static String switchHistoryQuery()

currentRedoNameQuery

static String currentRedoNameQuery()

databaseSupplementalLoggingAllCheckQuery

static String databaseSupplementalLoggingAllCheckQuery()

databaseSupplementalLoggingMinCheckQuery

static String databaseSupplementalLoggingMinCheckQuery()

tableSupplementalLoggingCheckQuery

static String tableSupplementalLoggingCheckQuery(TableId tableId)

currentScnQuery

static String currentScnQuery()

oldestFirstChangeQuery

static String oldestFirstChangeQuery(Duration archiveLogRetention)

allOnlineLogsQuery

public static String allOnlineLogsQuery()

archiveLogsQuery

public static String archiveLogsQuery(Scn scn,
                                      Duration archiveLogRetention)

Obtain the query to be used to fetch archive logs.

Parameters:

scn - oldest scn to search for

archiveLogRetention - duration archive logs will be mined

Returns:

query

startLogMinerStatement

static String startLogMinerStatement(Scn startScn,
                                     Scn endScn,
                                     OracleConnectorConfig.LogMiningStrategy strategy,
                                     boolean isContinuousMining)

This returns statement to build LogMiner view for online redo log files

Parameters:

startScn - mine from

endScn - mine till

strategy - Log Mining strategy

Returns:

statement todo: handle corruption. STATUS (Double) — value of 0 indicates it is executable

logMinerContentsQuery

static String logMinerContentsQuery(OracleConnectorConfig connectorConfig,
                                    String logMinerUser)

This is the query from the LogMiner view to get changes. The query uses the following columns from the view:

 SCN - The SCN at which a change was made
 SQL_REDO Reconstructed SQL statement that is equivalent to the original SQL statement that made the change
 OPERATION_CODE - Number of the operation code
 TIMESTAMP - Timestamp when the database change was made
 XID - Transaction Identifier
 CSF - Continuation SQL flag, identifies rows that should be processed together as a single row (0=no,1=yes)
 TABLE_NAME - Name of the modified table
 SEG_OWNER - Schema/Tablespace name
 OPERATION - Database operation type
 USERNAME - Name of the user who executed the transaction
 

Parameters:

connectorConfig - the connector configuration

logMinerUser - log mining session user name

Returns:

the query

buildSchemaPredicate

private static String buildSchemaPredicate(OracleConnectorConfig connectorConfig)

buildTablePredicate

private static String buildTablePredicate(OracleConnectorConfig connectorConfig)

listOfPatternsToSql

private static String listOfPatternsToSql(List<Pattern> patterns,
                                          String columnName,
                                          boolean applyNot)

resolveRegExpLikePattern

private static String resolveRegExpLikePattern(Pattern pattern)

addLogFileStatement

static String addLogFileStatement(String option,
                                  String fileName)

deleteLogFileStatement

static String deleteLogFileStatement(String fileName)

tableExistsQuery

static String tableExistsQuery(String tableName)

getHistoryTableNamesQuery

static String getHistoryTableNamesQuery()

dropHistoryTableStatement

static String dropHistoryTableStatement(String tableName)

logMiningHistoryDdl

static String logMiningHistoryDdl(String tableName)

truncateTableStatement

static String truncateTableStatement(String tableName)

bulkHistoryInsertStmt

static String bulkHistoryInsertStmt(String currentHistoryTableName)

diffInDaysQuery

public static String diffInDaysQuery(Long scn)

This method return query which converts given SCN in days and deduct from the current day

connectionProblem

public static boolean connectionProblem(Throwable e)

buildHistoryTableName

public static String buildHistoryTableName(LocalDateTime now)

parseRetentionFromName

public static long parseRetentionFromName(String historyTableName)