io.debezium.relational

Class RelationalDatabaseConnectorConfig

java.lang.Object

io.debezium.config.CommonConnectorConfig

io.debezium.relational.RelationalDatabaseConnectorConfig

Direct Known Subclasses:

HistorizedRelationalDatabaseConnectorConfig

public abstract class RelationalDatabaseConnectorConfig
extends CommonConnectorConfig

Configuration options shared across the relational CDC connectors.

Author:

Gunnar Morling

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RelationalDatabaseConnectorConfig.DecimalHandlingMode The set of predefined DecimalHandlingMode options or aliases.

Nested classes/interfaces inherited from class io.debezium.config.CommonConnectorConfig

CommonConnectorConfig.BinaryHandlingMode, CommonConnectorConfig.EventProcessingFailureHandlingMode, CommonConnectorConfig.Version

Field Summary

Fields

Modifier and Type	Field and Description
static Field	COLUMN_BLACKLIST A comma-separated list of regular expressions that match fully-qualified names of columns to be excluded from monitoring and change messages.
static Field	COLUMN_WHITELIST A comma-separated list of regular expressions that match fully-qualified names of columns to be excluded from monitoring and change messages.
protected static ConfigDefinition	CONFIG_DEFINITION
static Field	DECIMAL_HANDLING_MODE
static long	DEFAULT_SNAPSHOT_LOCK_TIMEOUT_MILLIS
static Field	INCLUDE_SCHEMA_CHANGES
private Key.KeyMapper	keyMapper
static Field	MASK_COLUMN
static Field	MASK_COLUMN_WITH_HASH
static Field	MSG_KEY_COLUMNS
private static Pattern	MSG_KEY_COLUMNS_PATTERN
static Field	SCHEMA_BLACKLIST A comma-separated list of regular expressions that match schema names to be excluded from monitoring.
static Field	SCHEMA_WHITELIST A comma-separated list of regular expressions that match schema names to be monitored.
static Field	SERVER_NAME
static Field	SNAPSHOT_LOCK_TIMEOUT_MS
static Field	SNAPSHOT_SELECT_STATEMENT_OVERRIDES_BY_TABLE
static Field	TABLE_BLACKLIST A comma-separated list of regular expressions that match the fully-qualified names of tables to be excluded from monitoring.
protected static String	TABLE_BLACKLIST_NAME
static Field	TABLE_IGNORE_BUILTIN
static Field	TABLE_WHITELIST A comma-separated list of regular expressions that match the fully-qualified names of tables to be monitored.
protected static String	TABLE_WHITELIST_NAME
private RelationalTableFilters	tableFilters
private Selectors.TableIdToStringMapper	tableIdMapper
private TemporalPrecisionMode	temporalPrecisionMode
static Field	TIME_PRECISION_MODE
static Field	TRUNCATE_COLUMN

Fields inherited from class io.debezium.config.CommonConnectorConfig

BINARY_HANDLING_MODE, CUSTOM_CONVERTERS, DATABASE_CONFIG_PREFIX, DEFAULT_MAX_BATCH_SIZE, DEFAULT_MAX_QUEUE_SIZE, DEFAULT_POLL_INTERVAL_MILLIS, EVENT_PROCESSING_FAILURE_HANDLING_MODE, MAX_BATCH_SIZE, MAX_QUEUE_SIZE, POLL_INTERVAL_MS, PROVIDE_TRANSACTION_METADATA, SANITIZE_FIELD_NAMES, SKIPPED_OPERATIONS, SNAPSHOT_DELAY_MS, SNAPSHOT_FETCH_SIZE, SOURCE_STRUCT_MAKER_VERSION, TOMBSTONES_ON_DELETE

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	RelationalDatabaseConnectorConfig(Configuration config, String logicalName, Tables.TableFilter systemTablesFilter, Selectors.TableIdToStringMapper tableIdMapper, int defaultSnapshotFetchSize)

Method Summary

Modifier and Type	Method and Description
JdbcValueConverters.DecimalMode	getDecimalMode() Returns the Decimal mode Enum for decimal.handling.mode configuration.
Key.KeyMapper	getKeyMapper()
Map<TableId,String>	getSnapshotSelectOverridesByTable() Returns any SELECT overrides, if present.
RelationalTableFilters	getTableFilters()
Selectors.TableIdToStringMapper	getTableIdMapper()
TemporalPrecisionMode	getTemporalPrecisionMode() Returns the temporal precision mode mode Enum for time.precision.mode configuration.
boolean	isSchemaChangesHistoryEnabled()
Duration	snapshotLockTimeout()
private static int	validateColumnBlacklist(Configuration config, Field field, Field.ValidationOutput problems)
private static int	validateMessageKeyColumnsField(Configuration config, Field field, Field.ValidationOutput problems)
private static int	validateSchemaBlacklist(Configuration config, Field field, Field.ValidationOutput problems)
private static int	validateTableBlacklist(Configuration config, Field field, Field.ValidationOutput problems)

Methods inherited from class io.debezium.config.CommonConnectorConfig

binaryHandlingMode, customConverterRegistry, getConfig, getConnectorName, getContextName, getEventProcessingFailureHandlingMode, getHeartbeatTopicsPrefix, getLogicalName, getMaxBatchSize, getMaxQueueSize, getPollInterval, getSanitizeFieldNames, getSkippedOps, getSnapshotDelay, getSnapshotFetchSize, getSourceInfoStructMaker, getSourceInfoStructMaker, isEmitTombstoneOnDelete, shouldProvideTransactionMetadata, validateServerNameIsDifferentFromHistoryTopicName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TABLE_BLACKLIST_NAME

protected static final String TABLE_BLACKLIST_NAME

See Also:

Constant Field Values

TABLE_WHITELIST_NAME

protected static final String TABLE_WHITELIST_NAME

See Also:

Constant Field Values

MSG_KEY_COLUMNS_PATTERN

private static final Pattern MSG_KEY_COLUMNS_PATTERN

DEFAULT_SNAPSHOT_LOCK_TIMEOUT_MILLIS

public static final long DEFAULT_SNAPSHOT_LOCK_TIMEOUT_MILLIS

SERVER_NAME

public static final Field SERVER_NAME

TABLE_WHITELIST

public static final Field TABLE_WHITELIST

A comma-separated list of regular expressions that match the fully-qualified names of tables to be monitored. Fully-qualified names for tables are of the form <databaseName>.<tableName> or <databaseName>.<schemaName>.<tableName>. May not be used with TABLE_BLACKLIST, and superseded by database inclusions/exclusions.

TABLE_BLACKLIST

public static final Field TABLE_BLACKLIST

A comma-separated list of regular expressions that match the fully-qualified names of tables to be excluded from monitoring. Fully-qualified names for tables are of the form <databaseName>.<tableName> or <databaseName>.<schemaName>.<tableName>. May not be used with TABLE_WHITELIST.

TABLE_IGNORE_BUILTIN

public static final Field TABLE_IGNORE_BUILTIN

COLUMN_BLACKLIST

public static final Field COLUMN_BLACKLIST

A comma-separated list of regular expressions that match fully-qualified names of columns to be excluded from monitoring and change messages. The exact form of fully qualified names for columns might vary between connector types. For instance, they could be of the form <databaseName>.<tableName>.<columnName> or <schemaName>.<tableName>.<columnName> or <databaseName>.<schemaName>.<tableName>.<columnName>.

COLUMN_WHITELIST

public static final Field COLUMN_WHITELIST

A comma-separated list of regular expressions that match fully-qualified names of columns to be excluded from monitoring and change messages. The exact form of fully qualified names for columns might vary between connector types. For instance, they could be of the form <databaseName>.<tableName>.<columnName> or <schemaName>.<tableName>.<columnName> or <databaseName>.<schemaName>.<tableName>.<columnName>.

MSG_KEY_COLUMNS

public static final Field MSG_KEY_COLUMNS

DECIMAL_HANDLING_MODE

public static final Field DECIMAL_HANDLING_MODE

SNAPSHOT_SELECT_STATEMENT_OVERRIDES_BY_TABLE

public static final Field SNAPSHOT_SELECT_STATEMENT_OVERRIDES_BY_TABLE

SCHEMA_WHITELIST

public static final Field SCHEMA_WHITELIST

A comma-separated list of regular expressions that match schema names to be monitored. May not be used with SCHEMA_BLACKLIST.

SCHEMA_BLACKLIST

public static final Field SCHEMA_BLACKLIST

A comma-separated list of regular expressions that match schema names to be excluded from monitoring. May not be used with SCHEMA_WHITELIST.

TIME_PRECISION_MODE

public static final Field TIME_PRECISION_MODE

SNAPSHOT_LOCK_TIMEOUT_MS

public static final Field SNAPSHOT_LOCK_TIMEOUT_MS

INCLUDE_SCHEMA_CHANGES

public static final Field INCLUDE_SCHEMA_CHANGES

MASK_COLUMN_WITH_HASH

public static final Field MASK_COLUMN_WITH_HASH

MASK_COLUMN

public static final Field MASK_COLUMN

TRUNCATE_COLUMN

public static final Field TRUNCATE_COLUMN

CONFIG_DEFINITION

protected static final ConfigDefinition CONFIG_DEFINITION

tableFilters

private final RelationalTableFilters tableFilters

temporalPrecisionMode

private final TemporalPrecisionMode temporalPrecisionMode

keyMapper

private final Key.KeyMapper keyMapper

tableIdMapper

private final Selectors.TableIdToStringMapper tableIdMapper

Constructor Detail

RelationalDatabaseConnectorConfig

protected RelationalDatabaseConnectorConfig(Configuration config,
                                            String logicalName,
                                            Tables.TableFilter systemTablesFilter,
                                            Selectors.TableIdToStringMapper tableIdMapper,
                                            int defaultSnapshotFetchSize)

Method Detail

getTableFilters

public RelationalTableFilters getTableFilters()

getDecimalMode

public JdbcValueConverters.DecimalMode getDecimalMode()

Returns the Decimal mode Enum for decimal.handling.mode configuration. This defaults to precise if nothing is provided.

getTemporalPrecisionMode

public TemporalPrecisionMode getTemporalPrecisionMode()

Returns the temporal precision mode mode Enum for time.precision.mode configuration. This defaults to adaptive if nothing is provided.

getKeyMapper

public Key.KeyMapper getKeyMapper()

snapshotLockTimeout

public Duration snapshotLockTimeout()

validateColumnBlacklist

private static int validateColumnBlacklist(Configuration config,
                                           Field field,
                                           Field.ValidationOutput problems)

isSchemaChangesHistoryEnabled

public boolean isSchemaChangesHistoryEnabled()

Overrides:

isSchemaChangesHistoryEnabled in class CommonConnectorConfig

Returns:

true if the connector should emit messages about schema changes into a public facing topic.

getTableIdMapper

public Selectors.TableIdToStringMapper getTableIdMapper()

validateTableBlacklist

private static int validateTableBlacklist(Configuration config,
                                          Field field,
                                          Field.ValidationOutput problems)

getSnapshotSelectOverridesByTable

public Map<TableId,String> getSnapshotSelectOverridesByTable()

Returns any SELECT overrides, if present.

validateSchemaBlacklist

private static int validateSchemaBlacklist(Configuration config,
                                           Field field,
                                           Field.ValidationOutput problems)

validateMessageKeyColumnsField

private static int validateMessageKeyColumnsField(Configuration config,
                                                  Field field,
                                                  Field.ValidationOutput problems)