io.debezium.connector.mysql

Class MySqlConnectorIT

java.lang.Object

io.debezium.embedded.AbstractConnectorTest

io.debezium.connector.mysql.MySqlConnectorIT

All Implemented Interfaces:

Testing

public class MySqlConnectorIT
extends AbstractConnectorTest

Author:

Randall Hauch

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	MySqlConnectorIT.BinlogPosition

Nested classes/interfaces inherited from class io.debezium.embedded.AbstractConnectorTest

AbstractConnectorTest.SourceRecords

Nested classes/interfaces inherited from interface io.debezium.util.Testing

Testing.Debug, Testing.Files, Testing.InterruptableFunction, Testing.Network, Testing.Print, Testing.Timer

Field Summary

Fields

Modifier and Type	Field and Description
private Configuration	config
private UniqueDatabase	DATABASE
private static Path	DB_HISTORY_PATH
private static int	INITIAL_EVENT_COUNT
private static int	ORDERS_TABLE_EVENT_COUNT
private static int	PRODUCTS_TABLE_EVENT_COUNT
private UniqueDatabase	RO_DATABASE

Fields inherited from class io.debezium.embedded.AbstractConnectorTest

engine, logger, OFFSET_STORE_PATH, pollTimeoutInMs, skipTestRule

Constructor Summary

Constructors

Constructor and Description
MySqlConnectorIT()

Method Summary

Modifier and Type	Method and Description
void	afterEach()
void	beforeEach()
private org.apache.kafka.connect.data.Struct	getAfter(org.apache.kafka.connect.source.SourceRecord record)
void	parseDeleteQuery() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for a DELETE over a single row is parsed into the resulting event.
void	parseMultipleInsertStatements() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the issue multiple INSERTs, the appropriate SQL statements are parsed into the resulting events.
void	parseMultipleRowInsertStatement() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the issue single multi-row INSERT, the appropriate SQL statements are parsed into the resulting events.
void	parseMultiRowDeleteQuery() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then issue a multi-row DELETE, the resulting events get the original SQL statement.
void	parseMultiRowUpdateQuery() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an UPDATE over a single row is parsed into the resulting event.
void	parseUpdateQuery() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an UPDATE over a single row is parsed into the resulting event.
private List<org.apache.kafka.connect.source.SourceRecord>	recordsForTopicForRoProductsTable(AbstractConnectorTest.SourceRecords records)
void	shouldConsumeAllEventsFromDatabaseUsingSnapshot()
void	shouldConsumeEventsWithMaskedAndBlacklistedColumns()
void	shouldConsumeEventsWithNoSnapshot()
void	shouldEmitNoTombstoneOnDelete()
void	shouldEmitTombstoneOnDeleteByDefault()
void	shouldFailToValidateConflictingLockingModeConfiguration() Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.
void	shouldFailToValidateConflictingLockingModeExtendedConfiguration() Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.
void	shouldFailToValidateConflictingLockingModeNoneConfiguration() Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.
void	shouldFailToValidateInvalidConfiguration()
void	shouldIgnoreAlterTableForNonCapturedTablesNotStoredInHistory()
void	shouldIgnoreAlterTableForNonCapturedTablesStoredInHistory()
void	shouldNotParseQueryIfConnectorNotConfiguredTo() This test case validates that if you enable MySQL option binlog_rows_query_log_events, but configure the connector to NOT include the query, it will not be included in the event.
void	shouldNotParseQueryIfServerOptionDisabled() This test case validates that if you disable MySQL option binlog_rows_query_log_events, then the original SQL statement for an INSERT statement is NOT parsed into the resulting event.
void	shouldNotStartWithInvalidConfiguration() Verifies that the connector doesn't run with an invalid configuration.
void	shouldParseQueryIfAvailableAndConnectorOptionEnabled() This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an INSERT statement is parsed into the resulting event.
void	shouldUseMultipleOverriddenSelectStatementsDuringSnapshotting()
void	shouldUseOverriddenSelectStatementDuringSnapshotting()
void	shouldValidateAcceptableConfiguration()
void	shouldValidateLockingModeNoneWithValidSnapshotModeConfiguration() Validates that SNAPSHOT_LOCKING_MODE 'none' is valid with all snapshot modes
void	shouldValidateLockingModeWithMinimalLocksEnabledConfiguration() Validates that if you use the deprecated snapshot.minimal.locking configuration value is set to true and its replacement snapshot.locking.mode is not explicitly defined, configuration validates as acceptable.
void	shouldValidateLockingModeWithOutMinimalLocksEnabledConfiguration() Validates that if you use the deprecated snapshot.minimal.locking configuration value is set to false and its replacement snapshot.locking.mode is not explicitly defined, configuration validates as acceptable.
void	shouldValidateValidConfigurationWithSSL()

Methods inherited from class io.debezium.embedded.AbstractConnectorTest

assertConfigurationErrors, assertConfigurationErrors, assertConfigurationErrors, assertConnectorIsRunning, assertConnectorNotRunning, assertDelete, assertEngineIsRunning, assertHasNoSourceQuery, assertInsert, assertKey, assertNoConfigurationErrors, assertNoRecordsToConsume, assertOffset, assertOffset, assertSchemaMatchesStruct, assertSchemaMatchesStruct, assertSourceQuery, assertTombstone, assertTombstone, assertUpdate, assertValueField, configValue, consumeAvailableRecords, consumeRecord, consumeRecords, consumeRecords, consumeRecordsByTopic, debug, getMaximumEnqueuedRecordCount, initializeConnectorTestFramework, loggingCompletion, print, readLastCommittedOffset, readLastCommittedOffsets, setConsumeTimeout, start, start, start, start, stopConnector, stopConnector, validate, waitForAvailableRecords

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.util.Testing

debug, once, once, print, print, printError, printError, printError, resetBeforeEachTest, time, time

Field Detail

DB_HISTORY_PATH

private static final Path DB_HISTORY_PATH

DATABASE

private final UniqueDatabase DATABASE

RO_DATABASE

private final UniqueDatabase RO_DATABASE

PRODUCTS_TABLE_EVENT_COUNT

private static final int PRODUCTS_TABLE_EVENT_COUNT

See Also:

Constant Field Values

ORDERS_TABLE_EVENT_COUNT

private static final int ORDERS_TABLE_EVENT_COUNT

See Also:

Constant Field Values

INITIAL_EVENT_COUNT

private static final int INITIAL_EVENT_COUNT

See Also:

Constant Field Values

config

private Configuration config

Constructor Detail

MySqlConnectorIT

public MySqlConnectorIT()

Method Detail

beforeEach

public void beforeEach()

afterEach

public void afterEach()

shouldNotStartWithInvalidConfiguration

public void shouldNotStartWithInvalidConfiguration()

Verifies that the connector doesn't run with an invalid configuration. This does not actually connect to the MySQL server.

shouldFailToValidateInvalidConfiguration

public void shouldFailToValidateInvalidConfiguration()

shouldValidateValidConfigurationWithSSL

public void shouldValidateValidConfigurationWithSSL()

shouldValidateAcceptableConfiguration

public void shouldValidateAcceptableConfiguration()

shouldValidateLockingModeWithMinimalLocksEnabledConfiguration

@FixFor(value="DBZ-602")
public void shouldValidateLockingModeWithMinimalLocksEnabledConfiguration()

Validates that if you use the deprecated snapshot.minimal.locking configuration value is set to true and its replacement snapshot.locking.mode is not explicitly defined, configuration validates as acceptable.

shouldValidateLockingModeWithOutMinimalLocksEnabledConfiguration

@FixFor(value="DBZ-602")
public void shouldValidateLockingModeWithOutMinimalLocksEnabledConfiguration()

Validates that if you use the deprecated snapshot.minimal.locking configuration value is set to false and its replacement snapshot.locking.mode is not explicitly defined, configuration validates as acceptable.

shouldFailToValidateConflictingLockingModeConfiguration

@FixFor(value="DBZ-602")
public void shouldFailToValidateConflictingLockingModeConfiguration()

Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.

shouldFailToValidateConflictingLockingModeExtendedConfiguration

@FixFor(value="DBZ-602")
public void shouldFailToValidateConflictingLockingModeExtendedConfiguration()

Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.

shouldFailToValidateConflictingLockingModeNoneConfiguration

@FixFor(value="DBZ-602")
public void shouldFailToValidateConflictingLockingModeNoneConfiguration()

Validates that if you use the deprecated snapshot.minimal.locking configuration value AND set its replacement snapshot.locking.mode an error will be generated.

shouldValidateLockingModeNoneWithValidSnapshotModeConfiguration

@FixFor(value="DBZ-639")
public void shouldValidateLockingModeNoneWithValidSnapshotModeConfiguration()

Validates that SNAPSHOT_LOCKING_MODE 'none' is valid with all snapshot modes

shouldConsumeAllEventsFromDatabaseUsingSnapshot

public void shouldConsumeAllEventsFromDatabaseUsingSnapshot()
                                                     throws SQLException,
                                                            InterruptedException

Throws:

SQLException

InterruptedException

shouldUseOverriddenSelectStatementDuringSnapshotting

public void shouldUseOverriddenSelectStatementDuringSnapshotting()
                                                          throws SQLException,
                                                                 InterruptedException

Throws:

SQLException

InterruptedException

shouldUseMultipleOverriddenSelectStatementsDuringSnapshotting

public void shouldUseMultipleOverriddenSelectStatementsDuringSnapshotting()
                                                                   throws SQLException,
                                                                          InterruptedException

Throws:

SQLException

InterruptedException

shouldIgnoreAlterTableForNonCapturedTablesNotStoredInHistory

@FixFor(value="DBZ-977")
public void shouldIgnoreAlterTableForNonCapturedTablesNotStoredInHistory()
                                                                                           throws SQLException,
                                                                                                  InterruptedException

Throws:

SQLException

InterruptedException

shouldIgnoreAlterTableForNonCapturedTablesStoredInHistory

@FixFor(value="DBZ-977")
public void shouldIgnoreAlterTableForNonCapturedTablesStoredInHistory()
                                                                                        throws SQLException,
                                                                                               InterruptedException

Throws:

SQLException

InterruptedException

getAfter

private org.apache.kafka.connect.data.Struct getAfter(org.apache.kafka.connect.source.SourceRecord record)

shouldConsumeEventsWithNoSnapshot

public void shouldConsumeEventsWithNoSnapshot()
                                       throws SQLException,
                                              InterruptedException

Throws:

SQLException

InterruptedException

shouldConsumeEventsWithMaskedAndBlacklistedColumns

public void shouldConsumeEventsWithMaskedAndBlacklistedColumns()
                                                        throws SQLException,
                                                               InterruptedException

Throws:

SQLException

InterruptedException

shouldEmitTombstoneOnDeleteByDefault

@FixFor(value="DBZ-582")
public void shouldEmitTombstoneOnDeleteByDefault()
                                                                   throws Exception

Throws:

Exception

shouldEmitNoTombstoneOnDelete

@FixFor(value="DBZ-582")
public void shouldEmitNoTombstoneOnDelete()
                                                            throws Exception

Throws:

Exception

shouldNotParseQueryIfServerOptionDisabled

@FixFor(value="DBZ-706")
public void shouldNotParseQueryIfServerOptionDisabled()
                                                                        throws Exception

This test case validates that if you disable MySQL option binlog_rows_query_log_events, then the original SQL statement for an INSERT statement is NOT parsed into the resulting event.

Throws:

Exception

shouldNotParseQueryIfConnectorNotConfiguredTo

@FixFor(value="DBZ-706")
public void shouldNotParseQueryIfConnectorNotConfiguredTo()
                                                                            throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, but configure the connector to NOT include the query, it will not be included in the event.

Throws:

Exception

shouldParseQueryIfAvailableAndConnectorOptionEnabled

@FixFor(value="DBZ-706")
public void shouldParseQueryIfAvailableAndConnectorOptionEnabled()
                                                                                   throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an INSERT statement is parsed into the resulting event.

Throws:

Exception

parseMultipleInsertStatements

@FixFor(value="DBZ-706")
public void parseMultipleInsertStatements()
                                                            throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the issue multiple INSERTs, the appropriate SQL statements are parsed into the resulting events.

Throws:

Exception

parseMultipleRowInsertStatement

@FixFor(value="DBZ-706")
public void parseMultipleRowInsertStatement()
                                                              throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the issue single multi-row INSERT, the appropriate SQL statements are parsed into the resulting events.

Throws:

Exception

parseDeleteQuery

@FixFor(value="DBZ-706")
public void parseDeleteQuery()
                                               throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for a DELETE over a single row is parsed into the resulting event.

Throws:

Exception

parseMultiRowDeleteQuery

@FixFor(value="DBZ-706")
public void parseMultiRowDeleteQuery()
                                                       throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then issue a multi-row DELETE, the resulting events get the original SQL statement.

Throws:

Exception

parseUpdateQuery

@FixFor(value="DBZ-706")
public void parseUpdateQuery()
                                               throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an UPDATE over a single row is parsed into the resulting event.

Throws:

Exception

parseMultiRowUpdateQuery

@FixFor(value="DBZ-706")
public void parseMultiRowUpdateQuery()
                                                       throws Exception

This test case validates that if you enable MySQL option binlog_rows_query_log_events, then the original SQL statement for an UPDATE over a single row is parsed into the resulting event.

Throws:

Exception

recordsForTopicForRoProductsTable

private List<org.apache.kafka.connect.source.SourceRecord> recordsForTopicForRoProductsTable(AbstractConnectorTest.SourceRecords records)