Package io.debezium.connector.mongodb.transforms

Class ExtractNewDocumentStateTestIT

java.lang.Object

io.debezium.embedded.AbstractConnectorTest

io.debezium.connector.mongodb.AbstractMongoConnectorIT

io.debezium.connector.mongodb.transforms.AbstractExtractNewDocumentStateTestIT

io.debezium.connector.mongodb.transforms.ExtractNewDocumentStateTestIT

All Implemented Interfaces:

Testing

public class ExtractNewDocumentStateTestIT
extends AbstractExtractNewDocumentStateTestIT

Integration test for ExtractNewDocumentState and DefaultDeleteHandlingStrategy. It sends operations into MongoDB and listens on messages that are generated by Debezium plug-in. The messages are then run through the SMT itself.

Author:

Harvey Yue

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.embedded.AbstractConnectorTest

AbstractConnectorTest.SourceRecords

Nested classes/interfaces inherited from interface io.debezium.util.Testing

Testing.Debug, Testing.Files, Testing.InterruptableFunction, Testing.Network, Testing.Print, Testing.Timer

Field Summary

Fields inherited from class io.debezium.connector.mongodb.transforms.AbstractExtractNewDocumentStateTestIT

ADD_FIELDS, ADD_FIELDS_PREFIX, ADD_HEADERS, ADD_HEADERS_PREFIX, ARRAY_ENCODING, CONFIG_DROP_TOMBSTONES, DB_NAME, DELIMITER, DROP_TOMBSTONE, FLATTEN_STRUCT, HANDLE_DELETES, HANDLE_TOMBSTONE_DELETES, SERVER_NAME, transformation

Fields inherited from class io.debezium.connector.mongodb.AbstractMongoConnectorIT

config, context, logInterceptor, mongo

Fields inherited from class io.debezium.embedded.AbstractConnectorTest

consumedLines, engine, isEngineRunning, logger, logTestName, OFFSET_STORE_PATH, pollTimeoutInMs, skipTestRule

Constructor Summary

Constructors

Constructor	Description
ExtractNewDocumentStateTestIT()

Method Summary

Modifier and Type	Method	Description
protected String	getCollectionName()
void	shouldAddFields()
void	shouldAddFieldsForRewriteDeleteEvent()
void	shouldAddUpdateDescription()
void	shouldDropDeleteMessagesByDefault()
void	shouldDropTombstoneByDefault()
void	shouldFlattenTransformRecordForInsertEvent()
void	shouldFlattenWithDelimiterTransformRecordForInsertEvent()
void	shouldFlattenWithDelimiterTransformRecordForUpdateEvent()
void	shouldGenerateRecordForDeleteEvent()
void	shouldGenerateRecordForDeleteEventsDeleteHandlingRewrite()
void	shouldGenerateRecordForDeleteEventWithoutTombstone()
void	shouldGenerateRecordForPartialUpdateEvent()
void	shouldGenerateRecordForSetOnlyPartialUpdateEvent()
void	shouldGenerateRecordForUnsetOnlyUpdateEvent()
void	shouldGenerateRecordForUpdateEvent()
void	shouldGenerateRecordForUpdateEventWithUnset()
void	shouldGenerateRecordHeaderForTombstone()
void	shouldNotFlattenTransformRecordForInsertEvent()
void	shouldPropagatePreviousRecordHeaders()
void	shouldRewriteDeleteMessage()
void	shouldRewriteMessagesWhichAreNotDeletes()
void	shouldSupportDbRef()
void	shouldSupportNestedArrays()
void	shouldSupportSubSanitizeFieldName()
void	shouldTransformEvents()
void	shouldTransformRecordForInsertEvent()
void	shouldTransformRecordForInsertEventWithComplexIdType()
void	tesAddFieldsHandleDeleteRewrite()
void	testAddField()
void	testAddFieldHandleDeleteRewrite()
void	testAddFields()
void	testAddFieldsForMissingOptionalField()
void	testAddFieldsHandleDeleteRewriteAndTombstone()
void	testAddFieldsSpecifyStruct()
void	testAddFieldsSpecifyStructHandleDeleteRewrite()
void	testAddHeader()
void	testAddHeadersForMissingOrInvalidFields()
void	testAddHeadersSpecifyingStruct()
void	testAddUpdatedFieldAfterUpdate()
void	testConnectorAndTransformAvroFieldNameAdjustment()
void	testEmptyArray()
void	testMatrixArrayAsDocumentType()
void	testMatrixType()
void	testNewFieldAndHeaderMapping()
void	testShouldThrowExceptionWithElementsDifferingStructures()

Methods inherited from class io.debezium.connector.mongodb.transforms.AbstractExtractNewDocumentStateTestIT

afterEach, beforeEach, beforeEach, createCreateRecord, createCreateRecordFromJson, createDeleteRecordWithTombstone, getBaseConfigBuilder, getNextRecord, getRecordByOperation, getSourceRecordHeaderByKey, getUpdateRecord, restartConnectorWithConfig, restartConnectorWithoutEmittingTombstones, topicName, waitForStreamingRunning

Methods inherited from class io.debezium.connector.mongodb.AbstractMongoConnectorIT

afterAll, beforeAll, connect, deleteDocuments, dropAndInsertDocuments, getSnapshotMetricsObjectName, getSnapshotMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, insertDocuments, insertDocumentsInTx, loadTestDocuments, storeDocuments, storeDocuments, updateDocument, updateDocumentsInTx, waitForSnapshotToBeCompleted, waitForSnapshotToBeCompleted, waitForStreamingRunning, waitForStreamingRunning

Methods inherited from class io.debezium.embedded.AbstractConnectorTest

assertBeginTransaction, assertConfigurationErrors, assertConfigurationErrors, assertConfigurationErrors, assertConnectorIsRunning, assertConnectorNotRunning, assertDelete, assertEndTransaction, assertEngineIsRunning, assertHasNoSourceQuery, assertInsert, assertKey, assertNoConfigurationErrors, assertNoRecordsToConsume, assertOffset, assertOffset, assertOnlyTransactionRecordsToConsume, assertRecordTransactionMetadata, assertSchemaMatchesStruct, assertSchemaMatchesStruct, assertSourceQuery, assertTombstone, assertTombstone, assertUpdate, assertValueField, configValue, consumeAvailableRecords, consumeAvailableRecordsByTopic, consumeDmlRecordsByTopic, consumeDmlRecordsByTopic, consumeDmlRecordsByTopic, consumeRecord, consumeRecords, consumeRecords, consumeRecords, consumeRecordsButSkipUntil, consumeRecordsByTopic, consumeRecordsByTopic, consumeRecordsByTopic, consumeRecordsByTopicUntil, consumeRecordsUntil, debug, getConsumer, getMaximumEnqueuedRecordCount, getSnapshotMetricsObjectName, getSnapshotMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, getStreamingNamespace, initializeConnectorTestFramework, isStreamingRunning, isStreamingRunning, isStreamingRunning, isStreamingRunning, isTransactionRecord, loggingCompletion, print, readLastCommittedOffset, readLastCommittedOffsets, setConsumeTimeout, skipAvroValidation, start, start, start, start, start, start, start, startAndConsumeTillEnd, startAndConsumeTillEnd, stopConnector, stopConnector, validate, waitForAvailableRecords, waitForConnectorShutdown, waitForSnapshotToBeCompleted, waitForSnapshotWithCustomMetricsToBeCompleted, waitForStreamingRunning, waitForStreamingRunning, waitForStreamingWithCustomMetricsToStart, waitTimeForRecords, waitTimeForRecordsAfterNulls

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.util.Testing

once, once, resetBeforeEachTest, time, time

Constructor Details

ExtractNewDocumentStateTestIT

public ExtractNewDocumentStateTestIT()

Method Details

getCollectionName

protected String getCollectionName()

Specified by:

getCollectionName in class AbstractExtractNewDocumentStateTestIT

shouldDropTombstoneByDefault

@FixFor("DBZ-563")
public void shouldDropTombstoneByDefault()
                                  throws InterruptedException

Throws:

InterruptedException

shouldTransformEvents

public void shouldTransformEvents()
                           throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

shouldSupportDbRef

@FixFor("DBZ-1767")
public void shouldSupportDbRef()
                        throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

shouldSupportSubSanitizeFieldName

@FixFor("DBZ-2680")
public void shouldSupportSubSanitizeFieldName()
                                       throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

shouldAddFields

@FixFor("DBZ-1442")
public void shouldAddFields()
                     throws InterruptedException

Throws:

InterruptedException

shouldAddFieldsForRewriteDeleteEvent

@FixFor("DBZ-1442")
public void shouldAddFieldsForRewriteDeleteEvent()
                                          throws InterruptedException

Throws:

InterruptedException

shouldTransformRecordForInsertEvent

public void shouldTransformRecordForInsertEvent()
                                         throws InterruptedException

Throws:

InterruptedException

shouldTransformRecordForInsertEventWithComplexIdType

public void shouldTransformRecordForInsertEventWithComplexIdType()
                                                          throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForUpdateEvent

public void shouldGenerateRecordForUpdateEvent()
                                        throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForPartialUpdateEvent

public void shouldGenerateRecordForPartialUpdateEvent()
                                               throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForSetOnlyPartialUpdateEvent

public void shouldGenerateRecordForSetOnlyPartialUpdateEvent()
                                                      throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForUpdateEventWithUnset

@FixFor("DBZ-612")
public void shouldGenerateRecordForUpdateEventWithUnset()
                                                 throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForUnsetOnlyUpdateEvent

@FixFor("DBZ-612")
public void shouldGenerateRecordForUnsetOnlyUpdateEvent()
                                                 throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForDeleteEventWithoutTombstone

@FixFor("DBZ-582")
public void shouldGenerateRecordForDeleteEventWithoutTombstone()
                                                        throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordHeaderForTombstone

@FixFor("DBZ-1032")
public void shouldGenerateRecordHeaderForTombstone()
                                            throws InterruptedException

Throws:

InterruptedException

shouldDropDeleteMessagesByDefault

@FixFor("DBZ-583")
public void shouldDropDeleteMessagesByDefault()
                                       throws InterruptedException

Throws:

InterruptedException

shouldRewriteDeleteMessage

@FixFor("DBZ-583")
public void shouldRewriteDeleteMessage()
                                throws InterruptedException

Throws:

InterruptedException

shouldRewriteMessagesWhichAreNotDeletes

@FixFor("DBZ-583")
public void shouldRewriteMessagesWhichAreNotDeletes()
                                             throws InterruptedException

Throws:

InterruptedException

shouldGenerateRecordForDeleteEvent

public void shouldGenerateRecordForDeleteEvent()
                                        throws InterruptedException

Throws:

InterruptedException

shouldPropagatePreviousRecordHeaders

@FixFor("DBZ-971")
public void shouldPropagatePreviousRecordHeaders()
                                          throws InterruptedException

Throws:

InterruptedException

shouldNotFlattenTransformRecordForInsertEvent

public void shouldNotFlattenTransformRecordForInsertEvent()
                                                   throws InterruptedException

Throws:

InterruptedException

shouldFlattenTransformRecordForInsertEvent

public void shouldFlattenTransformRecordForInsertEvent()
                                                throws InterruptedException

Throws:

InterruptedException

shouldFlattenWithDelimiterTransformRecordForInsertEvent

public void shouldFlattenWithDelimiterTransformRecordForInsertEvent()
                                                             throws InterruptedException

Throws:

InterruptedException

shouldFlattenWithDelimiterTransformRecordForUpdateEvent

public void shouldFlattenWithDelimiterTransformRecordForUpdateEvent()
                                                             throws InterruptedException

Throws:

InterruptedException

testAddHeader

@FixFor("DBZ-1791")
public void testAddHeader()
                   throws Exception

Throws:

Exception

testAddHeadersForMissingOrInvalidFields

@FixFor("DBZ-1791")
public void testAddHeadersForMissingOrInvalidFields()
                                             throws Exception

Throws:

Exception

testAddHeadersSpecifyingStruct

@FixFor({"DBZ-1791","DBZ-2504"})
public void testAddHeadersSpecifyingStruct()
                                    throws Exception

Throws:

Exception

testAddField

@FixFor("DBZ-1791")
public void testAddField()
                  throws Exception

Throws:

Exception

testNewFieldAndHeaderMapping

@FixFor({"DBZ-2606","DBZ-6773"})
public void testNewFieldAndHeaderMapping()
                                  throws Exception

Throws:

Exception

testAddFields

@FixFor({"DBZ-1791","DBZ-2504"})
public void testAddFields()
                   throws Exception

Throws:

Exception

testAddFieldsForMissingOptionalField

@FixFor("DBZ-1791")
public void testAddFieldsForMissingOptionalField()
                                          throws Exception

Throws:

Exception

testAddFieldsSpecifyStruct

@FixFor("DBZ-1791")
public void testAddFieldsSpecifyStruct()
                                throws Exception

Throws:

Exception

testAddFieldHandleDeleteRewrite

@FixFor("DBZ-1791")
public void testAddFieldHandleDeleteRewrite()
                                     throws Exception

Throws:

Exception

tesAddFieldsHandleDeleteRewrite

@FixFor("DBZ-1791")
public void tesAddFieldsHandleDeleteRewrite()
                                     throws Exception

Throws:

Exception

testAddFieldsSpecifyStructHandleDeleteRewrite

@FixFor("DBZ-1791")
public void testAddFieldsSpecifyStructHandleDeleteRewrite()
                                                   throws Exception

Throws:

Exception

testAddFieldsHandleDeleteRewriteAndTombstone

@FixFor("DBZ-1791")
public void testAddFieldsHandleDeleteRewriteAndTombstone()
                                                  throws Exception

Throws:

Exception

testEmptyArray

@FixFor("DBZ-2585")
public void testEmptyArray()
                    throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

testAddUpdatedFieldAfterUpdate

@FixFor("DBZ-2455")
public void testAddUpdatedFieldAfterUpdate()
                                    throws Exception

Throws:

Exception

testShouldThrowExceptionWithElementsDifferingStructures

@FixFor("DBZ-2316")
public void testShouldThrowExceptionWithElementsDifferingStructures()
                                                             throws Exception

Throws:

Exception

testMatrixType

@FixFor("DBZ-2569")
public void testMatrixType()
                    throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

testMatrixArrayAsDocumentType

@FixFor("DBZ-2569")
public void testMatrixArrayAsDocumentType()
                                   throws InterruptedException,
IOException

Throws:

InterruptedException

IOException

shouldSupportNestedArrays

@FixFor("DBZ-5434")
public void shouldSupportNestedArrays()
                               throws InterruptedException

Throws:

InterruptedException

shouldAddUpdateDescription

@FixFor({"DBZ-5834","DBZ-6774"})
public void shouldAddUpdateDescription()
                                throws Exception

Throws:

Exception

shouldGenerateRecordForDeleteEventsDeleteHandlingRewrite

@FixFor("DBZ-6725")
public void shouldGenerateRecordForDeleteEventsDeleteHandlingRewrite()
                                                              throws InterruptedException

Throws:

InterruptedException

testConnectorAndTransformAvroFieldNameAdjustment

@FixFor("DBZ-6809")
public void testConnectorAndTransformAvroFieldNameAdjustment()
                                                      throws InterruptedException,
IOException

Throws:

InterruptedException

IOException