Package io.debezium.connector.mongodb

Class MultiThreadIncrementalSnapshotIT

java.lang.Object

io.debezium.embedded.AbstractConnectorTest

io.debezium.connector.mongodb.AbstractMongoConnectorIT

io.debezium.connector.mongodb.IncrementalSnapshotIT

io.debezium.connector.mongodb.MultiThreadIncrementalSnapshotIT

All Implemented Interfaces:

Testing

public class MultiThreadIncrementalSnapshotIT
extends IncrementalSnapshotIT

Test to verify multi-thread incremental snapshotting for MongoDB.

Author:

Yue Wang

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.embedded.AbstractConnectorTest

AbstractConnectorTest.SourceRecords

Nested classes/interfaces inherited from interface io.debezium.util.Testing

Testing.Debug, Testing.Files, Testing.InterruptableFunction, Testing.Network, Testing.Print, Testing.Timer

Field Summary

Fields

Modifier and Type	Field	Description
private static final int	INCREMENTAL_SNAPSHOT_THREADS
protected static final int	ROW_COUNT

Fields inherited from class io.debezium.connector.mongodb.AbstractMongoConnectorIT

config, context, logInterceptor, mongo

Fields inherited from class io.debezium.embedded.AbstractConnectorTest

consumedLines, engine, isEngineRunning, logger, logTestName, OFFSET_STORE_PATH, pollTimeoutInMs, skipTestRule

Constructor Summary

Constructors

Constructor	Description
MultiThreadIncrementalSnapshotIT()

Method Summary

Modifier and Type	Method	Description
protected Configuration.Builder	config()
void	multiThreadingSnapshot()
void	multiThreadSnapshotWithRestart()

Methods inherited from class io.debezium.connector.mongodb.IncrementalSnapshotIT

after, before, connectorClass, consumeAnyRemainingIncrementalSnapshotEventsAndCheckForStopMessage, consumeMixedWithIncrementalSnapshot, consumeMixedWithIncrementalSnapshot, consumeMixedWithIncrementalSnapshot, consumeMixedWithIncrementalSnapshot, consumeMixedWithIncrementalSnapshot, consumeRecordsMixedWithIncrementalSnapshot, consumeRecordsMixedWithIncrementalSnapshot, dataCollectionName, dataCollectionNames, executeIncrementalSnapshotWithAdditionalCondition, extractFieldValue, fullDataCollectionName, fullDataCollectionNames, getMaximumEnqueuedRecordCount, insertAdditionalData, insertAdditionalData, insertDeleteWatermarkingStrategy, insertInsertWatermarkingStrategy, inserts, invalidTablesInTheList, pauseDuringSnapshot, pkFieldName, populateDataCollection, populateDataCollection, populateDataCollections, removeNotYetCapturedCollectionFromInProgressIncrementalSnapshot, removeStartedCapturedCollectionFromInProgressIncrementalSnapshot, sendAdHocSnapshotSignal, sendAdHocSnapshotSignal, sendAdHocSnapshotSignalAndWait, sendAdHocSnapshotSignalWithAdditionalConditions, sendAdHocSnapshotStopSignal, sendAdHocSnapshotStopSignalAndWait, sendPauseSignal, sendResumeSignal, shouldStreamWithDatabaseIncludeList, snapshotOnlyDecimal128, snapshotOnlyDouble, snapshotOnlyInt32, snapshotOnlyObjectId, snapshotOnlyString, snapshotOnlyUUID, snapshotOnlyWithInt64, snapshotOnlyWithRestart, startConnector, startConnector, startConnector, stopCurrentIncrementalSnapshotWithAllCollectionsAndTakeNewNewIncrementalSnapshotAfterRestart, stopCurrentIncrementalSnapshotWithoutCollectionsAndTakeNewNewIncrementalSnapshotAfterRestart, topicName, topicNames, updateData, updates, updatesLargeChunk, updatesWithRestart, valueFieldName, waitForConnectorToStart

Methods inherited from class io.debezium.connector.mongodb.AbstractMongoConnectorIT

afterAll, afterEach, beforeAll, beforeEach, connect, deleteDocuments, dropAndInsertDocuments, getSnapshotMetricsObjectName, getSnapshotMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, insertDocuments, insertDocumentsInTx, loadTestDocuments, storeDocuments, storeDocuments, updateDocument, updateDocumentsInTx, waitForSnapshotToBeCompleted, waitForSnapshotToBeCompleted, waitForStreamingRunning, waitForStreamingRunning

Methods inherited from class io.debezium.embedded.AbstractConnectorTest

assertBeginTransaction, assertConfigurationErrors, assertConfigurationErrors, assertConfigurationErrors, assertConnectorIsRunning, assertConnectorNotRunning, assertDelete, assertEndTransaction, assertEngineIsRunning, assertHasNoSourceQuery, assertInsert, assertKey, assertNoConfigurationErrors, assertNoRecordsToConsume, assertOffset, assertOffset, assertOnlyTransactionRecordsToConsume, assertRecordTransactionMetadata, assertSchemaMatchesStruct, assertSchemaMatchesStruct, assertSourceQuery, assertTombstone, assertTombstone, assertUpdate, assertValueField, configValue, consumeAvailableRecords, consumeAvailableRecordsByTopic, consumeDmlRecordsByTopic, consumeDmlRecordsByTopic, consumeDmlRecordsByTopic, consumeRecord, consumeRecords, consumeRecords, consumeRecords, consumeRecordsButSkipUntil, consumeRecordsByTopic, consumeRecordsByTopic, consumeRecordsByTopic, consumeRecordsByTopicUntil, consumeRecordsUntil, createEngine, createEngineBuilder, debug, getConsumer, getSnapshotMetricsObjectName, getSnapshotMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, getStreamingMetricsObjectName, getStreamingNamespace, initializeConnectorTestFramework, isStreamingRunning, isStreamingRunning, isStreamingRunning, isStreamingRunning, isTransactionRecord, loggingCompletion, print, readLastCommittedOffset, readLastCommittedOffsets, setConsumeTimeout, skipAvroValidation, start, start, start, start, start, start, start, startAndConsumeTillEnd, startAndConsumeTillEnd, stopConnector, stopConnector, storeOffsets, validate, waitForAvailableRecords, waitForConnectorShutdown, waitForEngineShutdown, waitForSnapshotToBeCompleted, waitForSnapshotWithCustomMetricsToBeCompleted, waitForStreamingRunning, waitForStreamingRunning, waitForStreamingWithCustomMetricsToStart, waitTimeForEngine, waitTimeForRecords, waitTimeForRecordsAfterNulls

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.debezium.util.Testing

once, once, resetBeforeEachTest, time, time

Field Details

ROW_COUNT

protected static final int ROW_COUNT

See Also:

• Constant Field Values

INCREMENTAL_SNAPSHOT_THREADS

private static final int INCREMENTAL_SNAPSHOT_THREADS

See Also:

• Constant Field Values

Constructor Details

MultiThreadIncrementalSnapshotIT

public MultiThreadIncrementalSnapshotIT()

Method Details

config

protected Configuration.Builder config()

Overrides:

config in class IncrementalSnapshotIT

multiThreadingSnapshot

public void multiThreadingSnapshot()
                            throws Exception

Throws:

Exception

multiThreadSnapshotWithRestart

public void multiThreadSnapshotWithRestart()
                                    throws Exception

Throws:

Exception