Package io.debezium.connector.mongodb

Class MongoDbConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.common.BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

io.debezium.connector.mongodb.MongoDbConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@ThreadSafe
public final class MongoDbConnectorTask
extends BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

A Kafka Connect source task that replicates the changes from one or more MongoDB replica sets.

Generally, the MongoDbConnector assigns each replica set to a separate task, although multiple replica sets will be assigned to each task when the maximum number of tasks is limited. Regardless, every task will use a separate thread to replicate the contents of each replica set, and each replication thread may use multiple threads to perform an initial sync of the replica set.

Author:

Randall Hauch

See Also:

• MongoDbConnector
• MongoDbConnectorConfig

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.common.BaseSourceTask

BaseSourceTask.State

Nested classes/interfaces inherited from class org.apache.kafka.connect.source.SourceTask

org.apache.kafka.connect.source.SourceTask.TransactionBoundary

Field Summary

Fields

Modifier and Type	Field	Description
private MongoDbConnectionContext	connectionContext
private static final String	CONTEXT_NAME
private ErrorHandler	errorHandler
private static final org.slf4j.Logger	LOGGER
private ChangeEventQueue<DataChangeEvent>	queue
private MongoDbSchema	schema
private MongoDbTaskContext	taskContext
private String	taskName

Fields inherited from class io.debezium.connector.common.BaseSourceTask

coordinator

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context, TRANSACTION_BOUNDARY_CONFIG

Constructor Summary

Constructors

Constructor	Description
MongoDbConnectorTask()

Method Summary

Modifier and Type	Method	Description
List<org.apache.kafka.connect.source.SourceRecord>	doPoll()
void	doStop()
protected Iterable<Field>	getAllConfigurationFields()
private Offsets<MongoDbPartition,MongoDbOffsetContext>	getPreviousOffsets(MongoDbConnectorConfig connectorConfig)
ChangeEventSourceCoordinator<MongoDbPartition,MongoDbOffsetContext>	start(Configuration config)
private void	validate(MongoDbConnection mongoDbConnection, Offsets<MongoDbPartition,MongoDbOffsetContext> previousOffsets, io.debezium.spi.snapshot.Snapshotter snapshotter)
String	version()
protected Configuration	withMaskedSensitiveOptions(Configuration config)

Methods inherited from class io.debezium.connector.common.BaseSourceTask

commit, commitRecord, getAvailableSignalChannels, getNotificationChannels, getPreviousOffsets, getTaskState, logStatistics, poll, registerServiceProviders, resetErrorHandlerRetriesIfNeeded, start, stop, validateAndLoadSchemaHistory

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

CONTEXT_NAME

private static final String CONTEXT_NAME

See Also:

• Constant Field Values

queue

private volatile ChangeEventQueue<DataChangeEvent> queue

taskName

private volatile String taskName

taskContext

private volatile MongoDbTaskContext taskContext

connectionContext

private volatile MongoDbConnectionContext connectionContext

errorHandler

private volatile ErrorHandler errorHandler

schema

private volatile MongoDbSchema schema

Constructor Details

MongoDbConnectorTask

public MongoDbConnectorTask()

Method Details

version

public String version()

start

public ChangeEventSourceCoordinator<MongoDbPartition,MongoDbOffsetContext> start(Configuration config)

Specified by:

start in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

getPreviousOffsets

private Offsets<MongoDbPartition,MongoDbOffsetContext> getPreviousOffsets(MongoDbConnectorConfig connectorConfig)

doPoll

public List<org.apache.kafka.connect.source.SourceRecord> doPoll()
                                                          throws InterruptedException

Specified by:

doPoll in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

Throws:

InterruptedException

doStop

public void doStop()

Specified by:

doStop in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

getAllConfigurationFields

protected Iterable<Field> getAllConfigurationFields()

Specified by:

getAllConfigurationFields in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

withMaskedSensitiveOptions

protected Configuration withMaskedSensitiveOptions(Configuration config)

Overrides:

withMaskedSensitiveOptions in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

validate

private void validate(MongoDbConnection mongoDbConnection,
 Offsets<MongoDbPartition,MongoDbOffsetContext> previousOffsets,
 io.debezium.spi.snapshot.Snapshotter snapshotter)