Package io.debezium.connector.mongodb

Class MongoDbConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.common.BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

io.debezium.connector.mongodb.MongoDbConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@ThreadSafe
public final class MongoDbConnectorTask
extends BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

A Kafka Connect source task that replicates the changes from one or more MongoDB replica sets.

Generally, the MongoDbConnector assigns each replica set to a separate task, although multiple replica sets will be assigned to each task when the maximum number of tasks is limited. Regardless, every task will use a separate thread to replicate the contents of each replica set, and each replication thread may use multiple threads to perform an initial sync of the replica set.

Author:

Randall Hauch

See Also:

• MongoDbConnector
• MongoDbConnectorConfig

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.common.BaseSourceTask

BaseSourceTask.State

Nested classes/interfaces inherited from class org.apache.kafka.connect.source.SourceTask

org.apache.kafka.connect.source.SourceTask.TransactionBoundary

Field Summary

Fields

Modifier and Type	Field	Description
private static final String	CONTEXT_NAME
private ErrorHandler	errorHandler
private final org.slf4j.Logger	logger
private static final org.slf4j.Logger	LOGGER
private ChangeEventQueue<DataChangeEvent>	queue
private MongoDbSchema	schema
private MongoDbTaskContext	taskContext
private String	taskName

Fields inherited from class io.debezium.connector.common.BaseSourceTask

coordinator

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context, TRANSACTION_BOUNDARY_CONFIG

Constructor Summary

Constructors

Constructor	Description
MongoDbConnectorTask()

Method Summary

Modifier and Type	Method	Description
private void	checkShardSpecificOffsetsIfNeeded(MongoDbConnectorConfig connectorConfig, ReplicaSets currentReplicaSets)
List<org.apache.kafka.connect.source.SourceRecord>	doPoll()
void	doStop()
protected Iterable<Field>	getAllConfigurationFields()
private MongoDbOffsetContext	getPreviousOffset(MongoDbConnectorConfig connectorConfig, ReplicaSets replicaSets)
private ReplicaSets	getReplicaSets(MongoDbConnectorConfig connectorConfig)
ChangeEventSourceCoordinator<MongoDbPartition,MongoDbOffsetContext>	start(Configuration config)
String	version()
protected Configuration	withMaskedSensitiveOptions(Configuration config)

Methods inherited from class io.debezium.connector.common.BaseSourceTask

commit, commitRecord, getAvailableSignalChannels, getNotificationChannels, getPreviousOffsets, getTaskState, logStatistics, poll, registerServiceProviders, resetErrorHandlerRetriesIfNeeded, start, stop

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

CONTEXT_NAME

private static final String CONTEXT_NAME

See Also:

• Constant Field Values

logger

private final org.slf4j.Logger logger

queue

private volatile ChangeEventQueue<DataChangeEvent> queue

taskName

private volatile String taskName

taskContext

private volatile MongoDbTaskContext taskContext

errorHandler

private volatile ErrorHandler errorHandler

schema

private volatile MongoDbSchema schema

Constructor Details

MongoDbConnectorTask

public MongoDbConnectorTask()

Method Details

version

public String version()

start

public ChangeEventSourceCoordinator<MongoDbPartition,MongoDbOffsetContext> start(Configuration config)

Specified by:

start in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

doPoll

public List<org.apache.kafka.connect.source.SourceRecord> doPoll()
                                                          throws InterruptedException

Specified by:

doPoll in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

Throws:

InterruptedException

doStop

public void doStop()

Specified by:

doStop in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

getAllConfigurationFields

protected Iterable<Field> getAllConfigurationFields()

Specified by:

getAllConfigurationFields in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>

getPreviousOffset

private MongoDbOffsetContext getPreviousOffset(MongoDbConnectorConfig connectorConfig,
 ReplicaSets replicaSets)

checkShardSpecificOffsetsIfNeeded

private void checkShardSpecificOffsetsIfNeeded(MongoDbConnectorConfig connectorConfig,
 ReplicaSets currentReplicaSets)

getReplicaSets

private ReplicaSets getReplicaSets(MongoDbConnectorConfig connectorConfig)

withMaskedSensitiveOptions

protected Configuration withMaskedSensitiveOptions(Configuration config)

Overrides:

withMaskedSensitiveOptions in class BaseSourceTask<MongoDbPartition,MongoDbOffsetContext>