io.debezium.connector.mongodb

Class MongoDbConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.common.BaseSourceTask

io.debezium.connector.mongodb.MongoDbConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@ThreadSafe
public final class MongoDbConnectorTask
extends BaseSourceTask

A Kafka Connect source task that replicates the changes from one or more MongoDB replica sets.

Generally, the MongoDbConnector assigns each replica set to a separate task, although multiple replica sets will be assigned to each task when the maximum number of tasks is limited. Regardless, every task will use a separate thread to replicate the contents of each replica set, and each replication thread may use multiple threads to perform an initial sync of the replica set.

Author:

Randall Hauch

See Also:

MongoDbConnector, MongoDbConnectorConfig

Nested Class Summary

Nested classes/interfaces inherited from class io.debezium.connector.common.BaseSourceTask

BaseSourceTask.State

Field Summary

Fields

Modifier and Type	Field and Description
private static String	CONTEXT_NAME
private ErrorHandler	errorHandler
private org.slf4j.Logger	logger
private ChangeEventQueue<DataChangeEvent>	queue
private MongoDbSchema	schema
private MongoDbTaskContext	taskContext
private String	taskName

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context

Constructor Summary

Constructors

Constructor and Description
MongoDbConnectorTask()

Method Summary

Modifier and Type	Method and Description
List<org.apache.kafka.connect.source.SourceRecord>	doPoll()
void	doStop()
protected Iterable<Field>	getAllConfigurationFields()
private MongoDbOffsetContext	getPreviousOffsets(MongoDbConnectorConfig connectorConfig, ReplicaSets replicaSets)
private ReplicaSets	getReplicaSets(Configuration config)
ChangeEventSourceCoordinator	start(Configuration config)
String	version()

Methods inherited from class io.debezium.connector.common.BaseSourceTask

commit, commitRecord, getPreviousOffset, poll, start, stop

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONTEXT_NAME

private static final String CONTEXT_NAME

See Also:

Constant Field Values

logger

private final org.slf4j.Logger logger

queue

private volatile ChangeEventQueue<DataChangeEvent> queue

taskName

private volatile String taskName

taskContext

private volatile MongoDbTaskContext taskContext

errorHandler

private volatile ErrorHandler errorHandler

schema

private volatile MongoDbSchema schema

Constructor Detail

MongoDbConnectorTask

public MongoDbConnectorTask()

Method Detail

version

public String version()

start

public ChangeEventSourceCoordinator start(Configuration config)

Specified by:

start in class BaseSourceTask

doPoll

public List<org.apache.kafka.connect.source.SourceRecord> doPoll()
                                                          throws InterruptedException

Specified by:

doPoll in class BaseSourceTask

Throws:

InterruptedException

doStop

public void doStop()

Specified by:

doStop in class BaseSourceTask

getAllConfigurationFields

protected Iterable<Field> getAllConfigurationFields()

Specified by:

getAllConfigurationFields in class BaseSourceTask

getPreviousOffsets

private MongoDbOffsetContext getPreviousOffsets(MongoDbConnectorConfig connectorConfig,
                                                ReplicaSets replicaSets)

getReplicaSets

private ReplicaSets getReplicaSets(Configuration config)