io.debezium.connector.mongodb

Class MongoDbConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.common.BaseSourceTask

io.debezium.connector.mongodb.MongoDbConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@ThreadSafe
public final class MongoDbConnectorTask
extends BaseSourceTask

A Kafka Connect source task that replicates the changes from one or more MongoDB replica sets, using one Replicator for each replica set.

Generally, the MongoDbConnector assigns each replica set to a separate task, although multiple replica sets will be assigned to each task when the maximum number of tasks is limited. Regardless, every task will use a separate thread to replicate the contents of each replica set, and each replication thread may use multiple threads to perform an initial sync of the replica set.

Author:

Randall Hauch

See Also:

MongoDbConnector, MongoDbConnectorConfig

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	MongoDbConnectorTask.RecordBatchSummarizer
protected static class	MongoDbConnectorTask.ReplicaSetSummary

Nested classes/interfaces inherited from class io.debezium.connector.common.BaseSourceTask

BaseSourceTask.State

Field Summary

Fields

Modifier and Type	Field and Description
private static String	CONTEXT_NAME
private org.slf4j.Logger	logger
private ChangeEventQueue<org.apache.kafka.connect.source.SourceRecord>	queue
private MongoDbConnectorTask.RecordBatchSummarizer	recordSummarizer
private Throwable	replicatorError
private Deque<Replicator>	replicators
private AtomicBoolean	running
private MongoDbTaskContext	taskContext
private String	taskName

Fields inherited from class io.debezium.connector.common.BaseSourceTask

state

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context

Constructor Summary

Constructors

Constructor and Description
MongoDbConnectorTask()

Method Summary

Modifier and Type	Method and Description
private void	failedReplicator(Throwable t)
protected Iterable<Field>	getAllConfigurationFields()
private LoggingContext.PreviousContext	getLoggingContext()
List<org.apache.kafka.connect.source.SourceRecord>	poll()
ChangeEventSourceCoordinator	start(Configuration config)
void	stop()
String	version()

Methods inherited from class io.debezium.connector.common.BaseSourceTask

commit, commitRecord, getPreviousOffset, start

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONTEXT_NAME

private static final String CONTEXT_NAME

See Also:

Constant Field Values

logger

private final org.slf4j.Logger logger

running

private final AtomicBoolean running

replicators

private final Deque<Replicator> replicators

recordSummarizer

private final MongoDbConnectorTask.RecordBatchSummarizer recordSummarizer

queue

private volatile ChangeEventQueue<org.apache.kafka.connect.source.SourceRecord> queue

taskName

private volatile String taskName

taskContext

private volatile MongoDbTaskContext taskContext

replicatorError

private volatile Throwable replicatorError

Constructor Detail

MongoDbConnectorTask

public MongoDbConnectorTask()

Method Detail

version

public String version()

start

public ChangeEventSourceCoordinator start(Configuration config)

Specified by:

start in class BaseSourceTask

poll

public List<org.apache.kafka.connect.source.SourceRecord> poll()
                                                        throws InterruptedException

Specified by:

poll in class org.apache.kafka.connect.source.SourceTask

Throws:

InterruptedException

stop

public void stop()

Specified by:

stop in interface org.apache.kafka.connect.connector.Task

Specified by:

stop in class org.apache.kafka.connect.source.SourceTask

getAllConfigurationFields

protected Iterable<Field> getAllConfigurationFields()

Specified by:

getAllConfigurationFields in class BaseSourceTask

getLoggingContext

private LoggingContext.PreviousContext getLoggingContext()

failedReplicator

private void failedReplicator(Throwable t)