io.debezium.connector.mongodb

Class MongoDbConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.mongodb.MongoDbConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@ThreadSafe
public final class MongoDbConnectorTask
extends org.apache.kafka.connect.source.SourceTask

A Kafka Connect source task that replicates the changes from one or more MongoDB replica sets, using one Replicator for each replica set.

Generally, the MongoDbConnector assigns each replica set to a separate task, although multiple replica sets will be assigned to each task when the maximum number of tasks is limited. Regardless, every task will use a separate thread to replicate the contents of each replica set, and each replication thread may use multiple threads to perform an initial sync of the replica set.

Author:

Randall Hauch

See Also:

MongoDbConnector, MongoDbConnectorConfig

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	MongoDbConnectorTask.RecordBatchSummarizer
protected static class	MongoDbConnectorTask.ReplicaSetSummary
protected static class	MongoDbConnectorTask.TaskRecordQueue

Field Summary

Fields

Modifier and Type	Field and Description
private org.slf4j.Logger	logger
private MongoDbConnectorTask.TaskRecordQueue	queue
private MongoDbConnectorTask.RecordBatchSummarizer	recordSummarizer
private ReplicationContext	replContext
private Deque<Replicator>	replicators
private AtomicBoolean	running
private String	taskName

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context

Constructor Summary

Constructors

Constructor and Description
MongoDbConnectorTask() Create an instance of the MongoDB task.

Method Summary

Modifier and Type	Method and Description
List<org.apache.kafka.connect.source.SourceRecord>	poll()
void	start(Map<String,String> props)
void	stop()
String	version()

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commit, commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

logger

private final org.slf4j.Logger logger

running

private final AtomicBoolean running

replicators

private final Deque<Replicator> replicators

recordSummarizer

private final MongoDbConnectorTask.RecordBatchSummarizer recordSummarizer

queue

private volatile MongoDbConnectorTask.TaskRecordQueue queue

taskName

private volatile String taskName

replContext

private volatile ReplicationContext replContext

Constructor Detail

MongoDbConnectorTask

public MongoDbConnectorTask()

Create an instance of the MongoDB task.

Method Detail

version

public String version()

start

public void start(Map<String,String> props)

Specified by:

start in interface org.apache.kafka.connect.connector.Task

Specified by:

start in class org.apache.kafka.connect.source.SourceTask

poll

public List<org.apache.kafka.connect.source.SourceRecord> poll()
                                                        throws InterruptedException

Specified by:

poll in class org.apache.kafka.connect.source.SourceTask

Throws:

InterruptedException

stop

public void stop()

Specified by:

stop in interface org.apache.kafka.connect.connector.Task

Specified by:

stop in class org.apache.kafka.connect.source.SourceTask