io.debezium.connector.mysql

Class MySqlConnectorTask

java.lang.Object

org.apache.kafka.connect.source.SourceTask

io.debezium.connector.mysql.MySqlConnectorTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

@NotThreadSafe
public final class MySqlConnectorTask
extends org.apache.kafka.connect.source.SourceTask

A Kafka Connect source task reads the MySQL binary log and generate the corresponding data change events.

Author:

Randall Hauch

See Also:

MySqlConnector

Field Summary

Fields

Modifier and Type	Field and Description
private BinlogReader	binlogReader
private AbstractReader	currentReader
private org.slf4j.Logger	logger
private AtomicBoolean	runningReader
private SnapshotReader	snapshotReader
private MySqlTaskContext	taskContext

Fields inherited from class org.apache.kafka.connect.source.SourceTask

context

Constructor Summary

Constructors

Constructor and Description
MySqlConnectorTask() Create an instance of the log reader that uses Kafka to store database schema history and the default topic selector of "<serverName>.<databaseName>.<tableName>" for data and "<serverName>" for metadata.

Method Summary

Modifier and Type	Method and Description
protected String	earliestBinlogFilename() Determine the earliest binlog filename that is still available in the server.
protected boolean	isBinlogAvailable() Determine whether the binlog position as set on the SourceInfo is available in the server.
protected boolean	isGtidModeEnabled() Determine whether the MySQL server has GTIDs enabled.
protected boolean	isRowBinlogEnabled() Determine whether the MySQL server has the row-level binlog enabled.
List<org.apache.kafka.connect.source.SourceRecord>	poll()
protected void	skipReadBinlog()
void	start(Map<String,String> props)
void	stop()
protected void	transitionToReadBinlog() Transition from the snapshot reader to the binlog reader.
String	version()

Methods inherited from class org.apache.kafka.connect.source.SourceTask

commit, commitRecord, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

logger

private final org.slf4j.Logger logger

runningReader

private final AtomicBoolean runningReader

taskContext

private volatile MySqlTaskContext taskContext

snapshotReader

private volatile SnapshotReader snapshotReader

binlogReader

private volatile BinlogReader binlogReader

currentReader

private volatile AbstractReader currentReader

Constructor Detail

MySqlConnectorTask

public MySqlConnectorTask()

Create an instance of the log reader that uses Kafka to store database schema history and the default topic selector of "<serverName>.<databaseName>.<tableName>" for data and "<serverName>" for metadata.

Method Detail

version

public String version()

start

public void start(Map<String,String> props)

Specified by:

start in interface org.apache.kafka.connect.connector.Task

Specified by:

start in class org.apache.kafka.connect.source.SourceTask

poll

public List<org.apache.kafka.connect.source.SourceRecord> poll()
                                                        throws InterruptedException

Specified by:

poll in class org.apache.kafka.connect.source.SourceTask

Throws:

InterruptedException

stop

public void stop()

Specified by:

stop in interface org.apache.kafka.connect.connector.Task

Specified by:

stop in class org.apache.kafka.connect.source.SourceTask

transitionToReadBinlog

protected void transitionToReadBinlog()

Transition from the snapshot reader to the binlog reader. This method is synchronized (along with start(Map) and stop()) to ensure that we don't transition while we've already begun to stop.

skipReadBinlog

protected void skipReadBinlog()

isBinlogAvailable

protected boolean isBinlogAvailable()

Determine whether the binlog position as set on the SourceInfo is available in the server.

Returns:

true if the server has the binlog coordinates, or false otherwise

earliestBinlogFilename

protected String earliestBinlogFilename()

Determine the earliest binlog filename that is still available in the server.

Returns:

the name of the earliest binlog filename, or null if there are none.

isGtidModeEnabled

protected boolean isGtidModeEnabled()

Determine whether the MySQL server has GTIDs enabled.

Returns:

false if the server's gtid_mode is set and is OFF, or true otherwise

isRowBinlogEnabled

protected boolean isRowBinlogEnabled()

Determine whether the MySQL server has the row-level binlog enabled.

Returns:

true if the server's binlog_format is set to ROW, or false otherwise