Package io.debezium.connector.cassandra

Class CommitLogProcessor

java.lang.Object

io.debezium.connector.cassandra.AbstractProcessor

io.debezium.connector.cassandra.CommitLogProcessor

public class CommitLogProcessor
extends AbstractProcessor

The CommitLogProcessor is used to process CommitLog in CDC directory. Upon readCommitLog, it processes the entire CommitLog specified in the CassandraConnectorConfig and converts each row change in the commit log into a Record, and then emit the log via a KafkaRecordEmitter.

Field Summary

Fields

Modifier and Type	Field	Description
private File	cdcDir
private org.apache.cassandra.db.commitlog.CommitLogReader	commitLogReader
private CommitLogReadHandlerImpl	commitLogReadHandler
private CommitLogTransfer	commitLogTransfer
private Set<String>	erroneousCommitLogs
private boolean	errorCommitLogReprocessEnabled
private boolean	initial
private boolean	latestOnly
private static org.slf4j.Logger	LOGGER
private CommitLogProcessorMetrics	metrics
private static String	NAME
private List<io.debezium.connector.base.ChangeEventQueue<Event>>	queues
private AbstractDirectoryWatcher	watcher

Constructor Summary

Constructors

Constructor	Description
CommitLogProcessor(CassandraConnectorContext context)

Method Summary

Modifier and Type	Method	Description
void	destroy()	Override destroy to clean up resources after stopping the processor
void	initialize()	Override initialize to initialize resources before starting the processor
void	process()	The actual work the processor is doing.
(package private) void	processCommitLog(File file)
(package private) void	processLastModifiedCommitLog()

Methods inherited from class io.debezium.connector.cassandra.AbstractProcessor

getName, isRunning, start, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

NAME

private static final String NAME

See Also:

Constant Field Values

commitLogReader

private final org.apache.cassandra.db.commitlog.CommitLogReader commitLogReader

commitLogReadHandler

private final CommitLogReadHandlerImpl commitLogReadHandler

cdcDir

private final File cdcDir

watcher

private final AbstractDirectoryWatcher watcher

queues

private final List<io.debezium.connector.base.ChangeEventQueue<Event>> queues

latestOnly

private final boolean latestOnly

metrics

private final CommitLogProcessorMetrics metrics

initial

private boolean initial

errorCommitLogReprocessEnabled

private final boolean errorCommitLogReprocessEnabled

commitLogTransfer

private final CommitLogTransfer commitLogTransfer

erroneousCommitLogs

private final Set<String> erroneousCommitLogs

Constructor Detail

CommitLogProcessor

public CommitLogProcessor(CassandraConnectorContext context)
                   throws IOException

Throws:

IOException

Method Detail

initialize

public void initialize()

Description copied from class: AbstractProcessor

Override initialize to initialize resources before starting the processor

Overrides:

initialize in class AbstractProcessor

destroy

public void destroy()

Description copied from class: AbstractProcessor

Override destroy to clean up resources after stopping the processor

Overrides:

destroy in class AbstractProcessor

process

public void process()
             throws IOException,
                    InterruptedException

Description copied from class: AbstractProcessor

The actual work the processor is doing. This method will be executed in a while loop until processor stops or encounters exception.

Specified by:

process in class AbstractProcessor

Throws:

IOException

InterruptedException

processCommitLog

void processCommitLog(File file)

processLastModifiedCommitLog

void processLastModifiedCommitLog()