Package io.debezium.connector.cassandra

Class CommitLogProcessor

java.lang.Object

io.debezium.connector.cassandra.AbstractProcessor

io.debezium.connector.cassandra.CommitLogProcessor

public class CommitLogProcessor
extends AbstractProcessor

The CommitLogProcessor is used to process CommitLog in CDC directory. Upon readCommitLog, it processes the entire CommitLog specified in the CassandraConnectorConfig and converts each row change in the commit log into a Record, and then emit the log via a KafkaRecordEmitter.

Field Summary

Fields

Modifier and Type	Field	Description
private final File	cdcDir
private final File	commitLogDir
private final CommitLogSegmentReader	commitLogReader
private final CommitLogTransfer	commitLogTransfer
private final CassandraConnectorContext	context
private final Set<String>	erroneousCommitLogs
private final boolean	errorCommitLogReprocessEnabled
private boolean	initial
private final boolean	latestOnly
private static final org.slf4j.Logger	LOGGER
private final CommitLogProcessorMetrics	metrics
private static final String	NAME
private final List<io.debezium.connector.base.ChangeEventQueue<Event>>	queues
private AbstractDirectoryWatcher	watcher

Constructor Summary

Constructors

Constructor	Description
CommitLogProcessor(CassandraConnectorContext context, CommitLogProcessorMetrics metrics, CommitLogSegmentReader commitLogReader, File cdcDir, File commitLogDir)

Method Summary

Modifier and Type	Method	Description
void	destroy()	Override destroy to clean up resources after stopping the processor
void	initialize()	Override initialize to initialize resources before starting the processor
void	process()	The actual work the processor is doing.
(package private) void	processCommitLog(File file)
(package private) void	processLastModifiedCommitLog()

Methods inherited from class io.debezium.connector.cassandra.AbstractProcessor

getName, isRunning, start, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

NAME

private static final String NAME

See Also:

• Constant Field Values

context

private final CassandraConnectorContext context

commitLogReader

private final CommitLogSegmentReader commitLogReader

cdcDir

private final File cdcDir

watcher

private AbstractDirectoryWatcher watcher

queues

private final List<io.debezium.connector.base.ChangeEventQueue<Event>> queues

latestOnly

private final boolean latestOnly

metrics

private final CommitLogProcessorMetrics metrics

initial

private boolean initial

errorCommitLogReprocessEnabled

private final boolean errorCommitLogReprocessEnabled

commitLogTransfer

private final CommitLogTransfer commitLogTransfer

erroneousCommitLogs

private final Set<String> erroneousCommitLogs

commitLogDir

private final File commitLogDir

Constructor Details

CommitLogProcessor

public CommitLogProcessor(CassandraConnectorContext context,
 CommitLogProcessorMetrics metrics,
 CommitLogSegmentReader commitLogReader,
 File cdcDir,
 File commitLogDir)

Method Details

initialize

public void initialize()

Description copied from class: AbstractProcessor

Override initialize to initialize resources before starting the processor

Overrides:

initialize in class AbstractProcessor

destroy

public void destroy()

Description copied from class: AbstractProcessor

Override destroy to clean up resources after stopping the processor

Overrides:

destroy in class AbstractProcessor

process

public void process()
             throws IOException,
InterruptedException

Description copied from class: AbstractProcessor

The actual work the processor is doing. This method will be executed in a while loop until processor stops or encounters exception.

Specified by:

process in class AbstractProcessor

Throws:

IOException

InterruptedException

processCommitLog

void processCommitLog(File file)

processLastModifiedCommitLog

void processLastModifiedCommitLog()