io.debezium.relational.history

Class KafkaDatabaseHistory

java.lang.Object

io.debezium.relational.history.AbstractDatabaseHistory

io.debezium.relational.history.KafkaDatabaseHistory

All Implemented Interfaces:

DatabaseHistory

@NotThreadSafe
public class KafkaDatabaseHistory
extends AbstractDatabaseHistory

A DatabaseHistory implementation that records schema changes as normal SourceRecords on the specified topic, and that recovers the history by establishing a Kafka Consumer re-processing all messages on that topic.

Author:

Randall Hauch

Field Summary

Fields

Modifier and Type	Field and Description
static Collection<Field>	ALL_FIELDS
static Field	BOOTSTRAP_SERVERS
private static String	CONSUMER_PREFIX
private Configuration	consumerConfig
private Integer	partition
private int	pollIntervalMs
private org.apache.kafka.clients.producer.KafkaProducer<String,String>	producer
private static String	PRODUCER_PREFIX
private Configuration	producerConfig
private DocumentReader	reader
static Field	RECOVERY_POLL_ATTEMPTS
static Field	RECOVERY_POLL_INTERVAL_MS
private int	recoveryAttempts
static Field	TOPIC
private String	topicName

Fields inherited from class io.debezium.relational.history.AbstractDatabaseHistory

config, logger

Fields inherited from interface io.debezium.relational.history.DatabaseHistory

CONFIGURATION_FIELD_PREFIX_STRING

Constructor Summary

Constructors

Constructor and Description
KafkaDatabaseHistory()

Method Summary

Modifier and Type	Method and Description
void	configure(Configuration config, HistoryRecordComparator comparator) Configure this instance.
protected void	recoverRecords(Tables schema, DdlParser ddlParser, Consumer<HistoryRecord> records)
void	start() Start the history.
void	stop() Stop recording history and release any resources acquired since DatabaseHistory.configure(Configuration, HistoryRecordComparator).
protected void	storeRecord(HistoryRecord record)
String	toString()

Methods inherited from class io.debezium.relational.history.AbstractDatabaseHistory

record, recover

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

TOPIC

public static final Field TOPIC

BOOTSTRAP_SERVERS

public static final Field BOOTSTRAP_SERVERS

RECOVERY_POLL_INTERVAL_MS

public static final Field RECOVERY_POLL_INTERVAL_MS

RECOVERY_POLL_ATTEMPTS

public static final Field RECOVERY_POLL_ATTEMPTS

ALL_FIELDS

public static Collection<Field> ALL_FIELDS

CONSUMER_PREFIX

private static final String CONSUMER_PREFIX

See Also:

Constant Field Values

PRODUCER_PREFIX

private static final String PRODUCER_PREFIX

See Also:

Constant Field Values

reader

private final DocumentReader reader

partition

private final Integer partition

topicName

private String topicName

consumerConfig

private Configuration consumerConfig

producerConfig

private Configuration producerConfig

producer

private org.apache.kafka.clients.producer.KafkaProducer<String,String> producer

recoveryAttempts

private int recoveryAttempts

pollIntervalMs

private int pollIntervalMs

Constructor Detail

KafkaDatabaseHistory

public KafkaDatabaseHistory()

Method Detail

configure

public void configure(Configuration config,
                      HistoryRecordComparator comparator)

Description copied from interface: DatabaseHistory

Configure this instance.

Specified by:

configure in interface DatabaseHistory

Overrides:

configure in class AbstractDatabaseHistory

Parameters:

config - the configuration for this history store

comparator - the function that should be used to compare history records during recovery; may be null if the default comparator is to be used

start

public void start()

Description copied from interface: DatabaseHistory

Start the history.

Specified by:

start in interface DatabaseHistory

Overrides:

start in class AbstractDatabaseHistory

storeRecord

protected void storeRecord(HistoryRecord record)

Specified by:

storeRecord in class AbstractDatabaseHistory

recoverRecords

protected void recoverRecords(Tables schema,
                              DdlParser ddlParser,
                              Consumer<HistoryRecord> records)

Specified by:

recoverRecords in class AbstractDatabaseHistory

stop

public void stop()

Description copied from interface: DatabaseHistory

Stop recording history and release any resources acquired since DatabaseHistory.configure(Configuration, HistoryRecordComparator).

Specified by:

stop in interface DatabaseHistory

Overrides:

stop in class AbstractDatabaseHistory

toString

public String toString()

Overrides:

toString in class Object