Package io.debezium.connector.spanner.task.leader

Class LeaderAction

java.lang.Object

io.debezium.connector.spanner.task.leader.LeaderAction

public class LeaderAction
extends Object

This class contains all the logic for the leader task functionality. Upon startup, the leader first checks if the sync topic is empty. If so, it assumes the connector is operating from a fresh start and sends an initial change stream query to receive back a list of initial change stream tokens. Then, it waits for all survived tasks to send a list of REBALANCE_ANSWER messages. Then, it rebalances change stream partitions from obsolete to new (survived) tasks. Finally, it generates a new epoch message with the new assignment of partitions and writes it into the sync topic.

Field Summary

Fields

Modifier and Type	Field	Description
private final io.debezium.util.Clock	clock
private static final Duration	EPOCH_OFFSET_UPDATE_DURATION
private Consumer<Throwable>	errorHandler
private final KafkaConsumerAdminService	kafkaAdminService
private final LeaderService	leaderService
private Thread	leaderThread
private static final org.slf4j.Logger	LOGGER
private final Duration	sleepInterval
private final TaskPartitionRebalancer	taskPartitonRebalancer
private final TaskSyncContextHolder	taskSyncContextHolder
private final TaskSyncPublisher	taskSyncPublisher

Constructor Summary

Constructors

Constructor	Description
LeaderAction(TaskSyncContextHolder taskSyncContextHolder, KafkaConsumerAdminService kafkaAdminService, LeaderService leaderService, TaskPartitionRebalancer taskPartitonRebalancer, TaskSyncPublisher taskSyncPublisher, Consumer<Throwable> errorHandler)

Method Summary

Modifier and Type	Method	Description
private Thread	createLeaderThread(long rebalanceGenerationId)
private void	newEpoch(long rebalanceGenerationId)
private TaskSyncContext	publishEpochOffset()
void	start(long rebalanceGenerationId)
void	stop(long rebalanceGenerationId)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

EPOCH_OFFSET_UPDATE_DURATION

private static final Duration EPOCH_OFFSET_UPDATE_DURATION

taskSyncContextHolder

private final TaskSyncContextHolder taskSyncContextHolder

kafkaAdminService

private final KafkaConsumerAdminService kafkaAdminService

leaderService

private final LeaderService leaderService

taskPartitonRebalancer

private final TaskPartitionRebalancer taskPartitonRebalancer

taskSyncPublisher

private final TaskSyncPublisher taskSyncPublisher

leaderThread

private volatile Thread leaderThread

errorHandler

private Consumer<Throwable> errorHandler

sleepInterval

private final Duration sleepInterval

clock

private final io.debezium.util.Clock clock

Constructor Details

LeaderAction

public LeaderAction(TaskSyncContextHolder taskSyncContextHolder,
 KafkaConsumerAdminService kafkaAdminService,
 LeaderService leaderService,
 TaskPartitionRebalancer taskPartitonRebalancer,
 TaskSyncPublisher taskSyncPublisher,
 Consumer<Throwable> errorHandler)

Method Details

createLeaderThread

private Thread createLeaderThread(long rebalanceGenerationId)

publishEpochOffset

private TaskSyncContext publishEpochOffset()
                                    throws InterruptedException

Throws:

InterruptedException

start

public void start(long rebalanceGenerationId)

stop

public void stop(long rebalanceGenerationId)

newEpoch

private void newEpoch(long rebalanceGenerationId)
               throws InterruptedException

Throws:

InterruptedException