io.ray.streaming.runtime.config.global

Interface CheckpointConfig

All Superinterfaces:

org.aeonbits.owner.Accessible, org.aeonbits.owner.Config, org.aeonbits.owner.Mutable, Serializable

public interface CheckpointConfig
extends Config, org.aeonbits.owner.Mutable

Configurations for checkpointing.

Nested Class Summary

Nested classes/interfaces inherited from interface org.aeonbits.owner.Config

org.aeonbits.owner.Config.ConverterClass, org.aeonbits.owner.Config.DecryptorClass, org.aeonbits.owner.Config.DefaultValue, org.aeonbits.owner.Config.DisableableFeature, org.aeonbits.owner.Config.DisableFeature, org.aeonbits.owner.Config.EncryptedValue, org.aeonbits.owner.Config.HotReload, org.aeonbits.owner.Config.HotReloadType, org.aeonbits.owner.Config.Key, org.aeonbits.owner.Config.LoadPolicy, org.aeonbits.owner.Config.LoadType, org.aeonbits.owner.Config.PreprocessorClasses, org.aeonbits.owner.Config.Separator, org.aeonbits.owner.Config.Sources, org.aeonbits.owner.Config.TokenizerClass

Field Summary

Fields

Modifier and Type	Field and Description
static String	CP_INTERVAL_SECS
static String	CP_PREFIX_KEY_MASTER
static String	CP_PREFIX_KEY_OPERATOR
static String	CP_PREFIX_KEY_WORKER
static String	CP_TIMEOUT_SECS

Method Summary

Modifier and Type	Method and Description
int	cpIntervalSecs() Checkpoint time interval.
int	cpTimeoutSecs() How long should JobMaster wait for checkpoint to finish.
String	jobMasterContextCpPrefixKey() This is used for saving JobMaster's context to storage, user usually don't need to change this.
String	jobWorkerContextCpPrefixKey() This is used for saving JobWorker's context to storage, user usually don't need to change this.
String	jobWorkerOpCpPrefixKey() This is used for saving user operator(in StreamTask)'s context to storage, user usually don't need to change this.

Methods inherited from interface org.aeonbits.owner.Accessible

fill, getProperty, getProperty, list, list, propertyNames, store, storeToXML

Methods inherited from interface org.aeonbits.owner.Mutable

addPropertyChangeListener, addPropertyChangeListener, clear, load, load, removeProperty, removePropertyChangeListener, setProperty

Field Detail

CP_INTERVAL_SECS

static final String CP_INTERVAL_SECS

See Also:

Constant Field Values

CP_TIMEOUT_SECS

static final String CP_TIMEOUT_SECS

See Also:

Constant Field Values

CP_PREFIX_KEY_MASTER

static final String CP_PREFIX_KEY_MASTER

See Also:

Constant Field Values

CP_PREFIX_KEY_WORKER

static final String CP_PREFIX_KEY_WORKER

See Also:

Constant Field Values

CP_PREFIX_KEY_OPERATOR

static final String CP_PREFIX_KEY_OPERATOR

See Also:

Constant Field Values

Method Detail

cpIntervalSecs

@Config.DefaultValue(value="5")
 @Config.Key(value="streaming.checkpoint.interval.secs")
int cpIntervalSecs()

Checkpoint time interval. JobMaster won't trigger 2 checkpoint in less than this time interval.

cpTimeoutSecs

@Config.DefaultValue(value="120")
 @Config.Key(value="streaming.checkpoint.timeout.secs")
int cpTimeoutSecs()

How long should JobMaster wait for checkpoint to finish. When this timeout is reached and JobMaster hasn't received all commits from workers, JobMaster will consider this checkpoint as failed and trigger another checkpoint.

jobMasterContextCpPrefixKey

@Config.DefaultValue(value="job_master_runtime_context_")
 @Config.Key(value="streaming.checkpoint.prefix-key.job-master.context")
String jobMasterContextCpPrefixKey()

This is used for saving JobMaster's context to storage, user usually don't need to change this.

jobWorkerContextCpPrefixKey

@Config.DefaultValue(value="job_worker_context_")
 @Config.Key(value="streaming.checkpoint.prefix-key.job-worker.context")
String jobWorkerContextCpPrefixKey()

This is used for saving JobWorker's context to storage, user usually don't need to change this.

jobWorkerOpCpPrefixKey

@Config.DefaultValue(value="job_worker_op_")
 @Config.Key(value="streaming.checkpoint.prefix-key.job-worker.operator")
String jobWorkerOpCpPrefixKey()

This is used for saving user operator(in StreamTask)'s context to storage, user usually don't need to change this.