io.ray.streaming.runtime.worker

类 JobWorker

java.lang.Object

io.ray.streaming.runtime.worker.JobWorker

所有已实现的接口:

Serializable

public class JobWorker
extends Object
implements Serializable

The streaming worker implementation class, it is ray actor. JobWorker is created by JobMaster through ray api, and JobMaster communicates with JobWorker through Ray.call().

The JobWorker is responsible for creating tasks and defines the methods of communication between workers.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
ContextBackend	contextBackend
Object	initialStateChangeLock
AtomicBoolean	isRecreate isRecreate=true means this worker is initialized more than once after actor created.

构造器概要

构造器

构造器和说明
JobWorker(ExecutionVertex executionVertex)

方法概要

限定符和类型	方法和说明
Boolean	checkIfNeedRollback(Long startCallTs)
Boolean	clearExpiredCheckpoint(Long expiredStateCpId, Long expiredQueueCpId)
ExecutionVertex	getExecutionVertex()
StreamTask	getTask()
StreamingWorkerConfig	getWorkerConfig()
JobWorkerContext	getWorkerContext()
Boolean	init(JobWorkerContext workerContext) Initialize JobWorker and data communication pipeline.
Boolean	notifyCheckpointTimeout(Long checkpointId)
void	onReaderMessage(byte[] buffer) Used by upstream streaming queue to send data to this actor
byte[]	onReaderMessageSync(byte[] buffer) Used by upstream streaming queue to send data to this actor and receive result from this actor
void	onWriterMessage(byte[] buffer) Used by downstream streaming queue to send data to this actor
byte[]	onWriterMessageSync(byte[] buffer) Used by downstream streaming queue to send data to this actor and receive result from this actor
void	requestRollback(String exceptionMsg)
CallResult<ChannelRecoverInfo>	rollback(Long checkpointId, Long startRollbackTs) Start worker's stream tasks with specific checkpoint ID.
void	saveContext()
Boolean	triggerCheckpoint(Long barrierId) Trigger source job worker checkpoint

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

initialStateChangeLock

public final Object initialStateChangeLock

isRecreate

public AtomicBoolean isRecreate

isRecreate=true means this worker is initialized more than once after actor created.

contextBackend

public ContextBackend contextBackend

构造器详细资料

JobWorker

public JobWorker(ExecutionVertex executionVertex)

方法详细资料

saveContext

public void saveContext()

init

public Boolean init(JobWorkerContext workerContext)

Initialize JobWorker and data communication pipeline.

rollback

public CallResult<ChannelRecoverInfo> rollback(Long checkpointId,
                                               Long startRollbackTs)

Start worker's stream tasks with specific checkpoint ID.

返回:

a CallResult with ChannelRecoverInfo, contains ChannelRecoverInfo.ChannelCreationStatus of each input queue.

triggerCheckpoint

public Boolean triggerCheckpoint(Long barrierId)

Trigger source job worker checkpoint

notifyCheckpointTimeout

public Boolean notifyCheckpointTimeout(Long checkpointId)

clearExpiredCheckpoint

public Boolean clearExpiredCheckpoint(Long expiredStateCpId,
                                      Long expiredQueueCpId)

requestRollback

public void requestRollback(String exceptionMsg)

checkIfNeedRollback

public Boolean checkIfNeedRollback(Long startCallTs)

getWorkerConfig

public StreamingWorkerConfig getWorkerConfig()

getWorkerContext

public JobWorkerContext getWorkerContext()

getExecutionVertex

public ExecutionVertex getExecutionVertex()

getTask

public StreamTask getTask()

onReaderMessage

public void onReaderMessage(byte[] buffer)

Used by upstream streaming queue to send data to this actor

onReaderMessageSync

public byte[] onReaderMessageSync(byte[] buffer)

Used by upstream streaming queue to send data to this actor and receive result from this actor

onWriterMessage

public void onWriterMessage(byte[] buffer)

Used by downstream streaming queue to send data to this actor

onWriterMessageSync

public byte[] onWriterMessageSync(byte[] buffer)

Used by downstream streaming queue to send data to this actor and receive result from this actor