io.ray.streaming.runtime.worker

Class JobWorker

java.lang.Object

io.ray.streaming.runtime.worker.JobWorker

All Implemented Interfaces:

Serializable

public class JobWorker
extends Object
implements Serializable

The streaming worker implementation class, it is ray actor. JobWorker is created by JobMaster through ray api, and JobMaster communicates with JobWorker through Ray.call().

The JobWorker is responsible for creating tasks and defines the methods of communication between workers.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
JobWorker()

Method Summary

Modifier and Type	Method and Description
ExecutionVertex	getExecutionVertex()
StreamTask	getTask()
int	getTaskId()
StreamingWorkerConfig	getWorkerConfig()
JobWorkerContext	getWorkerContext()
Boolean	init(JobWorkerContext workerContext) Initialize JobWorker and data communication pipeline.
void	onReaderMessage(byte[] buffer) Used by upstream streaming queue to send data to this actor
byte[]	onReaderMessageSync(byte[] buffer) Used by upstream streaming queue to send data to this actor and receive result from this actor
void	onWriterMessage(byte[] buffer) Used by downstream streaming queue to send data to this actor
byte[]	onWriterMessageSync(byte[] buffer) Used by downstream streaming queue to send data to this actor and receive result from this actor
Boolean	start() Start worker's stream tasks.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JobWorker

public JobWorker()

Method Detail

init

public Boolean init(JobWorkerContext workerContext)

Initialize JobWorker and data communication pipeline.

start

public Boolean start()

Start worker's stream tasks.

Returns:

result

getTaskId

public int getTaskId()

getWorkerConfig

public StreamingWorkerConfig getWorkerConfig()

getWorkerContext

public JobWorkerContext getWorkerContext()

getExecutionVertex

public ExecutionVertex getExecutionVertex()

getTask

public StreamTask getTask()

onReaderMessage

public void onReaderMessage(byte[] buffer)

Used by upstream streaming queue to send data to this actor

onReaderMessageSync

public byte[] onReaderMessageSync(byte[] buffer)

Used by upstream streaming queue to send data to this actor and receive result from this actor

onWriterMessage

public void onWriterMessage(byte[] buffer)

Used by downstream streaming queue to send data to this actor

onWriterMessageSync

public byte[] onWriterMessageSync(byte[] buffer)

Used by downstream streaming queue to send data to this actor and receive result from this actor