io.ray.streaming.runtime.worker.tasks

Class StreamTask

java.lang.Object

io.ray.streaming.runtime.worker.tasks.StreamTask

All Implemented Interfaces:

Runnable

Direct Known Subclasses:

InputStreamTask, SourceStreamTask

public abstract class StreamTask
extends Object
implements Runnable

StreamTask is a while-loop thread to read message, process message, and send result messages to downstream operators

Field Summary

Fields

Modifier and Type	Field and Description
boolean	isInitialState
protected JobWorker	jobWorker
long	lastCheckpointId
protected Processor	processor
protected DataReader	reader
protected boolean	running
protected boolean	stopped
protected DataWriter	writer

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	StreamTask(Processor processor, JobWorker jobWorker, long lastCheckpointId)

Method Summary

Modifier and Type	Method and Description
void	clearExpiredCpState(long checkpointId)
void	clearExpiredQueueMsg(long checkpointId)
void	close() Close running tasks.
void	doCheckpoint(long checkpointId, Map<String,OffsetInfo> inputPoints)
String	genOpCheckpointKey(long checkpointId)
protected abstract void	init() Task initialization related work.
boolean	isAlive()
void	notifyCheckpointTimeout(long checkpointId)
ChannelRecoverInfo	recover(boolean isRecover)
protected void	requestRollback(String exceptionMsg)
boolean	triggerCheckpoint(Long barrierId)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Runnable

run

Field Detail

isInitialState

public volatile boolean isInitialState

lastCheckpointId

public long lastCheckpointId

processor

protected Processor processor

jobWorker

protected JobWorker jobWorker

reader

protected DataReader reader

writer

protected DataWriter writer

running

protected volatile boolean running

stopped

protected volatile boolean stopped

Constructor Detail

StreamTask

protected StreamTask(Processor processor,
                     JobWorker jobWorker,
                     long lastCheckpointId)

Method Detail

recover

public ChannelRecoverInfo recover(boolean isRecover)

init

protected abstract void init()
                      throws Exception

Task initialization related work.

Throws:

Exception

close

public void close()

Close running tasks.

triggerCheckpoint

public boolean triggerCheckpoint(Long barrierId)

doCheckpoint

public void doCheckpoint(long checkpointId,
                         Map<String,OffsetInfo> inputPoints)

notifyCheckpointTimeout

public void notifyCheckpointTimeout(long checkpointId)

clearExpiredCpState

public void clearExpiredCpState(long checkpointId)

clearExpiredQueueMsg

public void clearExpiredQueueMsg(long checkpointId)

genOpCheckpointKey

public String genOpCheckpointKey(long checkpointId)

requestRollback

protected void requestRollback(String exceptionMsg)

isAlive

public boolean isAlive()