io.ray.streaming.runtime.transfer

Class DataReader

java.lang.Object

io.ray.streaming.runtime.transfer.DataReader

public class DataReader
extends Object

DataReader is wrapper of streaming c++ DataReader, which read data from channels of upstream workers

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataReader.BarrierType

Constructor Summary

Constructors

Constructor and Description
DataReader(List<String> inputChannels, List<io.ray.api.BaseActorHandle> fromActors, Map<String,OffsetInfo> checkpoints, StreamingWorkerConfig workerConfig)

Method Summary

Modifier and Type	Method and Description
void	close() Close reader to release resource
ChannelRecoverInfo	getQueueRecoverInfo()
ChannelMessage	read(long timeoutMillis) Read message from input channels, if timeout, return null.
void	stop() Stop reader

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataReader

public DataReader(List<String> inputChannels,
                  List<io.ray.api.BaseActorHandle> fromActors,
                  Map<String,OffsetInfo> checkpoints,
                  StreamingWorkerConfig workerConfig)

Parameters:

inputChannels - input channels ids

fromActors - upstream input actors

workerConfig - configuration

Method Detail

read

public ChannelMessage read(long timeoutMillis)

Read message from input channels, if timeout, return null.

Parameters:

timeoutMillis - timeout

Returns:

message or null

getQueueRecoverInfo

public ChannelRecoverInfo getQueueRecoverInfo()

stop

public void stop()

Stop reader

close

public void close()

Close reader to release resource