io.ray.streaming.runtime.transfer

Class DataWriter

java.lang.Object

io.ray.streaming.runtime.transfer.DataWriter

public class DataWriter
extends Object

DataWriter is a wrapper of streaming c++ DataWriter, which sends data to downstream workers

Constructor Summary

Constructors

Constructor and Description
DataWriter(List<String> outputChannels, List<io.ray.api.BaseActorHandle> toActors, Map<String,OffsetInfo> checkpoints, StreamingWorkerConfig workerConfig)

Method Summary

Modifier and Type	Method and Description
void	broadcastBarrier(long checkpointId, ByteBuffer attach)
void	clearCheckpoint(long checkpointId)
void	close() close writer to release resources
Map<String,OffsetInfo>	getOutputCheckpoints()
void	stop() stop writer
void	write(ChannelId id, ByteBuffer item) Write msg into the specified channel
void	write(Set<ChannelId> ids, ByteBuffer item) Write msg into the specified channels

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataWriter

public DataWriter(List<String> outputChannels,
                  List<io.ray.api.BaseActorHandle> toActors,
                  Map<String,OffsetInfo> checkpoints,
                  StreamingWorkerConfig workerConfig)

Parameters:

outputChannels - output channels ids

toActors - downstream output actors

workerConfig - configuration

checkpoints - offset of each channels

Method Detail

write

public void write(ChannelId id,
                  ByteBuffer item)

Write msg into the specified channel

Parameters:

id - channel id

item - message item data section is specified by [position, limit).

write

public void write(Set<ChannelId> ids,
                  ByteBuffer item)

Write msg into the specified channels

Parameters:

ids - channel ids

item - message item data section is specified by [position, limit). item doesn't have to be a direct buffer.

getOutputCheckpoints

public Map<String,OffsetInfo> getOutputCheckpoints()

broadcastBarrier

public void broadcastBarrier(long checkpointId,
                             ByteBuffer attach)

clearCheckpoint

public void clearCheckpoint(long checkpointId)

stop

public void stop()

stop writer

close

public void close()

close writer to release resources