io.ray.streaming.python.stream

Class PythonKeyDataStream

java.lang.Object

io.ray.streaming.api.stream.Stream<PythonDataStream,Object>

io.ray.streaming.python.stream.PythonDataStream

io.ray.streaming.python.stream.PythonKeyDataStream

All Implemented Interfaces:

PythonStream, Serializable

public class PythonKeyDataStream
extends PythonDataStream
implements PythonStream

Represents a python DataStream returned by a key-by operation.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PythonKeyDataStream(DataStream referencedStream) Create a python stream that reference passed python stream.
PythonKeyDataStream(PythonDataStream input, PythonOperator pythonOperator)

Method Summary

Modifier and Type	Method and Description
KeyDataStream<Object,Object>	asJavaStream() Convert this stream as a java stream.
PythonDataStream	reduce(PythonFunction func) Apply a reduce function to this stream.
PythonDataStream	reduce(String moduleName, String funcName)

Methods inherited from class io.ray.streaming.python.stream.PythonDataStream

broadcast, filter, filter, flatMap, flatMap, getLanguage, keyBy, keyBy, map, map, partitionBy, sink, sink, union, union

Methods inherited from class io.ray.streaming.api.stream.Stream

disableChain, forward, getConfig, getId, getInputStream, getOperator, getOriginalStream, getParallelism, getPartition, getStreamingContext, isProxyStream, setParallelism, setPartition, withChainStrategy, withConfig, withConfig

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonKeyDataStream

public PythonKeyDataStream(PythonDataStream input,
                           PythonOperator pythonOperator)

PythonKeyDataStream

public PythonKeyDataStream(DataStream referencedStream)

Create a python stream that reference passed python stream. Changes in new stream will be reflected in referenced stream and vice versa

Method Detail

reduce

public PythonDataStream reduce(String moduleName,
                               String funcName)

reduce

public PythonDataStream reduce(PythonFunction func)

Apply a reduce function to this stream.

Parameters:

func - The reduce function.

Returns:

A new DataStream.

asJavaStream

public KeyDataStream<Object,Object> asJavaStream()

Convert this stream as a java stream. The converted stream and this stream are the same logical stream, which has same stream id. Changes in converted stream will be reflected in this stream and vice versa.

Overrides:

asJavaStream in class PythonDataStream