io.ray.streaming.api.stream

Class KeyDataStream<K,T>

java.lang.Object

io.ray.streaming.api.stream.Stream<DataStream<T>,T>

io.ray.streaming.api.stream.DataStream<T>

io.ray.streaming.api.stream.KeyDataStream<K,T>

Type Parameters:

K - Type of the key.

T - Type of the data.

All Implemented Interfaces:

Serializable

public class KeyDataStream<K,T>
extends DataStream<T>

Represents a DataStream returned by a key-by operation.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
KeyDataStream(DataStream<T> input, StreamOperator streamOperator)
KeyDataStream(PythonDataStream referencedStream) Create a java stream that reference passed python stream.

Method Summary

Modifier and Type	Method and Description
<A,O> DataStream<O>	aggregate(AggregateFunction<T,A,O> aggregateFunction) Apply an aggregate Function to this stream.
PythonKeyDataStream	asPythonStream() Convert this stream as a python stream.
DataStream<T>	reduce(ReduceFunction reduceFunction) Apply a reduce function to this stream.

Methods inherited from class io.ray.streaming.api.stream.DataStream

broadcast, filter, flatMap, getLanguage, join, keyBy, map, partitionBy, process, sink, union, union

Methods inherited from class io.ray.streaming.api.stream.Stream

disableChain, forward, getConfig, getId, getInputStream, getOperator, getOriginalStream, getParallelism, getPartition, getStreamingContext, isProxyStream, setParallelism, setPartition, withChainStrategy, withConfig, withConfig

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KeyDataStream

public KeyDataStream(DataStream<T> input,
                     StreamOperator streamOperator)

KeyDataStream

public KeyDataStream(PythonDataStream referencedStream)

Create a java stream that reference passed python stream. Changes in new stream will be reflected in referenced stream and vice versa

Method Detail

reduce

public DataStream<T> reduce(ReduceFunction reduceFunction)

Apply a reduce function to this stream.

Parameters:

reduceFunction - The reduce function.

Returns:

A new DataStream.

aggregate

public <A,O> DataStream<O> aggregate(AggregateFunction<T,A,O> aggregateFunction)

Apply an aggregate Function to this stream.

Type Parameters:

A - The type of aggregated intermediate data.

O - The type of result data.

Parameters:

aggregateFunction - The aggregate function

Returns:

A new DataStream.

asPythonStream

public PythonKeyDataStream asPythonStream()

Convert this stream as a python stream. The converted stream and this stream are the same logical stream, which has same stream id. Changes in converted stream will be reflected in this stream and vice versa.

Overrides:

asPythonStream in class DataStream<T>