io.ray.streaming.api.stream

类 DataStream<T>

java.lang.Object

io.ray.streaming.api.stream.Stream<DataStream<T>,T>

io.ray.streaming.api.stream.DataStream<T>

类型参数:

T - Type of data in the stream.

所有已实现的接口:

Serializable

直接已知子类:

DataStreamSource, JoinStream, KeyDataStream, UnionStream

public class DataStream<T>
extends Stream<DataStream<T>,T>

Represents a stream of data.

This class defines all the streaming operations.

另请参阅:

序列化表格

构造器概要

构造器

构造器和说明
DataStream(DataStream<R> input, StreamOperator streamOperator)
DataStream(DataStream<R> input, StreamOperator streamOperator, Partition<T> partition)
DataStream(PythonDataStream referencedStream) Create a java stream that reference passed python stream.
DataStream(StreamingContext streamingContext, StreamOperator streamOperator)
DataStream(StreamingContext streamingContext, StreamOperator streamOperator, Partition<T> partition)

方法概要

限定符和类型	方法和说明
PythonDataStream	asPythonStream() Convert this stream as a python stream.
DataStream<T>	broadcast() Apply broadcast to this stream.
DataStream<T>	filter(FilterFunction<T> filterFunction)
<R> DataStream<R>	flatMap(FlatMapFunction<T,R> flatMapFunction) Apply a flat-map function to this stream.
Language	getLanguage()
<O,R> JoinStream<T,O,R>	join(DataStream<O> other) Apply a join transformation to this stream, with another stream.
<K> KeyDataStream<K,T>	keyBy(KeyFunction<T,K> keyFunction) Apply a key-by function to this stream.
<R> DataStream<R>	map(MapFunction<T,R> mapFunction) Apply a map function to this stream.
DataStream<T>	partitionBy(Partition<T> partition) Apply a partition to this stream.
<R> DataStream<R>	process()
DataStreamSink<T>	sink(SinkFunction<T> sinkFunction) Apply a sink function and get a StreamSink.
DataStream<T>	union(DataStream<T> stream, DataStream<T>... others) Apply union transformations to this stream by merging DataStream outputs of the same type with each other.
DataStream<T>	union(List<DataStream<T>> streams) Apply union transformations to this stream by merging DataStream outputs of the same type with each other.

从类继承的方法 io.ray.streaming.api.stream.Stream

disableChain, forward, getConfig, getId, getInputStream, getOperator, getOriginalStream, getParallelism, getPartition, getStreamingContext, isProxyStream, setParallelism, setPartition, withChainStrategy, withConfig, withConfig

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DataStream

public DataStream(StreamingContext streamingContext,
                  StreamOperator streamOperator)

DataStream

public DataStream(StreamingContext streamingContext,
                  StreamOperator streamOperator,
                  Partition<T> partition)

DataStream

public DataStream(DataStream<R> input,
                  StreamOperator streamOperator)

DataStream

public DataStream(DataStream<R> input,
                  StreamOperator streamOperator,
                  Partition<T> partition)

DataStream

public DataStream(PythonDataStream referencedStream)

Create a java stream that reference passed python stream. Changes in new stream will be reflected in referenced stream and vice versa

方法详细资料

map

public <R> DataStream<R> map(MapFunction<T,R> mapFunction)

Apply a map function to this stream.

类型参数:

R - Type of data returned by the map function.

参数:

mapFunction - The map function.

返回:

A new DataStream.

flatMap

public <R> DataStream<R> flatMap(FlatMapFunction<T,R> flatMapFunction)

Apply a flat-map function to this stream.

类型参数:

R - Type of data returned by the flatmap function.

参数:

flatMapFunction - The FlatMapFunction

返回:

A new DataStream

filter

public DataStream<T> filter(FilterFunction<T> filterFunction)

union

@SafeVarargs
public final DataStream<T> union(DataStream<T> stream,
                                              DataStream<T>... others)

Apply union transformations to this stream by merging DataStream outputs of the same type with each other.

参数:

stream - The DataStream to union output with.

others - The other DataStreams to union output with.

返回:

A new UnionStream.

union

public final DataStream<T> union(List<DataStream<T>> streams)

Apply union transformations to this stream by merging DataStream outputs of the same type with each other.

参数:

streams - The DataStreams to union output with.

返回:

A new UnionStream.

join

public <O,R> JoinStream<T,O,R> join(DataStream<O> other)

Apply a join transformation to this stream, with another stream.

类型参数:

O - The type of the other stream data.

R - The type of the data in the joined stream.

参数:

other - Another stream.

返回:

A new JoinStream.

process

public <R> DataStream<R> process()

sink

public DataStreamSink<T> sink(SinkFunction<T> sinkFunction)

Apply a sink function and get a StreamSink.

参数:

sinkFunction - The sink function.

返回:

A new StreamSink.

keyBy

public <K> KeyDataStream<K,T> keyBy(KeyFunction<T,K> keyFunction)

Apply a key-by function to this stream.

类型参数:

K - The type of the key.

参数:

keyFunction - the key function.

返回:

A new KeyDataStream.

broadcast

public DataStream<T> broadcast()

Apply broadcast to this stream.

返回:

This stream.

partitionBy

public DataStream<T> partitionBy(Partition<T> partition)

Apply a partition to this stream.

参数:

partition - The partitioning strategy.

返回:

This stream.

asPythonStream

public PythonDataStream asPythonStream()

Convert this stream as a python stream. The converted stream and this stream are the same logical stream, which has same stream id. Changes in converted stream will be reflected in this stream and vice versa.

getLanguage

public Language getLanguage()

指定者:

getLanguage 在类中 Stream<DataStream<T>,T>