io.ray.streaming.python.stream

类 PythonDataStream

java.lang.Object

io.ray.streaming.api.stream.Stream<PythonDataStream,Object>

io.ray.streaming.python.stream.PythonDataStream

所有已实现的接口:

PythonStream, Serializable

直接已知子类:

PythonKeyDataStream, PythonStreamSource, PythonUnionStream

public class PythonDataStream
extends Stream<PythonDataStream,Object>
implements PythonStream

Represents a stream of data whose transformations will be executed in python.

另请参阅:

序列化表格

构造器概要

构造器

限定符	构造器和说明
	PythonDataStream(DataStream referencedStream) Create a python stream that reference passed java stream.
	PythonDataStream(PythonDataStream input, PythonOperator pythonOperator)
	PythonDataStream(PythonDataStream input, PythonOperator pythonOperator, Partition<Object> partition)
protected	PythonDataStream(StreamingContext streamingContext, PythonOperator pythonOperator)
protected	PythonDataStream(StreamingContext streamingContext, PythonOperator pythonOperator, Partition<Object> partition)

方法概要

限定符和类型	方法和说明
DataStream<Object>	asJavaStream() Convert this stream as a java stream.
PythonDataStream	broadcast() Apply broadcast to this stream.
PythonDataStream	filter(PythonFunction func) Apply a filter function to this stream.
PythonDataStream	filter(String moduleName, String funcName)
PythonDataStream	flatMap(PythonFunction func) Apply a flat-map function to this stream.
PythonDataStream	flatMap(String moduleName, String funcName)
Language	getLanguage()
PythonKeyDataStream	keyBy(PythonFunction func) Apply a key-by function to this stream.
PythonKeyDataStream	keyBy(String moduleName, String funcName)
PythonDataStream	map(PythonFunction func) Apply a map function to this stream.
PythonDataStream	map(String moduleName, String funcName)
PythonDataStream	partitionBy(PythonPartition partition) Apply a partition to this stream.
PythonStreamSink	sink(PythonFunction func) Apply a sink function and get a StreamSink.
PythonStreamSink	sink(String moduleName, String funcName)
PythonDataStream	union(List<PythonDataStream> streams) Apply union transformations to this stream by merging PythonDataStream outputs of the same type with each other.
PythonDataStream	union(PythonDataStream stream, PythonDataStream... others) Apply union transformations to this stream by merging PythonDataStream outputs of the same type with each other.

从类继承的方法 io.ray.streaming.api.stream.Stream

disableChain, forward, getConfig, getId, getInputStream, getOperator, getOriginalStream, getParallelism, getPartition, getStreamingContext, isProxyStream, setParallelism, setPartition, withChainStrategy, withConfig, withConfig

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

PythonDataStream

protected PythonDataStream(StreamingContext streamingContext,
                           PythonOperator pythonOperator)

PythonDataStream

protected PythonDataStream(StreamingContext streamingContext,
                           PythonOperator pythonOperator,
                           Partition<Object> partition)

PythonDataStream

public PythonDataStream(PythonDataStream input,
                        PythonOperator pythonOperator)

PythonDataStream

public PythonDataStream(PythonDataStream input,
                        PythonOperator pythonOperator,
                        Partition<Object> partition)

PythonDataStream

public PythonDataStream(DataStream referencedStream)

Create a python stream that reference passed java stream. Changes in new stream will be reflected in referenced stream and vice versa

方法详细资料

map

public PythonDataStream map(String moduleName,
                            String funcName)

map

public PythonDataStream map(PythonFunction func)

Apply a map function to this stream.

参数:

func - The python MapFunction.

返回:

A new PythonDataStream.

flatMap

public PythonDataStream flatMap(String moduleName,
                                String funcName)

flatMap

public PythonDataStream flatMap(PythonFunction func)

Apply a flat-map function to this stream.

参数:

func - The python FlapMapFunction.

返回:

A new PythonDataStream

filter

public PythonDataStream filter(String moduleName,
                               String funcName)

filter

public PythonDataStream filter(PythonFunction func)

Apply a filter function to this stream.

参数:

func - The python FilterFunction.

返回:

A new PythonDataStream that contains only the elements satisfying the given filter predicate.

union

public final PythonDataStream union(PythonDataStream stream,
                                    PythonDataStream... others)

Apply union transformations to this stream by merging PythonDataStream outputs of the same type with each other.

参数:

stream - The DataStream to union output with.

others - The other DataStreams to union output with.

返回:

A new UnionStream.

union

public final PythonDataStream union(List<PythonDataStream> streams)

Apply union transformations to this stream by merging PythonDataStream outputs of the same type with each other.

参数:

streams - The DataStreams to union output with.

返回:

A new UnionStream.

sink

public PythonStreamSink sink(String moduleName,
                             String funcName)

sink

public PythonStreamSink sink(PythonFunction func)

Apply a sink function and get a StreamSink.

参数:

func - The python SinkFunction.

返回:

A new StreamSink.

keyBy

public PythonKeyDataStream keyBy(String moduleName,
                                 String funcName)

keyBy

public PythonKeyDataStream keyBy(PythonFunction func)

Apply a key-by function to this stream.

参数:

func - the python keyFunction.

返回:

A new KeyDataStream.

broadcast

public PythonDataStream broadcast()

Apply broadcast to this stream.

返回:

This stream.

partitionBy

public PythonDataStream partitionBy(PythonPartition partition)

Apply a partition to this stream.

参数:

partition - The partitioning strategy.

返回:

This stream.

asJavaStream

public DataStream<Object> asJavaStream()

Convert this stream as a java stream. The converted stream and this stream are the same logical stream, which has same stream id. Changes in converted stream will be reflected in this stream and vice versa.

getLanguage

public Language getLanguage()

指定者:

getLanguage 在类中 Stream<PythonDataStream,Object>