io.ray.streaming.api.function

接口 Function

所有超级接口:

Serializable

所有已知子接口:

AggregateFunction<I,A,O>, FilterFunction<T>, FlatMapFunction<T,R>, JoinFunction<T,O,R>, KeyFunction<T,K>, MapFunction<T,R>, Partition<T>, ProcessFunction<T>, ReduceFunction<T>, RichFunction, SinkFunction<T>, SourceFunction<T>

所有已知实现类:

BroadcastPartition, CollectionSourceFunction, ForwardPartition, KeyPartition, PythonFunction, PythonPartition, RoundRobinPartition

public interface Function
extends Serializable

Interface of streaming functions.

方法概要

限定符和类型	方法和说明
default void	loadCheckpoint(Serializable checkpointObject) This method will be called by framework when a worker died and been restarted.
default Serializable	saveCheckpoint() This method will be called periodically by framework, you should return a a serializable object which represents function state, framework will help you to serialize this object, save it to storage, and load it back when in fail-over through.

方法详细资料

saveCheckpoint

default Serializable saveCheckpoint()

This method will be called periodically by framework, you should return a a serializable object which represents function state, framework will help you to serialize this object, save it to storage, and load it back when in fail-over through. loadCheckpoint(Serializable).

返回:

A serializable object which represents function state.

loadCheckpoint

default void loadCheckpoint(Serializable checkpointObject)

This method will be called by framework when a worker died and been restarted. We will pass the last object you returned in saveCheckpoint() when doing checkpoint, you are responsible to load this object back to you function.

参数:

checkpointObject - the last object you returned in saveCheckpoint()