io.ray.streaming.python

类 PythonPartition

java.lang.Object

io.ray.streaming.python.PythonPartition

所有已实现的接口:

Function, Partition<Object>, Serializable

public class PythonPartition
extends Object
implements Partition<Object>

Represents a python partition function.

Python worker can create a partition object using information in this PythonPartition.

If this object is constructed from serialized python partition, python worker can deserialize it to create python partition directly. If this object is constructed from moduleName and className/functionName, python worker will use `importlib` to load python partition function.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
static PythonPartition	BroadcastPartition
static String	FORWARD_PARTITION_CLASS
static PythonPartition	ForwardPartition
static PythonPartition	KeyPartition
static PythonPartition	RoundRobinPartition

构造器概要

构造器

构造器和说明
PythonPartition(byte[] partition)
PythonPartition(String moduleName, String functionName) Create a python partition from a moduleName and partition function name

方法概要

限定符和类型	方法和说明
String	getFunctionName()
String	getModuleName()
byte[]	getPartition()
boolean	isConstructedFromBinary()
int[]	partition(Object record, int numPartition) Given a record and downstream partitions, determine which partition(s) should receive the record.
String	toString()

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

从接口继承的方法 io.ray.streaming.api.function.Function

loadCheckpoint, saveCheckpoint

字段详细资料

BroadcastPartition

public static final PythonPartition BroadcastPartition

KeyPartition

public static final PythonPartition KeyPartition

RoundRobinPartition

public static final PythonPartition RoundRobinPartition

FORWARD_PARTITION_CLASS

public static final String FORWARD_PARTITION_CLASS

另请参阅:

常量字段值

ForwardPartition

public static final PythonPartition ForwardPartition

构造器详细资料

PythonPartition

public PythonPartition(byte[] partition)

PythonPartition

public PythonPartition(String moduleName,
                       String functionName)

Create a python partition from a moduleName and partition function name

参数:

moduleName - module name of python partition

functionName - function/class name of the partition function.

方法详细资料

partition

public int[] partition(Object record,
                       int numPartition)

从接口复制的说明: Partition

Given a record and downstream partitions, determine which partition(s) should receive the record.

指定者:

partition 在接口中 Partition<Object>

参数:

record - The record.

numPartition - num of partitions

返回:

IDs of the downstream partitions that should receive the record.

getPartition

public byte[] getPartition()

getModuleName

public String getModuleName()

getFunctionName

public String getFunctionName()

isConstructedFromBinary

public boolean isConstructedFromBinary()

toString

public String toString()

覆盖:

toString 在类中 Object