Package io.debezium.transforms.partitions

Class PartitionRouting<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

java.lang.Object

io.debezium.transforms.partitions.PartitionRouting<R>

Type Parameters:

R - the subtype of ConnectRecord on which this transformation will operate

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.connect.components.Versioned, org.apache.kafka.connect.transforms.Transformation<R>

public class PartitionRouting<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>
extends Object
implements org.apache.kafka.connect.transforms.Transformation<R>, org.apache.kafka.connect.components.Versioned

This SMT allow to use payload fields to calculate the destination partition.

Author:

Mario Fiore Vitale

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	PartitionRouting.HashFunction

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CHANGE_SPECIAL_FIELD
static final String	FIELD_HASH_FUNCTION
static final String	FIELD_PAYLOAD_FIELD_CONF
static final String	FIELD_TOPIC_PARTITION_NUM_CONF
(package private) static final Field	HASH_FUNCTION_FIELD
private PartitionRouting.HashFunction	hashFc
private static final org.slf4j.Logger	LOGGER
private static final MurmurHash3	MURMUR_HASH_3
static final String	NESTING_SEPARATOR
(package private) static final Field	PARTITION_PAYLOAD_FIELDS_FIELD
private int	partitionNumber
private List<String>	payloadFields
private SmtManager<R>	smtManager
(package private) static final Field	TOPIC_PARTITION_NUM_FIELD

Constructor Summary

Constructors

Constructor	Description
PartitionRouting()

Method Summary

Modifier and Type	Method	Description
R	apply(R originalRecord)
private R	buildNewRecord(R originalRecord, org.apache.kafka.connect.data.Struct envelope, int partition)
void	close()
protected int	computePartition(Integer partitionNumber, List<Object> values)
org.apache.kafka.common.config.ConfigDef	config()
void	configure(Map<String,?> props)
private static String	getFieldName(org.apache.kafka.connect.data.Struct envelope, String[] subFields, int i)
private static org.apache.kafka.connect.data.Struct	getLastStruct(org.apache.kafka.connect.data.Struct envelope, String[] subFields)
private Optional<Object>	toValue(String fieldName, org.apache.kafka.connect.data.Struct envelope)
String	version()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

MURMUR_HASH_3

private static final MurmurHash3 MURMUR_HASH_3

NESTING_SEPARATOR

public static final String NESTING_SEPARATOR

See Also:

• Constant Field Values

CHANGE_SPECIAL_FIELD

public static final String CHANGE_SPECIAL_FIELD

See Also:

• Constant Field Values

FIELD_PAYLOAD_FIELD_CONF

public static final String FIELD_PAYLOAD_FIELD_CONF

See Also:

• Constant Field Values

FIELD_TOPIC_PARTITION_NUM_CONF

public static final String FIELD_TOPIC_PARTITION_NUM_CONF

See Also:

• Constant Field Values

FIELD_HASH_FUNCTION

public static final String FIELD_HASH_FUNCTION

See Also:

• Constant Field Values

PARTITION_PAYLOAD_FIELDS_FIELD

static final Field PARTITION_PAYLOAD_FIELDS_FIELD

TOPIC_PARTITION_NUM_FIELD

static final Field TOPIC_PARTITION_NUM_FIELD

HASH_FUNCTION_FIELD

static final Field HASH_FUNCTION_FIELD

smtManager

private SmtManager<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> smtManager

payloadFields

private List<String> payloadFields

partitionNumber

private int partitionNumber

hashFc

private PartitionRouting.HashFunction hashFc

Constructor Details

PartitionRouting

public PartitionRouting()

Method Details

config

public org.apache.kafka.common.config.ConfigDef config()

Specified by:

config in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

configure

public void configure(Map<String,?> props)

Specified by:

configure in interface org.apache.kafka.common.Configurable

apply

public R apply(R originalRecord)

Specified by:

apply in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

toValue

private Optional<Object> toValue(String fieldName,
 org.apache.kafka.connect.data.Struct envelope)

getLastStruct

private static org.apache.kafka.connect.data.Struct getLastStruct(org.apache.kafka.connect.data.Struct envelope,
 String[] subFields)

getFieldName

private static String getFieldName(org.apache.kafka.connect.data.Struct envelope,
 String[] subFields,
 int i)

buildNewRecord

private R buildNewRecord(R originalRecord,
 org.apache.kafka.connect.data.Struct envelope,
 int partition)

computePartition

protected int computePartition(Integer partitionNumber,
 List<Object> values)

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

version

public String version()

Specified by:

version in interface org.apache.kafka.connect.components.Versioned