Package io.debezium.transforms.partitions

Class ComputePartition<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

java.lang.Object

io.debezium.transforms.partitions.ComputePartition<R>

Type Parameters:

R - the subtype of ConnectRecord on which this transformation will operate

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.connect.transforms.Transformation<R>

public class ComputePartition<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>
extends Object
implements org.apache.kafka.connect.transforms.Transformation<R>

This SMT allow to use a specific table column to calculate the destination partition.

Author:

Mario Fiore Vitale

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CASSANDRA_CONNECTOR
static final String	COLLECTION_FIELD_NAME
static final String	CONNECTOR_FIELD_NAME
static final String	DB_FIELD_NAME
static final String	DB2_CONNECTOR
private Map<String,String>	fieldNameByTable
static final String	KEYSPACE_FIELD_NAME
private static final org.slf4j.Logger	LOGGER
static final String	MONGODB_CONNECTOR
static final String	MYSQL_CONNECTOR
private Map<String,Integer>	numberOfPartitionsByTable
static final String	ORACLE_CONNECTOR
static final String	POSTGRES_CONNECTOR
static final String	SCHEMA_FIELD_NAME
private SmtManager<R>	smtManager
static final String	SQLSERVER_CONNECTOR
static final String	TABLE_FIELD_NAME
private Set<String>	tableNames
static final String	VITESS_CONNECTOR

Constructor Summary

Constructors

Constructor	Description
ComputePartition()

Method Summary

Modifier and Type	Method	Description
R	apply(R r)
private void	checkConfigurationConsistency()
void	close()
private int	computePartition(Object fieldValue, String table)
org.apache.kafka.common.config.ConfigDef	config()
void	configure(Map<String,?> props)
private Optional<org.apache.kafka.connect.data.Struct>	extractPayload(org.apache.kafka.connect.data.Struct envelope)
private String	getTableName(org.apache.kafka.connect.data.Struct envelope)
private boolean	skipRecord(String table)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

SCHEMA_FIELD_NAME

public static final String SCHEMA_FIELD_NAME

See Also:

• Constant Field Values

SQLSERVER_CONNECTOR

public static final String SQLSERVER_CONNECTOR

See Also:

• Constant Field Values

KEYSPACE_FIELD_NAME

public static final String KEYSPACE_FIELD_NAME

See Also:

• Constant Field Values

TABLE_FIELD_NAME

public static final String TABLE_FIELD_NAME

See Also:

• Constant Field Values

COLLECTION_FIELD_NAME

public static final String COLLECTION_FIELD_NAME

See Also:

• Constant Field Values

CONNECTOR_FIELD_NAME

public static final String CONNECTOR_FIELD_NAME

See Also:

• Constant Field Values

MONGODB_CONNECTOR

public static final String MONGODB_CONNECTOR

See Also:

• Constant Field Values

DB_FIELD_NAME

public static final String DB_FIELD_NAME

See Also:

• Constant Field Values

MYSQL_CONNECTOR

public static final String MYSQL_CONNECTOR

See Also:

• Constant Field Values

POSTGRES_CONNECTOR

public static final String POSTGRES_CONNECTOR

See Also:

• Constant Field Values

ORACLE_CONNECTOR

public static final String ORACLE_CONNECTOR

See Also:

• Constant Field Values

DB2_CONNECTOR

public static final String DB2_CONNECTOR

See Also:

• Constant Field Values

CASSANDRA_CONNECTOR

public static final String CASSANDRA_CONNECTOR

See Also:

• Constant Field Values

VITESS_CONNECTOR

public static final String VITESS_CONNECTOR

See Also:

• Constant Field Values

tableNames

private Set<String> tableNames

smtManager

private SmtManager<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> smtManager

numberOfPartitionsByTable

private Map<String,Integer> numberOfPartitionsByTable

fieldNameByTable

private Map<String,String> fieldNameByTable

Constructor Details

ComputePartition

public ComputePartition()

Method Details

config

public org.apache.kafka.common.config.ConfigDef config()

Specified by:

config in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

configure

public void configure(Map<String,?> props)

Specified by:

configure in interface org.apache.kafka.common.Configurable

checkConfigurationConsistency

private void checkConfigurationConsistency()

apply

public R apply(R r)

Specified by:

apply in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

skipRecord

private boolean skipRecord(String table)

getTableName

private String getTableName(org.apache.kafka.connect.data.Struct envelope)

computePartition

private int computePartition(Object fieldValue,
 String table)

extractPayload

private Optional<org.apache.kafka.connect.data.Struct> extractPayload(org.apache.kafka.connect.data.Struct envelope)

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>