io.debezium.connector.mongodb.transforms

Class UnwrapFromMongoDbEnvelope<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

java.lang.Object

io.debezium.connector.mongodb.transforms.UnwrapFromMongoDbEnvelope<R>

Type Parameters:

R - the subtype of ConnectRecord on which this transformation will operate

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.connect.transforms.Transformation<R>

public class UnwrapFromMongoDbEnvelope<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>
extends Object
implements org.apache.kafka.connect.transforms.Transformation<R>

Debezium Mongo Connector generates the CDC records in String format. Sink connectors usually are not able to parse the string and insert the document as it is represented in the Source. so a user use this SMT to parse the String and insert the MongoDB document in the JSON format.

Author:

Sairam Polavarapu, Renato mefi

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	UnwrapFromMongoDbEnvelope.ArrayEncoding

Field Summary

Fields

Modifier and Type	Field and Description
private boolean	addOperationHeader
private org.apache.kafka.connect.transforms.ExtractField<R>	afterExtractor
private static Field	ARRAY_ENCODING
private MongoDataConverter	converter
(package private) static String	DEBEZIUM_OPERATION_HEADER_KEY
private static String	DELETED_FIELD
private String	delimiter
private static Field	DELIMITER
private static Field	DROP_TOMBSTONES
private boolean	dropTombstones
private static Field	FLATTEN_STRUCT
private boolean	flattenStruct
private static Field	HANDLE_DELETES
private UnwrapFromEnvelope.DeleteHandling	handleDeletes
private org.apache.kafka.connect.transforms.ExtractField<R>	keyExtractor
private static org.slf4j.Logger	LOGGER
private static Field	OPERATION_HEADER
private org.apache.kafka.connect.transforms.ExtractField<R>	patchExtractor
private org.apache.kafka.connect.transforms.Flatten<R>	recordFlattener

Constructor Summary

Constructors

Constructor and Description
UnwrapFromMongoDbEnvelope()

Method Summary

Modifier and Type	Method and Description
R	apply(R record)
void	close()
org.apache.kafka.common.config.ConfigDef	config()
void	configure(Map<String,?> map)
private org.bson.BsonDocument	getInsertDocument(R record, org.bson.BsonDocument key)
private org.bson.BsonDocument	getUpdateDocument(R patchRecord, org.bson.BsonDocument keyDocument)
private R	newRecord(R record, org.bson.BsonDocument keyDocument, org.bson.BsonDocument valueDocument)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEBEZIUM_OPERATION_HEADER_KEY

static final String DEBEZIUM_OPERATION_HEADER_KEY

See Also:

Constant Field Values

DELETED_FIELD

private static final String DELETED_FIELD

See Also:

Constant Field Values

LOGGER

private static final org.slf4j.Logger LOGGER

ARRAY_ENCODING

private static final Field ARRAY_ENCODING

FLATTEN_STRUCT

private static final Field FLATTEN_STRUCT

DELIMITER

private static final Field DELIMITER

OPERATION_HEADER

private static final Field OPERATION_HEADER

HANDLE_DELETES

private static final Field HANDLE_DELETES

DROP_TOMBSTONES

private static final Field DROP_TOMBSTONES

afterExtractor

private final org.apache.kafka.connect.transforms.ExtractField<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> afterExtractor

patchExtractor

private final org.apache.kafka.connect.transforms.ExtractField<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> patchExtractor

keyExtractor

private final org.apache.kafka.connect.transforms.ExtractField<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> keyExtractor

converter

private MongoDataConverter converter

recordFlattener

private final org.apache.kafka.connect.transforms.Flatten<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> recordFlattener

addOperationHeader

private boolean addOperationHeader

flattenStruct

private boolean flattenStruct

delimiter

private String delimiter

dropTombstones

private boolean dropTombstones

handleDeletes

private UnwrapFromEnvelope.DeleteHandling handleDeletes

Constructor Detail

UnwrapFromMongoDbEnvelope

public UnwrapFromMongoDbEnvelope()

Method Detail

apply

public R apply(R record)

Specified by:

apply in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

newRecord

private R newRecord(R record,
                    org.bson.BsonDocument keyDocument,
                    org.bson.BsonDocument valueDocument)

getUpdateDocument

private org.bson.BsonDocument getUpdateDocument(R patchRecord,
                                                org.bson.BsonDocument keyDocument)

getInsertDocument

private org.bson.BsonDocument getInsertDocument(R record,
                                                org.bson.BsonDocument key)

config

public org.apache.kafka.common.config.ConfigDef config()

Specified by:

config in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

configure

public void configure(Map<String,?> map)

Specified by:

configure in interface org.apache.kafka.common.Configurable