Package io.debezium.connector.mongodb.transforms

Class ExtractNewDocumentState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

java.lang.Object

io.debezium.transforms.AbstractExtractNewRecordState<R>

io.debezium.connector.mongodb.transforms.ExtractNewDocumentState<R>

Type Parameters:

R - the subtype of ConnectRecord on which this transformation will operate

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.connect.components.Versioned, org.apache.kafka.connect.transforms.Transformation<R>

public class ExtractNewDocumentState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>
extends AbstractExtractNewRecordState<R>

Debezium Mongo Connector generates the CDC records in String format. Sink connectors usually are not able to parse the string and insert the document as it is represented in the Source. so a user use this SMT to parse the String and insert the MongoDB document in the JSON format.

Author:

Sairam Polavarapu, Renato mefi

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	ExtractNewDocumentState.ArrayEncoding

Nested classes/interfaces inherited from class io.debezium.transforms.AbstractExtractNewRecordState

AbstractExtractNewRecordState.FieldReference, AbstractExtractNewRecordState.NewRecordValueMetadata

Field Summary

Fields

Modifier and Type	Field	Description
private static final Field	ARRAY_ENCODING
private final Field.Set	configFields
private MongoDataConverter	converter
private String	delimiter
private static final Field	DELIMITER
private static final Field	FLATTEN_STRUCT
private boolean	flattenStruct
private org.apache.kafka.connect.transforms.ExtractField<R>	keyExtractor
private static final org.slf4j.Logger	LOGGER
private org.apache.kafka.connect.transforms.Flatten<R>	recordFlattener
static final Field	REWRITE_TOMBSTONE_DELETES_WITH_ID
private boolean	rewriteTombstoneDeletesWithId

Fields inherited from class io.debezium.transforms.AbstractExtractNewRecordState

additionalFields, additionalHeaders, config, extractRecordStrategy, PURPOSE, routeByField, smtManager

Constructor Summary

Constructors

Constructor	Description
ExtractNewDocumentState()

Method Summary

Modifier and Type	Method	Description
private void	addAdditionalFieldsSchema(List<AbstractExtractNewRecordState.FieldReference> additionalFields, R originalRecord, org.apache.kafka.connect.data.SchemaBuilder valueSchemaBuilder)
private void	addFields(List<AbstractExtractNewRecordState.FieldReference> additionalFields, R originalRecord, org.apache.kafka.connect.data.Struct value)
void	close()
org.apache.kafka.common.config.ConfigDef	config()
void	configure(Map<String,?> configs)
R	doApply(R record)
private org.bson.BsonDocument	getFullDocument(R record, org.bson.BsonDocument key)
private org.bson.BsonDocument	getPartialUpdateDocument(R beforeRecord, R updateDescriptionRecord, org.bson.BsonDocument keyDocument)
private R	newRecord(R record, org.bson.BsonDocument keyDocument, org.bson.BsonDocument valueDocument)
Iterable<Field>	validateConfigFields()

Methods inherited from class io.debezium.transforms.AbstractExtractNewRecordState

apply, getHeaderByName, makeHeaders, setTopic, version

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

ARRAY_ENCODING

private static final Field ARRAY_ENCODING

FLATTEN_STRUCT

private static final Field FLATTEN_STRUCT

DELIMITER

private static final Field DELIMITER

REWRITE_TOMBSTONE_DELETES_WITH_ID

public static final Field REWRITE_TOMBSTONE_DELETES_WITH_ID

keyExtractor

private org.apache.kafka.connect.transforms.ExtractField<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> keyExtractor

recordFlattener

private org.apache.kafka.connect.transforms.Flatten<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> recordFlattener

converter

private MongoDataConverter converter

flattenStruct

private boolean flattenStruct

delimiter

private String delimiter

rewriteTombstoneDeletesWithId

private boolean rewriteTombstoneDeletesWithId

configFields

private final Field.Set configFields

Constructor Details

ExtractNewDocumentState

public ExtractNewDocumentState()

Method Details

configure

public void configure(Map<String,?> configs)

Specified by:

configure in interface org.apache.kafka.common.Configurable

Overrides:

configure in class AbstractExtractNewRecordState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

doApply

public R doApply(R record)

Specified by:

doApply in class AbstractExtractNewRecordState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

validateConfigFields

public Iterable<Field> validateConfigFields()

Specified by:

validateConfigFields in class AbstractExtractNewRecordState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

config

public org.apache.kafka.common.config.ConfigDef config()

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

Overrides:

close in class AbstractExtractNewRecordState<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

newRecord

private R newRecord(R record,
 org.bson.BsonDocument keyDocument,
 org.bson.BsonDocument valueDocument)

addAdditionalFieldsSchema

private void addAdditionalFieldsSchema(List<AbstractExtractNewRecordState.FieldReference> additionalFields,
 R originalRecord,
 org.apache.kafka.connect.data.SchemaBuilder valueSchemaBuilder)

addFields

private void addFields(List<AbstractExtractNewRecordState.FieldReference> additionalFields,
 R originalRecord,
 org.apache.kafka.connect.data.Struct value)

getPartialUpdateDocument

private org.bson.BsonDocument getPartialUpdateDocument(R beforeRecord,
 R updateDescriptionRecord,
 org.bson.BsonDocument keyDocument)

getFullDocument

private org.bson.BsonDocument getFullDocument(R record,
 org.bson.BsonDocument key)