io.cdap.transformation

Class TransformationUtil

java.lang.Object

io.cdap.transformation.TransformationUtil

public class TransformationUtil
extends Object

Utility for transformaiton plugin

Method Summary

Modifier and Type	Method and Description
static Map<String,TableTransformation>	getTableLevelTransformations(DeltaConfig deltaConfig) Get table level transformation config for each table
static Map<String,List<Transformation>>	loadTransformations(Configurer configurer, Map<String,TableTransformation> tableTransformations, SourceTable table) Load transformation plugins applied on a certain table
static String	parseDirectiveName(String directive)
static DDLEvent	transformDDLEvent(DDLEvent ddlEvent, List<Transformation> columnTransformations) Apply a list of transformations on a DDLEvent
static DefaultMutableRowSchema	transformSchema(io.cdap.cdap.api.data.schema.Schema schema, List<Transformation> transformations) Apply a list of transformations on a row schema
static DefaultMutableRowSchema	transformSchema(String table, io.cdap.cdap.api.data.schema.Schema schema, Map<String,List<Transformation>> transformations) A helper method to reuse transformSchema with column level detail which is to be called during pipeline assessment to track issues at a column level for better display of errors
static Map<String,Object>	transformValue(Map<String,Object> valuesMap, List<Transformation> transformations) Apply a list of transformations on a row value

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

parseDirectiveName

public static String parseDirectiveName(String directive)

transformValue

public static Map<String,Object> transformValue(Map<String,Object> valuesMap,
                                                List<Transformation> transformations)
                                         throws Exception

Apply a list of transformations on a row value

Parameters:

valuesMap - the values map of the input row whose key is the column name and value is the column value.

transformations - the list of transformations to apply

Returns:

a map whose key is transformed column name and value is the transformed column value

Throws:

Exception

transformSchema

public static DefaultMutableRowSchema transformSchema(String table,
                                                      io.cdap.cdap.api.data.schema.Schema schema,
                                                      Map<String,List<Transformation>> transformations)
                                               throws TransformationException

A helper method to reuse transformSchema with column level detail which is to be called during pipeline assessment to track issues at a column level for better display of errors

Parameters:

schema - the schema to apply transformation

transformations - the map of Column to list of transformations to apply

Returns:

the transformed mutable row schema.

Throws:

TransformationException

transformSchema

public static DefaultMutableRowSchema transformSchema(io.cdap.cdap.api.data.schema.Schema schema,
                                                      List<Transformation> transformations)
                                               throws Exception

Apply a list of transformations on a row schema

Parameters:

schema - the schema to apply transformation

transformations - the list of transformations to apply

Returns:

the transformed mutable row schema.

Throws:

Exception

transformDDLEvent

public static DDLEvent transformDDLEvent(DDLEvent ddlEvent,
                                         List<Transformation> columnTransformations)
                                  throws Exception

Apply a list of transformations on a DDLEvent

Parameters:

ddlEvent - the DDL event to apply transformations on

columnTransformations - the list of transformations to apply

Returns:

the new DDL event that has applied the transformations specified

Throws:

Exception

loadTransformations

public static Map<String,List<Transformation>> loadTransformations(Configurer configurer,
                                                                   Map<String,TableTransformation> tableTransformations,
                                                                   SourceTable table)
                                                            throws TransformationException

Load transformation plugins applied on a certain table

Parameters:

configurer - the plugin configurer

tableTransformations - a map whose key is the table name and value is the table level transformation config defined for that table

table - the table that transformations are applied on

Returns:

list of transformations applied on the specified table

Throws:

TransformationException

getTableLevelTransformations

public static Map<String,TableTransformation> getTableLevelTransformations(DeltaConfig deltaConfig)

Get table level transformation config for each table

Parameters:

deltaConfig - the Delta App config

Returns:

a map whose key is the table name and value is the table level transformation config defined for that table