io.cdap.wrangler.executor

Class RecipePipelineExecutor

java.lang.Object

io.cdap.wrangler.executor.RecipePipelineExecutor

All Implemented Interfaces:

RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>, Serializable

public final class RecipePipelineExecutor
extends Object
implements RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

The class RecipePipelineExecutor compiles the recipe and executes the directives.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RecipePipelineExecutor()

Method Summary

Modifier and Type	Method and Description
void	destroy() Invokes each directives destroy method to perform any cleanup required by each individual directive.
List<ErrorRecord>	errors() Returns records that are errored out.
List<Row>	execute(List<Row> rows) Executes the pipeline on the input.
List<io.cdap.cdap.api.data.format.StructuredRecord>	execute(List<Row> rows, io.cdap.cdap.api.data.schema.Schema schema) Executes the pipeline on the input.
void	initialize(RecipeParser parser, ExecutorContext context) Configures the pipeline based on the directives.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecipePipelineExecutor

public RecipePipelineExecutor()

Method Detail

initialize

public void initialize(RecipeParser parser,
                       ExecutorContext context)
                throws RecipeException

Configures the pipeline based on the directives. It parses the recipe, converting it into executable directives.

Specified by:

initialize in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Parameters:

parser - Wrangle directives parser.

Throws:

RecipeException

destroy

public void destroy()

Invokes each directives destroy method to perform any cleanup required by each individual directive.

Specified by:

destroy in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

execute

public List<io.cdap.cdap.api.data.format.StructuredRecord> execute(List<Row> rows,
                                                                   io.cdap.cdap.api.data.schema.Schema schema)
                                                            throws RecipeException

Executes the pipeline on the input.

Specified by:

execute in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Parameters:

rows - List of Input record of type I.

schema - Schema to which the output should be mapped.

Returns:

Parsed output list of record of type O

Throws:

RecipeException

execute

public List<Row> execute(List<Row> rows)
                  throws RecipeException

Executes the pipeline on the input.

Specified by:

execute in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Parameters:

rows - List of input record of type I.

Returns:

Parsed output list of record of type I

Throws:

RecipeException

errors

public List<ErrorRecord> errors()

Returns records that are errored out.

Specified by:

errors in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Returns:

records that have errored out.