io.cdap.wrangler.executor

Class RecipePipelineExecutor

java.lang.Object

io.cdap.wrangler.executor.RecipePipelineExecutor

All Implemented Interfaces:

RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>, Serializable, AutoCloseable

public final class RecipePipelineExecutor
extends Object
implements RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

The class RecipePipelineExecutor compiles the recipe and executes the directives.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RecipePipelineExecutor(RecipeParser recipeParser, ExecutorContext context)

Method Summary

Modifier and Type	Method and Description
void	close() Invokes each directives destroy method to perform any cleanup required by each individual directive.
List<ErrorRecord>	errors() Returns records that are errored out.
List<Row>	execute(List<Row> rows) Executes the pipeline on the input.
List<io.cdap.cdap.api.data.format.StructuredRecord>	execute(List<Row> rows, io.cdap.cdap.api.data.schema.Schema schema) Executes the pipeline on the input.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecipePipelineExecutor

public RecipePipelineExecutor(RecipeParser recipeParser,
                              @Nullable
                              ExecutorContext context)

Method Detail

close

public void close()

Invokes each directives destroy method to perform any cleanup required by each individual directive.

Specified by:

close in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Specified by:

close in interface AutoCloseable

execute

public List<io.cdap.cdap.api.data.format.StructuredRecord> execute(List<Row> rows,
                                                                   io.cdap.cdap.api.data.schema.Schema schema)
                                                            throws RecipeException

Executes the pipeline on the input.

Specified by:

execute in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Parameters:

rows - List of Input record of type I.

schema - Schema to which the output should be mapped.

Returns:

Parsed output list of record of type O

Throws:

RecipeException

execute

public List<Row> execute(List<Row> rows)
                  throws RecipeException

Executes the pipeline on the input.

Specified by:

execute in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Parameters:

rows - List of input record of type I.

Returns:

Parsed output list of record of type I

Throws:

RecipeException

errors

public List<ErrorRecord> errors()

Returns records that are errored out.

Specified by:

errors in interface RecipePipeline<Row,io.cdap.cdap.api.data.format.StructuredRecord,ErrorRecord>

Returns:

records that have errored out.