io.cdap.wrangler.parser

Class SimpleTextParser

java.lang.Object

io.cdap.wrangler.parser.SimpleTextParser

All Implemented Interfaces:

RecipeParser, Serializable

public class SimpleTextParser
extends Object
implements RecipeParser

Parses the DSL into specification containing stepRegistry for wrangling. Following are some of the commands and format that SimpleTextParser will handle.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SimpleTextParser(List<String> directives)
SimpleTextParser(String directives)
SimpleTextParser(String[] directives)

Method Summary

Modifier and Type	Method and Description
static String	getNextToken(StringTokenizer tokenizer, String directive, String field, int lineno)
static String	getNextToken(StringTokenizer tokenizer, String delimiter, String directive, String field, int lineno)
static String	getNextToken(StringTokenizer tokenizer, String delimiter, String directive, String field, int lineno, boolean optional)
void	initialize(DirectiveContext context) Initialises the directive with a DirectiveContext.
List<Directive>	parse() Parses the DSL to generate a sequence of stepRegistry to be executed by RecipePipeline.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleTextParser

public SimpleTextParser(String[] directives)

SimpleTextParser

public SimpleTextParser(String directives)

SimpleTextParser

public SimpleTextParser(List<String> directives)

Method Detail

parse

public List<Directive> parse()
                      throws DirectiveParseException

Parses the DSL to generate a sequence of stepRegistry to be executed by RecipePipeline. The transformation parsing here needs a better solution. It has many limitations and having different way would allow us to provide much more advanced semantics for directives.

Specified by:

parse in interface RecipeParser

Returns:

List of stepRegistry to be executed.

Throws:

ParseException

DirectiveParseException

getNextToken

public static String getNextToken(StringTokenizer tokenizer,
                                  String directive,
                                  String field,
                                  int lineno)
                           throws DirectiveParseException

Throws:

DirectiveParseException

getNextToken

public static String getNextToken(StringTokenizer tokenizer,
                                  String delimiter,
                                  String directive,
                                  String field,
                                  int lineno)
                           throws DirectiveParseException

Throws:

DirectiveParseException

getNextToken

public static String getNextToken(StringTokenizer tokenizer,
                                  String delimiter,
                                  String directive,
                                  String field,
                                  int lineno,
                                  boolean optional)
                           throws DirectiveParseException

Throws:

DirectiveParseException

initialize

public void initialize(DirectiveContext context)

Initialises the directive with a DirectiveContext.

Specified by:

initialize in interface RecipeParser

Parameters:

context -