cascading.nested.json.local

Class JSONTextLine

java.lang.Object

cascading.scheme.Scheme<java.util.Properties,java.io.InputStream,java.io.OutputStream,SourceContext,SinkContext>

cascading.scheme.local.CompressorScheme<java.io.LineNumberReader,java.io.PrintWriter>

cascading.scheme.local.TextLine

cascading.nested.json.local.JSONTextLine

All Implemented Interfaces:

cascading.scheme.FileFormat, cascading.util.Traceable, java.io.Serializable

public class JSONTextLine
extends cascading.scheme.local.TextLine

A JSONTextLine is a type of Scheme for JSON text files. Files are broken into lines, where each line is a JSON object. Either line-feed or carriage-return are used to signal end of line.

By default, this scheme returns a Tuple with one field, "json" with the type JSONCoercibleType.

Any Fields object passed to the constructor will have the JSONCoercibleType.TYPE type applied.

In order to read or write a compressed files, pass a CompressorScheme.Compressor instance to the appropriate constructors. See Compressors for provided compression algorithms.

Note, when supplying a custom ObjectMapper, the default JSONCoercibleType.TYPE and ObjectMapper sets the DeserializationFeature.FAIL_ON_READING_DUP_TREE_KEY Jackson property.

See Also:

Compressors, Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class cascading.scheme.local.CompressorScheme

cascading.scheme.local.CompressorScheme.Compressor

Field Summary

Fields

Modifier and Type	Field and Description
static cascading.tuple.Fields	DEFAULT_FIELDS

Fields inherited from class cascading.scheme.local.TextLine

DEFAULT_CHARSET, DEFAULT_SOURCE_FIELDS

Fields inherited from class cascading.scheme.local.CompressorScheme

compressor, NO_COMPRESSOR

Constructor Summary

Constructors

Constructor and Description
JSONTextLine() Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".
JSONTextLine(cascading.scheme.local.CompressorScheme.Compressor compressor) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".
JSONTextLine(cascading.tuple.Fields fields) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor, java.lang.String charsetName) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(cascading.tuple.Fields fields, java.lang.String charsetName) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(ObjectMapper mapper, cascading.scheme.local.CompressorScheme.Compressor compressor) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".
JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor, java.lang.String charsetName) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.
JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, java.lang.String charsetName) Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Method Summary

Modifier and Type	Method and Description
protected java.lang.String	getBaseFileExtension()
void	sink(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess, cascading.scheme.SinkCall<java.io.PrintWriter,java.io.OutputStream> sinkCall)
boolean	source(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess, cascading.scheme.SourceCall<java.io.LineNumberReader,java.io.InputStream> sourceCall)

Methods inherited from class cascading.scheme.local.TextLine

createInput, createOutput, getBaseCompressorExtension, getCharsetName, getExtension, presentSinkFields, presentSourceFields, setCharsetName, sinkCleanup, sinkConfInit, sinkPrepare, sourceCleanup, sourceConfInit, sourcePrepare, sourceRePrepare, verify

Methods inherited from class cascading.scheme.local.CompressorScheme

setCompressor, sinkWrap, sourceWrap

Methods inherited from class cascading.scheme.Scheme

equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFieldsInternal, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_FIELDS

public static final cascading.tuple.Fields DEFAULT_FIELDS

Constructor Detail

JSONTextLine

public JSONTextLine()

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".

JSONTextLine

public JSONTextLine(cascading.tuple.Fields fields)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

fields - of Fields

JSONTextLine

public JSONTextLine(cascading.tuple.Fields fields,
                    java.lang.String charsetName)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

fields - of Fields

charsetName - of String

JSONTextLine

public JSONTextLine(cascading.scheme.local.CompressorScheme.Compressor compressor)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".

Parameters:

compressor - of type Compressor, see Compressors

JSONTextLine

public JSONTextLine(cascading.tuple.Fields fields,
                    cascading.scheme.local.CompressorScheme.Compressor compressor)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

fields - of Fields

compressor - of type Compressor, see Compressors

JSONTextLine

public JSONTextLine(cascading.tuple.Fields fields,
                    cascading.scheme.local.CompressorScheme.Compressor compressor,
                    java.lang.String charsetName)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

fields - of Fields

compressor - of type Compressor, see Compressors

charsetName - of String

JSONTextLine

public JSONTextLine(ObjectMapper mapper,
                    cascading.tuple.Fields fields)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

mapper - of ObjectMapper

fields - of Fields

JSONTextLine

public JSONTextLine(ObjectMapper mapper,
                    cascading.tuple.Fields fields,
                    java.lang.String charsetName)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

mapper - of ObjectMapper

fields - of Fields

charsetName - of String

JSONTextLine

public JSONTextLine(ObjectMapper mapper,
                    cascading.scheme.local.CompressorScheme.Compressor compressor)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector returning results with the default field named "json".

Parameters:

mapper - of ObjectMapper

compressor - of type Compressor, see Compressors

JSONTextLine

public JSONTextLine(ObjectMapper mapper,
                    cascading.tuple.Fields fields,
                    cascading.scheme.local.CompressorScheme.Compressor compressor)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

mapper - of ObjectMapper

fields - of Fields

compressor - of type Compressor, see Compressors

JSONTextLine

public JSONTextLine(ObjectMapper mapper,
                    cascading.tuple.Fields fields,
                    cascading.scheme.local.CompressorScheme.Compressor compressor,
                    java.lang.String charsetName)

Constructor JSONTextLine creates a new JSONTextLine instance for use with the LocalFlowConnector.

Parameters:

mapper - of ObjectMapper

fields - of Fields

compressor - of type Compressor, see Compressors

charsetName - of String

Method Detail

source

public boolean source(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess,
                      cascading.scheme.SourceCall<java.io.LineNumberReader,java.io.InputStream> sourceCall)
               throws java.io.IOException

Overrides:

source in class cascading.scheme.local.TextLine

Throws:

java.io.IOException

sink

public void sink(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess,
                 cascading.scheme.SinkCall<java.io.PrintWriter,java.io.OutputStream> sinkCall)
          throws java.io.IOException

Overrides:

sink in class cascading.scheme.local.TextLine

Throws:

java.io.IOException

getBaseFileExtension

protected java.lang.String getBaseFileExtension()

Overrides:

getBaseFileExtension in class cascading.scheme.local.TextLine