public class JSONTextLine extends cascading.scheme.local.TextLine
Scheme for JSON text files. Files are broken into
lines, where each line is a JSON object. Either line-feed or carriage-return are used to signal end of line.
By default, this scheme returns a Tuple with one field, "json" with the type JSONCoercibleType.
Any Fields object passed to the constructor will have the JSONCoercibleType.TYPE type applied.
In order to read or write a compressed files, pass a CompressorScheme.Compressor
instance to the appropriate constructors. See Compressors for provided compression algorithms.
Note, when supplying a custom ObjectMapper, the default JSONCoercibleType.TYPE and ObjectMapper
sets the DeserializationFeature.FAIL_ON_READING_DUP_TREE_KEY Jackson property.
Compressors,
Serialized Form| Modifier and Type | Field and Description |
|---|---|
static cascading.tuple.Fields |
DEFAULT_FIELDS |
| Constructor and Description |
|---|
JSONTextLine()
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector returning results with the default field named "json". |
JSONTextLine(cascading.scheme.local.CompressorScheme.Compressor compressor)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector returning results with the default field named "json". |
JSONTextLine(cascading.tuple.Fields fields)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(cascading.tuple.Fields fields,
cascading.scheme.local.CompressorScheme.Compressor compressor)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(cascading.tuple.Fields fields,
cascading.scheme.local.CompressorScheme.Compressor compressor,
java.lang.String charsetName)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(cascading.tuple.Fields fields,
java.lang.String charsetName)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(ObjectMapper mapper,
cascading.scheme.local.CompressorScheme.Compressor compressor)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector returning results with the default field named "json". |
JSONTextLine(ObjectMapper mapper,
cascading.tuple.Fields fields)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(ObjectMapper mapper,
cascading.tuple.Fields fields,
cascading.scheme.local.CompressorScheme.Compressor compressor)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(ObjectMapper mapper,
cascading.tuple.Fields fields,
cascading.scheme.local.CompressorScheme.Compressor compressor,
java.lang.String charsetName)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
JSONTextLine(ObjectMapper mapper,
cascading.tuple.Fields fields,
java.lang.String charsetName)
Constructor JSONTextLine creates a new JSONTextLine instance for use with the
LocalFlowConnector. |
| Modifier and Type | Method and Description |
|---|---|
protected java.lang.String |
getBaseFileExtension() |
void |
sink(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess,
cascading.scheme.SinkCall<java.io.PrintWriter,java.io.OutputStream> sinkCall) |
boolean |
source(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess,
cascading.scheme.SourceCall<java.io.LineNumberReader,java.io.InputStream> sourceCall) |
createInput, createOutput, getBaseCompressorExtension, getCharsetName, getExtension, presentSinkFields, presentSourceFields, setCharsetName, sinkCleanup, sinkConfInit, sinkPrepare, sourceCleanup, sourceConfInit, sourcePrepare, sourceRePrepare, verifysetCompressor, sinkWrap, sourceWrapequals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFieldsInternal, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, toStringpublic static final cascading.tuple.Fields DEFAULT_FIELDS
public JSONTextLine()
LocalFlowConnector returning results with the default field named "json".public JSONTextLine(cascading.tuple.Fields fields)
LocalFlowConnector.fields - of Fieldspublic JSONTextLine(cascading.tuple.Fields fields, java.lang.String charsetName)
LocalFlowConnector.fields - of FieldscharsetName - of Stringpublic JSONTextLine(cascading.scheme.local.CompressorScheme.Compressor compressor)
LocalFlowConnector returning results with the default field named "json".compressor - of type Compressor, see Compressorspublic JSONTextLine(cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor)
LocalFlowConnector.fields - of Fieldscompressor - of type Compressor, see Compressorspublic JSONTextLine(cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor, java.lang.String charsetName)
LocalFlowConnector.fields - of Fieldscompressor - of type Compressor, see CompressorscharsetName - of Stringpublic JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields)
LocalFlowConnector.mapper - of ObjectMapperfields - of Fieldspublic JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, java.lang.String charsetName)
LocalFlowConnector.mapper - of ObjectMapperfields - of FieldscharsetName - of Stringpublic JSONTextLine(ObjectMapper mapper, cascading.scheme.local.CompressorScheme.Compressor compressor)
LocalFlowConnector returning results with the default field named "json".mapper - of ObjectMappercompressor - of type Compressor, see Compressorspublic JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor)
LocalFlowConnector.mapper - of ObjectMapperfields - of Fieldscompressor - of type Compressor, see Compressorspublic JSONTextLine(ObjectMapper mapper, cascading.tuple.Fields fields, cascading.scheme.local.CompressorScheme.Compressor compressor, java.lang.String charsetName)
LocalFlowConnector.mapper - of ObjectMapperfields - of Fieldscompressor - of type Compressor, see CompressorscharsetName - of Stringpublic boolean source(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess, cascading.scheme.SourceCall<java.io.LineNumberReader,java.io.InputStream> sourceCall) throws java.io.IOException
source in class cascading.scheme.local.TextLinejava.io.IOExceptionpublic void sink(cascading.flow.FlowProcess<? extends java.util.Properties> flowProcess, cascading.scheme.SinkCall<java.io.PrintWriter,java.io.OutputStream> sinkCall) throws java.io.IOException
sink in class cascading.scheme.local.TextLinejava.io.IOExceptionprotected java.lang.String getBaseFileExtension()
getBaseFileExtension in class cascading.scheme.local.TextLineCopyright © 2007-2021 Cascading Maintainers. All Rights Reserved.