org.openstreetmap.atlas.generator.persistence

Class AbstractMultipleAtlasBasedOutputFormat<Type>

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<K,V>

org.apache.hadoop.mapred.lib.MultipleOutputFormat<java.lang.String,Type>

org.openstreetmap.atlas.generator.persistence.AbstractMultipleAtlasBasedOutputFormat<Type>

Type Parameters:

Type - The type to be saved

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<java.lang.String,Type>

Direct Known Subclasses:

MultipleAtlasDeltaOutputFormat, MultipleAtlasGeoJsonOutputFormat, MultipleAtlasOutputFormat, MultipleAtlasProtoOutputFormat, MultipleAtlasStatisticsOutputFormat

public abstract class AbstractMultipleAtlasBasedOutputFormat<Type>
extends org.apache.hadoop.mapred.lib.MultipleOutputFormat<java.lang.String,Type>

Default MultipleOutputFormat for the Atlas jobs. This ensures all the output files of the AtlasGenerator follow the same output format structure.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_SCHEME

Constructor Summary

Constructors

Constructor and Description
AbstractMultipleAtlasBasedOutputFormat()

Method Summary

Modifier and Type	Method and Description
protected java.lang.String	generateFileNameForKeyValue(java.lang.String key, Type value, java.lang.String name)

Methods inherited from class org.apache.hadoop.mapred.lib.MultipleOutputFormat

generateActualKey, generateActualValue, generateLeafFileName, getBaseRecordWriter, getInputFileBasedOutputFileName, getRecordWriter

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_SCHEME

public static final java.lang.String DEFAULT_SCHEME

See Also:

Constant Field Values

Constructor Detail

AbstractMultipleAtlasBasedOutputFormat

public AbstractMultipleAtlasBasedOutputFormat()

Method Detail

generateFileNameForKeyValue

protected java.lang.String generateFileNameForKeyValue(java.lang.String key,
                                                       Type value,
                                                       java.lang.String name)

Overrides:

generateFileNameForKeyValue in class org.apache.hadoop.mapred.lib.MultipleOutputFormat<java.lang.String,Type>