org.openstreetmap.atlas.generator.persistence

Class AbstractFileOutputFormat<T>

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<java.lang.String,T>

org.openstreetmap.atlas.generator.persistence.AbstractFileOutputFormat<T>

Type Parameters:

T - The type to save

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<java.lang.String,T>

Direct Known Subclasses:

AtlasDeltaOutputFormat, AtlasGeoJsonOutputFormat, AtlasOutputFormat, AtlasProtoOutputFormat, AtlasStatisticsOutputFormat

public abstract class AbstractFileOutputFormat<T>
extends org.apache.hadoop.mapred.FileOutputFormat<java.lang.String,T>

Abstract implementation of FileOutputFormat that takes care of the RecordWriter

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Constructor Summary

Constructors

Constructor and Description
AbstractFileOutputFormat()

Method Summary

Modifier and Type	Method and Description
protected abstract java.lang.String	fileExtension()
org.apache.hadoop.mapred.RecordWriter<java.lang.String,T>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, java.lang.String name, org.apache.hadoop.util.Progressable progress)
protected abstract boolean	isCompressed()
protected org.openstreetmap.atlas.utilities.runtime.Retry	retry()
protected abstract void	save(T value, org.openstreetmap.atlas.streaming.resource.AbstractWritableResource out)

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractFileOutputFormat

public AbstractFileOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<java.lang.String,T> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                                                 org.apache.hadoop.mapred.JobConf job,
                                                                                 java.lang.String name,
                                                                                 org.apache.hadoop.util.Progressable progress)
                                                                          throws java.io.IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<java.lang.String,T>

Specified by:

getRecordWriter in class org.apache.hadoop.mapred.FileOutputFormat<java.lang.String,T>

Throws:

java.io.IOException

fileExtension

protected abstract java.lang.String fileExtension()

isCompressed

protected abstract boolean isCompressed()

retry

protected org.openstreetmap.atlas.utilities.runtime.Retry retry()

save

protected abstract void save(T value,
                             org.openstreetmap.atlas.streaming.resource.AbstractWritableResource out)