org.apache.hadoop.hive.ql.io
Class FlatFileInputFormat<T>

java.lang.Object
  org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>
      org.apache.hadoop.hive.ql.io.FlatFileInputFormat<T>

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<Void,FlatFileInputFormat.RowContainer<T>>

public class FlatFileInputFormat<T>
extends org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>

An InputFormat for Plain files with Deserializer records.

Nested Class Summary

class	FlatFileInputFormat.FlatFileRecordReader<R> An RecordReader for plain files with Deserializer records Reads one row at a time of type R.
static class	FlatFileInputFormat.RowContainer<T> A work-around until HADOOP-1230 is fixed.
static interface	FlatFileInputFormat.SerializationContext<S> An implementation of SerializationContext is responsible for looking up the Serialization implementation for the given RecordReader.
static class	FlatFileInputFormat.SerializationContextFromConf<S> An implementation of FlatFileInputFormat.SerializationContext that reads the Serialization class and specific subclass to be deserialized from the JobConf.

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

static String

SerializationImplKey The JobConf keys for the Serialization implementation.

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

LOG

Constructor Summary

FlatFileInputFormat()

Method Summary

org.apache.hadoop.mapred.RecordReader<Void,FlatFileInputFormat.RowContainer<T>>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
protected boolean	isSplittable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path filename)

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SerializationImplKey

public static final String SerializationImplKey

The JobConf keys for the Serialization implementation.

See Also:

Constant Field Values

Constructor Detail

FlatFileInputFormat

public FlatFileInputFormat()

Method Detail

isSplittable

protected boolean isSplittable(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path filename)

getRecordReader

public org.apache.hadoop.mapred.RecordReader<Void,FlatFileInputFormat.RowContainer<T>> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                                                       org.apache.hadoop.mapred.JobConf job,
                                                                                                       org.apache.hadoop.mapred.Reporter reporter)
                                                                                                throws IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<Void,FlatFileInputFormat.RowContainer<T>>

Specified by:

getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>

Throws:

IOException