com.pivotal.gemfirexd.hadoop.mapred

Class RowInputFormat

java.lang.Object

com.pivotal.gemfirexd.hadoop.mapred.RowInputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<Key,Row>

public class RowInputFormat
extends java.lang.Object
implements org.apache.hadoop.mapred.InputFormat<Key,Row>

This class extends from InputFormat to provide table data reading ability.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CHECKPOINT_MODE In this mode checkpoint data is provided to job.
protected org.apache.hadoop.conf.Configuration	conf
static java.lang.String	END_TIME_MILLIS If this filter is set, an event will be provided to map reduce job if it happened before this timestamp in milliseconds
static java.lang.String	HOME_DIR The home directory for gemfirexd data in HDFS.
static java.lang.String	INPUT_TABLE The name of the table to process, for example APP.CUSTOMERS.
protected org.slf4j.Logger	logger
static java.lang.String	PROPERTY_PREFIX A valid property starting with this prefix will be used to tune input format's behavior.
static java.lang.String	START_TIME_MILLIS If this filter is set, an event will be provided to map reduce job if it happened after this timestamp in milliseconds

Constructor Summary

Constructors

Constructor and Description
RowInputFormat()

Method Summary

Modifier and Type	Method and Description
protected MapRedRowRecordReader	getRecordReader()
org.apache.hadoop.mapred.RecordReader<Key,Row>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
protected org.apache.hadoop.mapred.InputSplit	getSplit(org.apache.hadoop.mapred.lib.CombineFileSplit split)
protected org.apache.hadoop.fs.Path[]	getSplitPaths(org.apache.hadoop.mapred.InputSplit split)
org.apache.hadoop.mapred.InputSplit[]	getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HOME_DIR

public static final java.lang.String HOME_DIR

The home directory for gemfirexd data in HDFS. This should match the HOMEDIR setting that was used with the CREATE HDFSSTORE in statement.

See Also:

Constant Field Values

INPUT_TABLE

public static final java.lang.String INPUT_TABLE

The name of the table to process, for example APP.CUSTOMERS. This should match the table name used with the CREATE TABLE statement.

See Also:

Constant Field Values

START_TIME_MILLIS

public static final java.lang.String START_TIME_MILLIS

If this filter is set, an event will be provided to map reduce job if it happened after this timestamp in milliseconds

See Also:

Constant Field Values

END_TIME_MILLIS

public static final java.lang.String END_TIME_MILLIS

If this filter is set, an event will be provided to map reduce job if it happened before this timestamp in milliseconds

See Also:

Constant Field Values

CHECKPOINT_MODE

public static final java.lang.String CHECKPOINT_MODE

In this mode checkpoint data is provided to job. Mapper, instead of getting all the events that happened in the system, which also includes old values of a key, gets the latest value known at the time of creating the checkpoint only. Checkpoint may not include latest data present in the system when the job is executed. In the checkpoint mode, time filters are ignored

See Also:

Constant Field Values

PROPERTY_PREFIX

public static final java.lang.String PROPERTY_PREFIX

A valid property starting with this prefix will be used to tune input format's behavior.

See Also:

Constant Field Values

logger

protected final org.slf4j.Logger logger

conf

protected org.apache.hadoop.conf.Configuration conf

Constructor Detail

RowInputFormat

public RowInputFormat()

Method Detail

getRecordReader

public org.apache.hadoop.mapred.RecordReader<Key,Row> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                      org.apache.hadoop.mapred.JobConf job,
                                                                      org.apache.hadoop.mapred.Reporter reporter)
                                                               throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<Key,Row>

Throws:

java.io.IOException

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                                       int numSplits)
                                                throws java.io.IOException

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<Key,Row>

Throws:

java.io.IOException

getSplit

protected org.apache.hadoop.mapred.InputSplit getSplit(org.apache.hadoop.mapred.lib.CombineFileSplit split)

getRecordReader

protected MapRedRowRecordReader getRecordReader()

getSplitPaths

protected org.apache.hadoop.fs.Path[] getSplitPaths(org.apache.hadoop.mapred.InputSplit split)