org.apache.hadoop.hive.ql.exec
Class MapJoinOperator

java.lang.Object
  org.apache.hadoop.hive.ql.exec.Operator<T>
      org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>
          org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<MapJoinDesc>
              org.apache.hadoop.hive.ql.exec.MapJoinOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

Direct Known Subclasses:

VectorMapJoinOperator

public class MapJoinOperator
extends AbstractMapJoinOperator<MapJoinDesc>
implements Serializable

Map side Join operator implementation.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

protected HashTableLoader	loader
protected MapJoinTableContainer[]	mapJoinTables
protected ByteStream.Output	outputForMapJoinKey

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, joinKeysStandardObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, hconf, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, done, groupKeyObject, groupKeyOI, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogInfoEnabled, operatorId, out, outputObjInspector, parentOperators, reporter, state, statsMap

Constructor Summary

MapJoinOperator()

MapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mjop)

Method Summary

void	cleanUpInputFileChangedOp()
void	closeOp(boolean abort) All done.
protected MapJoinKey	computeMapJoinKey(Object row, byte alias)
void	endGroup() Forward a record of join results.
void	generateMapMetaData()
String	getName() Implements the getName function for the Node Interface.
static String	getOperatorName()
protected MapJoinKey	getRefKey(MapJoinKey prevKey, byte alias)
OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	processOp(Object row, int tag) Process the row.
void	startGroup()

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, getFilteredValue, getFilterTag, getJoinOutputObjectInspector, getNextSize, getPosToAliasMap, hasFilter, internalForward, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, defaultEndGroup, defaultStartGroup, dump, dump, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getGroupKeyObjectInspector, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setGroupKeyObjectInspector, setId, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

loader

protected HashTableLoader loader

mapJoinTables

protected transient MapJoinTableContainer[] mapJoinTables

outputForMapJoinKey

protected final transient ByteStream.Output outputForMapJoinKey

Constructor Detail

MapJoinOperator

public MapJoinOperator()

MapJoinOperator

public MapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mjop)

Method Detail

endGroup

public void endGroup()
              throws HiveException

Description copied from class: CommonJoinOperator

Forward a record of join results.

Overrides:

endGroup in class CommonJoinOperator<MapJoinDesc>

Throws:

HiveException

startGroup

public void startGroup()
                throws HiveException

Overrides:

startGroup in class CommonJoinOperator<MapJoinDesc>

Throws:

HiveException

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class AbstractMapJoinOperator<MapJoinDesc>

Throws:

HiveException

generateMapMetaData

public void generateMapMetaData()
                         throws HiveException,
                                SerDeException

Throws:

HiveException

SerDeException

cleanUpInputFileChangedOp

public void cleanUpInputFileChangedOp()
                               throws HiveException

Overrides:

cleanUpInputFileChangedOp in class Operator<MapJoinDesc>

Throws:

HiveException

computeMapJoinKey

protected MapJoinKey computeMapJoinKey(Object row,
                                       byte alias)
                                throws HiveException

Throws:

HiveException

getRefKey

protected MapJoinKey getRefKey(MapJoinKey prevKey,
                               byte alias)

processOp

public void processOp(Object row,
                      int tag)
               throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

processOp in class Operator<MapJoinDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: CommonJoinOperator

All done.

Overrides:

closeOp in class AbstractMapJoinOperator<MapJoinDesc>

Throws:

HiveException

getName

public String getName()

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class CommonJoinOperator<MapJoinDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

getType

public OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Overrides:

getType in class AbstractMapJoinOperator<MapJoinDesc>

Returns:

OperatorType.*