org.apache.hadoop.hive.ql.exec.vector
Class VectorGroupByOperator

java.lang.Object
  org.apache.hadoop.hive.ql.exec.Operator<GroupByDesc>
      org.apache.hadoop.hive.ql.exec.GroupByOperator
          org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

public class VectorGroupByOperator
extends GroupByOperator

Vectorized GROUP BY operator implementation. Consumes the vectorized input and stores the aggregate operators' intermediate states. Emits row mode output.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.GroupByOperator

aggregationIsDistinct, aggregationParameterFields, aggregationParameterObjectInspectors, aggregationParameterObjects, aggregationParameterStandardObjectInspectors, aggregations, aggregationsParametersLastInvoke, currentKeyObjectInspectors, currentKeys, distinctKeyAggrs, hashAggr, hashAggregations, keyFields, keyObjectInspectors, keysCurrentGroup, maxHashTblMemory, maxMemory, memoryMXBean, memoryThreshold, newKeys, nonDistinctAggrs, nonDistinctKeyAggrs, numEntriesHashTable, objectInspectors

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

alias, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, done, groupKeyObject, groupKeyOI, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogInfoEnabled, operatorId, out, outputObjInspector, parentOperators, reporter, state, statsMap

Constructor Summary

VectorGroupByOperator()

VectorGroupByOperator(VectorizationContext vContext, OperatorDesc conf)

Method Summary

void	closeOp(boolean aborted) We need to forward all the aggregations to children.
VectorAggregateExpression[]	getAggregators()
VectorExpression[]	getKeyExpressions()
static String	getOperatorName()
protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	processOp(Object row, int tag) Process the row.
void	setAggregators(VectorAggregateExpression[] aggregators)
void	setKeyExpressions(VectorExpression[] keyExpressions)

Methods inherited from class org.apache.hadoop.hive.ql.exec.GroupByOperator

acceptLimitPushdown, endGroup, flush, forward, genColLists, getName, getType, groupingSet2BitSet, newAggregations, resetAggregations, startGroup, updateAggregations

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

allInitializedParentsAreClosed, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, defaultEndGroup, defaultStartGroup, dump, dump, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getGroupKeyObjectInspector, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setGroupKeyObjectInspector, setId, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

VectorGroupByOperator

public VectorGroupByOperator(VectorizationContext vContext,
                             OperatorDesc conf)
                      throws HiveException

Throws:

HiveException

VectorGroupByOperator

public VectorGroupByOperator()

Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class GroupByOperator

Throws:

HiveException

processOp

public void processOp(Object row,
                      int tag)
               throws HiveException

Description copied from class: Operator

Process the row.

Overrides:

processOp in class GroupByOperator

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean aborted)
             throws HiveException

Description copied from class: GroupByOperator

We need to forward all the aggregations to children.

Overrides:

closeOp in class GroupByOperator

Throws:

HiveException

getOperatorName

public static String getOperatorName()

getKeyExpressions

public VectorExpression[] getKeyExpressions()

setKeyExpressions

public void setKeyExpressions(VectorExpression[] keyExpressions)

getAggregators

public VectorAggregateExpression[] getAggregators()

setAggregators

public void setAggregators(VectorAggregateExpression[] aggregators)