org.apache.hadoop.hive.ql.exec.vector
Class VectorFileSinkOperator

java.lang.Object
  org.apache.hadoop.hive.ql.exec.Operator<T>
      org.apache.hadoop.hive.ql.exec.TerminalOperator<FileSinkDesc>
          org.apache.hadoop.hive.ql.exec.FileSinkOperator
              org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

public class VectorFileSinkOperator
extends FileSinkOperator

File Sink operator implementation.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.FileSinkOperator

FileSinkOperator.FSPaths, FileSinkOperator.RecordWriter

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

protected Object[]	singleRow
protected VectorExpressionWriter[]	valueWriters

Fields inherited from class org.apache.hadoop.hive.ql.exec.FileSinkOperator

autoDelete, bDynParts, bucketMap, childSpecPathDynLinkedPartitions, dpColNames, dpCtx, dpStartCol, dpVals, dpWritables, filesCreated, fs, fsp, hiveOutputFormat, isCompressed, isSkewedStoredAsSubDirectories, jc, key, lbCtx, maxPartitions, multiFileSpray, numDynParts, parent, prtner, recordValue, row_count, rowOutWriters, serializer, specPath, statsCollectRawDataSize, totalFiles, valToPaths

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

alias, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, done, groupKeyObject, groupKeyOI, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogInfoEnabled, LOG, operatorId, out, outputObjInspector, parentOperators, reporter, state, statsMap

Constructor Summary

VectorFileSinkOperator()

VectorFileSinkOperator(VectorizationContext context, OperatorDesc conf)

Method Summary

protected void	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
void	processOp(Object data, int tag) Process the row.

Methods inherited from class org.apache.hadoop.hive.ql.exec.FileSinkOperator

augmentPlan, checkOutputSpecs, closeOp, createBucketFiles, createBucketForFileIdx, generateListBucketingDirName, getDynOutPaths, getName, getOperatorName, getType, jobCloseOp, lookupListBucketingPaths, startGroup, updateProgress

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, allInitializedParentsAreClosed, areAllParentsInitialized, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, defaultEndGroup, defaultStartGroup, dump, dump, endGroup, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getGroupKeyObjectInspector, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, logStats, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, opAllowedBeforeSortMergeJoin, opAllowedConvertMapJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setGroupKeyObjectInspector, setId, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

singleRow

protected transient Object[] singleRow

valueWriters

protected transient VectorExpressionWriter[] valueWriters

Constructor Detail

VectorFileSinkOperator

public VectorFileSinkOperator(VectorizationContext context,
                              OperatorDesc conf)

VectorFileSinkOperator

public VectorFileSinkOperator()

Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class FileSinkOperator

Throws:

HiveException

processOp

public void processOp(Object data,
                      int tag)
               throws HiveException

Description copied from class: Operator

Process the row.

Overrides:

processOp in class FileSinkOperator

Parameters:

data - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException