org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast

Class VectorMapJoinFastTableContainer

java.lang.Object

org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastTableContainer

All Implemented Interfaces:

MapJoinTableContainer, VectorMapJoinTableContainer

public class VectorMapJoinFastTableContainer
extends Object
implements VectorMapJoinTableContainer

HashTableLoader for Tez constructs the hashtable from records read from a broadcast edge.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer

MapJoinTableContainer.ReusableGetAdaptor

Constructor Summary

Constructors

Constructor and Description
VectorMapJoinFastTableContainer(MapJoinDesc desc, org.apache.hadoop.conf.Configuration hconf, long keyCount)

Method Summary

Methods

Modifier and Type	Method and Description
void	clear() Clears the contents of the table.
MapJoinTableContainer.ReusableGetAdaptor	createGetter(MapJoinKey keyTypeFromLoader) Creates reusable get adaptor that can be used to retrieve rows from the table based on either vectorized or non-vectorized input rows to MapJoinOperator.
void	dumpMetrics()
MapJoinKey	getAnyKey()
boolean	hasSpill() Checks if the container has spilled any data onto disk.
MapJoinKey	putRow(MapJoinObjectSerDeContext keyContext, org.apache.hadoop.io.Writable currentKey, MapJoinObjectSerDeContext valueContext, org.apache.hadoop.io.Writable currentValue) Adds row from input to the table.
void	seal() Indicates to the container that the puts have ended; table is now r/o.
VectorMapJoinHashTable	vectorMapJoinHashTable()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VectorMapJoinFastTableContainer

public VectorMapJoinFastTableContainer(MapJoinDesc desc,
                               org.apache.hadoop.conf.Configuration hconf,
                               long keyCount)
                                throws SerDeException

Throws:

SerDeException

Method Detail

vectorMapJoinHashTable

public VectorMapJoinHashTable vectorMapJoinHashTable()

Specified by:

vectorMapJoinHashTable in interface VectorMapJoinTableContainer

putRow

public MapJoinKey putRow(MapJoinObjectSerDeContext keyContext,
                org.apache.hadoop.io.Writable currentKey,
                MapJoinObjectSerDeContext valueContext,
                org.apache.hadoop.io.Writable currentValue)
                  throws SerDeException,
                         HiveException,
                         IOException

Description copied from interface: MapJoinTableContainer

Adds row from input to the table.

Specified by:

putRow in interface MapJoinTableContainer

Throws:

SerDeException

HiveException

IOException

seal

public void seal()

Description copied from interface: MapJoinTableContainer

Indicates to the container that the puts have ended; table is now r/o.

Specified by:

seal in interface MapJoinTableContainer

createGetter

public MapJoinTableContainer.ReusableGetAdaptor createGetter(MapJoinKey keyTypeFromLoader)

Description copied from interface: MapJoinTableContainer

Creates reusable get adaptor that can be used to retrieve rows from the table based on either vectorized or non-vectorized input rows to MapJoinOperator.

Specified by:

createGetter in interface MapJoinTableContainer

Parameters:

keyTypeFromLoader - Last key from hash table loader, to determine key type used when loading hashtable (if it can vary).

clear

public void clear()

Description copied from interface: MapJoinTableContainer

Clears the contents of the table.

Specified by:

clear in interface MapJoinTableContainer

getAnyKey

public MapJoinKey getAnyKey()

Specified by:

getAnyKey in interface MapJoinTableContainer

dumpMetrics

public void dumpMetrics()

Specified by:

dumpMetrics in interface MapJoinTableContainer

hasSpill

public boolean hasSpill()

Description copied from interface: MapJoinTableContainer

Checks if the container has spilled any data onto disk. This is only applicable for HybridHashTableContainer.

Specified by:

hasSpill in interface MapJoinTableContainer