cascading.tuple.hadoop.collect

Class HadoopSpillableTupleMap

java.lang.Object

java.util.AbstractMap<K,V>

java.util.HashMap<cascading.tuple.Tuple,java.util.Collection<cascading.tuple.Tuple>>

cascading.tuple.collect.SpillableTupleMap

cascading.tuple.hadoop.collect.HadoopSpillableTupleMap

All Implemented Interfaces:

cascading.tuple.collect.Spillable, java.io.Serializable, java.lang.Cloneable, java.util.Map<cascading.tuple.Tuple,java.util.Collection<cascading.tuple.Tuple>>

public class HadoopSpillableTupleMap
extends cascading.tuple.collect.SpillableTupleMap

HadoopSpillableTupleMap is responsible for spilling values to disk if the map threshold is reached.

See Also:

SpillableTupleMap, SpillableTupleList, Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class java.util.AbstractMap

java.util.AbstractMap.SimpleEntry<K,V>, java.util.AbstractMap.SimpleImmutableEntry<K,V>

Nested classes/interfaces inherited from interface cascading.tuple.collect.Spillable

cascading.tuple.collect.Spillable.SpillListener, cascading.tuple.collect.Spillable.SpillStrategy

Nested classes/interfaces inherited from interface java.util.Map

java.util.Map.Entry<K,V>

Constructor Summary

Constructors

Constructor and Description
HadoopSpillableTupleMap(int initialCapacity, float loadFactor, int mapThreshold, int listThreshold, cascading.flow.FlowProcess<? extends Configuration> flowProcess)

Method Summary

Modifier and Type	Method and Description
protected java.util.Collection<cascading.tuple.Tuple>	createTupleCollection(cascading.tuple.Tuple tuple)
protected cascading.tuple.collect.Spillable.SpillStrategy	getSpillStrategy() Method getSpillStrategy returns a SpillStrategy instance that is passed to the underlying Spillable tuple collection.

Methods inherited from class cascading.tuple.collect.SpillableTupleMap

get, getGrouping, getInitListThreshold, getMapCapacity, getMapLoadFactor, getMapThreshold, getMapThreshold, getSpillListener, setGrouping, setSpillListener, setSpillStrategy, spillCount

Methods inherited from class java.util.HashMap

clear, clone, compute, computeIfAbsent, computeIfPresent, containsKey, containsValue, entrySet, forEach, getOrDefault, isEmpty, keySet, merge, put, putAll, putIfAbsent, remove, remove, replace, replace, replaceAll, size, values

Methods inherited from class java.util.AbstractMap

equals, hashCode, toString

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

equals, hashCode

Constructor Detail

HadoopSpillableTupleMap

public HadoopSpillableTupleMap(int initialCapacity,
                               float loadFactor,
                               int mapThreshold,
                               int listThreshold,
                               cascading.flow.FlowProcess<? extends Configuration> flowProcess)

Method Detail

createTupleCollection

protected java.util.Collection<cascading.tuple.Tuple> createTupleCollection(cascading.tuple.Tuple tuple)

Specified by:

createTupleCollection in class cascading.tuple.collect.SpillableTupleMap

getSpillStrategy

protected cascading.tuple.collect.Spillable.SpillStrategy getSpillStrategy()

Method getSpillStrategy returns a SpillStrategy instance that is passed to the underlying Spillable tuple collection.

Returns:

of type Spillable#SpillStrategy