cascading.flow.hadoop.stream

Class HadoopMemoryJoinGate

java.lang.Object

cascading.flow.stream.duct.Duct<Incoming,Outgoing>

cascading.flow.stream.duct.Gate<Incoming,Outgoing>

cascading.flow.stream.element.SpliceGate<cascading.tuple.TupleEntry,cascading.flow.stream.duct.Grouping<cascading.tuple.TupleEntry,cascading.tuple.TupleEntryIterator>>

cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.stream.element.MemorySpliceGate

cascading.flow.stream.element.MemoryHashJoinGate

cascading.flow.hadoop.stream.HadoopMemoryJoinGate

All Implemented Interfaces:

cascading.flow.stream.duct.Collapsing, cascading.flow.stream.duct.Window, cascading.flow.stream.element.ElementDuct

public class HadoopMemoryJoinGate
extends cascading.flow.stream.element.MemoryHashJoinGate

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HadoopMemoryJoinGate.Spill

Nested classes/interfaces inherited from class cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.stream.element.GroupingSpliceGate.DelegatedTuple

Field Summary

Fields inherited from class cascading.flow.stream.element.MemoryHashJoinGate

latch

Fields inherited from class cascading.flow.stream.element.MemorySpliceGate

closure, count, keys, keyValues, numIncomingEventingPaths

Fields inherited from class cascading.flow.stream.element.GroupingSpliceGate

groupComparators, groupHasher, grouping, groupSortTuple, groupTuple, keyBuilder, keyEntry, keyFields, keyTuple, nullsAreNotEqual, sortBuilder, sortFields, tupleEntryIterator, valueComparators, valuesBuilder, valuesFields, valueTuple

Fields inherited from class cascading.flow.stream.element.SpliceGate

flowProcess, incomingScopes, outgoingScopes, role, splice

Fields inherited from class cascading.flow.stream.duct.Duct

next

Constructor Summary

Constructors

Constructor and Description
HadoopMemoryJoinGate(cascading.flow.FlowProcess<? extends org.apache.hadoop.conf.Configuration> flowProcess, cascading.pipe.HashJoin join)

Method Summary

Modifier and Type	Method and Description
protected void	countDownLatch()
protected java.util.Set<cascading.tuple.Tuple>	createKeySet()
protected java.util.Map<cascading.tuple.Tuple,java.util.Collection<cascading.tuple.Tuple>>	createTupleMap()
protected void	waitOnLatch()

Methods inherited from class cascading.flow.stream.element.MemoryHashJoinGate

bind, complete, isBlockingStreamed, prepare, receive

Methods inherited from class cascading.flow.stream.element.MemorySpliceGate

createDefaultNarrowBuilder, createKeyValuesArray, initialize

Methods inherited from class cascading.flow.stream.element.GroupingSpliceGate

cleanup, createNarrowBuilder, createNulledBuilder, getDelegatedTuple, getKeyComparator, getNumDeclaredIncomingBranches, initComparators

Methods inherited from class cascading.flow.stream.element.SpliceGate

equals, getBranchNames, getFlowElement, getIncomingScopes, getOutgoingScopes, getSplice, handleException, handleReThrowableException, hashCode, hasTrapHandler, setBranchNames, setTrapHandler, toString

Methods inherited from class cascading.flow.stream.duct.Duct

getNext, getNextFor, receiveFirst, start

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

HadoopMemoryJoinGate

public HadoopMemoryJoinGate(cascading.flow.FlowProcess<? extends org.apache.hadoop.conf.Configuration> flowProcess,
                            cascading.pipe.HashJoin join)

Method Detail

createKeySet

protected java.util.Set<cascading.tuple.Tuple> createKeySet()

Overrides:

createKeySet in class cascading.flow.stream.element.MemorySpliceGate

createTupleMap

protected java.util.Map<cascading.tuple.Tuple,java.util.Collection<cascading.tuple.Tuple>> createTupleMap()

Overrides:

createTupleMap in class cascading.flow.stream.element.MemorySpliceGate

waitOnLatch

protected void waitOnLatch()

Overrides:

waitOnLatch in class cascading.flow.stream.element.MemoryHashJoinGate

countDownLatch

protected void countDownLatch()

Overrides:

countDownLatch in class cascading.flow.stream.element.MemoryHashJoinGate