cascading.flow.tez.stream.element

Class TezCoGroupGate

java.lang.Object

cascading.flow.stream.duct.Duct<Incoming,Outgoing>

cascading.flow.stream.duct.Gate<Incoming,Outgoing>

cascading.flow.stream.element.SpliceGate<cascading.tuple.TupleEntry,cascading.flow.stream.duct.Grouping<cascading.tuple.TupleEntry,cascading.tuple.TupleEntryIterator>>

cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.hadoop.stream.HadoopGroupGate

cascading.flow.tez.stream.element.TezGroupGate

cascading.flow.tez.stream.element.TezCoGroupGate

All Implemented Interfaces:

cascading.flow.stream.duct.Collapsing, cascading.flow.stream.duct.Window, cascading.flow.stream.element.ElementDuct, cascading.flow.stream.element.InputSource

public class TezCoGroupGate
extends TezGroupGate

Nested Class Summary

Nested classes/interfaces inherited from class cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.stream.element.GroupingSpliceGate.DelegatedTuple

Field Summary

Fields

Modifier and Type	Field and Description
protected cascading.flow.hadoop.util.TimedIterator<cascading.tuple.Tuple>[]	timedIterators

Fields inherited from class cascading.flow.tez.stream.element.TezGroupGate

logicalInputs, logicalOutput

Fields inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

closure, collector

Fields inherited from class cascading.flow.stream.element.GroupingSpliceGate

groupComparators, groupHasher, grouping, groupSortTuple, groupTuple, keyBuilder, keyEntry, keyFields, keyTuple, nullsAreNotEqual, sortBuilder, sortFields, tupleEntryIterator, valueComparators, valuesBuilder, valuesFields, valueTuple

Fields inherited from class cascading.flow.stream.element.SpliceGate

flowProcess, incomingScopes, outgoingScopes, role, splice

Fields inherited from class cascading.flow.stream.duct.Duct

next

Constructor Summary

Constructors

Constructor and Description
TezCoGroupGate(cascading.flow.FlowProcess flowProcess, cascading.pipe.CoGroup coGroup, cascading.flow.stream.graph.IORole role, org.apache.tez.runtime.api.LogicalOutput logicalOutput)
TezCoGroupGate(cascading.flow.FlowProcess flowProcess, cascading.pipe.CoGroup coGroup, cascading.flow.stream.graph.IORole role, cascading.util.SortedListMultiMap<java.lang.Integer,org.apache.tez.runtime.api.LogicalInput> logicalInputs)

Method Summary

Modifier and Type	Method and Description
protected cascading.flow.hadoop.HadoopCoGroupClosure	createClosure()
protected java.lang.Throwable	reduce()
protected cascading.tuple.Tuple	unwrapGrouping(cascading.tuple.Tuple key)

Methods inherited from class cascading.flow.tez.stream.element.TezGroupGate

createOutputCollector, initialize, prepare, run, wrapGroupingAndCollect

Methods inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

accept, bind, complete, receive, start

Methods inherited from class cascading.flow.stream.element.GroupingSpliceGate

cleanup, createDefaultNarrowBuilder, createNarrowBuilder, createNulledBuilder, getDelegatedTuple, getKeyComparator, getNumDeclaredIncomingBranches, initComparators

Methods inherited from class cascading.flow.stream.element.SpliceGate

equals, getBranchNames, getFlowElement, getIncomingScopes, getOutgoingScopes, getSplice, handleException, handleReThrowableException, hashCode, hasTrapHandler, setBranchNames, setTrapHandler, toString

Methods inherited from class cascading.flow.stream.duct.Duct

getNext, getNextFor, receiveFirst

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

timedIterators

protected cascading.flow.hadoop.util.TimedIterator<cascading.tuple.Tuple>[] timedIterators

Constructor Detail

TezCoGroupGate

public TezCoGroupGate(cascading.flow.FlowProcess flowProcess,
                      cascading.pipe.CoGroup coGroup,
                      cascading.flow.stream.graph.IORole role,
                      org.apache.tez.runtime.api.LogicalOutput logicalOutput)

TezCoGroupGate

public TezCoGroupGate(cascading.flow.FlowProcess flowProcess,
                      cascading.pipe.CoGroup coGroup,
                      cascading.flow.stream.graph.IORole role,
                      cascading.util.SortedListMultiMap<java.lang.Integer,org.apache.tez.runtime.api.LogicalInput> logicalInputs)

Method Detail

reduce

protected java.lang.Throwable reduce()
                              throws java.lang.Exception

Specified by:

reduce in class TezGroupGate

Throws:

java.lang.Exception

createClosure

protected cascading.flow.hadoop.HadoopCoGroupClosure createClosure()

Specified by:

createClosure in class cascading.flow.hadoop.stream.HadoopGroupGate

unwrapGrouping

protected cascading.tuple.Tuple unwrapGrouping(cascading.tuple.Tuple key)

Specified by:

unwrapGrouping in class cascading.flow.hadoop.stream.HadoopGroupGate