cascading.flow.tez.stream.element

Class TezGroupByGate

java.lang.Object

cascading.flow.stream.duct.Duct<Incoming,Outgoing>

cascading.flow.stream.duct.Gate<Incoming,Outgoing>

cascading.flow.stream.element.SpliceGate<cascading.tuple.TupleEntry,cascading.flow.stream.duct.Grouping<cascading.tuple.TupleEntry,cascading.tuple.TupleEntryIterator>>

cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.hadoop.stream.HadoopGroupGate

cascading.flow.tez.stream.element.TezGroupGate

cascading.flow.tez.stream.element.TezGroupByGate

All Implemented Interfaces:

cascading.flow.stream.duct.Collapsing, cascading.flow.stream.duct.Window, cascading.flow.stream.element.ElementDuct, cascading.flow.stream.element.InputSource

public class TezGroupByGate
extends TezGroupGate

Nested Class Summary

Nested classes/interfaces inherited from class cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.stream.element.GroupingSpliceGate.DelegatedTuple

Field Summary

Fields

Modifier and Type	Field and Description
protected cascading.flow.hadoop.util.TimedIterator[]	timedIterators

Fields inherited from class cascading.flow.tez.stream.element.TezGroupGate

logicalInputs, logicalOutput

Fields inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

closure, collector

Fields inherited from class cascading.flow.stream.element.GroupingSpliceGate

groupComparators, groupHasher, grouping, groupSortTuple, groupTuple, keyBuilder, keyEntry, keyFields, keyTuple, nullsAreNotEqual, sortBuilder, sortFields, tupleEntryIterator, valueComparators, valuesBuilder, valuesFields, valueTuple

Fields inherited from class cascading.flow.stream.element.SpliceGate

flowProcess, incomingScopes, outgoingScopes, role, splice

Fields inherited from class cascading.flow.stream.duct.Duct

next

Constructor Summary

Constructors

Constructor and Description
TezGroupByGate(cascading.flow.FlowProcess flowProcess, cascading.pipe.GroupBy groupBy, cascading.flow.stream.graph.IORole role, org.apache.tez.runtime.api.LogicalOutput logicalOutput)
TezGroupByGate(cascading.flow.FlowProcess flowProcess, cascading.pipe.GroupBy groupBy, cascading.flow.stream.graph.IORole role, cascading.util.SortedListMultiMap<java.lang.Integer,org.apache.tez.runtime.api.LogicalInput> logicalInputs)

Method Summary

Modifier and Type	Method and Description
protected cascading.flow.hadoop.HadoopGroupByClosure	createClosure()
protected java.lang.Throwable	reduce()
protected cascading.tuple.Tuple	unwrapGrouping(cascading.tuple.Tuple key)

Methods inherited from class cascading.flow.tez.stream.element.TezGroupGate

createOutputCollector, initialize, prepare, run, wrapGroupingAndCollect

Methods inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

accept, bind, complete, receive, start

Methods inherited from class cascading.flow.stream.element.GroupingSpliceGate

cleanup, createDefaultNarrowBuilder, createNarrowBuilder, createNulledBuilder, getDelegatedTuple, getKeyComparator, getNumDeclaredIncomingBranches, initComparators

Methods inherited from class cascading.flow.stream.element.SpliceGate

equals, getBranchNames, getFlowElement, getIncomingScopes, getOutgoingScopes, getSplice, handleException, handleReThrowableException, hashCode, hasTrapHandler, setBranchNames, setTrapHandler, toString

Methods inherited from class cascading.flow.stream.duct.Duct

getNext, getNextFor, receiveFirst

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

timedIterators

protected cascading.flow.hadoop.util.TimedIterator[] timedIterators

Constructor Detail

TezGroupByGate

public TezGroupByGate(cascading.flow.FlowProcess flowProcess,
                      cascading.pipe.GroupBy groupBy,
                      cascading.flow.stream.graph.IORole role,
                      org.apache.tez.runtime.api.LogicalOutput logicalOutput)

TezGroupByGate

public TezGroupByGate(cascading.flow.FlowProcess flowProcess,
                      cascading.pipe.GroupBy groupBy,
                      cascading.flow.stream.graph.IORole role,
                      cascading.util.SortedListMultiMap<java.lang.Integer,org.apache.tez.runtime.api.LogicalInput> logicalInputs)

Method Detail

reduce

protected java.lang.Throwable reduce()
                              throws java.lang.Exception

Specified by:

reduce in class TezGroupGate

Throws:

java.lang.Exception

createClosure

protected cascading.flow.hadoop.HadoopGroupByClosure createClosure()

Specified by:

createClosure in class cascading.flow.hadoop.stream.HadoopGroupGate

unwrapGrouping

protected cascading.tuple.Tuple unwrapGrouping(cascading.tuple.Tuple key)

Specified by:

unwrapGrouping in class cascading.flow.hadoop.stream.HadoopGroupGate