cascading.flow.hadoop.stream.element

Class HadoopCoGroupGate

java.lang.Object

cascading.flow.stream.duct.Duct<Incoming,Outgoing>

cascading.flow.stream.duct.Gate<Incoming,Outgoing>

cascading.flow.stream.element.SpliceGate<cascading.tuple.TupleEntry,cascading.flow.stream.duct.Grouping<cascading.tuple.TupleEntry,cascading.tuple.TupleEntryIterator>>

cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.hadoop.stream.HadoopGroupGate

cascading.flow.hadoop.stream.element.HadoopCoGroupGate

All Implemented Interfaces:

cascading.flow.stream.duct.Collapsing, cascading.flow.stream.duct.Window, cascading.flow.stream.element.ElementDuct

public class HadoopCoGroupGate
extends cascading.flow.hadoop.stream.HadoopGroupGate

Nested Class Summary

Nested classes/interfaces inherited from class cascading.flow.stream.element.GroupingSpliceGate

cascading.flow.stream.element.GroupingSpliceGate.DelegatedTuple

Field Summary

Fields inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

closure, collector

Fields inherited from class cascading.flow.stream.element.GroupingSpliceGate

groupComparators, groupHasher, grouping, groupSortTuple, groupTuple, keyBuilder, keyEntry, keyFields, nullsAreNotEqual, sortBuilder, sortFields, tupleEntryIterator, valueComparators, valuesBuilder, valuesFields

Fields inherited from class cascading.flow.stream.element.SpliceGate

flowProcess, incomingScopes, outgoingScopes, role, splice

Fields inherited from class cascading.flow.stream.duct.Duct

next

Constructor Summary

Constructors

Constructor and Description
HadoopCoGroupGate(cascading.flow.FlowProcess flowProcess, cascading.pipe.CoGroup coGroup, cascading.flow.stream.graph.IORole role)

Method Summary

Modifier and Type	Method and Description
void	bind(cascading.flow.stream.graph.StreamGraph streamGraph)
protected cascading.flow.hadoop.HadoopCoGroupClosure	createClosure()
protected org.apache.hadoop.mapred.OutputCollector	createOutputCollector()
protected cascading.tuple.Tuple	unwrapGrouping(cascading.tuple.Tuple key)
protected void	wrapGroupingAndCollect(cascading.flow.stream.duct.Duct previous, int ordinal, cascading.tuple.Tuple valuesTuple, cascading.tuple.Tuple groupKey)

Methods inherited from class cascading.flow.hadoop.stream.HadoopGroupGate

accept, complete, prepare, receive, start

Methods inherited from class cascading.flow.stream.element.GroupingSpliceGate

cleanup, createDefaultNarrowBuilder, createNarrowBuilder, createNulledBuilder, getDelegatedTuple, getKeyComparator, getNumDeclaredIncomingBranches, initComparators, initialize

Methods inherited from class cascading.flow.stream.element.SpliceGate

equals, getBranchNames, getFlowElement, getIncomingScopes, getOutgoingScopes, getSplice, handleException, handleReThrowableException, hashCode, hasTrapHandler, setBranchNames, setTrapHandler, toString

Methods inherited from class cascading.flow.stream.duct.Duct

getNext, getNextFor, receiveFirst

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

HadoopCoGroupGate

public HadoopCoGroupGate(cascading.flow.FlowProcess flowProcess,
                         cascading.pipe.CoGroup coGroup,
                         cascading.flow.stream.graph.IORole role)

Method Detail

bind

public void bind(cascading.flow.stream.graph.StreamGraph streamGraph)

Overrides:

bind in class cascading.flow.hadoop.stream.HadoopGroupGate

createClosure

protected cascading.flow.hadoop.HadoopCoGroupClosure createClosure()

Specified by:

createClosure in class cascading.flow.hadoop.stream.HadoopGroupGate

wrapGroupingAndCollect

protected void wrapGroupingAndCollect(cascading.flow.stream.duct.Duct previous,
                                      int ordinal,
                                      cascading.tuple.Tuple valuesTuple,
                                      cascading.tuple.Tuple groupKey)
                               throws java.io.IOException

Specified by:

wrapGroupingAndCollect in class cascading.flow.hadoop.stream.HadoopGroupGate

Throws:

java.io.IOException

unwrapGrouping

protected cascading.tuple.Tuple unwrapGrouping(cascading.tuple.Tuple key)

Specified by:

unwrapGrouping in class cascading.flow.hadoop.stream.HadoopGroupGate

createOutputCollector

protected org.apache.hadoop.mapred.OutputCollector createOutputCollector()

Specified by:

createOutputCollector in class cascading.flow.hadoop.stream.HadoopGroupGate