cascading.tap.hadoop

Class DistCacheTap

java.lang.Object

cascading.tap.Tap<Config,Input,Output>

cascading.tap.DecoratorTap<java.lang.Void,org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector>

cascading.tap.hadoop.BaseDistCacheTap

cascading.tap.hadoop.DistCacheTap

All Implemented Interfaces:

cascading.flow.FlowElement, cascading.flow.planner.ScopedElement, cascading.util.Traceable, java.io.Serializable

public class DistCacheTap
extends cascading.tap.hadoop.BaseDistCacheTap

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CASCADING_LOCAL_RESOURCES
static java.lang.String	CASCADING_REMOTE_RESOURCES

Fields inherited from class cascading.tap.DecoratorTap

metaInfo, original

Constructor Summary

Constructors

Constructor and Description
DistCacheTap(cascading.tap.Tap<org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> original)

Method Summary

Modifier and Type	Method and Description
protected void	addLocalCacheFiles(org.apache.hadoop.conf.Configuration conf, java.net.URI uri)
protected org.apache.hadoop.fs.Path[]	getLocalCacheFiles(cascading.flow.FlowProcess<? extends org.apache.hadoop.conf.Configuration> flowProcess)

Methods inherited from class cascading.tap.hadoop.BaseDistCacheTap

openForRead, sourceConfInit

Methods inherited from class cascading.tap.DecoratorTap

commitResource, createResource, createResource, deleteResource, deleteResource, flowConfInit, getConfigDef, getFullIdentifier, getFullIdentifier, getIdentifier, getMetaInfo, getModifiedTime, getModifiedTime, getNodeConfigDef, getOriginal, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hasNodeConfigDef, hasStepConfigDef, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForWrite, openForWrite, outgoingScopeFor, prepareResourceForRead, prepareResourceForWrite, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setMetaInfo, setOriginal, sinkConfInit, toString

Methods inherited from class cascading.tap.Tap

entryStream, entryStream, entryStreamCopy, entryStreamCopy, equals, hashCode, id, openForReadUnchecked, setScheme, spliterator, splititerator, taps, tupleStream, tupleStream, tupleStreamCopy, tupleStreamCopy

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

CASCADING_LOCAL_RESOURCES

public static final java.lang.String CASCADING_LOCAL_RESOURCES

See Also:

Constant Field Values

CASCADING_REMOTE_RESOURCES

public static final java.lang.String CASCADING_REMOTE_RESOURCES

See Also:

Constant Field Values

Constructor Detail

DistCacheTap

public DistCacheTap(cascading.tap.Tap<org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> original)

Method Detail

getLocalCacheFiles

protected org.apache.hadoop.fs.Path[] getLocalCacheFiles(cascading.flow.FlowProcess<? extends org.apache.hadoop.conf.Configuration> flowProcess)
                                                  throws java.io.IOException

Specified by:

getLocalCacheFiles in class cascading.tap.hadoop.BaseDistCacheTap

Throws:

java.io.IOException

addLocalCacheFiles

protected void addLocalCacheFiles(org.apache.hadoop.conf.Configuration conf,
                                  java.net.URI uri)

Specified by:

addLocalCacheFiles in class cascading.tap.hadoop.BaseDistCacheTap