cascading.platform.hadoop3

Class Hadoop3MRPlatform

java.lang.Object

cascading.platform.TestPlatform

cascading.platform.hadoop.BaseHadoopPlatform<org.apache.hadoop.mapred.JobConf>

cascading.platform.hadoop3.Hadoop3MRPlatform

public class Hadoop3MRPlatform
extends cascading.platform.hadoop.BaseHadoopPlatform<org.apache.hadoop.mapred.JobConf>

Class Hadoop3Platform is automatically loaded and injected into a PlatformTestCase instance so that all *PlatformTest classes can be tested against Apache Hadoop 2.x.

Field Summary

Fields inherited from class cascading.platform.hadoop.BaseHadoopPlatform

configuration, fileSys, logger, properties

Fields inherited from class cascading.platform.TestPlatform

CLUSTER_TESTING_PROPERTY, numGatherPartitions, numMappers, numReducers, PLATFORM_PREFIX

Constructor Summary

Constructors

Constructor and Description
Hadoop3MRPlatform()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapred.JobConf	getConfiguration()
cascading.tap.Tap	getDistCacheTap(cascading.tap.hadoop.Hfs parent)
cascading.flow.FlowConnector	getFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties)
cascading.flow.FlowProcess	getFlowProcess()
java.lang.String	getName()
java.lang.Integer	getNumMapTasks(java.util.Map<java.lang.Object,java.lang.Object> properties)
java.lang.Integer	getNumReduceTasks(java.util.Map<java.lang.Object,java.lang.Object> properties)
void	setNumMapTasks(java.util.Map<java.lang.Object,java.lang.Object> properties, int numMapTasks)
void	setNumReduceTasks(java.util.Map<java.lang.Object,java.lang.Object> properties, int numReduceTasks)
void	setUp()

Methods inherited from class cascading.platform.hadoop.BaseHadoopPlatform

copyFromLocal, copyToLocal, getDelimitedFile, getDelimitedFile, getDelimitedFile, getHiddenTemporaryPath, getJSONFile, getLongComparator, getPartitionTap, getProperties, getStringComparator, getTap, getTestConfigDefScheme, getTestFailScheme, getTextFile, isHDFSAvailable, isMapReduce, remoteExists, remoteRemove, safeFileName, setNumGatherPartitions, setNumMappers, setNumReducers, tearDown

Methods inherited from class cascading.platform.TestPlatform

getApplicationJar, getDelimitedFile, getDelimitedFile, getDelimitedFile, getDelimitedFile, getDelimitedFile, getFlowConnector, getGlobalProperties, getJSONFile, getNumGatherPartitions, getNumGatherPartitionTasks, getNumMappers, getNumReducers, getTabDelimitedFile, getTabDelimitedFile, getTextFile, getTextFile, getTextFile, getTextFile, isDAG, isUseCluster, setNumGatherPartitionTasks, setUseCluster, supportsGroupByAfterMerge

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Hadoop3MRPlatform

public Hadoop3MRPlatform()

Method Detail

getName

public java.lang.String getName()

Overrides:

getName in class cascading.platform.TestPlatform

getFlowConnector

public cascading.flow.FlowConnector getFlowConnector(java.util.Map<java.lang.Object,java.lang.Object> properties)

Specified by:

getFlowConnector in class cascading.platform.TestPlatform

setNumMapTasks

public void setNumMapTasks(java.util.Map<java.lang.Object,java.lang.Object> properties,
                           int numMapTasks)

Overrides:

setNumMapTasks in class cascading.platform.TestPlatform

setNumReduceTasks

public void setNumReduceTasks(java.util.Map<java.lang.Object,java.lang.Object> properties,
                              int numReduceTasks)

Overrides:

setNumReduceTasks in class cascading.platform.TestPlatform

getNumMapTasks

public java.lang.Integer getNumMapTasks(java.util.Map<java.lang.Object,java.lang.Object> properties)

Overrides:

getNumMapTasks in class cascading.platform.TestPlatform

getNumReduceTasks

public java.lang.Integer getNumReduceTasks(java.util.Map<java.lang.Object,java.lang.Object> properties)

Overrides:

getNumReduceTasks in class cascading.platform.TestPlatform

getConfiguration

public org.apache.hadoop.mapred.JobConf getConfiguration()

Specified by:

getConfiguration in class cascading.platform.hadoop.BaseHadoopPlatform<org.apache.hadoop.mapred.JobConf>

getDistCacheTap

public cascading.tap.Tap getDistCacheTap(cascading.tap.hadoop.Hfs parent)

Specified by:

getDistCacheTap in class cascading.platform.hadoop.BaseHadoopPlatform<org.apache.hadoop.mapred.JobConf>

getFlowProcess

public cascading.flow.FlowProcess getFlowProcess()

Specified by:

getFlowProcess in class cascading.platform.TestPlatform

setUp

public void setUp()
           throws java.io.IOException

Specified by:

setUp in class cascading.platform.TestPlatform

Throws:

java.io.IOException