io.apigee.trireme.samples.hadoop

Class HadoopMapper

java.lang.Object

org.apache.hadoop.mapred.MapReduceBase

io.apigee.trireme.samples.hadoop.HadoopBase

io.apigee.trireme.samples.hadoop.HadoopMapper

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

public class HadoopMapper
extends HadoopBase
implements org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

This mapper will launch Noderunner and tell it to run a "module". (A module doesn't have to do anything but wait to be called.)

Field Summary

Fields inherited from class io.apigee.trireme.samples.hadoop.HadoopBase

env, module, runningScript, SCRIPT_FILE_KEY, scriptFileName

Constructor Summary

Constructors

Constructor and Description
HadoopMapper()

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
void	map(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> out, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class io.apigee.trireme.samples.hadoop.HadoopBase

configure, startNodeModule, stopNodeModule

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.mapred.JobConfigurable

configure

Constructor Detail

HadoopMapper

public HadoopMapper()

Method Detail

map

public void map(org.apache.hadoop.io.LongWritable key,
       org.apache.hadoop.io.Text value,
       org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> out,
       org.apache.hadoop.mapred.Reporter reporter)
         throws IOException

Specified by:

map in interface org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class org.apache.hadoop.mapred.MapReduceBase