eu.stratosphere.example.java.wordcount

Class WordCount.Tokenizer

java.lang.Object

eu.stratosphere.api.common.functions.AbstractFunction

eu.stratosphere.api.java.functions.FlatMapFunction<String,Tuple2<String,Integer>>

eu.stratosphere.example.java.wordcount.WordCount.Tokenizer

All Implemented Interfaces:

Function, GenericFlatMap<String,Tuple2<String,Integer>>, Serializable

Enclosing class:

WordCount

public static final class WordCount.Tokenizer
extends FlatMapFunction<String,Tuple2<String,Integer>>

Implements the string tokenizer that splits sentences into words as a user-defined FlatMapFunction. The function takes a line (String) and splits it into multiple pairs in the form of "(word,1)" (Tuple2).

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
void	flatMap(String value, Collector<Tuple2<String,Integer>> out)

Methods inherited from class eu.stratosphere.api.common.functions.AbstractFunction

close, getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface eu.stratosphere.api.common.functions.Function

close, getRuntimeContext, open, setRuntimeContext

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

flatMap

public void flatMap(String value,
                    Collector<Tuple2<String,Integer>> out)

Specified by:

flatMap in interface GenericFlatMap<String,Tuple2<String,Integer>>

Specified by:

flatMap in class FlatMapFunction<String,Tuple2<String,Integer>>