eu.europeana.cloud.service.dps.storm.topologies.extractandindex

Class ExtractAndIndexTopology

java.lang.Object

eu.europeana.cloud.service.dps.storm.topologies.extractandindex.ExtractAndIndexTopology

public class ExtractAndIndexTopology
extends Object

This topology combines TextStrippingTopology and IndexTopology.

Author:

Pavel Kefurt

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ExtractAndIndexTopology.SpoutType

Constructor Summary

Constructors

Constructor and Description
ExtractAndIndexTopology(ExtractAndIndexTopology.SpoutType spoutType) Constructor of extract and index topology.

Method Summary

Methods

Modifier and Type	Method and Description
protected backtype.storm.generated.StormTopology	buildTopology()
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ExtractAndIndexTopology

public ExtractAndIndexTopology(ExtractAndIndexTopology.SpoutType spoutType)

Constructor of extract and index topology.

Parameters:

spoutType - type of spout

Method Detail

buildTopology

protected backtype.storm.generated.StormTopology buildTopology()

main

public static void main(String[] args)
                 throws backtype.storm.generated.AlreadyAliveException,
                        backtype.storm.generated.InvalidTopologyException,
                        backtype.storm.generated.AuthorizationException

Parameters:

args - the command line arguments

1. topology name (e.g. index_topology)
2. number of workers (e.g. 1)
3. max task parallelism (e.g. 1)
4. JVM parameters (e.g. "-Dhttp.proxyHost=xxx -Dhttp.proxyPort=xx") - TOPOLOGY_WORKER_CHILDOPTS

Throws:

backtype.storm.generated.AlreadyAliveException

backtype.storm.generated.InvalidTopologyException

backtype.storm.generated.AuthorizationException