eu.stratosphere.example.java.record.relational.generator

Class WebLogGenerator

java.lang.Object

eu.stratosphere.example.java.record.relational.generator.WebLogGenerator

public class WebLogGenerator
extends Object

Constructor Summary

Constructors

Constructor and Description
WebLogGenerator()

Method Summary

Methods

Modifier and Type	Method and Description
static void	genDocs(int noDocs, int noFiles, String[] filterKeyWords, String[] words, String path) Generates the files for the documents relation.
static void	genRanks(int noDocs, int noFiles, String path) Generates the files for the ranks relation.
static void	genVisits(int noVisits, int noDocs, int noFiles, String path) Generates the files for the visits relation.
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WebLogGenerator

public WebLogGenerator()

Method Detail

main

public static void main(String[] args)

genDocs

public static void genDocs(int noDocs,
           int noFiles,
           String[] filterKeyWords,
           String[] words,
           String path)

Generates the files for the documents relation. The entries apply the following format:
URL | Content

Parameters:

noDocs - Number of entries for the documents relation

noFiles - Number of files for the documents relation

filterKeyWords - A list of keywords that should be contained

words - A list of words to fill the entries

path - Output path for the documents relation

genRanks

public static void genRanks(int noDocs,
            int noFiles,
            String path)

Generates the files for the ranks relation. The ranks entries apply the following format:
Rank | URL | Average Duration |\n

Parameters:

noDocs - Number of entries in the documents relation

noFiles - Number of files for the ranks relation

path - Output path for the ranks relation

genVisits

public static void genVisits(int noVisits,
             int noDocs,
             int noFiles,
             String path)

Generates the files for the visits relation. The visits entries apply the following format:
IP Address | URL | Date (YYYY-MM-DD) | Misc. Data (e.g. User-Agent) |\n

Parameters:

noVisits - Number of entries for the visits relation

noDocs - Number of entries in the documents relation

noFiles - Number of files for the visits relation

path - Output path for the visits relation