eu.stratosphere.example.java.record.relational

Class WebLogAnalysis

java.lang.Object

eu.stratosphere.example.java.record.relational.WebLogAnalysis

All Implemented Interfaces:

Program, ProgramDescription

public class WebLogAnalysis
extends Object
implements Program, ProgramDescription

Implements the following relational OLAP query as PACT program:

 SELECT r.pageURL, r.pageRank, r.avgDuration
 FROM Documents d JOIN Rankings r
        ON d.url = r.url
 WHERE CONTAINS(d.text, [keywords])
        AND r.rank > [rank]
        AND NOT EXISTS (
                SELECT * FROM Visits v
                WHERE v.destUrl = d.url
                        AND v.visitDate < [date]); 
  * 

Table Schemas:

 CREATE TABLE Documents (
                                        url VARCHAR(100) PRIMARY KEY,
                                        contents TEXT );
 
 CREATE TABLE Rankings (
                                        pageRank INT,
                                        pageURL VARCHAR(100) PRIMARY KEY,     
                                        avgDuration INT );       
 
 CREATE TABLE Visits (
                                        sourceIP VARCHAR(16),
                                        destURL VARCHAR(100),
                                        visitDate DATE,
                                        adRevenue FLOAT,
                                        userAgent VARCHAR(64),
                                        countryCode VARCHAR(3),
                                        languageCode VARCHAR(6),
                                        searchWord VARCHAR(32),
                                        duration INT );
 

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WebLogAnalysis.AntiJoinVisits CoGroupFunction that realizes an anti-join.
static class	WebLogAnalysis.FilterDocs MapFunction that filters for documents that contain a certain set of keywords.
static class	WebLogAnalysis.FilterRanks MapFunction that filters for records where the rank exceeds a certain threshold.
static class	WebLogAnalysis.FilterVisits MapFunction that filters for records of the visits relation where the year (from the date string) is equal to a certain value.
static class	WebLogAnalysis.JoinDocRanks JoinFunction that joins the filtered entries from the documents and the ranks relation.

Constructor Summary

Constructors

Constructor and Description
WebLogAnalysis()

Method Summary

Methods

Modifier and Type	Method and Description
String	getDescription()
Plan	getPlan(String... args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WebLogAnalysis

public WebLogAnalysis()

Method Detail

getPlan

public Plan getPlan(String... args)

Specified by:

getPlan in interface Program

getDescription

public String getDescription()

Specified by:

getDescription in interface ProgramDescription