Package net.sansa_stack.spark.io.rdf.output

Class RddRdfOpsImpl<T>

java.lang.Object

net.sansa_stack.spark.io.rdf.output.RddRdfOpsImpl<T>

All Implemented Interfaces:

RddRdfOps<T>

public class RddRdfOpsImpl<T>
extends Object
implements RddRdfOps<T>

Field Summary

Fields

Modifier and Type	Field	Description
protected int	componentCount
protected JavaRddFunction<T,org.apache.jena.graph.Node>	convertToNode
protected JavaRddFunction<T,org.apache.jena.sparql.core.Quad>	convertToQuad
protected JavaRddFunction<T,org.apache.jena.graph.Triple>	convertToTriple
protected Function<? super T,Comparable<?>>	keyFunction
protected BiConsumer<T,org.apache.jena.riot.system.StreamRDF>	sendRecordToStreamRDF

Constructor Summary

Constructors

Constructor	Description
RddRdfOpsImpl(int componentCount, BiConsumer<T,org.apache.jena.riot.system.StreamRDF> sendRecordToStreamRDF, JavaRddFunction<T,org.apache.jena.graph.Triple> convertToTriple, JavaRddFunction<T,org.apache.jena.sparql.core.Quad> convertToQuad, JavaRddFunction<T,org.apache.jena.graph.Node> convertToNode, Function<? super T,Comparable<?>> keyFunction)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.api.java.JavaRDD<org.apache.jena.graph.Node>	convertToNode(org.apache.spark.api.java.JavaRDD<T> rdd)
org.apache.spark.api.java.JavaRDD<org.apache.jena.sparql.core.Quad>	convertToQuad(org.apache.spark.api.java.JavaRDD<T> rdd)
org.apache.spark.api.java.JavaRDD<org.apache.jena.graph.Triple>	convertToTriple(org.apache.spark.api.java.JavaRDD<T> rdd)
static <T> RddRdfOpsImpl<T>	create(int componentCount, org.aksw.commons.lambda.serializable.SerializableBiConsumer<T,org.apache.jena.riot.system.StreamRDF> sendRecordToStreamRDF, JavaRddFunction<T,org.apache.jena.graph.Triple> convertToTriple, JavaRddFunction<T,org.apache.jena.sparql.core.Quad> convertToQuad, JavaRddFunction<T,org.apache.jena.graph.Node> convertToNode, org.aksw.commons.lambda.serializable.SerializableFunction<? super T,Comparable<?>> keyFunction)	Create method.
static RddRdfOpsImpl<org.aksw.jenax.arq.dataset.api.DatasetOneNg>	createForDataset()
static RddRdfOpsImpl<org.aksw.jenax.arq.dataset.api.DatasetGraphOneNg>	createForDatasetGraph()
static RddRdfOpsImpl<org.apache.jena.graph.Graph>	createForGraph()
static RddRdfOpsImpl<org.apache.jena.rdf.model.Model>	createForModel()
static RddRdfOpsImpl<org.apache.jena.sparql.core.Quad>	createForQuad()
static RddRdfOpsImpl<org.apache.jena.graph.Triple>	createForTriple()
int	getComponentCount()	Whether the operations provided by this class are based on quads
Function<? super T,Comparable<?>>	getKeyFunction()
void	sendRecordToStreamRDF(T record, org.apache.jena.riot.system.StreamRDF streamRDF)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.sansa_stack.spark.io.rdf.output.RddRdfOps

usesQuads

Field Details

componentCount

protected int componentCount

sendRecordToStreamRDF

protected BiConsumer<T,org.apache.jena.riot.system.StreamRDF> sendRecordToStreamRDF

convertToTriple

protected JavaRddFunction<T,org.apache.jena.graph.Triple> convertToTriple

convertToQuad

protected JavaRddFunction<T,org.apache.jena.sparql.core.Quad> convertToQuad

convertToNode

protected JavaRddFunction<T,org.apache.jena.graph.Node> convertToNode

keyFunction

protected Function<? super T,Comparable<?>> keyFunction

Constructor Details

RddRdfOpsImpl

public RddRdfOpsImpl(int componentCount,
 BiConsumer<T,org.apache.jena.riot.system.StreamRDF> sendRecordToStreamRDF,
 JavaRddFunction<T,org.apache.jena.graph.Triple> convertToTriple,
 JavaRddFunction<T,org.apache.jena.sparql.core.Quad> convertToQuad,
 JavaRddFunction<T,org.apache.jena.graph.Node> convertToNode,
 Function<? super T,Comparable<?>> keyFunction)

Method Details

getComponentCount

public int getComponentCount()

Description copied from interface: RddRdfOps

Whether the operations provided by this class are based on quads

Specified by:

getComponentCount in interface RddRdfOps<T>

sendRecordToStreamRDF

public void sendRecordToStreamRDF(T record,
 org.apache.jena.riot.system.StreamRDF streamRDF)

Specified by:

sendRecordToStreamRDF in interface RddRdfOps<T>

convertToTriple

public org.apache.spark.api.java.JavaRDD<org.apache.jena.graph.Triple> convertToTriple(org.apache.spark.api.java.JavaRDD<T> rdd)

Specified by:

convertToTriple in interface RddRdfOps<T>

convertToQuad

public org.apache.spark.api.java.JavaRDD<org.apache.jena.sparql.core.Quad> convertToQuad(org.apache.spark.api.java.JavaRDD<T> rdd)

Specified by:

convertToQuad in interface RddRdfOps<T>

convertToNode

public org.apache.spark.api.java.JavaRDD<org.apache.jena.graph.Node> convertToNode(org.apache.spark.api.java.JavaRDD<T> rdd)

Specified by:

convertToNode in interface RddRdfOps<T>

getKeyFunction

public Function<? super T,Comparable<?>> getKeyFunction()

Specified by:

getKeyFunction in interface RddRdfOps<T>

create

public static <T> RddRdfOpsImpl<T> create(int componentCount,
 org.aksw.commons.lambda.serializable.SerializableBiConsumer<T,org.apache.jena.riot.system.StreamRDF> sendRecordToStreamRDF,
 JavaRddFunction<T,org.apache.jena.graph.Triple> convertToTriple,
 JavaRddFunction<T,org.apache.jena.sparql.core.Quad> convertToQuad,
 JavaRddFunction<T,org.apache.jena.graph.Node> convertToNode,
 org.aksw.commons.lambda.serializable.SerializableFunction<? super T,Comparable<?>> keyFunction)

Create method. Note that the 'sendRecordToSTreamRDF' parameter must be serializable because it is used within mapPartitions. The convertToTriple and convertToQuad arguments are applied on the driver while preparing the spark operations.

Type Parameters:

T -

Parameters:

sendRecordToStreamRDF -

convertToTriple -

convertToQuad -

Returns:

createForTriple

public static RddRdfOpsImpl<org.apache.jena.graph.Triple> createForTriple()

createForQuad

public static RddRdfOpsImpl<org.apache.jena.sparql.core.Quad> createForQuad()

createForGraph

public static RddRdfOpsImpl<org.apache.jena.graph.Graph> createForGraph()

createForDatasetGraph

public static RddRdfOpsImpl<org.aksw.jenax.arq.dataset.api.DatasetGraphOneNg> createForDatasetGraph()

createForModel

public static RddRdfOpsImpl<org.apache.jena.rdf.model.Model> createForModel()

createForDataset

public static RddRdfOpsImpl<org.aksw.jenax.arq.dataset.api.DatasetOneNg> createForDataset()