Package net.sansa_stack.spark.io.rdf.input.impl

Class RdfSourceFactoryImpl

java.lang.Object

net.sansa_stack.spark.io.rdf.input.impl.RdfSourceFactoryImpl

All Implemented Interfaces:

RdfSourceFactory

public class RdfSourceFactoryImpl
extends Object
implements RdfSourceFactory

Implementation of a source factory based on spark/hadoop.

Author:

raven

Field Summary

Fields

Modifier and Type	Field	Description
protected org.apache.spark.sql.SparkSession	sparkSession

Constructor Summary

Constructors

Constructor	Description
RdfSourceFactoryImpl(org.apache.spark.sql.SparkSession sparkSession)

Method Summary

Modifier and Type	Method	Description
RdfSourceFromResource	create(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.jena.riot.Lang lang)
static RdfSourceFactory	from(org.apache.spark.sql.SparkSession sparkSession)
static org.apache.hadoop.fs.FileSystem	getDefaultFileSystem()
RdfSourceCollection	newRdfSourceCollection()	Return a collection to which RdfSources can be added from which a union rdd can be obtained
static org.apache.jena.riot.Lang	probeLang(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fileSystem)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.sansa_stack.spark.io.rdf.input.api.RdfSourceFactory

get, get, get, get

Field Details

sparkSession

protected org.apache.spark.sql.SparkSession sparkSession

Constructor Details

RdfSourceFactoryImpl

public RdfSourceFactoryImpl(org.apache.spark.sql.SparkSession sparkSession)

Method Details

from

public static RdfSourceFactory from(org.apache.spark.sql.SparkSession sparkSession)

create

public RdfSourceFromResource create(org.apache.hadoop.fs.Path path,
 org.apache.hadoop.fs.FileSystem fileSystem,
 org.apache.jena.riot.Lang lang)
                             throws Exception

Specified by:

create in interface RdfSourceFactory

Throws:

Exception

newRdfSourceCollection

public RdfSourceCollection newRdfSourceCollection()

Description copied from interface: RdfSourceFactory

Return a collection to which RdfSources can be added from which a union rdd can be obtained

Specified by:

newRdfSourceCollection in interface RdfSourceFactory

probeLang

public static org.apache.jena.riot.Lang probeLang(org.apache.hadoop.fs.Path path,
 org.apache.hadoop.fs.FileSystem fileSystem)
                                           throws IOException

Throws:

IOException

getDefaultFileSystem

public static org.apache.hadoop.fs.FileSystem getDefaultFileSystem()
                                                            throws IOException

Throws:

IOException