org.verdictdb.connection

Class SparkConnection

java.lang.Object

org.verdictdb.connection.SparkConnection

All Implemented Interfaces:

DbmsConnection, MetaDataProvider

public class SparkConnection
extends Object
implements DbmsConnection

Constructor Summary

Constructors

Constructor and Description
SparkConnection(org.apache.spark.sql.SparkSession sc)
SparkConnection(org.apache.spark.sql.SparkSession sc, SqlSyntax syntax)

Method Summary

Modifier and Type	Method and Description
void	close()
DbmsConnection	copy()
DbmsQueryResult	execute(String query) Executes a query (or queries).
List<org.apache.commons.lang3.tuple.Pair<String,String>>	getColumns(String schema, String table)
String	getDefaultSchema()
List<String>	getPartitionColumns(String schema, String table)
List<String>	getSchemas()
org.apache.spark.sql.SparkSession	getSparkSession()
SqlSyntax	getSyntax()
List<String>	getTables(String schema)
void	setDefaultSchema(String schema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkConnection

public SparkConnection(org.apache.spark.sql.SparkSession sc)

SparkConnection

public SparkConnection(org.apache.spark.sql.SparkSession sc,
                       SqlSyntax syntax)

Method Detail

getSchemas

public List<String> getSchemas()
                        throws VerdictDBDbmsException

Specified by:

getSchemas in interface MetaDataProvider

Throws:

VerdictDBDbmsException

getTables

public List<String> getTables(String schema)
                       throws VerdictDBDbmsException

Specified by:

getTables in interface MetaDataProvider

Throws:

VerdictDBDbmsException

getColumns

public List<org.apache.commons.lang3.tuple.Pair<String,String>> getColumns(String schema,
                                                                           String table)
                                                                    throws VerdictDBDbmsException

Specified by:

getColumns in interface MetaDataProvider

Throws:

VerdictDBDbmsException

getPartitionColumns

public List<String> getPartitionColumns(String schema,
                                        String table)
                                 throws VerdictDBDbmsException

Specified by:

getPartitionColumns in interface MetaDataProvider

Throws:

VerdictDBDbmsException

getDefaultSchema

public String getDefaultSchema()

Specified by:

getDefaultSchema in interface MetaDataProvider

setDefaultSchema

public void setDefaultSchema(String schema)

Specified by:

setDefaultSchema in interface MetaDataProvider

execute

public DbmsQueryResult execute(String query)
                        throws VerdictDBDbmsException

Description copied from interface: DbmsConnection

Executes a query (or queries). If the result exists, return it.

If a query includes multiple queries separated by semicolons, issue them separately in order.

Specified by:

execute in interface DbmsConnection

Returns:

Throws:

VerdictDBDbmsException

getSyntax

public SqlSyntax getSyntax()

Specified by:

getSyntax in interface DbmsConnection

close

public void close()

Specified by:

close in interface DbmsConnection

getSparkSession

public org.apache.spark.sql.SparkSession getSparkSession()

copy

public DbmsConnection copy()

Specified by:

copy in interface DbmsConnection