Packages

o

net.sansa_stack.ml.spark.featureExtraction

FeatureExtractingSparqlGenerator

object FeatureExtractingSparqlGenerator

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. FeatureExtractingSparqlGenerator
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val _literalReplacement: Node
  5. val _literalReplacementString: String
  6. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  8. def createDataframesToTraverse(df: DataFrame): (DataFrame, DataFrame)

    creates dataframe for traversing over join

    creates dataframe for traversing over join

    df

    dataframe representing entire graph

    returns

    dataframes for traversing up (which is same as df and down which is up flipped and added the traverse direction column)

  9. def createSeedFetchingSparql(seedVarName: String, seedWhereClause: String, sortedByLinks: Boolean): String

    create on string level the seed fetching query

    create on string level the seed fetching query

    seedVarName

    projection var name for seed element

    seedWhereClause

    where clause how seed can be fetched

    sortedByLinks

    boolean value if seeds should be ordered by outgoing links in desc order or fifo seeds

    returns

    string representing the seed fetching sparql query

  10. def createSparql(ds: Dataset[Triple], seedVarName: String, seedWhereClause: String, maxUp: Int, maxDown: Int, numberSeeds: Int = 0, ratioNumberSeeds: Double = 1.0, numberRandomWalks: Int = 0, sortedByLinks: Boolean = false, featuresInOptionalBlocks: Boolean = true): (String, List[String])

    this function creates the sparql and a list of corresponding porjection variables

    this function creates the sparql and a list of corresponding porjection variables

    the function operates on dataframe level and first fetches the seeds then seeds are cutoff to the desired number or ration to be considered from seeds we traverse up in the graph traverse down create for each traversed path a query line take unique query lines create sparql query

    ds

    dataset of triple of true columns of type string representing triples s p o

    seedVarName

    how the seeds should be named and with beginning question mark as needed for projection variable

    seedWhereClause

    a string representing the where part of a sparql query specifying how to reach seeds

    maxUp

    integer for limiting number of traversal up steps

    maxDown

    integer for limiting traverse down steps

    numberSeeds

    number of seeds to consider

    ratioNumberSeeds

    number of seeds specified by ratio

    returns

    string of resulting sparql and list of string for each projection variable which later can be used for dataframe column naming

  11. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  13. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. def main(args: Array[String]): Unit

    the main function call the entire process

    the main function call the entire process

    all configuration have to be done in a config file. this allows easier interaction as soon as a standalone jar has been created.

    args

    path to the typesafe conf file

  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  20. def rowToQuery(row: Row, seedVarName: String, featuresInOptionalBlocks: Boolean): (String, String)

    creates a string corresponding to an OPTIONAL block for where part in resulting sparql

    creates a string corresponding to an OPTIONAL block for where part in resulting sparql

    row

    row from dataframe created by traversing all paths

    seedVarName

    name of seed projection var

    returns

    string representing OPTIONAL block

  21. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  22. def toString(): String
    Definition Classes
    AnyRef → Any
  23. def traverse(paths: DataFrame, traverseDf: DataFrame, iterationLimit: Int, traverseDirection: String, numberRandomWalks: Int = 0): DataFrame

    traverses a tree by joining dataframes of current paths and traversable hops

    traverses a tree by joining dataframes of current paths and traversable hops

    paths

    current paths initially started at seeds

    traverseDf

    the dataframe giving traversal opportunities

    iterationLimit

    how deep to traverse or how often join should be performed max

    traverseDirection

    direction whether up or down

    returns

    the traversed dataframe with current paths after traverse up, and paths ending with literals after traverse down

  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  26. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from AnyRef

Inherited from Any

Ungrouped