Package io.openlineage.spark.shade.extension.v1
package io.openlineage.spark.shade.extension.v1
-
ClassDescriptionInput dataset with a node in LogicalPlan where a input dataset shall be extracted fromInput dataset with an identifier containing namespace and nameInterface to be implemented for LogicalPlan nodes to extract lineage information about input datasets.Interface to be implemented for extension's classes extending `org.apache.spark.sql.sources.BaseRelation`.Interface for classes implementing `org.apache.spark.sql.sources.RelationProvider`.Class to contain reference to Spark's ExprId without adding dependency to Spark libraryOutput dataset with a node in LogicalPlan where a input dataset shall be extracted fromOutput dataset with an identifier containing namespace and nameInterface to be implemented for LogicalPlan nodes to extract lineage information about output datasets.