Package io.openlineage.spark.shade.extension.v1

Interface OutputLineageNode

public interface OutputLineageNode
Interface to be implemented for LogicalPlan nodes to extract lineage information about output datasets.

  • Method Summary

    Modifier and Type
    Method
    Description
    List<OutputDatasetWithFacets>
    getOutputs(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)
    Gets output dataset read by this LogicalPlans node

  • Method Details

    • getOutputs

      List<OutputDatasetWithFacets> getOutputs(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)
      Gets output dataset read by this LogicalPlans node
      Parameters:
      sparkListenerEventName - class name of SparkListenerEvent that triggered OpenLineageSparkListener
      openLineage - instance to create OpenLineage objects
      Returns:
      list of dataset with facets