Package io.openlineage.spark.shade.extension.v1

Interface InputLineageNode

public interface InputLineageNode
Interface to be implemented for LogicalPlan nodes to extract lineage information about input datasets.

  • Method Summary

    Modifier and Type
    Method
    Description
    List<InputDatasetWithFacets>
    getInputs(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)
    Gets input dataset read by this LogicalPlans node

  • Method Details

    • getInputs

      List<InputDatasetWithFacets> getInputs(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)
      Gets input dataset read by this LogicalPlans node
      Parameters:
      sparkListenerEventName - class name of SparkListenerEvent that triggered OpenLineageSparkListener
      openLineage - instance to create OpenLineage objects
      Returns:
      list of input datasets with facets