Package io.openlineage.spark.shade.extension.v1

Interface LineageRelation

public interface LineageRelation
Interface to be implemented for extension's classes extending `org.apache.spark.sql.sources.BaseRelation`. Implementing it allows extracting lineage from such objects. Implementing `getNamespace` and `getName` within the `DatasetIdentifier` is obligatory.

  • Method Summary

    Modifier and Type
    Method
    Description
    io.openlineage.client.utils.DatasetIdentifier
    getLineageDatasetIdentifier(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)
     

  • Method Details

    • getLineageDatasetIdentifier

      io.openlineage.client.utils.DatasetIdentifier getLineageDatasetIdentifier(String sparkListenerEventName, io.openlineage.client.OpenLineage openLineage)