org.apache.spark.sql.streaming

DirectKafkaStreamRelation

final class DirectKafkaStreamRelation extends StreamBaseRelation with Logging with StreamPlan with Serializable

Linear Supertypes
StreamBaseRelation, Logging, Serializable, Serializable, DestroyRelation, TableScan, StreamPlan, ParentRelation, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. DirectKafkaStreamRelation
  2. StreamBaseRelation
  3. Logging
  4. Serializable
  5. Serializable
  6. DestroyRelation
  7. TableScan
  8. StreamPlan
  9. ParentRelation
  10. BaseRelation
  11. AnyRef
  12. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DirectKafkaStreamRelation(sqlContext: SQLContext, options: Map[String, String], schema: StructType)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. val K: String

  7. val KD: String

  8. val V: String

  9. val VD: String

  10. def addDependent(dependent: DependentRelation, catalog: SnappyStoreHiveCatalog): Boolean

    Used by DependentRelations to register with parent

    Used by DependentRelations to register with parent

    Definition Classes
    StreamBaseRelation → ParentRelation

  11. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  12. def buildScan(): RDD[Row]

    Definition Classes
    StreamBaseRelation → TableScan

  13. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  14. final def context: SnappyStreamingContext

    Definition Classes
    StreamBaseRelation

  15. def createRowStream(): DStream[InternalRow]

    Attributes
    protected
    Definition Classes
    DirectKafkaStreamRelation → StreamBaseRelation

  16. def destroy(ifExists: Boolean): Unit

    Destroy and cleanup this relation.

    Destroy and cleanup this relation. It may include, but not limited to, dropping the external table that this relation represents.

    Definition Classes
    StreamBaseRelation → DestroyRelation

  17. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  18. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  19. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  21. def getDependents(catalog: SnappyStoreHiveCatalog): Seq[String]

    Get the dependent child.

    Get the dependent child.

    Definition Classes
    StreamBaseRelation → ParentRelation

  22. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  23. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  24. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  25. val kafkaParams: Map[String, String]

  26. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  27. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  28. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  29. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  30. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  31. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  32. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  33. def logName: String

    Attributes
    protected
    Definition Classes
    Logging

  34. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  35. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  36. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  37. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  38. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  39. val needConversion: Boolean

    Definition Classes
    StreamBaseRelation → BaseRelation

  40. final def notify(): Unit

    Definition Classes
    AnyRef

  41. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  42. def recoverDependentsRelation(): Unit

    Recover/Re-create the dependent child relations.

    Recover/Re-create the dependent child relations. This callback is to recreate Dependent relations when the ParentRelation is being created.

    Definition Classes
    StreamBaseRelation → ParentRelation

  43. def removeDependent(dependent: DependentRelation, catalog: SnappyStoreHiveCatalog): Boolean

    Used by DependentRelations to unregister with parent

    Used by DependentRelations to unregister with parent

    Definition Classes
    StreamBaseRelation → ParentRelation

  44. val rowConverter: StreamToRowsConverter

    Definition Classes
    StreamBaseRelation

  45. final lazy val rowStream: DStream[InternalRow]

    Definition Classes
    StreamBaseRelation → StreamPlan

  46. val schema: StructType

    Definition Classes
    DirectKafkaStreamRelation → StreamPlan → BaseRelation

  47. def sizeInBytes: Long

    Definition Classes
    BaseRelation

  48. val sqlContext: SQLContext

    Definition Classes
    DirectKafkaStreamRelation → BaseRelation

  49. val storageLevel: StorageLevel

    Definition Classes
    StreamBaseRelation

  50. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  51. val tableName: String

    Definition Classes
    StreamBaseRelation

  52. def toString(): String

    Definition Classes
    AnyRef → Any

  53. val topicsSet: Set[String]

  54. def truncate(): Unit

    Truncate the table represented by this relation.

    Truncate the table represented by this relation.

    Definition Classes
    StreamBaseRelation → DestroyRelation

  55. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Definition Classes
    BaseRelation

  56. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  57. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  58. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from StreamBaseRelation

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from DestroyRelation

Inherited from TableScan

Inherited from StreamPlan

Inherited from ParentRelation

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped