org.apache.spark.scheduler

ExternalClusterManager

trait ExternalClusterManager extends AnyRef

A cluster manager interface to plugin external scheduler.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ExternalClusterManager
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def canCreate(masterURL: String): Boolean

    Check if this cluster manager instance can create scheduler components for a certain master URL.

    Check if this cluster manager instance can create scheduler components for a certain master URL.

    masterURL

    the master URL

    returns

    True if the cluster manager can create scheduler backend/

  2. abstract def createSchedulerBackend(sc: SparkContext, scheduler: TaskScheduler): SchedulerBackend

    Create a scheduler backend for the given SparkContext and scheduler.

    Create a scheduler backend for the given SparkContext and scheduler. This is called after task scheduler is created using ExternalClusterManager.createTaskScheduler().

    sc

    SparkContext

    scheduler

    TaskScheduler that will be used with the scheduler backend.

    returns

    SchedulerBackend that works with a TaskScheduler

  3. abstract def createTaskScheduler(sc: SparkContext): TaskScheduler

    Create a task scheduler instance for the given SparkContext

    Create a task scheduler instance for the given SparkContext

    sc

    SparkContext

    returns

    TaskScheduler that will be responsible for task handling

  4. abstract def initialize(scheduler: TaskScheduler, backend: SchedulerBackend): Unit

    Initialize task scheduler and backend scheduler.

    Initialize task scheduler and backend scheduler. This is called after the scheduler components are created

    scheduler

    TaskScheduler that will be responsible for task handling

    backend

    SchedulerBackend that works with a TaskScheduler

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  12. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  13. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  14. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  15. final def notify(): Unit

    Definition Classes
    AnyRef

  16. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  17. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  18. def toString(): String

    Definition Classes
    AnyRef → Any

  19. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  20. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  21. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped