io.ray.streaming.runtime.master.scheduler

Class JobSchedulerImpl

java.lang.Object

io.ray.streaming.runtime.master.scheduler.JobSchedulerImpl

All Implemented Interfaces:

JobScheduler

public class JobSchedulerImpl
extends Object
implements JobScheduler

Job scheduler implementation.

Constructor Summary

Constructors

Constructor and Description
JobSchedulerImpl(JobMaster jobMaster)

Method Summary

Modifier and Type	Method and Description
protected Map<ExecutionVertex,JobWorkerContext>	buildWorkersContext(ExecutionGraph executionGraph) Build workers context.
boolean	createWorkers(ExecutionGraph executionGraph) Create JobWorker actors according to the physical plan.
boolean	destroyWorkers(List<ExecutionVertex> executionVertices) Destroy JobWorkers according to the vertex infos.
protected boolean	initWorkers(Map<ExecutionVertex,JobWorkerContext> vertexToContextMap) Init JobWorkers according to the vertex and context infos.
protected void	prepareResourceAndCreateWorker(ExecutionGraph executionGraph) Allocate job workers' resource then create job workers' actor.
boolean	scheduleJob(ExecutionGraph executionGraph) Schedule streaming job using the physical plan.
boolean	startWorkers(ExecutionGraph executionGraph, long checkpointId) Start JobWorkers according to the physical plan.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JobSchedulerImpl

public JobSchedulerImpl(JobMaster jobMaster)

Method Detail

scheduleJob

public boolean scheduleJob(ExecutionGraph executionGraph)

Description copied from interface: JobScheduler

Schedule streaming job using the physical plan.

Specified by:

scheduleJob in interface JobScheduler

Parameters:

executionGraph - physical plan

Returns:

scheduling result

prepareResourceAndCreateWorker

protected void prepareResourceAndCreateWorker(ExecutionGraph executionGraph)

Allocate job workers' resource then create job workers' actor.

Parameters:

executionGraph - the physical plan

createWorkers

public boolean createWorkers(ExecutionGraph executionGraph)

Create JobWorker actors according to the physical plan.

Parameters:

executionGraph - physical plan

Returns:

actor creation result

initWorkers

protected boolean initWorkers(Map<ExecutionVertex,JobWorkerContext> vertexToContextMap)

Init JobWorkers according to the vertex and context infos.

Parameters:

vertexToContextMap - vertex - context map

startWorkers

public boolean startWorkers(ExecutionGraph executionGraph,
                            long checkpointId)

Start JobWorkers according to the physical plan.

buildWorkersContext

protected Map<ExecutionVertex,JobWorkerContext> buildWorkersContext(ExecutionGraph executionGraph)

Build workers context.

Parameters:

executionGraph - execution graph

Returns:

vertex to worker context map

destroyWorkers

public boolean destroyWorkers(List<ExecutionVertex> executionVertices)

Destroy JobWorkers according to the vertex infos.

Parameters:

executionVertices - specified vertices