io.ray.streaming.runtime.master.resourcemanager.strategy.impl

Class PipelineFirstStrategy

java.lang.Object

io.ray.streaming.runtime.master.resourcemanager.strategy.impl.PipelineFirstStrategy

All Implemented Interfaces:

ResourceAssignStrategy

public class PipelineFirstStrategy
extends Object
implements ResourceAssignStrategy

Based on Ray dynamic resource function, resource details(by ray gcs get) and execution logic diagram, PipelineFirstStrategy provides a actor scheduling strategies to make the cluster load balanced and controllable scheduling. Assume that we have 2 containers and have a DAG graph composed of a source node with parallelism of 2 and a sink node with parallelism of 2, the structure will be like:

   container_0
             |- source_1
             |- sink_1
   container_1
             |- source_2
             |- sink_2
 

Field Summary

Fields

Modifier and Type	Field and Description
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
PipelineFirstStrategy()

Method Summary

Modifier and Type	Method and Description
ResourceAssignmentView	assignResource(List<Container> containers, ExecutionGraph executionGraph) Assign resource to each execution vertex in the given execution graph.
String	getName() Get container assign strategy name

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

PipelineFirstStrategy

public PipelineFirstStrategy()

Method Detail

assignResource

public ResourceAssignmentView assignResource(List<Container> containers,
                                             ExecutionGraph executionGraph)

Assign resource to each execution vertex in the given execution graph.

Specified by:

assignResource in interface ResourceAssignStrategy

Parameters:

containers - registered containers

executionGraph - execution graph

Returns:

allocating map, key is container ID, value is list of vertextId, and contains vertices

getName

public String getName()

Description copied from interface: ResourceAssignStrategy

Get container assign strategy name

Specified by:

getName in interface ResourceAssignStrategy