Enum Class LlamaSplitMode

java.lang.Object
java.lang.Enum<LlamaSplitMode>
chat.octet.model.enums.LlamaSplitMode
All Implemented Interfaces:
Serializable, Comparable<LlamaSplitMode>, java.lang.constant.Constable

public enum LlamaSplitMode extends Enum<LlamaSplitMode>
Llama split mode define
Author:
William
  • Enum Constant Details

    • LLAMA_SPLIT_MODE_NONE

      public static final LlamaSplitMode LLAMA_SPLIT_MODE_NONE
      single GPU.
    • LLAMA_SPLIT_MODE_LAYER

      public static final LlamaSplitMode LLAMA_SPLIT_MODE_LAYER
      split layers and KV across GPUs.
    • LLAMA_SPLIT_MODE_ROW

      public static final LlamaSplitMode LLAMA_SPLIT_MODE_ROW
      split rows across GPUs.
  • Method Details

    • values

      public static LlamaSplitMode[] values()
      Returns an array containing the constants of this enum class, in the order they are declared.
      Returns:
      an array containing the constants of this enum class, in the order they are declared
    • valueOf

      public static LlamaSplitMode valueOf(String name)
      Returns the enum constant of this class with the specified name. The string must match exactly an identifier used to declare an enum constant in this class. (Extraneous whitespace characters are not permitted.)
      Parameters:
      name - the name of the enum constant to be returned.
      Returns:
      the enum constant with the specified name
      Throws:
      IllegalArgumentException - if this enum class has no constant with the specified name
      NullPointerException - if the argument is null
    • valueOfType

      public static LlamaSplitMode valueOfType(int type)
    • toString

      public String toString()
      Overrides:
      toString in class Enum<LlamaSplitMode>