Package ai.djl.serving.wlm.util

Class WlmConfigManager

  • public final class WlmConfigManager
extends java.lang.Object
    This manages some configurations used by the WorkLoadManager.

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      int getDefaultWorkers​(ai.djl.ndarray.NDManager manager, java.lang.String deviceName, int target)
      Returns the default number of workers for a new registered model.
      static WlmConfigManager getInstance()
      Returns the singleton ConfigManager instance.
      boolean isDebug()
      Returns if debug is enabled.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • WlmConfigManager

        public WlmConfigManager()

    • Method Detail

      • getInstance

        public static WlmConfigManager getInstance()
        Returns the singleton ConfigManager instance.
        Returns:
        the singleton ConfigManager instance

      • isDebug

        public boolean isDebug()
        Returns if debug is enabled.
        Returns:
        true if debug is enabled

      • getDefaultWorkers

        public int getDefaultWorkers​(ai.djl.ndarray.NDManager manager,
                             java.lang.String deviceName,
                             int target)
        Returns the default number of workers for a new registered model.
        Parameters:
        manager - the NDManager the model uses
        deviceName - the device that model loaded on
        target - the target number of worker
        Returns:
        the default number of workers for a new registered model