ai.djl.serving.wlm.util

Class WlmConfigManager

java.lang.Object

ai.djl.serving.wlm.util.WlmConfigManager

public final class WlmConfigManager
extends java.lang.Object

This manages some configurations used by the WorkLoadManager.

Constructor Summary

Constructors

Constructor and Description
WlmConfigManager()

Method Summary

Modifier and Type	Method and Description
int	getDefaultWorkers(ai.djl.ndarray.NDManager manager, java.lang.String deviceName, int target) Returns the default number of workers for a new registered model.
static WlmConfigManager	getInstance() Returns the singleton ConfigManager instance.
boolean	isDebug() Returns if debug is enabled.
WlmConfigManager	setDebug(boolean debug) Sets debug mode.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WlmConfigManager

public WlmConfigManager()

Method Detail

getInstance

public static WlmConfigManager getInstance()

Returns the singleton ConfigManager instance.

Returns:

the singleton ConfigManager instance

isDebug

public boolean isDebug()

Returns if debug is enabled.

Returns:

true if debug is enabled

setDebug

public WlmConfigManager setDebug(boolean debug)

Sets debug mode.

Parameters:

debug - true to enable debug mode and false to disable

Returns:

this config manager

getDefaultWorkers

public int getDefaultWorkers(ai.djl.ndarray.NDManager manager,
                             java.lang.String deviceName,
                             int target)

Returns the default number of workers for a new registered model.

Parameters:

manager - the NDManager the model uses

deviceName - the device that model loaded on

target - the target number of worker

Returns:

the default number of workers for a new registered model