Package ai.djl.serving.wlm.util

package ai.djl.serving.wlm.util

Contains utilities to support the WorkLoadManager.

Related Packages

Package	Description
ai.djl.serving.wlm	Contains the model server backend which manages worker threads and executes jobs on models.

Class	Description
WlmCapacityException	Thrown to throttle when a job is run but the job queue capacity is exceeded.
WlmConfigManager	This manages some configurations used by the WorkLoadManager.
WlmException	Thrown when an exception occurs inside the WorkLoadManager.
WlmOutOfMemoryException	Thrown when no enough memory to load the model.
WlmShutdownException	Thrown when a job is run but all workers are shutdown.
WorkerJob<I,O>	A Job containing metadata from the WorkLoadManager.