ai.djl.serving.wlm

Class WorkerThread

java.lang.Object

ai.djl.serving.wlm.WorkerThread

All Implemented Interfaces:

java.lang.Runnable

public final class WorkerThread
extends java.lang.Object
implements java.lang.Runnable

The WorkerThread is the worker managed by the WorkLoadManager.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WorkerThread.Builder A Builder to construct a WorkerThread.

Method Summary

Modifier and Type	Method and Description
static WorkerThread.Builder	builder() Creates a builder to build a WorkerThread.
int	getGpuId() Returns the gpu id used by the thread.
long	getStartTime() Returns the thread start time.
WorkerState	getState() Returns the worker state.
int	getWorkerId() Returns the worker thread ID.
boolean	isFixPoolThread() check if this worker is instantiate is one of the fix threads of a pool.
boolean	isRunning() Returns true if the worker thread is running.
void	run()
void	shutdown(WorkerState state) Shuts down the worker thread.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

run

public void run()

Specified by:

run in interface java.lang.Runnable

getWorkerId

public int getWorkerId()

Returns the worker thread ID.

Returns:

the worker thread ID

isRunning

public boolean isRunning()

Returns true if the worker thread is running.

Returns:

true if the worker thread is running

getGpuId

public int getGpuId()

Returns the gpu id used by the thread.

Returns:

the gpu id used by the thread

getStartTime

public long getStartTime()

Returns the thread start time.

Returns:

the thread start time

getState

public WorkerState getState()

Returns the worker state.

Returns:

the worker state

shutdown

public void shutdown(WorkerState state)

Shuts down the worker thread.

Parameters:

state - the state to set the thread to

isFixPoolThread

public boolean isFixPoolThread()

check if this worker is instantiate is one of the fix threads of a pool. fix threads are not automatically scales down, so they are candidate for down scaling when minWorker/maxWorker size of a model changes.

Returns:

the fixPoolThread

builder

public static WorkerThread.Builder builder()

Creates a builder to build a WorkerThread.

Returns:

a new builder