Package ai.djl.serving.wlm

Class WorkerPoolConfig.ThreadConfig<I,O>

java.lang.Object

ai.djl.serving.wlm.WorkerPoolConfig.ThreadConfig<I,O>

Type Parameters:

I - the input type

O - the output type

Direct Known Subclasses:

ModelInfo.ModelThread

Enclosing class:

WorkerPoolConfig<I,O>

public abstract static class WorkerPoolConfig.ThreadConfig<I,O>
extends Object

The part of the WorkerPoolConfig for an individual WorkerThread.

Field Summary

Fields

Modifier and Type	Field	Description
protected LinkedBlockingDeque<Job<I,O>>	configJobs

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	ThreadConfig(ai.djl.Device device)

Method Summary

Modifier and Type	Method	Description
abstract void	close()	Closes the thread type and frees any resources.
LinkedBlockingDeque<Job<I,O>>	getConfigJobs()	Gets the configuration jobs for the worker.
abstract void	run(List<Job<I,O>> inputs)	Runs the work on the WorkerThread and stores in the job.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

configJobs

protected LinkedBlockingDeque<Job<I,O>> configJobs

Constructor Details

ThreadConfig

protected ThreadConfig(ai.djl.Device device)

Method Details

run

public abstract void run(List<Job<I,O>> inputs)
                  throws ai.djl.translate.TranslateException

Runs the work on the WorkerThread and stores in the job.

Parameters:

inputs - the work input

Throws:

ai.djl.translate.TranslateException - if it failed to compute

getConfigJobs

public LinkedBlockingDeque<Job<I,O>> getConfigJobs()

Gets the configuration jobs for the worker.

Returns:

the configuration jobs for the worker

close

public abstract void close()

Closes the thread type and frees any resources.