Package ai.djl.serving.wlm

Class ModelInfo.ModelThread

java.lang.Object

ai.djl.serving.wlm.WorkerPoolConfig.ThreadConfig<I,O>

ai.djl.serving.wlm.ModelInfo.ModelThread

Enclosing class:

ModelInfo<I,O>

protected class ModelInfo.ModelThread
extends WorkerPoolConfig.ThreadConfig<I,O>

Field Summary

Fields inherited from class ai.djl.serving.wlm.WorkerPoolConfig.ThreadConfig

configJobs

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	ModelThread(ai.djl.Device device)

Method Summary

Modifier and Type	Method	Description
void	close()	Closes the thread type and frees any resources.
ai.djl.inference.Predictor<I,O>	getPredictor()	Returns the predictor.
void	run(List<Job<I,O>> jobs)	Runs the work on the WorkerThread and stores in the job.

Methods inherited from class ai.djl.serving.wlm.WorkerPoolConfig.ThreadConfig

getConfigJobs

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ModelThread

protected ModelThread(ai.djl.Device device)

Method Details

run

public void run(List<Job<I,O>> jobs)
         throws ai.djl.translate.TranslateException

Description copied from class: WorkerPoolConfig.ThreadConfig

Runs the work on the WorkerThread and stores in the job.

Specified by:

run in class WorkerPoolConfig.ThreadConfig<I,O>

Parameters:

jobs - the work input

Throws:

ai.djl.translate.TranslateException - if it failed to compute

getPredictor

public ai.djl.inference.Predictor<I,O> getPredictor()

Returns the predictor.

Returns:

the predictor

close

public void close()

Closes the thread type and frees any resources.

Specified by:

close in class WorkerPoolConfig.ThreadConfig<I,O>