Package ai.djl.serving.wlm

Class WorkerThread.Builder<I,O>

java.lang.Object
ai.djl.serving.wlm.WorkerThread.Builder<I,O>
Enclosing class:
WorkerThread<I,O>
public static final class WorkerThread.Builder<I,O> extends Object
A Builder to construct a WorkerThread.

  • Method Details

    • setDevice

      public WorkerThread.Builder<I,O> setDevice(ai.djl.Device device)
      RSets the device to run operations on.
      Parameters:
      device - the device to run operations on
      Returns:
      self-reference to this builder

    • setJobQueue

      public WorkerThread.Builder<I,O> setJobQueue(LinkedBlockingDeque<WorkerJob<I,O>> jobQueue)
      Sets the jobQueue used to poll for new jobs.
      Parameters:
      jobQueue - the jobQueue to set
      Returns:
      self-reference to this builder.

    • optFixPoolThread

      public WorkerThread.Builder<I,O> optFixPoolThread(boolean fixPoolThread)
      Sets if the workerThread should be part of the fixed pool. Fixed Pool workers don't terminate themself but are managed by WorkLoadManager min/max-worker scale functionality.
      Parameters:
      fixPoolThread - the fixPoolThread to set
      Returns:
      self-reference to this builder.

    • build

      public WorkerThread<I,O> build()
      Builds the WorkerThread with the provided data.
      Returns:
      an WorkerThread