All Classes and Interfaces
Class
Description
An adapter is a modification producing a variation of a model that can be used during prediction.
Class to generate an unique worker id.
A class manages model server events.
A class represents an inference job.
A function describing the action to take in a
Job.A utility class to auto configure LMI model properties.
A utility class to detect optimal engine for LMI model.
A class represent a loaded model and it's metadata.
An interface that represent a model server event listener.
Base implementation of the
ModelServerListener that does nothing.a batch aggregator that never terminates by itself.
An overload of
Adapter for the python engine.A utility class to detect optimal engine for SageMaker saved model.
a batch aggregator that terminates after a maximum idle time.
Thrown to throttle when a job is run but the job queue capacity is exceeded.
This manages some configurations used by the
WorkLoadManager.Thrown when an exception occurs inside the
WorkLoadManager.Thrown when no enough memory to load the model.
Thrown when a job is run but all workers are shutdown.
A
Job containing metadata from the WorkLoadManager.Manages the work load for a single model.
A
WorkerPoolConfig represents a task that could be run in the WorkLoadManager.An enum represents state of a worker type.
The part of the
WorkerPoolConfig for an individual WorkerThread.An enum represents state of a worker.
The
WorkerThread is the worker managed by the WorkLoadManager.A Builder to construct a
WorkerThread.WorkLoadManager is responsible to manage the work load of worker thread.