-
- All Implemented Interfaces:
-
ai.zerogpu.android.sdk.adapter.InferenceAdapter,java.lang.AutoCloseable
public final class GgufAdapter implements InferenceAdapter
GGUF adapter (kind
decoder_generation). One generate path serves every generative task type (text generation, summary, translation, chat, instruct, …); the task differs only by the prompt, which is data in the opaque input.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public classGgufAdapter.Companion
-
Field Summary
Fields Modifier and Type Field Description private final ModelConfigconfig
-
Constructor Summary
Constructors Constructor Description GgufAdapter(ModelConfig config, LlamaRuntime runtime)
-
Method Summary
Modifier and Type Method Description ModelConfiggetConfig()JsonObjectrun(JsonObject input)Run one job. SampleResultrunSample(JsonObject sample)Warm up / self-test using the recipe's sample. Unitclose()-
-
Constructor Detail
-
GgufAdapter
GgufAdapter(ModelConfig config, LlamaRuntime runtime)
-
-
Method Detail
-
getConfig
ModelConfig getConfig()
-
run
JsonObject run(JsonObject input)
Run one job. Input and output are opaque JSON the SDK core never inspects.
-
runSample
SampleResult runSample(JsonObject sample)
Warm up / self-test using the recipe's sample.
-
-
-
-