| Package | Description |
|---|---|
| xyz.felh.openai.jtokkit.api |
| Modifier and Type | Method and Description |
|---|---|
EncodingResult |
Encoding.encode(java.lang.String text,
int maxTokens)
Encodes the given text into a list of token ids.
|
EncodingResult |
Encoding.encodeOrdinary(java.lang.String text,
int maxTokens)
Encodes the given text into a list of token ids, ignoring special tokens.
|
Copyright © 2023. All Rights Reserved.