Uses of Class
xyz.felh.openai.gpt3.tokenizer.ChatFormatDescriptor

Uses of ChatFormatDescriptor in xyz.felh.openai.gpt3.tokenizer

Methods in xyz.felh.openai.gpt3.tokenizer that return ChatFormatDescriptor

Modifier and Type	Method and Description
static ChatFormatDescriptor	ChatFormatDescriptor.forModel(java.lang.String modelName)

Methods in xyz.felh.openai.gpt3.tokenizer with parameters of type ChatFormatDescriptor

Modifier and Type	Method and Description
int	TokenCount.Calculator.countTokensFromMessages(java.util.List<ChatMessage> messages, GPT3Tokenizer tokenizer, ChatFormatDescriptor chatFormat)
int	TokenCount.StandardCalculator.countTokensFromMessages(java.util.List<ChatMessage> messages, GPT3Tokenizer tokenizer, ChatFormatDescriptor chatFormat)
static int	TokenCount.fromMessages(java.util.List<ChatMessage> messages, GPT3Tokenizer tokenizer, ChatFormatDescriptor chatFormat) Calculates the token count for a list of chat messages using the provided tokenizer and chat format descriptor.