xyz.felh.openai.jtokkit

Class Encodings

java.lang.Object

xyz.felh.openai.jtokkit.Encodings

public final class Encodings
extends java.lang.Object

Method Summary

Modifier and Type	Method and Description
static EncodingRegistry	newDefaultEncodingRegistry() Creates a new EncodingRegistry with the default encodings found in the EncodingType enum.
static EncodingRegistry	newLazyEncodingRegistry() Creates a new EncodingRegistry without any EncodingType registered.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

newDefaultEncodingRegistry

public static EncodingRegistry newDefaultEncodingRegistry()

Creates a new EncodingRegistry with the default encodings found in the EncodingType enum.

Returns:

the new EncodingRegistry

newLazyEncodingRegistry

public static EncodingRegistry newLazyEncodingRegistry()

Creates a new EncodingRegistry without any EncodingType registered. Encodings will be loaded on-demand when they are first requested. For example, if you call EncodingRegistry.getEncoding(EncodingType) with EncodingType.CL100K_BASE for the first time, it will be loaded from the classpath. Subsequent calls with EncodingType.CL100K_BASE will re-use the already loaded encoded.

Returns:

the new EncodingRegistry