Class ChatRequest

java.lang.Object
ai.vectros.resources.inference.requests.ChatRequest

public final class ChatRequest extends Object
  • Method Details

    • getMessages

      public List<ChatMessage> getMessages()
      Returns:
      The conversation history, in order. A message with role system is extracted and used as the system prompt; user and assistant messages are sent to the model as conversation turns.
    • getModel

      public Optional<String> getModel()
      Returns:
      Model alias to use, from the list returned by GET /v1/models. Defaults to claude-haiku-4-5.
    • getMaxTokens

      public Optional<Integer> getMaxTokens()
      Returns:
      Maximum number of tokens to generate. Defaults to 2048; the maximum is 8192.
    • getTemperature

      public Optional<Float> getTemperature()
      Returns:
      Sampling temperature, between 0.0 and 1.0. Higher values produce more varied output. Defaults to 0.7.
    • getTopP

      public Optional<Float> getTopP()
      Returns:
      Top-p (nucleus) sampling. Ignored when temperature is greater than 0.
    • getAllowGlobalRegion

      public Optional<Boolean> getAllowGlobalRegion()
      Returns:
      Opt this request into global (non-US) region serving for lower cost. Requires a signed global-processing waiver on your account that permits per-request override; otherwise the request is rejected with 403. When omitted, the request follows your account's default residency setting. Configure data residency under Data Residency and Region settings in the developer portal.
    • equals

      public boolean equals(Object other)
      Overrides:
      equals in class Object
    • getAdditionalProperties

      public Map<String,Object> getAdditionalProperties()
    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object
    • toString

      public String toString()
      Overrides:
      toString in class Object
    • builder

      public static ChatRequest.Builder builder()