Class ReinforcementTuningAutoraterScorer

java.lang.Object
com.google.genai.JsonSerializable
com.google.genai.types.ReinforcementTuningAutoraterScorer

public abstract class ReinforcementTuningAutoraterScorer extends JsonSerializable
Reinforcement tuning autorater scorer.
  • Constructor Details

    • ReinforcementTuningAutoraterScorer

      public ReinforcementTuningAutoraterScorer()
  • Method Details

    • autoraterConfig

      public abstract Optional<AutoraterConfig> autoraterConfig()
      Autorater config for evaluation.
    • autoraterPrompt

      public abstract Optional<String> autoraterPrompt()
      The prompt for an autorater to scorer the parsed sample response. This field supports the following placeholders that will be replaced before scoring: - {{prompt}} - {{response}} - {{system_instruction}} - {{references.key}}
    • autoraterResponseParseConfig

      public abstract Optional<ReinforcementTuningParseResponseConfig> autoraterResponseParseConfig()
      Parses autorater returned response for scoring. For example, if the autorater response has reward stored in the `2.0` block, defining a parsing response config using regex `".*(.*?)"` will return a score `"2.0"`.
    • parsedResponseConversionScorer

      public abstract Optional<ReinforcementTuningAutoraterScorerParsedResponseConversionScorer> parsedResponseConversionScorer()
      Scores autorater responses by directly converting parsed autorater response to a float reward. Note: Reward is clipped to be within `[-1, 1]`, i.e., `reward = max(min(reward, 1.0), -1.0)`.
    • exactMatchScorer

      public abstract Optional<ReinforcementTuningAutoraterScorerExactMatchScorer> exactMatchScorer()
      Scores autorater responses by using string match reward scorer.
    • builder

      Instantiates a builder for ReinforcementTuningAutoraterScorer.
    • toBuilder

      public abstract ReinforcementTuningAutoraterScorer.Builder toBuilder()
      Creates a builder with the same values as this instance.
    • fromJson

      public static ReinforcementTuningAutoraterScorer fromJson(String jsonString)
      Deserializes a JSON string to a ReinforcementTuningAutoraterScorer object.