Class ReinforcementTuningAutoraterScorerExactMatchScorer

java.lang.Object
com.google.genai.JsonSerializable
com.google.genai.types.ReinforcementTuningAutoraterScorerExactMatchScorer

public abstract class ReinforcementTuningAutoraterScorerExactMatchScorer extends JsonSerializable
Scores autorater responses by using exact string match reward scorer. This data type is not supported in Gemini API.
  • Constructor Details

    • ReinforcementTuningAutoraterScorerExactMatchScorer

      public ReinforcementTuningAutoraterScorerExactMatchScorer()
  • Method Details

    • correctAnswerReward

      public abstract Optional<Float> correctAnswerReward()
      Assigns this reward score if the parsed response string equals the expression.
    • wrongAnswerReward

      public abstract Optional<Float> wrongAnswerReward()
      Assigns this reward score if the parsed reward value does not equal the expression.
    • expression

      public abstract Optional<String> expression()
      The string expression to match against for scoring. This field supports placeholders in the format of {{references.key}} that will be replaced before matching. Regex is not supported for this expression. For example, users can define an ExactMatchScorer as follows: { "correctAnswerReward": 1.0, "wrongAnswerReward": -1.0, "expression": "{{references.concise_answer}}" } When evaluating the reward for each parsed autorater response, if the prompt references in the training/validation dataset has the following fields: ``` { "example": ..., "references": { "concise_ansser": "Yes", "verbose_answer": "The answer is Yes" } } ``` The above ExactMatchScorer will be replaced as follows for scoring: ``` { "correctAnswerReward": 1.0, "wrongAnswerReward": -1.0, "expression": "Yes" } ``` If the *parsed* autorater response is equal to the string `"Yes"`, then the reward is `1.0`, otherwise the reward is `-1.0`.
    • builder

      Instantiates a builder for ReinforcementTuningAutoraterScorerExactMatchScorer.
    • toBuilder

      Creates a builder with the same values as this instance.
    • fromJson

      public static ReinforcementTuningAutoraterScorerExactMatchScorer fromJson(String jsonString)
      Deserializes a JSON string to a ReinforcementTuningAutoraterScorerExactMatchScorer object.