Interface EvaluateInstancesRequestOrBuilder
- All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder
- All Known Implementing Classes:
EvaluateInstancesRequest,EvaluateInstancesRequest.Builder
@Generated
public interface EvaluateInstancesRequestOrBuilder
extends com.google.protobuf.MessageOrBuilder
-
Method Summary
Modifier and TypeMethodDescriptionOptional.Optional.Instances and metric spec for bleu metric.Instances and metric spec for bleu metric.Input for coherence metric.Input for coherence metric.Translation metrics.Translation metrics.Auto metric instances.Auto metric instances.LLM-based metric instance.LLM-based metric instance.Input for fulfillment metric.Input for fulfillment metric.Input for groundedness metric.Input for groundedness metric.The instance to be evaluated.The instance to be evaluated.Required.com.google.protobuf.ByteStringRequired.getMetrics(int index) The metrics used for evaluation.intThe metrics used for evaluation.The metrics used for evaluation.getMetricsOrBuilder(int index) The metrics used for evaluation.List<? extends MetricOrBuilder>The metrics used for evaluation.getMetricSources(int index) Optional.intOptional.Optional.getMetricSourcesOrBuilder(int index) Optional.List<? extends MetricSourceOrBuilder>Optional.Input for Metricx metric.Input for Metricx metric.Input for pairwise metric.Input for pairwise metric.Input for pairwise question answering quality metric.Input for pairwise question answering quality metric.Input for pairwise summarization quality metric.Input for pairwise summarization quality metric.Input for pointwise metric.Input for pointwise metric.Input for question answering correctness metric.Input for question answering correctness metric.Input for question answering helpfulness metric.Input for question answering helpfulness metric.Input for question answering quality metric.Input for question answering quality metric.Input for question answering relevance metric.Input for question answering relevance metric.Instances and metric spec for rouge metric.Instances and metric spec for rouge metric.Rubric Based Instruction Following metric.Rubric Based Instruction Following metric.Input for safety metric.Input for safety metric.Input for summarization helpfulness metric.Input for summarization helpfulness metric.Input for summarization quality metric.Input for summarization quality metric.Input for summarization verbosity metric.Input for summarization verbosity metric.Tool call metric instances.Tool call metric instances.Input for tool name match metric.Input for tool name match metric.Input for tool parameter key match metric.Input for tool parameter key match metric.Input for tool parameter key value match metric.Input for tool parameter key value match metric.Input for trajectory match any order metric.Input for trajectory match any order metric.Input for trajectory exact match metric.Input for trajectory exact match metric.Input for trajectory in order match metric.Input for trajectory in order match metric.Input for trajectory precision metric.Input for trajectory precision metric.Input for trajectory recall metric.Input for trajectory recall metric.Input for trajectory single tool use metric.Input for trajectory single tool use metric.booleanOptional.booleanInstances and metric spec for bleu metric.booleanInput for coherence metric.booleanTranslation metrics.booleanAuto metric instances.booleanLLM-based metric instance.booleanInput for fulfillment metric.booleanInput for groundedness metric.booleanThe instance to be evaluated.booleanInput for Metricx metric.booleanInput for pairwise metric.booleanInput for pairwise question answering quality metric.booleanInput for pairwise summarization quality metric.booleanInput for pointwise metric.booleanInput for question answering correctness metric.booleanInput for question answering helpfulness metric.booleanInput for question answering quality metric.booleanInput for question answering relevance metric.booleanInstances and metric spec for rouge metric.booleanRubric Based Instruction Following metric.booleanInput for safety metric.booleanInput for summarization helpfulness metric.booleanInput for summarization quality metric.booleanInput for summarization verbosity metric.booleanTool call metric instances.booleanInput for tool name match metric.booleanInput for tool parameter key match metric.booleanInput for tool parameter key value match metric.booleanInput for trajectory match any order metric.booleanInput for trajectory exact match metric.booleanInput for trajectory in order match metric.booleanInput for trajectory precision metric.booleanInput for trajectory recall metric.booleanInput for trajectory single tool use metric.Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder
isInitializedMethods inherited from interface com.google.protobuf.MessageOrBuilder
findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
-
Method Details
-
hasExactMatchInput
boolean hasExactMatchInput()Auto metric instances. Instances and metric spec for exact match metric.
.google.cloud.aiplatform.v1beta1.ExactMatchInput exact_match_input = 2;- Returns:
- Whether the exactMatchInput field is set.
-
getExactMatchInput
ExactMatchInput getExactMatchInput()Auto metric instances. Instances and metric spec for exact match metric.
.google.cloud.aiplatform.v1beta1.ExactMatchInput exact_match_input = 2;- Returns:
- The exactMatchInput.
-
getExactMatchInputOrBuilder
ExactMatchInputOrBuilder getExactMatchInputOrBuilder()Auto metric instances. Instances and metric spec for exact match metric.
.google.cloud.aiplatform.v1beta1.ExactMatchInput exact_match_input = 2; -
hasBleuInput
boolean hasBleuInput()Instances and metric spec for bleu metric.
.google.cloud.aiplatform.v1beta1.BleuInput bleu_input = 3;- Returns:
- Whether the bleuInput field is set.
-
getBleuInput
BleuInput getBleuInput()Instances and metric spec for bleu metric.
.google.cloud.aiplatform.v1beta1.BleuInput bleu_input = 3;- Returns:
- The bleuInput.
-
getBleuInputOrBuilder
BleuInputOrBuilder getBleuInputOrBuilder()Instances and metric spec for bleu metric.
.google.cloud.aiplatform.v1beta1.BleuInput bleu_input = 3; -
hasRougeInput
boolean hasRougeInput()Instances and metric spec for rouge metric.
.google.cloud.aiplatform.v1beta1.RougeInput rouge_input = 4;- Returns:
- Whether the rougeInput field is set.
-
getRougeInput
RougeInput getRougeInput()Instances and metric spec for rouge metric.
.google.cloud.aiplatform.v1beta1.RougeInput rouge_input = 4;- Returns:
- The rougeInput.
-
getRougeInputOrBuilder
RougeInputOrBuilder getRougeInputOrBuilder()Instances and metric spec for rouge metric.
.google.cloud.aiplatform.v1beta1.RougeInput rouge_input = 4; -
hasFluencyInput
boolean hasFluencyInput()LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
.google.cloud.aiplatform.v1beta1.FluencyInput fluency_input = 5;- Returns:
- Whether the fluencyInput field is set.
-
getFluencyInput
FluencyInput getFluencyInput()LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
.google.cloud.aiplatform.v1beta1.FluencyInput fluency_input = 5;- Returns:
- The fluencyInput.
-
getFluencyInputOrBuilder
FluencyInputOrBuilder getFluencyInputOrBuilder()LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
.google.cloud.aiplatform.v1beta1.FluencyInput fluency_input = 5; -
hasCoherenceInput
boolean hasCoherenceInput()Input for coherence metric.
.google.cloud.aiplatform.v1beta1.CoherenceInput coherence_input = 6;- Returns:
- Whether the coherenceInput field is set.
-
getCoherenceInput
CoherenceInput getCoherenceInput()Input for coherence metric.
.google.cloud.aiplatform.v1beta1.CoherenceInput coherence_input = 6;- Returns:
- The coherenceInput.
-
getCoherenceInputOrBuilder
CoherenceInputOrBuilder getCoherenceInputOrBuilder()Input for coherence metric.
.google.cloud.aiplatform.v1beta1.CoherenceInput coherence_input = 6; -
hasSafetyInput
boolean hasSafetyInput()Input for safety metric.
.google.cloud.aiplatform.v1beta1.SafetyInput safety_input = 8;- Returns:
- Whether the safetyInput field is set.
-
getSafetyInput
SafetyInput getSafetyInput()Input for safety metric.
.google.cloud.aiplatform.v1beta1.SafetyInput safety_input = 8;- Returns:
- The safetyInput.
-
getSafetyInputOrBuilder
SafetyInputOrBuilder getSafetyInputOrBuilder()Input for safety metric.
.google.cloud.aiplatform.v1beta1.SafetyInput safety_input = 8; -
hasGroundednessInput
boolean hasGroundednessInput()Input for groundedness metric.
.google.cloud.aiplatform.v1beta1.GroundednessInput groundedness_input = 9;- Returns:
- Whether the groundednessInput field is set.
-
getGroundednessInput
GroundednessInput getGroundednessInput()Input for groundedness metric.
.google.cloud.aiplatform.v1beta1.GroundednessInput groundedness_input = 9;- Returns:
- The groundednessInput.
-
getGroundednessInputOrBuilder
GroundednessInputOrBuilder getGroundednessInputOrBuilder()Input for groundedness metric.
.google.cloud.aiplatform.v1beta1.GroundednessInput groundedness_input = 9; -
hasFulfillmentInput
boolean hasFulfillmentInput()Input for fulfillment metric.
.google.cloud.aiplatform.v1beta1.FulfillmentInput fulfillment_input = 12;- Returns:
- Whether the fulfillmentInput field is set.
-
getFulfillmentInput
FulfillmentInput getFulfillmentInput()Input for fulfillment metric.
.google.cloud.aiplatform.v1beta1.FulfillmentInput fulfillment_input = 12;- Returns:
- The fulfillmentInput.
-
getFulfillmentInputOrBuilder
FulfillmentInputOrBuilder getFulfillmentInputOrBuilder()Input for fulfillment metric.
.google.cloud.aiplatform.v1beta1.FulfillmentInput fulfillment_input = 12; -
hasSummarizationQualityInput
boolean hasSummarizationQualityInput()Input for summarization quality metric.
.google.cloud.aiplatform.v1beta1.SummarizationQualityInput summarization_quality_input = 7;- Returns:
- Whether the summarizationQualityInput field is set.
-
getSummarizationQualityInput
SummarizationQualityInput getSummarizationQualityInput()Input for summarization quality metric.
.google.cloud.aiplatform.v1beta1.SummarizationQualityInput summarization_quality_input = 7;- Returns:
- The summarizationQualityInput.
-
getSummarizationQualityInputOrBuilder
SummarizationQualityInputOrBuilder getSummarizationQualityInputOrBuilder()Input for summarization quality metric.
.google.cloud.aiplatform.v1beta1.SummarizationQualityInput summarization_quality_input = 7; -
hasPairwiseSummarizationQualityInput
boolean hasPairwiseSummarizationQualityInput()Input for pairwise summarization quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseSummarizationQualityInput pairwise_summarization_quality_input = 23;- Returns:
- Whether the pairwiseSummarizationQualityInput field is set.
-
getPairwiseSummarizationQualityInput
PairwiseSummarizationQualityInput getPairwiseSummarizationQualityInput()Input for pairwise summarization quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseSummarizationQualityInput pairwise_summarization_quality_input = 23;- Returns:
- The pairwiseSummarizationQualityInput.
-
getPairwiseSummarizationQualityInputOrBuilder
PairwiseSummarizationQualityInputOrBuilder getPairwiseSummarizationQualityInputOrBuilder()Input for pairwise summarization quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseSummarizationQualityInput pairwise_summarization_quality_input = 23; -
hasSummarizationHelpfulnessInput
boolean hasSummarizationHelpfulnessInput()Input for summarization helpfulness metric.
.google.cloud.aiplatform.v1beta1.SummarizationHelpfulnessInput summarization_helpfulness_input = 14;- Returns:
- Whether the summarizationHelpfulnessInput field is set.
-
getSummarizationHelpfulnessInput
SummarizationHelpfulnessInput getSummarizationHelpfulnessInput()Input for summarization helpfulness metric.
.google.cloud.aiplatform.v1beta1.SummarizationHelpfulnessInput summarization_helpfulness_input = 14;- Returns:
- The summarizationHelpfulnessInput.
-
getSummarizationHelpfulnessInputOrBuilder
SummarizationHelpfulnessInputOrBuilder getSummarizationHelpfulnessInputOrBuilder()Input for summarization helpfulness metric.
.google.cloud.aiplatform.v1beta1.SummarizationHelpfulnessInput summarization_helpfulness_input = 14; -
hasSummarizationVerbosityInput
boolean hasSummarizationVerbosityInput()Input for summarization verbosity metric.
.google.cloud.aiplatform.v1beta1.SummarizationVerbosityInput summarization_verbosity_input = 15;- Returns:
- Whether the summarizationVerbosityInput field is set.
-
getSummarizationVerbosityInput
SummarizationVerbosityInput getSummarizationVerbosityInput()Input for summarization verbosity metric.
.google.cloud.aiplatform.v1beta1.SummarizationVerbosityInput summarization_verbosity_input = 15;- Returns:
- The summarizationVerbosityInput.
-
getSummarizationVerbosityInputOrBuilder
SummarizationVerbosityInputOrBuilder getSummarizationVerbosityInputOrBuilder()Input for summarization verbosity metric.
.google.cloud.aiplatform.v1beta1.SummarizationVerbosityInput summarization_verbosity_input = 15; -
hasQuestionAnsweringQualityInput
boolean hasQuestionAnsweringQualityInput()Input for question answering quality metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringQualityInput question_answering_quality_input = 10;- Returns:
- Whether the questionAnsweringQualityInput field is set.
-
getQuestionAnsweringQualityInput
QuestionAnsweringQualityInput getQuestionAnsweringQualityInput()Input for question answering quality metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringQualityInput question_answering_quality_input = 10;- Returns:
- The questionAnsweringQualityInput.
-
getQuestionAnsweringQualityInputOrBuilder
QuestionAnsweringQualityInputOrBuilder getQuestionAnsweringQualityInputOrBuilder()Input for question answering quality metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringQualityInput question_answering_quality_input = 10; -
hasPairwiseQuestionAnsweringQualityInput
boolean hasPairwiseQuestionAnsweringQualityInput()Input for pairwise question answering quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseQuestionAnsweringQualityInput pairwise_question_answering_quality_input = 24;- Returns:
- Whether the pairwiseQuestionAnsweringQualityInput field is set.
-
getPairwiseQuestionAnsweringQualityInput
PairwiseQuestionAnsweringQualityInput getPairwiseQuestionAnsweringQualityInput()Input for pairwise question answering quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseQuestionAnsweringQualityInput pairwise_question_answering_quality_input = 24;- Returns:
- The pairwiseQuestionAnsweringQualityInput.
-
getPairwiseQuestionAnsweringQualityInputOrBuilder
PairwiseQuestionAnsweringQualityInputOrBuilder getPairwiseQuestionAnsweringQualityInputOrBuilder()Input for pairwise question answering quality metric.
.google.cloud.aiplatform.v1beta1.PairwiseQuestionAnsweringQualityInput pairwise_question_answering_quality_input = 24; -
hasQuestionAnsweringRelevanceInput
boolean hasQuestionAnsweringRelevanceInput()Input for question answering relevance metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringRelevanceInput question_answering_relevance_input = 16;- Returns:
- Whether the questionAnsweringRelevanceInput field is set.
-
getQuestionAnsweringRelevanceInput
QuestionAnsweringRelevanceInput getQuestionAnsweringRelevanceInput()Input for question answering relevance metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringRelevanceInput question_answering_relevance_input = 16;- Returns:
- The questionAnsweringRelevanceInput.
-
getQuestionAnsweringRelevanceInputOrBuilder
QuestionAnsweringRelevanceInputOrBuilder getQuestionAnsweringRelevanceInputOrBuilder()Input for question answering relevance metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringRelevanceInput question_answering_relevance_input = 16; -
hasQuestionAnsweringHelpfulnessInput
boolean hasQuestionAnsweringHelpfulnessInput()Input for question answering helpfulness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringHelpfulnessInput question_answering_helpfulness_input = 17;- Returns:
- Whether the questionAnsweringHelpfulnessInput field is set.
-
getQuestionAnsweringHelpfulnessInput
QuestionAnsweringHelpfulnessInput getQuestionAnsweringHelpfulnessInput()Input for question answering helpfulness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringHelpfulnessInput question_answering_helpfulness_input = 17;- Returns:
- The questionAnsweringHelpfulnessInput.
-
getQuestionAnsweringHelpfulnessInputOrBuilder
QuestionAnsweringHelpfulnessInputOrBuilder getQuestionAnsweringHelpfulnessInputOrBuilder()Input for question answering helpfulness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringHelpfulnessInput question_answering_helpfulness_input = 17; -
hasQuestionAnsweringCorrectnessInput
boolean hasQuestionAnsweringCorrectnessInput()Input for question answering correctness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringCorrectnessInput question_answering_correctness_input = 18;- Returns:
- Whether the questionAnsweringCorrectnessInput field is set.
-
getQuestionAnsweringCorrectnessInput
QuestionAnsweringCorrectnessInput getQuestionAnsweringCorrectnessInput()Input for question answering correctness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringCorrectnessInput question_answering_correctness_input = 18;- Returns:
- The questionAnsweringCorrectnessInput.
-
getQuestionAnsweringCorrectnessInputOrBuilder
QuestionAnsweringCorrectnessInputOrBuilder getQuestionAnsweringCorrectnessInputOrBuilder()Input for question answering correctness metric.
.google.cloud.aiplatform.v1beta1.QuestionAnsweringCorrectnessInput question_answering_correctness_input = 18; -
hasPointwiseMetricInput
boolean hasPointwiseMetricInput()Input for pointwise metric.
.google.cloud.aiplatform.v1beta1.PointwiseMetricInput pointwise_metric_input = 28;- Returns:
- Whether the pointwiseMetricInput field is set.
-
getPointwiseMetricInput
PointwiseMetricInput getPointwiseMetricInput()Input for pointwise metric.
.google.cloud.aiplatform.v1beta1.PointwiseMetricInput pointwise_metric_input = 28;- Returns:
- The pointwiseMetricInput.
-
getPointwiseMetricInputOrBuilder
PointwiseMetricInputOrBuilder getPointwiseMetricInputOrBuilder()Input for pointwise metric.
.google.cloud.aiplatform.v1beta1.PointwiseMetricInput pointwise_metric_input = 28; -
hasPairwiseMetricInput
boolean hasPairwiseMetricInput()Input for pairwise metric.
.google.cloud.aiplatform.v1beta1.PairwiseMetricInput pairwise_metric_input = 29;- Returns:
- Whether the pairwiseMetricInput field is set.
-
getPairwiseMetricInput
PairwiseMetricInput getPairwiseMetricInput()Input for pairwise metric.
.google.cloud.aiplatform.v1beta1.PairwiseMetricInput pairwise_metric_input = 29;- Returns:
- The pairwiseMetricInput.
-
getPairwiseMetricInputOrBuilder
PairwiseMetricInputOrBuilder getPairwiseMetricInputOrBuilder()Input for pairwise metric.
.google.cloud.aiplatform.v1beta1.PairwiseMetricInput pairwise_metric_input = 29; -
hasToolCallValidInput
boolean hasToolCallValidInput()Tool call metric instances. Input for tool call valid metric.
.google.cloud.aiplatform.v1beta1.ToolCallValidInput tool_call_valid_input = 19;- Returns:
- Whether the toolCallValidInput field is set.
-
getToolCallValidInput
ToolCallValidInput getToolCallValidInput()Tool call metric instances. Input for tool call valid metric.
.google.cloud.aiplatform.v1beta1.ToolCallValidInput tool_call_valid_input = 19;- Returns:
- The toolCallValidInput.
-
getToolCallValidInputOrBuilder
ToolCallValidInputOrBuilder getToolCallValidInputOrBuilder()Tool call metric instances. Input for tool call valid metric.
.google.cloud.aiplatform.v1beta1.ToolCallValidInput tool_call_valid_input = 19; -
hasToolNameMatchInput
boolean hasToolNameMatchInput()Input for tool name match metric.
.google.cloud.aiplatform.v1beta1.ToolNameMatchInput tool_name_match_input = 20;- Returns:
- Whether the toolNameMatchInput field is set.
-
getToolNameMatchInput
ToolNameMatchInput getToolNameMatchInput()Input for tool name match metric.
.google.cloud.aiplatform.v1beta1.ToolNameMatchInput tool_name_match_input = 20;- Returns:
- The toolNameMatchInput.
-
getToolNameMatchInputOrBuilder
ToolNameMatchInputOrBuilder getToolNameMatchInputOrBuilder()Input for tool name match metric.
.google.cloud.aiplatform.v1beta1.ToolNameMatchInput tool_name_match_input = 20; -
hasToolParameterKeyMatchInput
boolean hasToolParameterKeyMatchInput()Input for tool parameter key match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKeyMatchInput tool_parameter_key_match_input = 21;- Returns:
- Whether the toolParameterKeyMatchInput field is set.
-
getToolParameterKeyMatchInput
ToolParameterKeyMatchInput getToolParameterKeyMatchInput()Input for tool parameter key match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKeyMatchInput tool_parameter_key_match_input = 21;- Returns:
- The toolParameterKeyMatchInput.
-
getToolParameterKeyMatchInputOrBuilder
ToolParameterKeyMatchInputOrBuilder getToolParameterKeyMatchInputOrBuilder()Input for tool parameter key match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKeyMatchInput tool_parameter_key_match_input = 21; -
hasToolParameterKvMatchInput
boolean hasToolParameterKvMatchInput()Input for tool parameter key value match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKVMatchInput tool_parameter_kv_match_input = 22;- Returns:
- Whether the toolParameterKvMatchInput field is set.
-
getToolParameterKvMatchInput
ToolParameterKVMatchInput getToolParameterKvMatchInput()Input for tool parameter key value match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKVMatchInput tool_parameter_kv_match_input = 22;- Returns:
- The toolParameterKvMatchInput.
-
getToolParameterKvMatchInputOrBuilder
ToolParameterKVMatchInputOrBuilder getToolParameterKvMatchInputOrBuilder()Input for tool parameter key value match metric.
.google.cloud.aiplatform.v1beta1.ToolParameterKVMatchInput tool_parameter_kv_match_input = 22; -
hasCometInput
boolean hasCometInput()Translation metrics. Input for Comet metric.
.google.cloud.aiplatform.v1beta1.CometInput comet_input = 31;- Returns:
- Whether the cometInput field is set.
-
getCometInput
CometInput getCometInput()Translation metrics. Input for Comet metric.
.google.cloud.aiplatform.v1beta1.CometInput comet_input = 31;- Returns:
- The cometInput.
-
getCometInputOrBuilder
CometInputOrBuilder getCometInputOrBuilder()Translation metrics. Input for Comet metric.
.google.cloud.aiplatform.v1beta1.CometInput comet_input = 31; -
hasMetricxInput
boolean hasMetricxInput()Input for Metricx metric.
.google.cloud.aiplatform.v1beta1.MetricxInput metricx_input = 32;- Returns:
- Whether the metricxInput field is set.
-
getMetricxInput
MetricxInput getMetricxInput()Input for Metricx metric.
.google.cloud.aiplatform.v1beta1.MetricxInput metricx_input = 32;- Returns:
- The metricxInput.
-
getMetricxInputOrBuilder
MetricxInputOrBuilder getMetricxInputOrBuilder()Input for Metricx metric.
.google.cloud.aiplatform.v1beta1.MetricxInput metricx_input = 32; -
hasTrajectoryExactMatchInput
boolean hasTrajectoryExactMatchInput()Input for trajectory exact match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryExactMatchInput trajectory_exact_match_input = 33;- Returns:
- Whether the trajectoryExactMatchInput field is set.
-
getTrajectoryExactMatchInput
TrajectoryExactMatchInput getTrajectoryExactMatchInput()Input for trajectory exact match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryExactMatchInput trajectory_exact_match_input = 33;- Returns:
- The trajectoryExactMatchInput.
-
getTrajectoryExactMatchInputOrBuilder
TrajectoryExactMatchInputOrBuilder getTrajectoryExactMatchInputOrBuilder()Input for trajectory exact match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryExactMatchInput trajectory_exact_match_input = 33; -
hasTrajectoryInOrderMatchInput
boolean hasTrajectoryInOrderMatchInput()Input for trajectory in order match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryInOrderMatchInput trajectory_in_order_match_input = 34;- Returns:
- Whether the trajectoryInOrderMatchInput field is set.
-
getTrajectoryInOrderMatchInput
TrajectoryInOrderMatchInput getTrajectoryInOrderMatchInput()Input for trajectory in order match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryInOrderMatchInput trajectory_in_order_match_input = 34;- Returns:
- The trajectoryInOrderMatchInput.
-
getTrajectoryInOrderMatchInputOrBuilder
TrajectoryInOrderMatchInputOrBuilder getTrajectoryInOrderMatchInputOrBuilder()Input for trajectory in order match metric.
.google.cloud.aiplatform.v1beta1.TrajectoryInOrderMatchInput trajectory_in_order_match_input = 34; -
hasTrajectoryAnyOrderMatchInput
boolean hasTrajectoryAnyOrderMatchInput()Input for trajectory match any order metric.
.google.cloud.aiplatform.v1beta1.TrajectoryAnyOrderMatchInput trajectory_any_order_match_input = 35;- Returns:
- Whether the trajectoryAnyOrderMatchInput field is set.
-
getTrajectoryAnyOrderMatchInput
TrajectoryAnyOrderMatchInput getTrajectoryAnyOrderMatchInput()Input for trajectory match any order metric.
.google.cloud.aiplatform.v1beta1.TrajectoryAnyOrderMatchInput trajectory_any_order_match_input = 35;- Returns:
- The trajectoryAnyOrderMatchInput.
-
getTrajectoryAnyOrderMatchInputOrBuilder
TrajectoryAnyOrderMatchInputOrBuilder getTrajectoryAnyOrderMatchInputOrBuilder()Input for trajectory match any order metric.
.google.cloud.aiplatform.v1beta1.TrajectoryAnyOrderMatchInput trajectory_any_order_match_input = 35; -
hasTrajectoryPrecisionInput
boolean hasTrajectoryPrecisionInput()Input for trajectory precision metric.
.google.cloud.aiplatform.v1beta1.TrajectoryPrecisionInput trajectory_precision_input = 37;- Returns:
- Whether the trajectoryPrecisionInput field is set.
-
getTrajectoryPrecisionInput
TrajectoryPrecisionInput getTrajectoryPrecisionInput()Input for trajectory precision metric.
.google.cloud.aiplatform.v1beta1.TrajectoryPrecisionInput trajectory_precision_input = 37;- Returns:
- The trajectoryPrecisionInput.
-
getTrajectoryPrecisionInputOrBuilder
TrajectoryPrecisionInputOrBuilder getTrajectoryPrecisionInputOrBuilder()Input for trajectory precision metric.
.google.cloud.aiplatform.v1beta1.TrajectoryPrecisionInput trajectory_precision_input = 37; -
hasTrajectoryRecallInput
boolean hasTrajectoryRecallInput()Input for trajectory recall metric.
.google.cloud.aiplatform.v1beta1.TrajectoryRecallInput trajectory_recall_input = 38;- Returns:
- Whether the trajectoryRecallInput field is set.
-
getTrajectoryRecallInput
TrajectoryRecallInput getTrajectoryRecallInput()Input for trajectory recall metric.
.google.cloud.aiplatform.v1beta1.TrajectoryRecallInput trajectory_recall_input = 38;- Returns:
- The trajectoryRecallInput.
-
getTrajectoryRecallInputOrBuilder
TrajectoryRecallInputOrBuilder getTrajectoryRecallInputOrBuilder()Input for trajectory recall metric.
.google.cloud.aiplatform.v1beta1.TrajectoryRecallInput trajectory_recall_input = 38; -
hasTrajectorySingleToolUseInput
boolean hasTrajectorySingleToolUseInput()Input for trajectory single tool use metric.
.google.cloud.aiplatform.v1beta1.TrajectorySingleToolUseInput trajectory_single_tool_use_input = 39;- Returns:
- Whether the trajectorySingleToolUseInput field is set.
-
getTrajectorySingleToolUseInput
TrajectorySingleToolUseInput getTrajectorySingleToolUseInput()Input for trajectory single tool use metric.
.google.cloud.aiplatform.v1beta1.TrajectorySingleToolUseInput trajectory_single_tool_use_input = 39;- Returns:
- The trajectorySingleToolUseInput.
-
getTrajectorySingleToolUseInputOrBuilder
TrajectorySingleToolUseInputOrBuilder getTrajectorySingleToolUseInputOrBuilder()Input for trajectory single tool use metric.
.google.cloud.aiplatform.v1beta1.TrajectorySingleToolUseInput trajectory_single_tool_use_input = 39; -
hasRubricBasedInstructionFollowingInput
boolean hasRubricBasedInstructionFollowingInput()Rubric Based Instruction Following metric.
.google.cloud.aiplatform.v1beta1.RubricBasedInstructionFollowingInput rubric_based_instruction_following_input = 40;- Returns:
- Whether the rubricBasedInstructionFollowingInput field is set.
-
getRubricBasedInstructionFollowingInput
RubricBasedInstructionFollowingInput getRubricBasedInstructionFollowingInput()Rubric Based Instruction Following metric.
.google.cloud.aiplatform.v1beta1.RubricBasedInstructionFollowingInput rubric_based_instruction_following_input = 40;- Returns:
- The rubricBasedInstructionFollowingInput.
-
getRubricBasedInstructionFollowingInputOrBuilder
RubricBasedInstructionFollowingInputOrBuilder getRubricBasedInstructionFollowingInputOrBuilder()Rubric Based Instruction Following metric.
.google.cloud.aiplatform.v1beta1.RubricBasedInstructionFollowingInput rubric_based_instruction_following_input = 40; -
getLocation
String getLocation()Required. The resource name of the Location to evaluate the instances. Format: `projects/{project}/locations/{location}`string location = 1 [(.google.api.field_behavior) = REQUIRED, (.google.api.resource_reference) = { ... }- Returns:
- The location.
-
getLocationBytes
com.google.protobuf.ByteString getLocationBytes()Required. The resource name of the Location to evaluate the instances. Format: `projects/{project}/locations/{location}`string location = 1 [(.google.api.field_behavior) = REQUIRED, (.google.api.resource_reference) = { ... }- Returns:
- The bytes for location.
-
getMetricsList
The metrics used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.Metric metrics = 49; -
getMetrics
The metrics used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.Metric metrics = 49; -
getMetricsCount
int getMetricsCount()The metrics used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.Metric metrics = 49; -
getMetricsOrBuilderList
List<? extends MetricOrBuilder> getMetricsOrBuilderList()The metrics used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.Metric metrics = 49; -
getMetricsOrBuilder
The metrics used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.Metric metrics = 49; -
getMetricSourcesList
List<MetricSource> getMetricSourcesList()Optional. The metrics (either inline or registered) used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.MetricSource metric_sources = 52 [(.google.api.field_behavior) = OPTIONAL]; -
getMetricSources
Optional. The metrics (either inline or registered) used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.MetricSource metric_sources = 52 [(.google.api.field_behavior) = OPTIONAL]; -
getMetricSourcesCount
int getMetricSourcesCount()Optional. The metrics (either inline or registered) used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.MetricSource metric_sources = 52 [(.google.api.field_behavior) = OPTIONAL]; -
getMetricSourcesOrBuilderList
List<? extends MetricSourceOrBuilder> getMetricSourcesOrBuilderList()Optional. The metrics (either inline or registered) used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.MetricSource metric_sources = 52 [(.google.api.field_behavior) = OPTIONAL]; -
getMetricSourcesOrBuilder
Optional. The metrics (either inline or registered) used for evaluation. Currently, we only support evaluating a single metric. If multiple metrics are provided, only the first one will be evaluated.
repeated .google.cloud.aiplatform.v1beta1.MetricSource metric_sources = 52 [(.google.api.field_behavior) = OPTIONAL]; -
hasInstance
boolean hasInstance()The instance to be evaluated.
.google.cloud.aiplatform.v1beta1.EvaluationInstance instance = 50;- Returns:
- Whether the instance field is set.
-
getInstance
EvaluationInstance getInstance()The instance to be evaluated.
.google.cloud.aiplatform.v1beta1.EvaluationInstance instance = 50;- Returns:
- The instance.
-
getInstanceOrBuilder
EvaluationInstanceOrBuilder getInstanceOrBuilder()The instance to be evaluated.
.google.cloud.aiplatform.v1beta1.EvaluationInstance instance = 50; -
hasAutoraterConfig
boolean hasAutoraterConfig()Optional. Autorater config used for evaluation.
.google.cloud.aiplatform.v1beta1.AutoraterConfig autorater_config = 30 [(.google.api.field_behavior) = OPTIONAL];- Returns:
- Whether the autoraterConfig field is set.
-
getAutoraterConfig
AutoraterConfig getAutoraterConfig()Optional. Autorater config used for evaluation.
.google.cloud.aiplatform.v1beta1.AutoraterConfig autorater_config = 30 [(.google.api.field_behavior) = OPTIONAL];- Returns:
- The autoraterConfig.
-
getAutoraterConfigOrBuilder
AutoraterConfigOrBuilder getAutoraterConfigOrBuilder()Optional. Autorater config used for evaluation.
.google.cloud.aiplatform.v1beta1.AutoraterConfig autorater_config = 30 [(.google.api.field_behavior) = OPTIONAL]; -
getMetricInputsCase
EvaluateInstancesRequest.MetricInputsCase getMetricInputsCase()
-