Interface AutomatedEvaluationConfig.Builder

    • Method Detail

      • datasetMetricConfigs

        AutomatedEvaluationConfig.Builder datasetMetricConfigs​(Collection<EvaluationDatasetMetricConfig> datasetMetricConfigs)

        Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

        Parameters:
        datasetMetricConfigs - Configuration details of the prompt datasets and metrics you want to use for your evaluation job.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • datasetMetricConfigs

        AutomatedEvaluationConfig.Builder datasetMetricConfigs​(EvaluationDatasetMetricConfig... datasetMetricConfigs)

        Configuration details of the prompt datasets and metrics you want to use for your evaluation job.

        Parameters:
        datasetMetricConfigs - Configuration details of the prompt datasets and metrics you want to use for your evaluation job.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • evaluatorModelConfig

        AutomatedEvaluationConfig.Builder evaluatorModelConfig​(EvaluatorModelConfig evaluatorModelConfig)

        Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.

        Parameters:
        evaluatorModelConfig - Contains the evaluator model configuration details. EvaluatorModelConfig is required for evaluation jobs that use a knowledge base or in model evaluation job that use a model as judge. This model computes all evaluation related metrics.
        Returns:
        Returns a reference to this object so that method calls can be chained together.