AutomatedEvaluationCustomMetricConfig
Defines the configuration of custom metrics to be used in an evaluation job. To learn more about using custom metrics in Amazon Bedrock evaluation jobs, see Create a prompt for a custom metrics (LLM-as-a-judge model evaluations) and Create a prompt for a custom metrics (RAG evaluations).
Contents
- customMetrics
-
Defines a list of custom metrics to be used in an Amazon Bedrock evaluation job.
Type: Array of AutomatedEvaluationCustomMetricSource objects
Array Members: Minimum number of 1 item. Maximum number of 10 items.
Required: Yes
- evaluatorModelConfig
-
Configuration of the evaluator model you want to use to evaluate custom metrics in an Amazon Bedrock evaluation job.
Type: CustomMetricEvaluatorModelConfig object
Required: Yes
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: