EvaluationInferenceConfig
The configuration details of the inference model for an evaluation job.
For automated model evaluation jobs, only a single model is supported.
For human-based model evaluation jobs, your annotator can compare the responses for up to two different models.
Contents
Important
This data type is a UNION, so only one of the following members can be specified when used or returned.
- models
-
Specifies the inference models.
Type: Array of EvaluationModelConfig objects
Array Members: Minimum number of 1 item. Maximum number of 2 items.
Required: No
- ragConfigs
-
Contains the configuration details of the inference for a knowledge base evaluation job, including either the retrieval only configuration or the retrieval with response generation configuration.
Type: Array of RAGConfig objects
Array Members: Fixed number of 1 item.
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: