GenerationConfiguration
Contains configurations for response generation based on the knowledge base query results.
This data type is used in the following API operations:
Contents
- additionalModelRequestFields
-
Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows users to provide custom model parameters specific to the language model being used.
Type: String to JSON value map
Key Length Constraints: Minimum length of 1. Maximum length of 100.
Required: No
- guardrailConfiguration
-
The configuration details for the guardrail.
Type: GuardrailConfiguration object
Required: No
- inferenceConfig
-
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using a knowledge base as a source.
Type: InferenceConfig object
Required: No
- performanceConfig
-
The latency configuration for the model.
Type: PerformanceConfiguration object
Required: No
- promptTemplate
-
Contains the template for the prompt that's sent to the model for response generation. Generation prompts must include the
$search_results$variable. For more information, see Use placeholder variables in the user guide.Type: PromptTemplate object
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: