SampleTokenUsage - SageMaker Training Session
ContentsSee Also
Services or capabilities described in AWS documentation might vary by Region. To see the differences applicable to the AWS European Sovereign Cloud Region, see the AWS European Sovereign Cloud User Guide.

SampleTokenUsage

The token usage statistics for a sample generation.

Contents

decode

The number of tokens generated (decode phase).

Type: Integer

Required: Yes

prefill

The number of tokens in the input prompt (prefill phase).

Type: Integer

Required: Yes

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: