Containers with custom inference code - Amazon SageMaker AI
Services or capabilities described in AWS documentation might vary by Region. To see the differences applicable to the AWS European Sovereign Cloud Region, see the AWS European Sovereign Cloud User Guide.

Containers with custom inference code

You can use Amazon SageMaker AI to interact with Docker containers and run your own inference code in one of two ways:

  • To use your own inference code with a persistent endpoint to get one prediction at a time, use SageMaker AI hosting services.

  • To use your own inference code to get predictions for an entire dataset, use SageMaker AI batch transform.

Topics