Services or capabilities described in AWS documentation might vary by Region. To see the differences applicable to the AWS European Sovereign Cloud Region, see the AWS European Sovereign Cloud User Guide.

SageMaker HyperPod cluster events reference

This page provides a complete reference of all structured events emitted by Amazon SageMaker HyperPod clusters. Events provide visibility into cluster, instance group, and instance-level operations including provisioning, scaling, patching, and orchestrator-specific lifecycle changes.

Cluster events are available for HyperPod clusters with NodeProvisioningMode set to Continuous. Events are accessible through the ListClusterEvents and DescribeClusterEvent APIs, the SageMaker AI console Events tab, and Amazon EventBridge.

Cluster event record

Each cluster event is represented as a structured record containing identification, timing, scope, severity, and operation-specific metadata. The following example shows a complete event record as delivered through the DescribeClusterEvent API and Amazon EventBridge:

{
  "version": "0",
  "id": "0bd4a141-0a02-9d8a-f977-3924c3fb259c",
  "detail-type": "SageMaker HyperPod Cluster Event",
  "source": "aws.sagemaker",
  "account": "111122223333",
  "time": "2026-06-01T17:20:25Z",
  "region": "us-west-2",
  "resources": [
    "arn:aws:sagemaker:us-west-2:111122223333:cluster/sample-cluster"
  ],
  "detail": {
    "EventDetails": {
      "EventId": "83ea0bb5-be77-45e8-a458-0a87f778a205",
      "ClusterArn": "arn:aws:sagemaker:us-west-2:111122223333:cluster/sample-cluster",
      "ClusterName": "sample-cluster",
      "InstanceGroupName": "p5Inst",
      "InstanceId": "i-0391f86fa0fe0d465",
      "ResourceType": "Instance",
      "EventTime": 1748794825350,
      "EventLevel": "Error",
      "Description": "Instance creation in Cluster sample-cluster and InstanceGroup p5Inst failed",
      "EventDetails": {
        "EventMetadata": {
          "Instance": {
            "FailureMessage": "We currently do not have sufficient capacity to launch new ml.p5.48xlarge instances. Please try again.",
            "NodeLogicalId": "df268d19-f035-4f28-9b80-b956b92ae21e"
          }
        }
      }
    }
  }
}

Event record fields

The detail.EventDetails object contains the following fields:

Event levels

Resource types

EventDetails metadata

Cluster events include an EventMetadata object within the EventDetails field that provides operation-specific context beyond what the event description conveys. The contents of EventMetadata vary by resource type and event type. For the complete schema and supported fields, see EventMetadata in the Amazon SageMaker AI API Reference.

EventBridge envelope fields

When delivered through Amazon EventBridge, the event record is wrapped in the standard EventBridge envelope:

Common events (EKS and Slurm)

The following events are emitted for all HyperPod clusters regardless of orchestrator. The Description column shows the value of the Description field in the event record as it appears in the API response and the console Events tab.

Cluster lifecycle

Instance group lifecycle

Instance group network configuration

Instance creation

Instance deletion

Instance reboot

Instance operation (generic)

Instance replacement

FSx filesystem lifecycle

Patching (common steps)

These patching events are emitted for both EKS and Slurm clusters during UpdateClusterSoftware operations.

EKS-specific events

The following events are emitted only for HyperPod clusters orchestrated with Amazon EKS.

Access entry management

Kubernetes configuration updates

Karpenter autoscaling

Patching — EKS instance-level

Patching — EKS rollback

Slurm-specific events

The following events are emitted only for HyperPod clusters orchestrated with Slurm.

EventBridge integration

HyperPod sends cluster events to Amazon EventBridge using three detail types:

Event pattern examples

All HyperPod cluster events:

{
  "source": ["aws.sagemaker"],
  "detail-type": ["SageMaker HyperPod Cluster Event"]
}

Error events only (for alerting):

{
  "source": ["aws.sagemaker"],
  "detail-type": ["SageMaker HyperPod Cluster Event"],
  "detail": {
    "EventDetails": {
      "EventLevel": ["Error"]
    }
  }
}

Events for a specific cluster:

{
  "source": ["aws.sagemaker"],
  "detail-type": ["SageMaker HyperPod Cluster Event"],
  "resources": ["arn:aws:sagemaker:us-west-2:111122223333:cluster/my-cluster-id"]
}

Node health events:

{
  "source": ["aws.sagemaker"],
  "detail-type": ["SageMaker HyperPod Cluster Node Health Event"]
}

API reference

See also