AWS Routes HyperPod Inference Across Regions From One Endpoint

AWS introduced Amazon SageMaker HyperPod Global Inference Gateway on November 20, 2026, giving customers one managed endpoint for inference requests across registered HyperPod clusters in a single AWS Region or multiple Regions. The service selects a cluster using capacity, queue, proximity and error signals, with automatic failover when a cluster becomes unavailable. The launch adds a second routing tier above the existing SageMaker HyperPod Inference Gateway. That cluster-level gateway…

Leave a Reply

Your email address will not be published. Required fields are marked *

Back To Top