Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters | Amazon Web Services
Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and authenticates every request with SigV4 and IAM over AWS PrivateLink.
Amazon Web Services ยท https://www.facebook.com/amazonwebservices
Topics: Infrastructure
Entities: Infrastructure