Managed NVIDIA Dynamo on Amazon SageMaker HyperPod Inference | Amazon Web Services
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes without building the orchestration layer yourself.
Amazon Web Services ยท https://www.facebook.com/amazonwebservices
Topics: ModelsInfrastructure
Entities: ModelsInfrastructureNVIDIANVIDIA Dynamo