Capacity-aware inference: Automatic instance fallback for SageMaker AI endpoints | Amazon Web Services
Today, Amazon SageMaker AI introduces capacity aware instance pool for new and existing inference endpoints. You define a prioritized list of instance types, and SageMaker AI automatically works through your list whenever capacity is constrained at...
Topics: Infrastructure