this post was submitted on 18 Dec 2023
0 points (50.0% liked)

AWS

13 readers
1 users here now

A community for news, discussions and knowledge sharing about Amazon Web Services.

founded 2 years ago
MODERATORS
[email protected]
0
Amazon SageMaker adds new inference capabilities to help reduce foundation model deployment costs and latency (aws.amazon.com)
submitted 1 year ago by [email protected] to c/[email protected]
0 comments fedilink hide all child comments
 

Today, we are announcing new Amazon SageMaker inference capabilities that can help you optimize deployment costs and reduce latency. With the new inference capabilities, you can deploy one or more foundation models (FMs) on the same SageMaker endpoint and control how many accelerators and how much memory is reserved for each FM. This helps to […]

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here