BriefsToolAvailable now
Amazon ECS now supports AI GPU sharing with NVIDIA MPS
Amazon ECS now allows multiple tasks to run concurrently on a single NVIDIA GPU using Multi-Process Service.
Summary
Amazon Elastic Container Service now supports GPU sharing using NVIDIA Multi-Process Service. This lets you run multiple tasks concurrently on a single NVIDIA GPU. You can define memory needs and optional compute shares in task definitions.
What changed
- Amazon ECS added support for GPU sharing with NVIDIA Multi-Process Service.
- You can run multiple Amazon ECS tasks concurrently on a single NVIDIA GPU.
- You can set GPU memory and optional maximum compute shares in container definitions.
- The capability is available in all AWS commercial and AWS GovCloud US regions.
Availability
Available now“This capability is available in all AWS commercial and AWS GovCloud (US) Regions .”
Founder takeaway
If you run model inference on AWS, test this feature to pack multiple tasks onto a single GPU and reduce infrastructure costs.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Vercel adds sandbox plugin support for running Paseo AI agents
Paseo now supports running AI agents in the cloud using the Vercel Sandbox plugin.
Vercel1 min read
Vercel introduces Virtual Models on AI Gateway for AI apps
Vercel released Virtual Models on AI Gateway to let developers manage model strings and fallbacks centrally.
Vercel1 min read
Vercel CLI allows AI agents to enable web analytics and observability
AI agents can now enable Web Analytics and Observability Plus for projects without requiring an interactive terminal.
Vercel1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.