BriefsToolAvailable now
Amazon EKS Auto Mode and Karpenter add support for Dynamic Resource Allocation
Amazon EKS Auto Mode and Karpenter now support Dynamic Resource Allocation for NVIDIA GPUs and Elastic Fabric Adapter network devices.
Summary
Amazon EKS Auto Mode and Karpenter now support Dynamic Resource Allocation (DRA) for NVIDIA GPUs and Elastic Fabric Adapter (EFA) network devices. This allows users to define specific device attributes for Kubernetes workloads, share GPU devices across Pods, and scale EC2 instances based on demand.
What changed
- Added support for Dynamic Resource Allocation for NVIDIA GPUs and EFA network devices in Amazon EKS Auto Mode and Karpenter.
- Enabled definition of device attributes for workloads using ResourceClaim or ResourceClaimTemplate objects.
- Automated the launch of instances matching DRA requirements via Karpenter.
- Integrated NVIDIA and EFA DRA drivers into Amazon EKS Auto Mode.
Availability
Available now“DRA support for Amazon EKS Auto Mode and Karpenter is available in all AWS Regions, except the AWS GovCloud (US) Regions and the China Regions.”
Founder takeaway
If you run distributed training or inference on EKS, evaluate using DRA to define GPU and EFA requirements, which allows Karpenter to automatically provision the most cost-effective instances.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
LangSmith adds coding agent reporting and outcome tracking
LangChain updates LangSmith with new reporting features that link AI coding agent spend to GitHub pull requests and GitLab merge requests.
LangChain1 min read
Reson8 releases Rumble-2-Flash as an open 0.5B speech AI model
Reson8 released Rumble-2-Flash, an open 0.5B-parameter speech recognition AI model supporting over forty languages.
Hugging Face1 min read
NVIDIA releases RTX Spark compact desktops for local AI
ASUS, Dell, and MSI launched new RTX Spark desktops to run local AI agents, generation, and model fine-tuning on Windows.
NVIDIA1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.