BriefsToolAvailable now
Amazon CloudWatch EKS Container Insights adds monitoring for open source tools
Amazon CloudWatch EKS Container Insights adds built-in monitoring for open source Kubernetes and AI inference tools.
Summary
Amazon CloudWatch now monitors open source tools on Amazon EKS clusters without requiring Prometheus or Grafana. The system tracks inference metrics like queued requests and KV cache usage for tools such as vLLM and SGLang. Monitoring starts automatically when you enable OTel Container Insights version 8.0.0 or later.
What changed
- CloudWatch adds built-in monitoring for open source tools on Amazon EKS clusters.
- Supported tools include vLLM, KServe, SGLang, Ray, Knative Serving, Karpenter, and KEDA.
- Dashboards appear automatically without running Prometheus or Grafana.
- Monitoring begins when you enable OTel Container Insights version 8.0.0 or later.
Availability
Available now“These EKS solutions are available in version 8.0.0 and later of the add-on and Helm chart, in all AWS Regions where CloudWatch supports OpenTelemetry metrics.”
Pricing
| Plan | Price, as stated | Checked |
|---|---|---|
| Amazon EKS OpenTelemetry ingestion rate | $0.08 per GB“Metrics are charged at the Amazon EKS OpenTelemetry ingestion rate of $0.08 per GB.” source |
Prices as stated by the company; we don’t convert or estimate.
Founder takeaway
If you run inference workloads on EKS with tools like vLLM or SGLang, check that you are using version 8.0.0 or later to track metrics through CloudWatch.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Google adds AI connected apps to search and gemini
Google is integrating grocery, finance, and home service apps into Search and the Gemini app for U.S. users.
Google Gemini1 min read
AWS adds Demand Center to AWS Partner Central
AWS launched Demand Center in AWS Partner Central, providing an AI-powered experience to manage demand generation campaigns.
AWS1 min read
AWS updates Quick with new AI agent flows and web features
AWS released updates to Quick, adding multi-agent orchestration, new deterministic workflow steps, an updated web app, and new connectors.
AWS1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.