BriefsToolBeta
LangChain launches LangSmith LLM Gateway in public beta for AI agents
LangChain introduces LangSmith LLM Gateway in public beta to add runtime controls like spend limits and fallbacks for AI agents.
Summary
LangChain released LangSmith LLM Gateway in public beta to help engineering teams govern AI agent model calls in production. The gateway sits between agents and providers to enforce spend caps, rate limits, model fallbacks, and data redaction. It is available now for Plus and Enterprise plans.
What changed
- LangSmith LLM Gateway is available in public beta for Plus and Enterprise plans.
- Teams can set spend and rate limits at organization, workspace, API key, and user levels.
- Configurable model fallback rules allow routing to alternative models and hosts when failures occur.
- Data redaction detects and replaces PII and secrets before requests reach model providers.
Availability
Beta“LangSmith LLM Gateway is now available in public beta.”
Founder takeaway
If you run production AI agents, test LangSmith LLM Gateway to centralize spend caps, rate limits, and fallback rules without writing custom controls.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Vercel adds sandbox plugin support for running Paseo AI agents
Paseo now supports running AI agents in the cloud using the Vercel Sandbox plugin.
Vercel1 min read
Vercel introduces Virtual Models on AI Gateway for AI apps
Vercel released Virtual Models on AI Gateway to let developers manage model strings and fallbacks centrally.
Vercel1 min read
Vercel CLI allows AI agents to enable web analytics and observability
AI agents can now enable Web Analytics and Observability Plus for projects without requiring an interactive terminal.
Vercel1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.