BriefsNewsAvailable now
Vercel AI Gateway adds Private Inference support for custom models
Vercel AI Gateway now lets developers connect fine-tuned, self-hosted, and prerelease AI models using Private Inference.
Summary
Vercel added Private Inference support to AI Gateway, allowing teams to connect custom model endpoints alongside catalog models. Developers can use unified authentication, SDKs, APIs, and observability features for their own endpoints. The feature supports switching between private and catalog models, scoping models to specific Vercel teams, and connecting coding agents.
What changed
- Connect fine-hosted, self-hosted, and prerelease models to AI Gateway.
- Use unified authentication, SDKs, APIs, and observability for private models.
- Configure fallback options to catalog models if private endpoints fail.
- Register private providers and models using the Vercel CLI version 65.16.0 or later.
Availability
Available now“You can now connect your own model endpoints to AI Gateway with Private Inference .”
Founder takeaway
If your team uses self-hosted or fine-tuned AI models, connect them to Vercel AI Gateway to centralize observability, fallbacks, and agent usage alongside catalog models.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Google brings the Gemini app to low-memory Android devices
Google re-architected the Gemini app so it can run on eligible Android Go edition phones.
Google AI1 min read
Fireworks AI benchmarks the MiniMax M3.1 Flash AI model
Fireworks AI compares the MiniMax M3.1 Flash AI model against closed alternatives and tests how combining models changes costs and coding completions.
Fireworks AI1 min read
Google adds temporary threads to AI Mode in Search
Google introduced temporary threads in AI Mode so users can ask questions without saving them to their history or affecting recommendations.
Google Search1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.