BriefsNewsAvailable now1 min read

Vercel AI Gateway adds Private Inference support for custom models

Vercel AI Gateway now lets developers connect fine-tuned, self-hosted, and prerelease AI models using Private Inference.

Vercel AI Gateway adds Private Inference support for custom models — image from Vercel
Image: Vercel

Summary

Vercel added Private Inference support to AI Gateway, allowing teams to connect custom model endpoints alongside catalog models. Developers can use unified authentication, SDKs, APIs, and observability features for their own endpoints. The feature supports switching between private and catalog models, scoping models to specific Vercel teams, and connecting coding agents.

What changed

  • Connect fine-hosted, self-hosted, and prerelease models to AI Gateway.
  • Use unified authentication, SDKs, APIs, and observability for private models.
  • Configure fallback options to catalog models if private endpoints fail.
  • Register private providers and models using the Vercel CLI version 65.16.0 or later.

Availability

Available now

“You can now connect your own model endpoints to AI Gateway with Private Inference .”

Founder takeaway

If your team uses self-hosted or fine-tuned AI models, connect them to Vercel AI Gateway to centralize observability, fallbacks, and agent usage alongside catalog models.

Source

VercelAI Gateway now supports Private Inference - Vercel

Announced Checked

Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.

SharePost on XLinkedIn

Related

More briefs

All briefs
  1. Google brings the Gemini app to low-memory Android devices — image from Google AI

    NewsAvailable now

    Google brings the Gemini app to low-memory Android devices

    Google re-architected the Gemini app so it can run on eligible Android Go edition phones.

    Google AI1 min read

  2. Fireworks AI benchmarks the MiniMax M3.1 Flash AI model — image from Fireworks AI

    NewsAvailable now

    Fireworks AI benchmarks the MiniMax M3.1 Flash AI model

    Fireworks AI compares the MiniMax M3.1 Flash AI model against closed alternatives and tests how combining models changes costs and coding completions.

    Fireworks AI1 min read

  3. Google adds temporary threads to AI Mode in Search — image from Google Search

    NewsRolling out

    Google adds temporary threads to AI Mode in Search

    Google introduced temporary threads in AI Mode so users can ask questions without saving them to their history or affecting recommendations.

    Google Search1 min read

One email, every Monday

Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.

One email. Every Monday.