BriefsToolAvailable now1 min read

LangChain adds real-time AI app alerts to LangSmith

LangChain launched Alerts in LangSmith to help developers monitor LLM apps and agents for errors, latency, and feedback scores.

LangChain adds real-time AI app alerts to LangSmith — image from LangChain
Image: LangChain

Summary

LangChain released Alerts in LangSmith to monitor LLM applications and AI agents in real time. Developers can set alerts based on error rates, run latency, and feedback scores using specific filters and aggregation windows. Notifications can be routed through PagerDuty or custom webhooks like Slack.

What changed

  • Added alerts for error count and rate, average latency, and average feedback score in LangSmith.
  • Added filtering options by model, tool call, or run type for alert metrics.
  • Added support for 5 or 15 minute aggregation windows and custom alert thresholds.
  • Added integrations for PagerDuty and custom webhooks for Slack notifications.

Availability

Available now

“If you’re already sending production traces to LangSmith, you can set up your first alert today.”

Founder takeaway

If you use LangSmith to trace your LLM apps, set up error and latency alerts today to catch production failures early.

Source

LangChainCatch production failures early with LangSmith Alerts

Announced Checked

Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.

SharePost on XLinkedIn

Related

More briefs

All briefs
  1. Google adds AI connected apps to search and gemini — image from Google Gemini

    ToolRolling out

    Google adds AI connected apps to search and gemini

    Google is integrating grocery, finance, and home service apps into Search and the Gemini app for U.S. users.

    Google Gemini1 min read

  2. AWS logo on a FounderHeist card

    ToolAvailable now

    AWS adds Demand Center to AWS Partner Central

    AWS launched Demand Center in AWS Partner Central, providing an AI-powered experience to manage demand generation campaigns.

    AWS1 min read

  3. AWS updates Quick with new AI agent flows and web features — image from AWS

    ToolAvailable now

    AWS updates Quick with new AI agent flows and web features

    AWS released updates to Quick, adding multi-agent orchestration, new deterministic workflow steps, an updated web app, and new connectors.

    AWS1 min read

One email, every Monday

Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.

One email. Every Monday.