BriefsToolAvailable now
LangChain adds real-time AI app alerts to LangSmith
LangChain launched Alerts in LangSmith to help developers monitor LLM apps and agents for errors, latency, and feedback scores.
Summary
LangChain released Alerts in LangSmith to monitor LLM applications and AI agents in real time. Developers can set alerts based on error rates, run latency, and feedback scores using specific filters and aggregation windows. Notifications can be routed through PagerDuty or custom webhooks like Slack.
What changed
- Added alerts for error count and rate, average latency, and average feedback score in LangSmith.
- Added filtering options by model, tool call, or run type for alert metrics.
- Added support for 5 or 15 minute aggregation windows and custom alert thresholds.
- Added integrations for PagerDuty and custom webhooks for Slack notifications.
Availability
Available now“If you’re already sending production traces to LangSmith, you can set up your first alert today.”
Founder takeaway
If you use LangSmith to trace your LLM apps, set up error and latency alerts today to catch production failures early.
Source
Researched and drafted with AI from the official sources above, then checked automatically before publishing. Spotted a mistake? Tell us.
Related
More briefs
Google adds AI connected apps to search and gemini
Google is integrating grocery, finance, and home service apps into Search and the Gemini app for U.S. users.
Google Gemini1 min read
AWS adds Demand Center to AWS Partner Central
AWS launched Demand Center in AWS Partner Central, providing an AI-powered experience to manage demand generation campaigns.
AWS1 min read
AWS updates Quick with new AI agent flows and web features
AWS released updates to Quick, adding multi-agent orchestration, new deterministic workflow steps, an updated web app, and new connectors.
AWS1 min read
One email, every Monday
Briefs are published here through the day. Monday Heist is the email: one useful AI workflow, the files to use it, and the catch. The first issue is being prepared; subscribers get it first. Free, and you can leave in one click.
One email. Every Monday.