{
  "video_id": "efVSns9DAmo",
  "title": "LangChain Academy New Course: Monitoring Production Agents",
  "url": "https://www.youtube.com/watch?v=efVSns9DAmo",
  "transcript": "I'm excited to announce our latest Langchain Academy course, Production Monitoring with Langsmith. We're tackling one of the hardest truths about building agents. You don't know what they'll do until they're in production. In traditional software, you can test against a known set of inputs and reliably predict edge cases. Agents are fundamentally different. Your users can say anything, providing input that you never anticipated. And because your agent is non-deterministic, even the same input can produce different results. You simply cannot test your way to full coverage before launch. So if you can't fully predict behavior in development, you need to get great at understanding behavior in production. And the signal you care about isn't in status codes or traditional monitoring dashboards. It's in the conversations themselves. What the user asked, how the agent responded, and what steps it made along the way. In this course you use Langsmith our platform for agent observability and evals to track your agents in production You start with learning how to track costs so you know when spikes happen and how spend breaks down across models and users Then you'll learn how to use insights, Langsmith's Trace Analysis Tool. Instead of manually reading thousands of traces, you'll use clustering and summarization to surface trends, failure patterns, and usage signals you'd never catch by hand. Next, you'll set up quality monitoring, tracking user sentiment, error spikes and latency regressions, and A-B testing to compare agent versions in production. Finally, you'll build a security layer with online evals that run automatically on production traces to detect prompt injection and PII leakage. By the end, you'll have a complete monitoring stack that lets you understand, improve and protect your agents at production scale. I'm excited for you to dive in and learn how to monitor agents in production with Langsmith. You can enroll today.",
  "transcript_chars": 1955,
  "transcript_filled_at": "2026-06-06T14:36:53.898854+00:00",
  "transcript_filled_by": "tk-bulk-groq-retry-20260606"
}