►
Paving the Road to Production: Governed Enterprise AI Agents — Harish Gaggar, Credit Karma
AI Engineer · 2026, enterprise AI agents, MCP authorization, LangGraph
AI directory search
Use this when you know the topic you need: Claude Code, MCP, evals, RAG, agents, product, coding, prompting, foundations, or model internals.
13 matches for "traces"
Watch first when you want a fast feel for the topic before opening courses, docs, or profiles.
►
AI Engineer · 2026, enterprise AI agents, MCP authorization, LangGraph
►
Hamel Husain · 2026, agent simulations, evals, production traces
►
AI Engineer · 2026, agent evaluation, tracing, LLM as judge
Langfuse Docs · Intermediate
Good operational material for tracing, scoring, and improving production LLM apps.
Topics
Observability, Prompt management, Evals, Tracing
AI observability and evaluation platform · Arize AI · Intermediate to advanced
Teams that want evaluation connected to OpenTelemetry traces, datasets, experiments, prompt iterations, and production troubleshooting.
evals, llm evaluation, ai quality, evaluation platforms
AI evaluation and observability platform · Braintrust Data · Intermediate to advanced
Teams that want a feedback loop from production traces and failures into datasets, regression experiments, CI gates, and continuous scoring.
evals, llm evaluation, ai quality, evaluation platforms
LLM and agent evaluation platform · Weights & Biases · Intermediate to advanced
Teams already using Weights & Biases or wanting versioned datasets, scorers, traces, and evaluation comparisons in an experiment-oriented workflow.
evals, llm evaluation, ai quality, evaluation platforms
Application-evaluation learning resource · Hamel Husain and Shreya Shankar · Intermediate to advanced
Practitioners building product-specific evals from traces, domain-expert judgments, and observed failures instead of relying on generic benchmarks.
evals, llm evaluation, ai quality, benchmarks and learning resources
Open security benchmark · Hugging Face Community · Intermediate to advanced
You want a reproducible September 5, 2026 benchmark for comparing how agentic models handle indirect prompt injection, with public data, a public harness, control runs, tool-call traces, and outcome metrics tied to unauthorized payment actions.
agents, prompt injection, agent security, evals, tool use
Open-source guide and repo · Hugging Face · Intermediate
You want a September 3, 2026 walkthrough of funes, an open-source local memory layer that indexes agent traces, preserves provenance, and lets Claude Code, Codex, pi, and Hermes recall decisions across sessions and machines.
hugging face, coding agents, agent memory, codex, claude code
Evaluation guide · Hugging Face Community · Intermediate
You need a practical evaluation plan built around representative tasks, controlled environments, observable traces, outcome and constraint metrics, repeated trials, and production failures turned into regression tests.
hugging face, agents, evals, evaluation harnesses, trajectory metrics
Guide · OpenAI · Intermediate
You need the current OpenAI path for tracing, grading, and regression-testing agent workflows instead of only single-prompt evals.
openai, agents, evals, traces, graders
Beehiiv post · Sumanth P · Intermediate
You want a concise technical briefing on why code, traces, tests, and harnesses matter for real agent systems.
beehiiv, agents, ai engineering, evals, tracing