AI directory search

Search across educators, skills, and resources.

Use this when you know the topic you need: Claude Code, MCP, evals, RAG, agents, product, coding, prompting, foundations, or model internals.

13 matches for "traces"

Video matches

Watch first when you want a fast feel for the topic before opening courses, docs, or profiles.

Paving the Road to Production: Governed Enterprise AI Agents — Harish Gaggar, Credit Karma video thumbnail ►

Paving the Road to Production: Governed Enterprise AI Agents — Harish Gaggar, Credit Karma

AI Engineer · 2026, enterprise AI agents, MCP authorization, LangGraph

How To Test AI Agents With Simulations video thumbnail ►

How To Test AI Agents With Simulations

Hamel Husain · 2026, agent simulations, evals, production traces

From Vibes to Production: Evaluating and Shipping AI Agents That Work 101 — Laurie Voss, Arize AI video thumbnail ►

From Vibes to Production: Evaluating and Shipping AI Agents That Work 101 — Laurie Voss, Arize AI

AI Engineer · 2026, agent evaluation, tracing, LLM as judge

Providers and platforms

Langfuse profile photo

Langfuse

Langfuse Docs · Intermediate

Good operational material for tracing, scoring, and improving production LLM apps.

Topics

Observability, Prompt management, Evals, Tracing

Resources

Arize Phoenix

AI observability and evaluation platform · Arize AI · Intermediate to advanced

Teams that want evaluation connected to OpenTelemetry traces, datasets, experiments, prompt iterations, and production troubleshooting.

evals, llm evaluation, ai quality, evaluation platforms

Braintrust

AI evaluation and observability platform · Braintrust Data · Intermediate to advanced

Teams that want a feedback loop from production traces and failures into datasets, regression experiments, CI gates, and continuous scoring.

evals, llm evaluation, ai quality, evaluation platforms

W&B Weave

LLM and agent evaluation platform · Weights & Biases · Intermediate to advanced

Teams already using Weights & Biases or wanting versioned datasets, scorers, traces, and evaluation comparisons in an experiment-oriented workflow.

evals, llm evaluation, ai quality, evaluation platforms

LLM Evals: Everything You Need to Know

Application-evaluation learning resource · Hamel Husain and Shreya Shankar · Intermediate to advanced

Practitioners building product-specific evals from traces, domain-expert judgments, and observed failures instead of relying on generic benchmarks.

evals, llm evaluation, ai quality, benchmarks and learning resources

Agentic models, measured on the injections that move money

Open security benchmark · Hugging Face Community · Intermediate to advanced

You want a reproducible September 5, 2026 benchmark for comparing how agentic models handle indirect prompt injection, with public data, a public harness, control runs, tool-call traces, and outcome metrics tied to unauthorized payment actions.

agents, prompt injection, agent security, evals, tool use

Give Your Coding Agents a Memory You Own

Open-source guide and repo · Hugging Face · Intermediate

You want a September 3, 2026 walkthrough of funes, an open-source local memory layer that indexes agent traces, preserves provenance, and lets Claude Code, Codex, pi, and Hermes recall decisions across sessions and machines.

hugging face, coding agents, agent memory, codex, claude code

How to Evaluate AI Agents

Evaluation guide · Hugging Face Community · Intermediate

You need a practical evaluation plan built around representative tasks, controlled environments, observable traces, outcome and constraint metrics, repeated trials, and production failures turned into regression tests.

hugging face, agents, evals, evaluation harnesses, trajectory metrics

OpenAI Evaluate agent workflows

Guide · OpenAI · Intermediate

You need the current OpenAI path for tracing, grading, and regression-testing agent workflows instead of only single-prompt evals.

openai, agents, evals, traces, graders

AI Engineering: Code Is the New Agent Harness

Beehiiv post · Sumanth P · Intermediate

You want a concise technical briefing on why code, traces, tests, and harnesses matter for real agent systems.

beehiiv, agents, ai engineering, evals, tracing