Search across educators, skills, and resources.

Learn first

• Test sets
• Human review
• Regression checks
• Quality metrics

Good matches

Hamel Husain Shreya Shankar Chip Huyen Matt Pocock

Open next

• AI SDK v6 Crash Course
• The AI Engineer Roadmap
• AI Engineering
• LLM Evals

Evaluating AI Agents

Short course · DeepLearning.AI · Intermediate

You need to test, trace, and improve agent workflows instead of judging only single LLM responses.

agent evals, evals, agents, reliability, tracing

Patronus AI

AI reliability and evaluation platform · Patronus AI · Intermediate to advanced

Safety- and reliability-sensitive RAG or agent systems needing specialized hallucination, retrieval, PII, bias, policy, and custom-criteria evaluators.

evals, llm evaluation, ai quality, evaluation platforms

Grok 4.7 explained

Frontier coding model launch explainer · SpaceXAI · Intermediate to advanced

SpaceXAI released Grok 4.7 on September 21, 2026 for coding, agentic tasks, and knowledge work. Use this guide to compare its task reliability and total cost with your current model.

grok 4.7, coding agents, long-running agents, model selection, evals

How to Evaluate AI Agents

Evaluation guide · Hugging Face Community · Intermediate

You need a practical evaluation plan built around representative tasks, controlled environments, observable traces, outcome and constraint metrics, repeated trials, and production failures turned into regression tests.

hugging face, agents, evals, evaluation harnesses, trajectory metrics

OpenAI production best practices

Guide · OpenAI · Intermediate

You are moving from experiments to production and need the official OpenAI guidance on latency, retries, rate limits, safety, monitoring, and operational rollout.

openai, production, reliability, latency, cost

OpenAI eval design guide

Guide · OpenAI · Intermediate

You need practical guidance for designing representative eval datasets, choosing graders, and turning model testing into an engineering loop instead of ad hoc spot checks, especially while OpenAI's older Evals platform is winding down toward read-only status on October 31, 2026.

openai, evals, quality, datasets, regression testing

OpenAI Working with evals

Guide · OpenAI · Intermediate

You need API-level guidance for testing outputs, comparing models, and catching regressions during upgrades.

openai, evals, quality, regression testing, reliability

OpenAI Evaluate agent workflows

Guide · OpenAI · Intermediate

You need the current OpenAI path for tracing, grading, and regression-testing agent workflows instead of only single-prompt evals.

openai, agents, evals, traces, graders

►

Claude models overview

Model docs · Anthropic · Beginner to advanced

You need the official comparison of the current Claude 5 family, context windows, aliases, and release families before choosing cost, speed, and reliability tradeoffs.

claude, anthropic, claude 5, model selection, frontier models

OpenRouter provider routing

Guide · OpenRouter · Intermediate

You need to learn how OpenRouter routes across providers, handles fallbacks, and exposes preference controls before relying on it in production.

openrouter, provider routing, fallbacks, model selection, reliability

►

AI Evals for Engineers & PMs

Cohort course · Hamel Husain and Shreya Shankar · Intermediate

You are shipping AI features and need a serious evaluation workflow.

evals, product, llm reliability

AI Evals for Engineers and PMs

Course · Shreya Shankar · Intermediate

Use this when you want Shreya Shankar's material for evals and related AI skills.

Evals, LLM reliability, Product quality