►
Trends in AI Engineering: Careers, Coding Agents & Evals | Hugo Bowne-Anderson & Alexey Grigorev
Alexey Grigorev · 2026, AI engineering careers, coding agents, evals
AI directory search
Search across educators, skills, and resources.
Use this when you know the topic you need: Claude Code, MCP, evals, RAG, agents, product, coding, prompting, foundations, or model internals.
14 matches for "tests"
Video matches
Watch first when you want a fast feel for the topic before opening courses, docs, or profiles.
►
►
2,000 AI Agents Rewrote a Coding Agent in Rust
Bitwise AI · 2026, Prime Agent, Rust, multi-agent coding
Educators
Ben Tossell
Ben's Bites · Beginner
Useful for lightweight discovery of AI tools and trends, best paired with deeper resources.
Skills
AI news, Tools, Workflow discovery
Matt Wolfe
Future Tools · Beginner
Useful for discovering tools, then pairing that discovery with deeper implementation resources.
Skills
Tool discovery, Creative AI, AI workflows
Resources
Essential AI Coding Feedback Loops For TypeScript Projects
Guide · Matt Pocock · Intermediate
You want TypeScript checks, tests, linters, and review loops that help agents produce better code and catch regressions quickly.
ai coding, typescript, testing, feedback loops
Promptfoo
Open-source eval and red-team framework · OpenAI / Promptfoo · Intermediate to advanced
Declarative regression tests and side-by-side comparisons of prompts, models, RAG systems, and agent configurations, especially when red teaming is also required.
evals, llm evaluation, ai quality, open-source frameworks
DeepEval
Pytest-style LLM evaluation framework · Confident AI · Intermediate to advanced
Engineering teams that want LLM and agent evaluations to behave like software unit tests, with thresholds, assertions, and CI-friendly failures.
evals, llm evaluation, ai quality, open-source frameworks
Giskard
Agent testing and red-team framework · Giskard AI · Intermediate to advanced
Behavioral tests and adversarial scans of multi-turn agents, chatbots, and RAG systems from a pytest-compatible workflow.
evals, llm evaluation, ai quality, open-source frameworks
OpenAI Evals
Hosted LLM and agent evaluation API · OpenAI · Intermediate to advanced
Existing OpenAI API teams maintaining dataset-based prompt or model regression tests during the remaining service window.
evals, llm evaluation, ai quality, cloud and provider evals
SWE-bench
Software-engineering agent benchmark · SWE-bench team · Intermediate to advanced
Measuring whether coding agents can resolve real GitHub issues by producing repository patches that pass executable tests.
evals, llm evaluation, ai quality, benchmarks and learning resources
How to Evaluate AI Agents
Evaluation guide · Hugging Face Community · Intermediate
You need a practical evaluation plan built around representative tasks, controlled environments, observable traces, outcome and constraint metrics, repeated trials, and production failures turned into regression tests.
hugging face, agents, evals, evaluation harnesses, trajectory metrics
Qwen Code common workflows
Guide · Qwen · Intermediate
You want practical official examples for review, debugging, test work, and subagent delegation instead of learning Qwen Code only from the onboarding docs.
qwen, coding agents, common workflows, reviews, tests
►
Promptfoo Intro
Open source docs · Promptfoo · Intermediate
You need regression tests for prompts, models, and LLM outputs.
evals, prompt testing, red teaming
AI Engineering: Code Is the New Agent Harness
Beehiiv post · Sumanth P · Intermediate
You want a concise technical briefing on why code, traces, tests, and harnesses matter for real agent systems.
beehiiv, agents, ai engineering, evals, tracing