MCP
Testing MCP Server Authentication and Authorization: OAuth, Tokens, and Permission Scoping
Most MCP server tutorials skip authentication. The examples use stdio transport with no auth, the server runs locally, and there's nothing to secure.
MCP
Most MCP server tutorials skip authentication. The examples use stdio transport with no auth, the server runs locally, and there's nothing to secure.
Testing
A previous guide covered the basics of testing MCP servers — unit testing tools, resources, and prompts with in-memory transports.
Testing
Your AI agent worked great in development. Then you changed the system prompt by three sentences, deployed it, and customer satisfaction dropped 12%.
Testing
Single agents are hard enough to test. Multi-agent systems add another dimension: the interactions between agents.
Testing
Traditional software regression: you change a function, run tests, and if they fail you've introduced a regression. Easy to detect.
Testing
An AI agent that manages your GitHub issues calls the GitHub API. An agent that schedules meetings calls Google Calendar.
Testing
AI agent workflows are harder to test than traditional software because the intermediate steps (which tools get called, in what order, with what arguments) are non-deterministic. This guide covers deterministic testing strategies: behavioral assertions over tool calls, golden dataset testing, state-based verification, and contract testing for agent-tool
Testing
Model Context Protocol has rapidly become the standard interface for connecting AI agents to external capabilities.
Testing
Off-the-shelf eval frameworks (DeepEval, Ragas, TruLens) cover 80% of use cases. For the remaining 20% — specialized domains, proprietary metrics, internal tooling constraints — you need to build your own. This guide walks you through designing metrics, curating datasets, implementing an LLM judge, and wiring it all into CI. When
Testing
TruLens is an open-source observability and evaluation framework for LLM applications. Its core contribution is the RAG Triad — three metrics (groundedness, context relevance, answer relevance) that together diagnose where a RAG pipeline breaks. Traces are stored locally or remotely, and a built-in dashboard makes debugging fast. What TruLens
Testing
LangSmith gives you production observability for LLM applications — full request traces, cost tracking, latency breakdowns, and human annotation queues. Combined with its evaluation layer, you can compare prompt versions, run automated evaluators, and catch regressions before they reach users. Why Tracing Matters for LLM Applications An LLM application isn'
Testing
Promptfoo is the standard tool for prompt regression testing and LLM red-teaming. Define test cases in YAML, run them against multiple models simultaneously, and catch prompt regressions before they reach production. The red-team mode automatically probes for jailbreaks, prompt injection, and safety failures. The Problem Promptfoo Solves Every