Testing
Promptfoo is the standard tool for prompt regression testing and LLM red-teaming. Define test cases in YAML, run them against multiple models simultaneously, and catch prompt regressions before they reach production. The red-team mode automatically probes for jailbreaks, prompt injection, and safety failures. The Problem Promptfoo Solves Every time you
Testing
Session management testing covers four areas: cookie security attributes (HttpOnly, Secure, SameSite), CSRF protection, token refresh behavior, and session lifecycle (creation, invalidation, concurrent sessions). These aren't glamorous tests, but session vulnerabilities — session fixation, missing CSRF protection, cookies over HTTP — are consistently in the OWASP Top 10. This guide
Testing
Data pipeline orchestrators (Airflow, Prefect, Dagster) each have different testing models, but the principle is the same: unit-test your business logic in isolation, integration-test the orchestration layer with real or containerized dependencies. This guide covers testing patterns for all three orchestrators plus shared practices that apply to any pipeline. Key
Testing
Keycloak testing requires a dedicated test realm to isolate test users and configuration from production. The Keycloak REST Admin API handles test setup and teardown — creating users, resetting passwords, and managing roles programmatically. For E2E tests, token generation via the Direct Access Grant bypasses browser login. This guide covers Keycloak
Testing
SAP testing requires tools that understand SAP's proprietary GUI, transaction codes, and BAPI interfaces. This guide covers the three main automation approaches — UTFx, Worksoft Certify, and SAP's built-in eCATT — plus how to integrate them into CI pipelines. SAP Testing Challenges Testing SAP is fundamentally different from
Testing
Ragas gives you a rigorous metric suite for RAG pipelines: faithfulness, answer relevancy, context precision, and context recall. Each metric isolates a different failure mode — bad retrieval vs. bad generation vs. incomplete recall. This guide shows you how to compute them, interpret scores, and integrate Ragas into CI. The RAG
Testing
JWT testing requires testing your token validation logic — not just the happy path (valid token accepted), but also expiry, wrong algorithm, tampered signatures, missing claims, and algorithm confusion attacks. This guide covers creating test JWTs with PyJWT and jsonwebtoken, testing validation middleware, mocking JWT verification for unit tests, and the
Testing
Great Expectations (GX) is a Python library for defining and running data quality assertions against DataFrames, files, and databases. You define Expectations (e.g., "this column should be non-null"), group them into Expectation Suites, and run them via Checkpoints. Failed Expectations produce HTML Data Docs reports showing exactly
Testing
OAuth2 testing requires either a real OAuth provider in test mode or a mock OAuth server for unit and integration tests. The authorization code flow involves browser redirects that are hard to automate — mock servers eliminate the browser redirect while still testing your token exchange and validation logic. This guide
Testing
Salesforce requires a minimum of 75% Apex code coverage before any deployment to production. This guide covers writing Apex unit tests, mocking callouts and DML, testing flows, and automating UI tests with Provar inside a CI pipeline. Why Salesforce Testing Is Different Testing Salesforce applications comes with unique constraints that
Testing
DeepEval brings unit testing discipline to LLM applications. Write assertions on model outputs the same way you write pytest assertions on function return values — with G-Eval metrics, faithfulness checks, and hallucination detection. This tutorial walks you from installation to CI-integrated test suite. Why LLM Applications Need Unit Tests You'
Testing
Auth0 testing requires a dedicated test tenant, programmatic token generation for API tests, mock JWKS servers for unit tests, and cypress-auth0 or Playwright helpers for E2E tests. Testing against your production Auth0 tenant pollutes logs and risks rate limits. This guide covers the right setup for each test layer. Key