Testing - HelpMeTest (Page 76)

Testing

Testing Microsoft Dynamics 365: EasyRepro, Power Automate, and API Testing

Dynamics 365 UI testing requires EasyRepro — Microsoft's open-source Selenium wrapper that understands D365's dynamic control IDs. This guide covers EasyRepro setup, Dataverse API testing, Power Automate flow testing, and integrating everything into CI. Why Dynamics 365 Testing Is Hard Testing Dynamics 365 with standard Selenium fails

Testing

LangSmith for LLM Tracing and Evaluation

LangSmith gives you production observability for LLM applications — full request traces, cost tracking, latency breakdowns, and human annotation queues. Combined with its evaluation layer, you can compare prompt versions, run automated evaluators, and catch regressions before they reach users. Why Tracing Matters for LLM Applications An LLM application isn'

Testing

Pandas Testing Best Practices: Testing Data Transformations with pytest

Testing pandas code requires different patterns than testing application code. DataFrames are complex objects—you rarely want to assert on the entire DataFrame at once. Instead, assert on specific columns, row counts, data types, and statistical properties. Use pytest fixtures for reusable test data, pandas.testing for DataFrame comparisons, and

Testing

Testing SSO and SAML Flows: SP-Initiated, IdP-Initiated, and Assertion Validation

SAML SSO testing requires testing both SP-initiated and IdP-initiated flows, SAML assertion validation (signature, conditions, audience), and error handling for invalid assertions. Most teams only test the happy path through the browser UI. This guide covers automated testing of SAML assertion handling, IdP simulation for integration tests, and the security

Testing

ServiceNow ATF Testing Guide: Automated Test Framework Deep Dive

ServiceNow's Automated Test Framework (ATF) is a built-in, no-license-required testing tool that supports UI tests, server-side script tests, and API tests. This guide covers ATF setup, test writing patterns, and CI/CD integration using the ServiceNow REST API. What Is ServiceNow ATF? The Automated Test Framework (ATF) is

Testing

Promptfoo: Testing and Red-Teaming LLM Prompts

Promptfoo is the standard tool for prompt regression testing and LLM red-teaming. Define test cases in YAML, run them against multiple models simultaneously, and catch prompt regressions before they reach production. The red-team mode automatically probes for jailbreaks, prompt injection, and safety failures. The Problem Promptfoo Solves Every time you

Testing

Session Management Testing: Cookies, CSRF, Token Refresh, and Security

Session management testing covers four areas: cookie security attributes (HttpOnly, Secure, SameSite), CSRF protection, token refresh behavior, and session lifecycle (creation, invalidation, concurrent sessions). These aren't glamorous tests, but session vulnerabilities — session fixation, missing CSRF protection, cookies over HTTP — are consistently in the OWASP Top 10. This guide

Testing

Data Pipeline Testing: Unit and Integration Tests for Airflow, Prefect, and Dagster

Data pipeline orchestrators (Airflow, Prefect, Dagster) each have different testing models, but the principle is the same: unit-test your business logic in isolation, integration-test the orchestration layer with real or containerized dependencies. This guide covers testing patterns for all three orchestrators plus shared practices that apply to any pipeline. Key

Testing

Testing Keycloak Integrations: Test Realm, REST API, and Robot Framework

Keycloak testing requires a dedicated test realm to isolate test users and configuration from production. The Keycloak REST Admin API handles test setup and teardown — creating users, resetting passwords, and managing roles programmatically. For E2E tests, token generation via the Direct Access Grant bypasses browser login. This guide covers Keycloak

Testing

SAP Test Automation Guide: UTFx, Worksoft, and eCATT

SAP testing requires tools that understand SAP's proprietary GUI, transaction codes, and BAPI interfaces. This guide covers the three main automation approaches — UTFx, Worksoft Certify, and SAP's built-in eCATT — plus how to integrate them into CI pipelines. SAP Testing Challenges Testing SAP is fundamentally different from

Testing

Ragas Guide: Evaluating RAG Pipelines with Faithfulness, Relevancy, and Precision

Ragas gives you a rigorous metric suite for RAG pipelines: faithfulness, answer relevancy, context precision, and context recall. Each metric isolates a different failure mode — bad retrieval vs. bad generation vs. incomplete recall. This guide shows you how to compute them, interpret scores, and integrate Ragas into CI. The RAG

Testing

JWT Testing: Validate, Decode, and Mock JWTs in Tests

JWT testing requires testing your token validation logic — not just the happy path (valid token accepted), but also expiry, wrong algorithm, tampered signatures, missing claims, and algorithm confusion attacks. This guide covers creating test JWTs with PyJWT and jsonwebtoken, testing validation middleware, mocking JWT verification for unit tests, and the