Agentic QA Engineer / Generative AI & Agentic Systems (Contract & FTE)-7
Company: Realign
Location: Dallas, TX
Salary: $114,617 a year
Type: Full-time
Posted: 2026-03-29
About this role
Dallas, Texas 75019 Posted March 29th, 2026
Looking for more job opportunities? Click here!
Job Type: Full Time
Job Category: IT
Job Description
Role: Agentic QA Engineer – Generative AI & Agentic Systems
Location: Dallas, TX - In Person interviews
Contract & FTE
Summary
We are seeking a hands-on AI Engineer to design and execute end-to-end testing strategies for agentic AI solutions, including multi-agent systems in production-grade environments. This role partners with the Agentic Operations Team to ensure resiliency, reliability, accuracy, latency, orchestration correctness, and scale. You will establish QA frameworks, build reusable test artifacts, drive macro-level validations across complex workflows, and lead the QA function for Agentic AI from Dev to Prod.
Key Responsibilities
Quality Strategy & Leadership
Agentic & Multi‑Agent Testing
Reliability, Resiliency, and Latency
Accuracy & Macro-Level Validations
Scale & Orchestration
Dev Prod Readiness
Define and own the QA strategy for agentic/multi-agent AI systems across dev, staging, and prod.
Mentor a team of QA engineers; establish testing standards, coding guidelines for test harnesses, and review practices.
Partner with Agentic Operations, Data Science, MLOps, and Platform teams to embed QA in the SDLC and incident response.
Design tests for agent orchestration, tool calling, planner-executor loops, and inter-agent coordination (e.g., task decomposition, handoff integrity, and convergence to goals).
Validate state management, context windows, memory/knowledge stores, and prompt/graph correctness under varying conditions.
Implement scenario fuzzing (e.g., adversarial inputs, prompt perturbations, tool latency spikes, degraded APIs).
Create resilience testing suites: chaos experiments, failover, retries/backoff, circuit-breaking, and degraded mode behavior.
Establish latency SLOs and measure end...