Generate a McCoy IQ challenge in 30 seconds.
See how candidates think and approach the work this role demands, before the phone screen. We'll build a video challenge from this posting, and you can edit or share it before it goes live.
Key details
What makes this role novel
This role involves architecting and building AI-agent-driven testing systems with prompt engineering as a core discipline—a fundamentally new approach to QA that treats prompts as versioned code artifacts and uses AI agents for autonomous test execution, which didn't exist as a distinct job category before 2023.
Job Description
- AI-Driven Test Automation Architecture & Framework Design Design and implement scalable, maintainable testing frameworks utilizing AI agents for high-fidelity, enterprise-grade testing. Architect prompt-driven testing systems that abstract complex test logic into composable, reusable workflows. Develop infrastructure for orchestrating AI agents, managing state, parallelizing test scenarios, and ensuring failure recovery. Build observability and debugging tools (logging, tracing) for transparent AI-driven test execution and root cause analysis. Establish integration patterns for UI, REST APIs, webhooks, and custom tools with AI agents to achieve deterministic, high-signal testing. Develop reusable prompt modules for common enterprise scenarios: authentication, role-based access, data validation, multi-tenant workflows, and complex transactions. Implement version control, testing, and deployment pipelines for prompts, treating them as first-class code artifacts. Design and execute end-to-end test workflows for complex enterprise features, including integrations, multi-step configurations, and role-based access. Build frameworks to validate the AI QA platform itself, ensuring agent behavior is reliable, human-like, and compliant. Develop data-driven feedback loops to analyze test results, identify gaps, and continuously improve prompt libraries and agent capabilities. Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent professional experience). 1+ years of hands-on experience designing and building test automation frameworks for enterprise applications. 1+ years of experience with production automation infrastructure: system design, reliability, maintainability, and scalability. Deep understanding of test design principles: boundary analysis, equivalence classes, and end-to-end workflow validation. Strong fundamentals in modern browser automation: DOM interaction, selectors, state management, and handling flakiness/race conditions. Proficiency in Python or TypeScript/JavaScript (preferred) within test automation ecosystems. Hands-on experience with Playwright (strongly preferred), Selenium, or similar modern browser automation frameworks. Experience building or significantly architecting test automation frameworks from scratch. Familiarity with LLM-driven workflows, prompt engineering, or evaluation frameworks (e.g., LangChain, Anthropic SDK). Experience testing or validating complex enterprise platforms (e.g., Salesforce, ServiceNow, Workday, SAP). Knowledge of CI/CD pipelines, observability tools (logging, tracing, metrics), and test result analytics. Background in specialized quality domains like API testing or performance testing. Experience with DevOps-adjacent technologies: infrastructure-as-code, Docker, Kubernetes. Relevant enterprise platform or test automation framework certifications.
Audit details(provenance, verification trail, raw fields)
Core fields
eightfoldai:68761550606Provenance
eightfold.aiVerification trail
This posting hasn't been probed by our closure verifier yet. Stream C runs on a rolling schedule against postings approaching the close-decision threshold.
LLM enrichment
See how we measure for definitions, or our corrections log for known issues. Found something wrong? Flag a correction.
