G
Senior Test Automation AI Engineer (Automation & Operations) - Vice President - Dallas
Goldman Sachs
Onsite (Dallas, TX)
Senior Level
Posted Today
Skills
Test Automation
AI/ML Engineering
Large Language Models
Agentic Workflows
LangGraph
CrewAI
CI/CD Integration
Synthetic Data Orchestration
Observability & Monitoring
Predictive Risk Analysis
Giskard
DeepEval
API Testing
UI Testing
Telemetry Pipelines
Microservices
About the Role
Role Overview:
In the rapid development landscape of 2026, the role of a Senior AI/ML Engineer in test automation is to transform Quality Assurance (QA) from a reactive bottleneck into a proactive, intelligent layer. By leveraging Large Language Models (LLMs) and agentic workflows, you will build a "self-healing" test harness that provides the confidence needed for continuous, high-velocity deployments.
Responsibilities:
- Autonomous Test Harness Engineering: Design and maintain "self-healing" test frameworks that use AI to automatically update locators and scripts when UI or API schemas change, reducing maintenance toil by up to 70%.
- LLM-Powered Test Generation: Implement agentic workflows (using frameworks like LangGraph or CrewAI) to analyze Jira stories, PR diffs, and system architecture to generate comprehensive test suites, including edge cases and negative scenarios.
- Intelligent Observability & Monitoring: Build telemetry pipelines that use ML for anomaly detection and predictive risk analysis, identifying high-risk code areas before they reach production.
- Synthetic Data Orchestration: Leverage Generative AI to create high-fidelity, privacy-compliant synthetic datasets for complex integration and performance testing.
- "LLM-as-a-Judge" Implementation: Establish automated evaluation frameworks (e.g., Giskard, DeepEval) to measure the accuracy, safety, and hallucination rates of AI-driven features.
- CI/CD Integration: Architect intelligent gates within the CI/CD pipeline that use predictive test selection to run only the most relevant tests for a given code change, optimizing execution speed.
- Cross-Functional Collaboration: Partner with developers and data scientists to ensure "testability" is built into AI models and microservices from the design phase.
Similar Jobs
Senior AI-First Full-Stack Engineer, Test Automation & Platform Readiness
Virtasant
Remote (Austin, North America)
N
Lead Software Engineer (AI - Quality focus)
NICE
Hybrid (Atlanta, Georgia)
I
QA Engineer (AI-Enabled Testing)
IntelliTrans
Hybrid (Atlanta, GA)
S
AI Testing Architect
Select Minds LLC
Onsite (Dallas, TX)
$120k - $135k/yr
C
Senior Generative AI & Testing Efficiency Developer, Vice President
Citi
Remote (6400 LAS COLINAS BLVD IRVING, Texas)
$125k - $188k/yr
F
Transformation Engineer - Software Development, AI & Quality Engineering
Fitch Group
Hybrid (Chicago, IL)
$130k - $150k/yr
C
Agentic AI Test Engineer
Comcast
Remote (Mount Laurel, New Jersey)
$114k - $172k/yr
AI Lead Engineer, Client Technology - SVP - NYC
Citi
Hybrid (New York, NY,US)
$176k - $265k/yr
M
AI Quality Engineer
Momentive
Remote (Atlanta, Georgia)
C
Senior Software Engineer in Test (AI Agentic Systems)
Collective Health
Hybrid (Lehi, Utah)
$99k - $148k/yr