Quality Engineer (Automation & AI) - Remote

Zyte is looking for a Quality Engineer to join our unified Quality Engineering function. This is an automation-first, AI-native role embedded directly within our engineering squads.

You will be responsible for designing risk-based test strategies, rapidly converting them into automated checks using AI-assisted development workflows, and continuously improving the quality, speed, and reliability of software delivery. Quality at Zyte is not a gatekeeping function. It is an engineering discipline focused on preventing defects, accelerating delivery, and increasing confidence in every release.

AI coding agents are a core part of how we work. You will be expected to use Claude Code or equivalent AI-assisted development environments as your primary development partner for generating, reviewing, debugging, refactoring, and maintaining automation code.

• Design risk-based test strategies for new features and releases, then rapidly convert those strategies into automated coverage using AI-assisted development workflows
• Use Claude Code within VS Code or equivalent AI coding agents as your primary development environment to generate, scale, and maintain automated test coverage
• Build and maintain automated test suites using Playwright, integrated within GitHub CI/CD pipelines, ensuring quality gates are embedded throughout the software development lifecycle
• Design and implement agentic testing workflows that generate, adapt, and maintain automated tests using AI models and APIs
• Build reusable frameworks, utilities, shared libraries, and AI-powered tools that increase test authoring velocity across engineering teams
• Partner closely with engineers, product managers, and designers to shift quality left, influencing requirements, design decisions, observability, and deployment strategies
• Continuously improve test suite health by reducing flakiness, increasing execution speed, and ensuring reliable quality signals for every release
• Drive quality upstream by identifying risks early and implementing preventative quality practices
• Own and improve quality metrics including automated coverage growth, escaped defects, test execution performance, flakiness rates, and release confidence
• Enable developers to write, execute, and maintain automated tests as part of their daily workflow

• Strong software engineering fundamentals, with the ability to review, validate and debug code across any modern programming language
• Strong experience with modern test automation frameworks, preferably Playwright
• Demonstrated ability to use AI coding agents as a primary development partner for generating, reviewing, debugging, refactoring, and maintaining code
• Comfortable delegating significant portions of implementation work to AI agents while maintaining high engineering and quality standards
• Experience building and maintaining scalable automation frameworks
• Experience integrating automated test suites into CI/CD pipelines using GitHub Actions or similar platforms
• Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations within engineering workflows
• Proven track record of increasing automation coverage, reducing manual effort, and improving software quality outcomes
• Strong understanding of quality engineering principles, test strategy, risk analysis, and defect prevention
• Comfortable working as an embedded engineer within cross-functional product squads
• Strong communication skills with the ability to provide concise, actionable updates and collaborate effectively across teams
• Curiosity, adaptability, and a growth mindset toward emerging AI technologies and engineering practices

• Experience testing AI-powered products, agents, or LLM-based applications
• Experience designing evaluation frameworks for AI-generated outputs
• Familiarity with prompt engineering, AI quality assessment, and AI observability
• Experience with performance, load, or resilience testing
• Experience with test management platforms integrated with Jira
• Experience building internal developer platforms, testing tools, or engineering productivity solutions

Within your first six months, you will:

• Increase automated regression coverage for your squad
• Reduce manual testing effort sprint over sprint
• Build reusable automation components adopted by multiple teams
• Demonstrate effective use of AI agents to accelerate automation development and maintenance
• Improve release confidence while supporting fast, reliable software delivery
• Contribute to a culture where quality is owned by the entire engineering team