Lead / Principal AI Quality Engineer - San Jose & Chicago
Lenovo
- Location
- Hybrid (Chicago, Illinois)
- Compensation
- $160k - $246k/yr
- Employment
- Full-time
- Level
- Senior Level
About the Role
Lenovo is seeking a Senior Quality Engineer to validate its new cross-device Personal AI, Qira, across mobile, device, and cloud environments. The role focuses on driving model evaluation pipelines, ensuring accuracy and safety, and maintaining robust automation frameworks for AI-driven features.
Skills
Perks
- Hybrid Work
- Bonus
Full job details
Why Work at Lenovo
Description and Requirements
About Our Team
We are looking for an Senior Quality Engineer with solid experience testing mobile, device, or cloud systems. This role focuses on writing tests, maintaining automation, validating features, and identifying issues early. You will work closely with developers, product teams, and senior QEs to ensure strong test coverage and quality across Qira.
We recently introduced Qira, our new cross‑device Personal AI that works seamlessly across Lenovo and Motorola products. More information can be found here: https://news.lenovo.com/pressroom/press-releases/lenovo-unveils-lenovo-and-motorola-qira/
Location: San Jose, CA OR Chicago, IL, Hybrid (3 days onsite and 2 days remote)
What You'll Do
- Write and execute functional, regression, integration, and exploratory tests.
- Test Qira features across device, mobile, and cloud environments.
- Help maintain and expand automated test suites.
- Validate AI workflows, cross‑device features, and user scenarios.
- Reproduce, document, and track defects through resolution.
- Analyze logs, crashes, and behaviors to support engineering teams.
- Provide quality status during testing cycles and release checkpoints.
- Drive model and agent evaluation pipelines, including accuracy, latency, grounding, hallucination detection, safety checks, and guardrail tests.
Basic Qualifications
- 8+ years in Quality Engineering or Software Testing.
- Bachelor's Degree in Engineering or Technical Discipline.
- Experience writing structured test cases and performing manual and automated tests.
- Basic automation experience (Python, Java, JavaScript, or similar).
- Experience testing Android (Mobile and Tablets), Windows (PC), or cross‑device applications.
- Hands-on experience testing AI models, RAG/LLM systems, perception models, or agentic behaviors.
Preferred Qualifications
- Experience testing AI‑driven features or task workflows.
- Familiarity with automated test frameworks and CI/CD pipelines.
- Exposure to performance or reliability testing.
- Familiarity with cloud systems, logs, and debugging tools.
- Strong communication and documentation skills.