Machine Learning Engineer, Evaluation, Agentic Search Capabilities
Apple
- Location
- Onsite (Cupertino, California)
- Employment
- Full-time
- Level
- Senior Level
Posted 6 days ago
About the role
Join Apple's Agentic Search team to redefine how users access information across devices with privacy-first personalized search. You will build scalable evaluation systems and metrics to improve Siri and Apple Intelligence experiences.
Skills
Machine Learning
Python
C++
Search Systems
NLP
Recommendation Systems
Information Retrieval
Data Generation
Data Quality Assessment
Metrics Development
Statistical Modeling
Software Engineering
Agentic Search
Personalized Search
System Scalability
Full job details
The Agentic Search team is redefining how hundreds of millions of people access information across Apple devices, with privacy built in from the ground up. As part of the Agentic Search Evaluation team, you will help advance Apple Intelligence through personalized search that powers experiences across Siri, Spotlight, Mail, Messages, and more. Your team researches and builds deep search systems for Personal Question Answering, enabling Siri to answer questions about a user's emails, messages, events, files, and more, while keeping personal data private.
We are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality solutions to evaluate personalized agentic search applications. In this role, you will directly impact how we assess and improve the quality of novel agentic search applications by driving solutions for data generation, data quality assessment, offline and online metrics, and methods for statistical model and search quality assessment. Your work will impact the quality of innovative Personalized Agentic Search experiences across Siri and Apple products. In this role you will have the opportunity to build scalable systems for comprehensive evaluation of personalized model and search systems, develop data generation and curation methodologies to support evaluations, and design online and offline metrics for product quality assessment. Our team is responsible for models and evaluation of search experiences that answer user’s questions using their personal documents with privacy at the forefront.
6+ years industry experience in building Machine Learning or ML evaluation systems at scale. Strong software engineering skills in mainstream programming languages, such as: Python, C/C++. Ability to quickly prototype ideas and solutions, and perform critical analysis. Strong communication skills and ability to drive solutions in collaboration with partner teams. Bachelors in Computer Science, Engineering, Statistics or related field.
Experience in design and building production ML systems and applications in search, NLP, recommendation systems, or information retrieval. Experience in data collection, data generation and/or data quality assessment of language, image or multi-modal data. Strong skills for quality metrics development; interpretation of evaluations; and presentation to executive audience. Advanced degree (Master’s or Ph.D.) in Computer Science, Engineering, Statistics, or related field, or equivalent industry work experience.
Description
We are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality solutions to evaluate personalized agentic search applications. In this role, you will directly impact how we assess and improve the quality of novel agentic search applications by driving solutions for data generation, data quality assessment, offline and online metrics, and methods for statistical model and search quality assessment. Your work will impact the quality of innovative Personalized Agentic Search experiences across Siri and Apple products. In this role you will have the opportunity to build scalable systems for comprehensive evaluation of personalized model and search systems, develop data generation and curation methodologies to support evaluations, and design online and offline metrics for product quality assessment. Our team is responsible for models and evaluation of search experiences that answer user’s questions using their personal documents with privacy at the forefront.
Minimum Qualifications
6+ years industry experience in building Machine Learning or ML evaluation systems at scale. Strong software engineering skills in mainstream programming languages, such as: Python, C/C++. Ability to quickly prototype ideas and solutions, and perform critical analysis. Strong communication skills and ability to drive solutions in collaboration with partner teams. Bachelors in Computer Science, Engineering, Statistics or related field.
Preferred Qualifications
Experience in design and building production ML systems and applications in search, NLP, recommendation systems, or information retrieval. Experience in data collection, data generation and/or data quality assessment of language, image or multi-modal data. Strong skills for quality metrics development; interpretation of evaluations; and presentation to executive audience. Advanced degree (Master’s or Ph.D.) in Computer Science, Engineering, Statistics, or related field, or equivalent industry work experience.