A
Machine Learning Engineer - AI & ML Evaluation Frameworks
Apple
- Location
- Onsite (Cupertino, California)
- Employment
- Full-time
- Level
- Mid Level
Posted 2 weeks ago
About the Role
Join Apple's Health Sensing Machine Learning Interpretability & Analytics team to build the next generation of scalable evaluation infrastructure for health features. You will develop cutting-edge tools and frameworks to ensure AI models are mathematically sound, demographically equitable, and clinically safe.
Skills
Machine Learning Engineering
Python
LLM Evaluation
Failure Analysis
Data Pipelines
CI/CD
Object-Oriented Programming
Synthetic Data Generation
Prompt Engineering
Model Interpretability
AI Safety
Multi-modal Sensor Fusion
Full job details
The Health Sensing Machine Learning Interpretability & Analytics (MLIA) team ensures clinical rigor and contextual trust are at the foundation of Apple’s health sensing features. We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations into model performance. You will develop cutting-edge tools, synthetic data pipelines, and automated frameworks that ensure our health features are mathematically sound, demographically equitable, and clinically safe. If you are passionate about AI safety, robust software architecture, and pushing the boundaries of ML innovation, come join us!
In this role, you will architect and build large-scale evaluation frameworks to interrogate unimodal ML systems and multi-modal foundation models. Beyond infrastructure, you will lead deep-dive ML evaluations, performing failure analysis to uncover performance gaps, reasoning flaws, and edge cases. You will translate findings into actionable insights and work directly with algorithm teams to improve the safety and reliability of our health features. Your work will empower teams across Apple to rapidly evaluate multi-modal sensor fusion while upholding Apple's privacy standards.
BS in Computer Science, Machine Learning, Statistics, or related field 3+ years of experience in ML Engineering or Applied ML Strong experience in evaluating supervised, unsupervised, LLMs and deep learning models. Proficiency in Python with the ability to write production-grade code (OOP, CI/CD, Git) Hands-on experience in failure analysis, evaluating LLMs and driving subsequent model improvements Experience building data pipelines, inference frameworks, and automated evaluation systems Strong communication skills to articulate complex technical concepts across technical and non-technical audiences
MS/PhD in Computer Science, Machine Learning, Statistics, or related field Experience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation) Experience with synthetic data generation and prompt engineering Experience in parallel data processing (Spark, Kubernetes, Airflow) or privacy-preserving ML (Federated Learning) Background in AI Safety, model interpretability, or adversarial testing Interest in digital health and clinical rigor
Description
In this role, you will architect and build large-scale evaluation frameworks to interrogate unimodal ML systems and multi-modal foundation models. Beyond infrastructure, you will lead deep-dive ML evaluations, performing failure analysis to uncover performance gaps, reasoning flaws, and edge cases. You will translate findings into actionable insights and work directly with algorithm teams to improve the safety and reliability of our health features. Your work will empower teams across Apple to rapidly evaluate multi-modal sensor fusion while upholding Apple's privacy standards.
Minimum Qualifications
BS in Computer Science, Machine Learning, Statistics, or related field 3+ years of experience in ML Engineering or Applied ML Strong experience in evaluating supervised, unsupervised, LLMs and deep learning models. Proficiency in Python with the ability to write production-grade code (OOP, CI/CD, Git) Hands-on experience in failure analysis, evaluating LLMs and driving subsequent model improvements Experience building data pipelines, inference frameworks, and automated evaluation systems Strong communication skills to articulate complex technical concepts across technical and non-technical audiences
Preferred Qualifications
MS/PhD in Computer Science, Machine Learning, Statistics, or related field Experience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation) Experience with synthetic data generation and prompt engineering Experience in parallel data processing (Spark, Kubernetes, Airflow) or privacy-preserving ML (Federated Learning) Background in AI Safety, model interpretability, or adversarial testing Interest in digital health and clinical rigor