Staff UX Quantitative Researcher, Agentic AI Ad Sales

Minimum qualifications:

• Bachelor's degree in Human-Computer Interaction, Cognitive Science, Statistics, Psychology, Anthropology, a related field, or equivalent practical experience.
• 8 years of experience in an applied research setting, or similar.
• Experience in programming languages used for data manipulation and computational statistics (e.g., Python, R, MATLAB, C++, Java, or Go).
• Experience with agentic AI evaluation: evaluating multi-agent architectures, agentic workflows, orchestrators, or subagent routing systems.

Preferred qualifications:

• 8 years of experience conducting UX research on products.
• 5 years of experience managing projects, and working in a large, matrixed organization.
• Experience developing evaluation rubrics for human raters and AI models.
• Experience with advanced statistical and psychometric modeling.
• Expertise in multivariate experimental design and methods for causal inference.

About the job:

At Google, we "Focus on the user and all else will follow." As a User Experience Researcher (UXR), you make this possible. You will join our multi-disciplinary UX team, collaborating with Engineering and Product Management, to gather insights and create industry-leading products.

You’ll play a critical role in helping your team understand user needs and will drive impact at all stages of product development, ensuring products are useful, usable, and helpful. You will explore user behaviors and motivations by conducting primary research, including: field studies, interviews, diary studies, ethnography, surveys, usability testing, and logs analysis. You will also grow within a supportive UXR community offering mentorship, regular meetups, and exclusive internal tools.

Google Ads is at the forefront of AI innovation, applying cutting-edge machine learning and Generative AI models like Gemini to power a multi-billion dollar global business.

Our work directly impacts billions of users by protecting users from harm, improving ad quality, and optimizing campaigns for advertiser return-on-investment. We foster a culture of deep collaboration, partnering closely with teams like Google Research and DeepMind to solve complex challenges. Join us to work on state-of-the-art AI, take on problems at an unparalleled scale, and build the next generation of advertising technology.

Responsibilities:

• Apply statistical methods (e.g., statistical inference, regression modeling, experimental design) to analyze large-scale log data, survey data, and other behavioral data.
• Partner with product managers, engineers, and designers to identify research opportunities, define user-centered success metrics, and ensure appropriate data instrumentation.
• Translate complex findings into actionable insights and communicate them effectively to cross-functional stakeholders at various levels. Ensure research doesn't just result in a report, but in a shipped product that moves the needle on revenue and seller effectiveness.
• Collaborate with qualitative UXRs, data scientists, and business analysts to triangulate findings and provide a holistic view of the user experience.
• Design and analyze human and synthetic evaluation systems, applying crossed rater/item statistical models and bradley-terry preference frameworks to calibrate agent routing quality and mitigate rater bias.