Overview

Are you a customer-obsessed, AI-curious problem-solver who thrives in an inclusive, collaborative global team? The Azure Engineering Operations (EngOps) team's mission is to transform Microsoft Cloud customers into fans. Through our deep engineering engagements with customers and teams across Microsoft, we analyze and amplify customer needs and drive the vision to improve Cloud quality, security, and reliability. Our culture of growth mindset and empowerment are central to who we are and how we work.

Our ACES engineering team is at the heart of delivering scalable, intelligent, AI-powered solutions that transform the Azure customer support experience. We are seeking an Applied AI II Engineer to join the team and help build the next generation of agentic AI services that resolve customer issues faster, reduce support volume, and power AI-first support at Azure scale. You will take product specifications and turn them into production-ready, scalable AI services — working with LLM orchestration, multi-agent coordination, and RAG-based systems. You will ship production services that directly impact Azure customers.

Every day, our customers stake their business and reputation on our cloud. You can help Azure EngOps provide our customers with the world-class cloud services they need to succeed.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Translate product specifications into AI service architectures — decompose business intent into agent workflows, data source integrations, and scalable
service designs.

• Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations,
and agent lifecycle management.

• Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipeline design.

• Build evaluation systems including rubrics, golden datasets, and judge agents to validate agent correctness and safety before production deployment.

• Write production-quality C# and Python with test-driven development, ensuring services meet reliability, performance, and security standards.

• Deploy services using CI/CD pipelines, feature flags, and staged rollouts with full production observability (tracing, logging, metrics).

• Implement secure service patterns including RBAC, Managed Identities, and secrets management.

• Integrate agents with Azure data sources and cloud-native services to ground agent responses in real-time signals.

• Apply Responsible AI practices across all agent development, ensuring outputs are safe, fair, and compliant.

• Execute reliably within sprint and co-development commitments across ACES and partner engineering teams.

• Own the end-to-end lifecycle of AI service components, including design, development, testing, deployment, monitoring, and incident response.

Qualifications

Required qualifications

Bachelor's Degree AND 2+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience.

Additional or preferred qualifications

Bachelor's Degree AND 5+ years experience in low-code application development, engineering product/technical program management, data analysis, or product development OR equivalent experience.
1+ year(s) of experience using low-code/no-code platforms (e.g., Dataverse, Power Applications).
1+ year(s) of experience managing and configuring artificial intelligence solutions (e.g., chatbots).
1+ year(s) of experience with programming/coding.
• Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies).
• Experience with CI/CD pipelines, automated testing, and production observability.
• Understanding of data structures, algorithms, and system design fundamentals.

#EngOps #EngOpsACES

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Applied AI Engineer II

About the Role

Skills

Full job details

Not the right fit?

Similar Jobs

Sr. AI Engineer

AI / ML Engineer

AI Developer II

Software Engineer Responsible AI

Member of Technical Staff, Applied AI Engineer

Senior Generative AI Engineer

AI Engineer I - Hybrid

AI Engineer

Agentic AI Developer

AI Engineer