Skip to content
AI Engineer Jobs

Software Engineer II - AI Infrastructure

Microsoft

Location
Hybrid (Mountain View, CA,US · Redmond, WA,US)
Compensation
$102k - $219k/yr
Employment
Full-time
Level
Mid Level
Posted 2 days ago

About the role

Microsoft's Cloud + AI team is seeking a Software Engineer to design and build scalable, high-performance architectures for AI inference backends and API interfaces. This role enables secure, multimodal AI experiences for millions of customers while advancing the reliability and safety of AI platforms.

Skills

Distributed systems Scalable architecture API design Machine learning AI fundamentals Python C++ C# Rust Kubernetes Docker gRPC FastAPI Azure DevOps LangChain Semantic Kernel

Full job details

Overview
Software engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems.
 
You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You'll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms.
 
This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.



Responsibilities
  • Implement AI Systems: Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions.
  • Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.
  • Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
  • Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
  • Full-Stack Engagement: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.


Qualifications

Required Qualifications: 

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
     

Preferred Qualifications: 

  • Master's Degree in Computer Science or related technical field
    • AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field
    • AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions.
  • Familiarity with relevant tools, frameworks, or programming languages: Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, LangChain.
  • Optional experience with OpenAI API / Azure OpenAI.
  • Communication and collaboration abilities.
  • Problem-solving and decision-making under ambiguity.
  • Strategic thinking and adaptability.


Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.