Skip to content
AI Engineer Jobs

Principal Software Engineer - AI Inference and Serving (CoreAI)

Microsoft

Location
Hybrid (Redmond, WA,US)
Compensation
$142k - $331k/yr
Employment
Full-time
Level
Senior Level
Posted 5 days ago

About the role

Join Microsoft's CoreAI team to build and optimize the infrastructure for AI model training and inference at scale. As a Principal Software Engineer, you will lead the delivery of secure, high-performance inference services, improving capacity, cost, and latency for global customers.

Skills

C C++ C# Java JavaScript Python Distributed systems Model serving Kubernetes vLLM SGLang TensorRT-LLM Capacity planning Observability Tensor parallelism Quantization

Full job details