Skip to content
AI Engineer Jobs

Principal Software Engineer - AI Runtime & Distributed Inference Systems

International Recruiting LLC

Location
Onsite (San Jose, California)
Employment
Full-time
Level
Senior Level
Posted 1 week ago

About the role

International Recruiting LLC is seeking a Principal Software Engineer to architect large-scale AI inference systems on custom accelerators. This role leads the design of distributed runtimes, communication libraries, and scheduling infrastructure to serve frontier foundation models at datacenter scale.

Skills

Distributed Systems C++ Rust AI Infrastructure CUDA Triton Compiler Design Memory Management Collective Communication Performance Engineering Transformer Architectures MoE Systems Network Topology Kernel Optimization System Architecture Parallel Computing

Full job details