Skip to content
AI Engineer Jobs

Machine Learning Engineer, Inference & Serving (Speech LLM)

IntelliPro Group Inc.

Location
Hybrid (San Francisco, CA)
Compensation
$170k - $320k/yr
Employment
Full-time
Level
Senior Level
Posted 1 week ago

About the role

IntelliPro Group is seeking a Machine Learning Engineer to build and deploy high-throughput, ultra-low-latency inference systems for large language and foundational speech models. The role focuses on optimizing performance on GPU clusters and collaborating between core ML training and backend infrastructure teams.

Skills

Machine learning Inference systems Large language models Speech models GPU architecture C++ Python Kubernetes TensorRT-LLM vLLM NVIDIA Triton WebSockets WebRTC Quantization Distributed systems Performance optimization

Benefits

  • Health insurance
  • Dental insurance
  • Vision insurance
  • 401(k) plan
  • Unlimited PTO
  • Paid holidays
  • Paid parental leave

Perks

  • Equity
  • Performance bonus
  • Hybrid Work

Full job details