Hiring activity
Hiring Right Now
- Total open jobs
- 57
- Onsite jobs
- 50
- Hybrid jobs
- 4
- Remote jobs
- 3
Inference Engineer jobs
Inference Engineer Jobs
Owns model serving, runtimes, and production inference, optimizing latency, throughput, and quantization.
Role market
Inference Engineer Hiring at a Glance
In-demand skills
Skills Employers Want Most
Based on current active Inference Engineer jobs across this site.
-
Python 68% · 39 jobs
-
C++ 44% · 25 jobs
-
Machine learning 44% · 25 jobs
-
PyTorch 39% · 22 jobs
-
Distributed systems 37% · 21 jobs
-
CUDA 33% · 19 jobs
-
vLLM 30% · 17 jobs
-
Kubernetes 25% · 14 jobs
Hiring now
Top Inference Engineer Jobs
Senior Solutions Architect – Large Scale AI Inference
NVIDIA
Onsite (Clermont-Dessous, Nouvelle-Aquitaine)
$292k - $507k/yr
Full-time
1 benefits
+ 1 perks
AI inference
Neural networks
Transformer optimization
Quantization
+12 more
Staff AI/ML Engineer, AI Rapid Response Team
Onsite (Mountain View, CA)
$207k - $300k/yr
Full-time
1 benefits
+ 2 perks
Software development
Machine learning
C++
Python
+12 more
Research Engineer (LLM Performance), London
Isomorphic Labs
Hybrid (London, England)
Full-time
1 perks
Large scale distributed training
LLM
JAX
PyTorch
+12 more
Senior/Principal AI Optimization Software Engineer - Multiple roles
Microsoft
Hybrid (Israel)
Full-time
1 perks
C++
Python
AI Optimization
AI Kernels
+12 more
Principal AI Optimization Software Engineer Lead
Microsoft
Hybrid (Israel)
Full-time
1 perks
C++
Python
AI Optimization
Machine Learning
+12 more
AI SDK Software Engineer
Qualcomm
Onsite (Shanghai, Shanghai,CN)
Full-time
C++
Python
Deep Learning
Neural Networks
+12 more