Hiring activity
Hiring right now
- Total open jobs
- 154
- Onsite jobs
- 97
- Hybrid jobs
- 50
- Remote jobs
- 7
Inference Engineer jobs
Inference Engineer Jobs
Owns model serving, runtimes, and production inference, optimizing latency, throughput, and quantization.
Role market
Inference Engineer hiring at a glance
In-demand skills
Skills employers want most
Based on current active Inference Engineer jobs across this site.
-
Python 75% · 116 jobs
-
C++ 60% · 93 jobs
-
PyTorch 41% · 63 jobs
-
CUDA 38% · 58 jobs
-
Distributed systems 36% · 56 jobs
-
Machine Learning 30% · 46 jobs
-
Performance profiling 25% · 38 jobs
-
vLLM 25% · 38 jobs
Hiring now
Top Inference Engineer Jobs
Senior Inference Engineer
Uniphore
Onsite (USA - CA - Palo Alto, California)
$200k - $350k/yr
Full-time
7 benefits
+ 2 perks
Python
C++
CUDA
GPU profiling
+12 more
Staff Inference Engineer
Uniphore
Onsite (USA - CA - Palo Alto, California)
$200k - $350k/yr
Full-time
7 benefits
+ 2 perks
GPU systems
Distributed inference
ML serving
Python
+12 more
Senior/Staff Software Engineer (Back-End), Inference
Cohere
Onsite (Canada)
$205k - $315k/yr
Full-time
6 benefits
+ 7 perks
Distributed systems
Go
Python
Java
+12 more
Senior Staff Software Engineer, AI Model Enablement & Software Tools
Qualcomm
Onsite (San Diego, CA,US)
$194k - $291k/yr
Full-time
3 benefits
+ 2 perks
Python
C++
PyTorch
ONNX
+12 more
AI Model Optimization Engineer
Intel Corporation
Hybrid (USA - CA - Santa Clara, California)
$149k - $275k/yr
Full-time
3 benefits
+ 2 perks
Python
C++
PyTorch
TensorFlow
+12 more
Senior Staff Inference Performance Engineer
d-Matrix
Remote (Santa Clara, California)
$175k - $265k/yr
Full-time
4 benefits
+ 3 perks
Performance engineering
Systems engineering
Linux internals
NUMA
+11 more