Hiring activity
Hiring Right Now
- Total open jobs
- 55
- Onsite jobs
- 45
- Hybrid jobs
- 7
- Remote jobs
- 3
Inference Engineer jobs
Inference Engineer Jobs
Owns model serving, runtimes, and production inference, optimizing latency, throughput, and quantization.
Role market
Inference Engineer Hiring at a Glance
In-demand skills
Skills Employers Want Most
Based on current active Inference Engineer jobs across this site.
-
Python 67% · 37 jobs
-
C++ 51% · 28 jobs
-
CUDA 44% · 24 jobs
-
PyTorch 44% · 24 jobs
-
Distributed systems 42% · 23 jobs
-
Machine learning 40% · 22 jobs
-
vLLM 31% · 17 jobs
-
Kubernetes 22% · 12 jobs
Hiring now
Top Inference Engineer Jobs
ML Engineer, Inference Optimization
Build AI
Onsite (San Francisco, California)
$200k - $320k/yr
Full-time
3 benefits
+ 6 perks
Machine learning
Inference optimization
Python
C++
+11 more
Senior Software Engineer (AI Inference & Runtime Platform)
AZX
Remote (Seattle, Washington)
$140k - $225k/yr
Full-time
2 benefits
+ 3 perks
Rust
Kubernetes
Python
FastAPI
+12 more
Senior AI Engineer, High Performance AI
NVIDIA
Onsite (Redmond, Washington)
$152k - $241k/yr
Full-time
1 benefits
+ 1 perks
AI systems development
CUDA
C++
Python
+11 more
Senior Lead AI Engineer (GenAI Platform Services, Agentic Platform)
Capital One
Onsite (San Jose, California)
$250k - $286k/yr
Full-time
5 benefits
+ 3 perks
Artificial Intelligence
Machine Learning
Python
Go
+11 more
Principal Software Engineer - LLM Optimization
JPMorgan Chase & Co.
Onsite (Jersey City, NJ)
$204k - $285k/yr
Full-time
6 benefits
+ 2 perks
LLM inference
GPU architecture
Quantization
Speculative decoding
+12 more
AI Inference Engineer
F5
Onsite (San Jose, California)
$176k - $265k/yr
Full-time
4 benefits
+ 3 perks
Python
C++
Rust
Golang
+12 more