Skip to content
AI Engineer Jobs

Cloud Inference Engineer

Luminal

Location
Onsite (San Francisco, California)
Compensation
$150k - $250k/yr
Employment
Full-time
Level
Mid Level
Posted 1 week ago

About the role

Luminal is building an AI compiler and serving stack to make models 10x faster and production ready. As a founding engineer, you will ship low latency, high throughput model serving on Luminal Cloud.

Skills

CUDA GPU Inference Optimization vLLM SGLang TensorRT-LLM KV Caching Paged Attention Batching Token Streaming Distributed Compute Model Performance Review Scheduler Optimization Autoscaling Latency Profiling Kernel Development

Perks

  • Equity

Full job details