Skip to content
AI Engineer Jobs

Software Engineer - Inference Product

Baseten

Location
Onsite (San Francisco, California)
Compensation
$200k - $400k/yr
Employment
Full-time
Level
Mid Level
Posted 3 days ago

About the role

Baseten is an AI infrastructure platform enabling companies to bring cutting-edge models into production. This role involves building and operating the high-scale API layer for Model APIs, focusing on authentication, rate limiting, metering, and billing to ensure reliable and performant inference services.

Skills

Distributed systems Backend infrastructure API development Rate limiting Authentication Capacity planning Observability Performance profiling SLO management Kubernetes Service meshes API gateways Distributed scheduling Autoscaling Inference engineering

Benefits

  • Medical
  • Dental
  • Vision
  • 401k
  • PTO
  • Parental Leave

Perks

  • Equity
  • Flexible PTO
  • Winter Break
  • Family Stipend

Full job details