Skip to content
AI Engineer Jobs
Verda

Senior Backend Engineer – LLM Inference

Verda

Location
Remote (Helsinki, EMEA · London, EMEA · Berlin, Uusimaa)
Employment
Full-time
Level
Senior Level
Posted 3 weeks ago

About the Role

Verda is building a full-stack AI cloud infrastructure, headquartered in Helsinki with global operations. This role involves designing and maintaining production backend services and Kubernetes-native applications to support reliable and scalable LLM inference.

Skills

Go Kubernetes Distributed systems PostgreSQL API design Concurrency Infrastructure Observability Helm SQL Cloud platform LLM inference Reliability engineering System architecture Automation

Benefits

  • Healthcare
  • Lunch
  • Wellbeing

Perks

  • Equity
  • Remote Work

Full job details

At Verda, we're building a full-stack AI cloud, covering everything from data centers and hardware to our own cloud platform that the world's leading AI teams use to do serious AI work.

We strive to make a positive mark on the world through the infrastructure we build and give leading teams a service they can truly depend on. Headquartered in Helsinki, we operate globally with offices in London and San Francisco.

Join Verda while it’s still being built - not once it’s finished.

About the role

At Verda, we are building the platform that makes LLM inference reliable and accessible on our AI cloud.

As a Senior Backend Engineer, you will develop backend services and Kubernetes-native applications that support our inference offering. You will work closely with infrastructure and AI engineering teams to improve the platform’s reliability, scalability and developer experience.

This is a hands-on role with ownership from design and implementation through deployment and production operation. You will help shape technical decisions as the platform grows.

Your responsibilities

  • Design, build and maintain production backend services in Go.

  • Develop Kubernetes-native applications and automation for reliable platform operations.

  • Build APIs and integrations that support our inference services and wider cloud platform.

  • Improve scalability, performance and reliability through testing, observability and operational improvements.

  • Collaborate across teams on technical design, delivery and production troubleshooting.

Your key competencies

  • Experience designing, shipping and operating production backend services, with the judgment to own work from an initial design through production rollout.

  • Strong Go experience. You have shipped and maintained production Go services and are comfortable with concurrency, context propagation, API design and error handling.

  • A solid understanding of asynchronous execution, concurrency, HTTP and long-lived connections. You can reason about timeouts, resource limits, cancellation and failure propagation.

  • Distributed systems experience, including caching, consistency, retries, idempotency and reliable event processing.

  • Strong SQL and relational data modelling skills, including transactions, schema migrations and PostgreSQL.

  • Hands-on Kubernetes-native development experience, including controllers or operators, custom resources and reconciliation loops. You understand idempotent reconciliation, desired versus observed state, retries and resource lifecycle handling.

  • Experience deploying and troubleshooting services on Kubernetes, including Helm, networking, readiness, configuration and safe rollouts.

  • A disciplined approach to validation: meaningful tests, load measurements and failure scenarios, with clear communication about what has and has not been verified.

  • Clear written English and the ability to explain design decisions, trade-offs and operational behavior to other teams.

Nice to have

  • Rust experience, particularly in asynchronous or network services.

  • Experience with API gateways, networking or traffic management.

  • Familiarity with LLM API protocols and inference systems such as vLLM, SGLang, NVIDIA Dynamo or llm-d.

  • Experience with Valkey/Redis, NATS JetStream or comparable distributed state and messaging systems.

  • Experience with reliable event processing or usage metering systems.

  • OpenTelemetry, Prometheus and capacity planning for workloads with variable request costs.

  • Service discovery, GitOps or deployments across multiple Kubernetes clusters and regions.

  • Python experience for integration with existing inference tooling.

Why Verda

  • Cash and equity compensation along with various fringe benefits (healthcare, lunch, wellbeing, and more).

  • Profitable operations with rapid, sustained growth.

  • 40+ nationalities, with 6 different ones on the management team.

  • A real chance to make an impact and work alongside world class engineers, researchers, and partners across the global AI ecosystem.

Practicalities

  • Work mode: Based in Helsinki, Finland or London, UK or remote in Europe

  • Level: Senior

  • Employment type: Full time and permanent

What's next

We're building fast and this role needs the right person behind it. There's no artificial deadline, but when we find who we're looking for, we move. If this sounds like your next move, apply now.

Please submit your application through our Careers page. We don't accept applications sent by email.