Senior AI Platform & Software Engineer (m/f/d)

Didn't find a suitable job?

Here's how to win us over

How to impress us

Who we're looking for

Your mission

• Software Development and Integration: You will develop and enhance innovative software solutions for our Validas products, internal tools, and business processes. In this role, you will integrate modern AI capabilities into existing applications using secure APIs, services, and workflows.
• AI and LLM Platform: You will design, operate, and continuously improve our internal AI and LLM infrastructure. In addition, you will deploy and manage self-hosted Large Language Models as inference services and evaluate suitable models, model formats, and quantization techniques.
• Performance and Operations: You will optimize context handling, KV cache and memory consumption, throughput, latency, and hardware resource utilization. You will also ensure reliable operations through monitoring, backup and recovery processes, and proactive capacity planning.
• Linux, GPU, and Infrastructure: You will administer the underlying Linux systems and manage GPU and accelerator hardware, including drivers, primarily the CUDA toolkit and driver stack. Furthermore, you will support multi-GPU configurations and hardware upgrades.
• Security and Governance: You will protect our AI infrastructure against prompt injection, data leakage, and misuse by implementing guardrails and content filters, and you will secure the platform through RBAC, SSO, audit logging, and secrets management.
• Documentation, Architecture and Quality: You will create technical specifications, operational documentation, and security designs, while contributing to architectural decisions. In addition, you will ensure the quality, stability, and maintainability of our systems through testing, code reviews, monitoring, and structured root cause analysis.

Your profile

• A degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, or a comparable field; alternatively, a vocational qualification in IT combined with relevant professional experience.
• Several years of experience in software development, AI engineering, system administration, or the operation of production-grade IT systems.
• Strong Linux skills, along with experience working with APIs, internal services, and distributed systems.
• A solid understanding of modern AI and machine learning concepts, particularly in the areas of LLMs, embeddings, inference service integration, and agentic workflows / RAG pipelines.
• Solid knowledge of security principles, access control concepts, authentication mechanisms, and the secure operation of IT systems.
• Strong analytical thinking, a pragmatic approach to problem-solving, and a passion for turning emerging technologies into robust, practical solutions.
• Good written and spoken German and English skills.

• Experience operating LLM-based systems, AI serving frameworks, or tools such as vLLM, TGI, llama.cpp, or NVIDIA Triton, or comparable technologies.
• Knowledge of model formats, quantization, tokenization, context windows, LoRA, and performance optimization techniques for AI systems.
• Hands-on experience with GPU or accelerator hardware, device drivers, the CUDA toolkit and driver stack, GPU memory management, and multi-GPU configurations.
• Experience with monitoring, backup and recovery, capacity planning, and the operation of business-critical systems.
• Understanding of AI-specific security risks, including prompt injection, data leakage, insecure tool usage, and excessive agent permissions.

We offer

• Attractive compensation 
• Flexible working hours & option for home office
• Company pension scheme
• Individual training opportunities
• Flat hierarchies, short decision-making paths
• Casual work environment with employees from 20+ different nations
• Regular team events
• Spacious, light-filled, and modern office spaces
• Convenient location directly at the S-Bahn station Hackerbrücke in the heart of Munich
• Pool table, games, drinks, and a high-end coffee machine

About us