Back to jobs
Why This Role Matters
Job Description
AI DevOps Engineer (f/m/d)
Department: osapiens Terra
Employment Type: Permanent - Full Time
Location: Mannheim
Description
We’re looking for an AI Development Operations Engineer to build and operate the internal AI infrastructure that empowers our developers to work smarter and ship faster. You will integrate cutting-edge AI systems like Claude, Codex and next-generation agentic frameworks directly into engineering workflows, making AI a natural part of how we design, build and maintain software.
Why This Role Matters
AI assisted development is reshaping modern engineering. In this role, you’ll architect and run our core AI developer platform, from ingestion pipelines and vector search to context assembly, RAG systems and agent skill libraries. You’ll embed AI seamlessly into IDEs, CI/CD pipelines, code reviews and architectural decisions, enabling teams to tackle tasks like refactoring, debugging, test generation and security scanning with powerful agentic capabilities. At the same time, you will ensure that the platform operates securely, reliably, and responsibly. Your work defines how quickly—and how well—our engineers build the next generation of our product.
Your Responsibilities
Platform Engineering
- Design and operate our end-to-end AI platform (RAG pipelines, retrieval, indexing, embeddings, vector DBs).
- Build MCP Servers, extensions and integrations for IDEs, CI/CD systems and internal tooling.
- Create orchestration interfaces that allow AI agents to interact safely with internal systems.
Agent Skills & Automation
- Develop reusable agent skills for architecture reasoning, secure coding, test generation, debugging and more.
- Maintain and evolve a skill library aligned with engineering needs and platform adoption.
AI Powered Developer Experience
- Automate code review, CI checks and troubleshooting with LLM-based workflows.
- Provide context aware knowledge retrieval across codebases, logs, docs, incidents and design artifacts.
Governance & Reliability
- Define guidelines for prompt engineering, model evaluation and cost optimization.
- Implement monitoring, audit logging, performance tracking and access controls.
Collaboration
- Partner closely with engineering, product and qa-teams.
- Communicate platform strategy and progress to leadership.
- Support developers in adopting and maximizing AI based workflows.
Your Experience
Technical Skills
- Strong software engineering background (Python + one systems language like Typescript / Java).
- Experience with LLM APIs (OpenAI, Claude, Gemini) and agent frameworks (LangChain, LlamaIndex).
- DevOps/MLOps expertise: Kubernetes, Docker, CI/CD, observability.
- Cloud architecture experience (AWS/GCP/Azure) optimized for AI workloads.
- Hands-on knowledge of retrieval systems and vector databases (Pinecone, Weaviate, etc.).
- Solid understanding of security, compliance and safe AI usage.
Additional Strengths
- Experience with knowledge graphs, largescale ingestion pipelines, finetuning or advanced prompting.
- Background in developer experience, internal platforms or productivity engineering.
- Proven technical leadership and strong cross functional collaboration skills.
Your Mindset
You thrive as a cross functional partner who aligns naturally with engineering, product, design, security and leadership. You communicate technical strategies clearly, shape actionable roadmaps and enable developers through practical guidance, training and strong documentation. Rapid prototyping, fast iteration and evaluating new models for real impact are core elements of how you work.
What Success Looks Like
What Success Looks Like
Within your first 12 months, you will have:
- Delivered a production ready AI developer platform with strong adoption.
- Built a library of agent skills used across engineering teams.
- Established evaluation, governance and best practices for safe, scalable AI usage.
- Acted as the strategic bridge between development teams and leadership for AI adoption.
Join us for this and more...
- A purpose-driven mission tackling complex sustainability challenges while working alongside global industry pioneers at a fast-growing unicorn company
- Room for creativity through collaborative teamwork and an open communication culture
- Flexibility and team bonding with our hybrid work options
- Fuel for your growth journey, both personally and professionally
- Sustainable mobility options, promoting eco-friendly commuting solutions
- Fun team events and outings with our global teams
- Inspiring workspaces in Mannheim, Munich and Madrid