Senior AI Engineer (Applied AI / LLM & RAG)
Job Description
Line of Service
Internal Firm ServicesIndustry/Sector
Not ApplicableSpecialism
IFS - Internal Firm Services - OtherManagement Level
Senior AssociateJob Description & Summary
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to deliver innovative software products and solutions.In technology delivery at PwC, you will focus on implementing and delivering innovative technology solutions to clients, enabling seamless integration and efficient project execution. You will manage the end-to-end delivery process and collaborate with cross-functional teams to drive successful technology implementations.
Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn’t clear, you ask questions, and you use these moments as opportunities to grow.
Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
- Respond effectively to the diverse perspectives, needs, and feelings of others.
- Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.
- Use critical thinking to break down complex concepts.
- Understand the broader objectives of your project or role and how your work fits into the overall strategy.
- Develop a deeper understanding of the business context and how it is changing.
- Use reflection to develop self awareness, enhance strengths and address development areas.
- Interpret data to inform insights and recommendations.
- Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.
About the role
We are looking for a Senior AI Engineer to design, build and productionize enterprise-grade AI applications, with a strong focus on LLM-based solutions (commercial models), RAG pipelines, document automation, and integration with existing products and platforms. This role will complement a team with strong DevOps, fullstack and backend capabilities by bringing deep expertise in LLMOps, evaluation, AI architecture, and hands-on delivery of production AI systems operating under real-world traffic and reliability constraints.
What you’ll do (responsibilities)
Design and implement AI-powered features and applications (assistants, enterprise search, Q&A over documents, extraction/classification, workflow automation).
Build robust integrations with commercial LLM APIs (e.g., Azure OpenAI/OpenAI) using Python, including streaming, function calling/tool use, error handling and cost controls.
Architect and develop RAG end-to-end: embeddings and indexing (vector/hybrid search), retrieval, reranking, citations/grounding, “no-answer” patterns.
Establish LLMOps practices: prompt/version management, automated evaluations and regression tests, tracing/observability, monitoring and alerting, deployment patterns and runbooks.
Define and implement security & governance controls for enterprise environments:
RBAC/ABAC and document-level permissions, PII handling (redaction/masking),
mitigation of prompt injection and data exfiltration, auditability and compliance-ready logging.
Provide technical leadership to full-stack developers by defining end-to-end AI architecture, set implementation patterns, and guiding delivery of production-ready services (CI/CD, secrets, scaling, reliability). Produce high-quality technical documentation and contribute reusable components/accelerators for faster delivery.
What you’ll bring (minimum qualifications)
Strong software engineering skills with Python (API development, clean code, testing).
Experience integrating external APIs and building backend services (REST, auth, retries, rate limiting).
Hands-on experience building LLM applications using commercial model APIs.
Proven ability to provide technical leadership to full-stack developers, including designing end-to-end AI architecture and guiding implementation decisions. Hands-on experience deploying AI models and services to production environments, including operating under real-world traffic, performance, reliability, and monitoring requirements.
Hands-on experience with Document AI, data ingestion pipelines, and unstructured data processing for document-centric automation use cases.
Preferred qualifications
Experience with Azure services (Azure OpenAI, Azure AI Search, Storage, Key Vault, Functions/App Service/Container Apps).
Familiarity with frameworks such as LangChain / LlamaIndex / Semantic Kernel (or equivalent).
Experience with hybrid search, reranking, evaluation frameworks, and observability (OpenTelemetry or similar).
Experience with advanced AI architecture such as Multi-Agent Systems (MAS) or advanced approaches, including graph-based RAG.
Prior work in regulated/enterprise environments and/or consulting delivery models.
Key skills (summary)
Python, FastAPI/Flask, testing (pytest), Git
LLM APIs, prompt engineering, function calling/tool use
RAG: chunking, embeddings, vector DB/search, hybrid retrieval, reranking, citations, grounding, evaluation.
LLMOps: prompt/versioning, evaluation, monitoring, tracing
Document AI, OCR, ingestion pipelines, unstructured data processing Security: PII, access control, prompt injection mitigations
Architecture & leadership: end-to-end AI system design, technical guidance for full-stack teams
Cloud & DevOps: Docker, CI/CD, logging/metrics, scalable deployment
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications (if blank, certifications not specified)
Required Skills
Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Client Management, Communication, Creativity, Deliverable Planning, Delivery Management, Developing User Stories, Embracing Change, Emotional Regulation, Empathy, Inclusion, Intellectual Curiosity, IT Business Strategy, IT Consulting, IT Infrastructure, IT Service Management (ITSM), IT Systems Development, Leading Design Workshops, Learning Agility, Market Research, Optimism, Process Improvement {+ 22 more}Desired Languages (If blank, desired languages not specified)
Travel Requirements
Up to 20%Available for Work Visa Sponsorship?
NoGovernment Clearance Required?
NoJob Posting End Date
July 31, 2026