Senior Data Engineer
Job Description
Senior Data Engineer
Role Description
We are seeking a skilled and experienced Senior Data Engineer with a strong focus on Databricks to join our team. The ideal candidate will have expertise in Python/Pyspark, CI/CD pipelines, and hands-on experience with Databricks to design, implement, and optimize scalable data solutions.
This role will be based in our Guildford office with office attendance expected fortnightly on a Wednesday.
Salary Information
Pay: Circa £74,000 per year.
Pay is based on relevant experience, skills for the role, and location. Salary is only one part of our total reward package.
About You
- You will be leading solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog.
- Develop, implement, test, and document scalable ETL (Extract, Transform, Load) data pipelines and workflows using Databricks / Synapse to efficiently ingest and transform data from various sources.
- Work collaboratively with testers to ensure automated test plans are in place and agree on test packs for UAT.
- Ensure solution designs align with the Allianz Data Technology Strategy, maintaining and enhancing Allianz standards and Service Excellence.
- Implement robust data security measures and ensure compliance with data privacy regulations.
- Peer reviews the work of colleagues and take accountability for the quality of deliverables within the squad.
- Identify and address performance bottlenecks and data quality issues to ensure data accuracy and reliability.
- Collaborate with stakeholders and analysts to understand data requirements and deliver clean, reliable, and accessible data.
- Stay up to date with industry trends and best practices in data engineering, driving continuous improvement and innovation.
Essential Skills
- Databricks Expertise: Proven hands-on experience with Databricks, including building and optimizing data pipelines, managing Delta Lake, and leveraging Databricks features for scalable data solutions.
- Python Proficiency: Strong programming skills in Python / Pyspark for data engineering tasks, including data processing, automation, and scripting.
- CI/CD Knowledge: Experience designing and implementing CI/CD pipelines for data engineering using tools like Azure DevOps, GitHub Actions, or similar platforms.
- Cloud-Native Data Engineering: Experience with data modelling and ETL/ELT frameworks in a cloud-native environment, particularly on Azure.
- Big Data File Formats: Hands-on experience with big data file formats like Parquet and Delta Lake.
We support the government scheme “Access to Work” please feel free to ask us about the access to work scheme.
Desirable Skills
- Responsible Artificial Intelligence usage.
- Familiarity with event-driven architectures (e.g., Kafka).
- Knowledge of AI tools and their application in data engineering.
- Knowledge of the UK Insurance Market.
- Strong analytical and data interpretation skills, with the ability to communicate findings effectively to both technical and non-technical audiences.
- Excellent problem-solving skills and attention to detail, with a focus on delivering high-quality solutions.
What We Will Offer You
Recognised and rewarded for a job well done, we have a range of flexible benefits for you to choose from- so you can pick a package that’s perfect for you. We also offer flexible working options, global career opportunities across the wider Allianz Group, and fantastic career development and training. That’s on top of enjoying all the benefits you’d expect from the world’s number one insurance brand, including:
- Flexible buy/sell holiday options
- Hybrid working
- Annual performance related bonus
- Contributory pension scheme
- Development days
- A discount up to 50% on a range of insurance products including car, home and pet
- Retail discounts
- Volunteering days
Our Ways of Working
Do you need flexibility with the hours you work? Let us know as part of your application and if it’s right for our customers, our business and for you, then we’ll do everything we can to make it happen. Here at Allianz, we are signatories of the ABIs flexible working charter. We believe in supporting hybrid work patterns, which balance the needs of our customers, with your personal circumstances and our business requirements. Our aim with this is to help innovation, creativity, and you to thrive - Your work life balance is important to us.
Integrity, Fairness, Inclusion & Trust
At Allianz, we believe in fostering an inclusive workforce and are proud to be an equal opportunity employer. Our commitment to equal opportunities, gender equity, and balanced gender representation, is demonstrated by our numerous accreditations: EDGE certified for gender inclusion, Women in Finance Charter members, Disability Confident employer, Stonewall Diversity Champion, Business in the Community’s Race at Work Charter signatories, and Armed Forces Covenant gold standard employer.
We embrace neurodiversity and welcome applications from neurodivergent and disabled candidates, offering tailored adjustments to ensure your success.
We encourage our employees to advocate for their needs, whether it’s assistive technology, ergonomic equipment, mentoring, coaching, or flexible work arrangements.
Accessible Application for All
As part of the Disability Confident Scheme, we support candidates with disabilities or long-term health conditions through the Offer an Interview Scheme, for those meeting the essential skills for the role.
Contact our Resourcing team to opt into this scheme or for assistance with your application, including larger text, hard copies, or spoken applications.
For any inquiries or to submit your application, please contact: Matthew Irvine
Closing date 11/6/2026
We reserve the right to close the advert early if we reach enough applications.
#LI-Hybrid
Join us - Let’s Care for Tomorrow.
98992 | Data & AI | Professional | Non-Executive | Allianz UK | Full-Time | Permanent
Join us - Let’s Care for Tomorrow.
#LI-Hybrid