Back to jobs

Lead Data Engineer
London, United KingdomPosted 3 months ago
Full-timehybridMid-Senior Level
Job Description
Please Note that this is a 4 Day Work from Office Role in Central London & 1 Day work from Home
Key Responsibilities
- Feature development, issue resolution, and daily monitoring on cloud delta lakehouse data platform.
- Operate as part of an agile technical team participating in all agile team ceremonies such as daily stand up meetings and backlog refinement sessions.
- Lead Architectural decisions, mentor junior engineers and contribute to establishing engineering standards, documentation, and reusable frameworks.
Experience
- Overall 10+yrs experience in data engineering.
- At least five years of experience working in a data warehouse solution landscape.
- Proven ability to lead complex data initiatives and drive architectural decisions.
- Experienced with agile delivery methodologies, ideally SCRUM/Kanban.
- Be able to assume ownership of data issues, perform investigation and root cause analysis, and implement remediation through code and data changes.
- Understanding of data warehouse testing strategies and quality assurance processes.
- Good understanding of git branching strategies and code management.
- Good understanding of technical release management processes in Azure DevOps.
- Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency within teams.
- A bachelor's or master's degree in computer science, data management, information systems industry approved; relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)
Tech Stack
- SQL Server, SSIS, T-SQL
- ADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lake