Senior Data Engineer

We are seeking an experienced and ambitious Senior Data Engineer to join our core data team within MSC's cross-country IoT department. This is a unique opportunity for a hands-on engineer who is passionate about building robust data solutions and eager to grow into a broader role as a Data Lead or Data Architect. Our small and agile data team operates within the 50-person IoT department, with members based in Antwerp, Turin, and Chennai. In this role, you will play a pivotal part in shaping our data landscape, from raw data ingestion to the delivery of actionable insights. While a significant portion of your time will be dedicated to hands-on engineering, you will also contribute to guiding technical decisions, translating business needs into technical solutions, and mentoring team members. Key Responsibilities: Data Pipeline Development : Build, optimize, and maintain scalable Big Data ETL/ELT pipelines using Azure Metastore, RabbitMQ, and Event Hub : You will own the quality and reliability of daily data ingests. DevOps Automation : Manage the data solution lifecycle using Azure DevOps, including CI/CD, Git for version control, and YAML for build and release pipelines. Data Transformation Modelling : Develop complex data transformations and build curated datasets in Azure Databricks using clean, production-ready PySpark code. Analytics Insights : Independently handle ad-hoc analytical requests, from querying and discovering patterns to presenting conclusions clearly to diverse audiences. Functional Architectural Leadership : Act as the bridge between business and tech. Translate functional requests into technical tasks and help evolve our overall data architecture. Team Collaboration Mentorship : Actively contribute in team meetings, challenge assumptions to align with business objectives, and mentor team members as you grow in the role.