Back to jobs
Bachelor's Degree in Computer Science, Engineering, Data Science, or related field OR Master's Degree in Data Engineering, Computer Science, or MBA (preferred)
5-7 years of data engineering experience with AWS-native implementations
Proven experience working as part of a data engineering team on ETL migration projects
Hands-on experience implementing Databricks notebooks using PySpark, Python, and SQL for ETL automation
Demonstrated expertise developing PySpark scripts for efficient data extraction, transformation, and loading from large datasets
Experience utilising Python for custom data manipulation, validation, and error handling in ETL processes
Proficiency employing SQL for complex joins, aggregations, and database operations within Databricks environments
Track record of testing, debugging, and optimising data transformation processes for accuracy and performance
Experience verifying data integrity throughout pipeline stages and resolving troubleshooting issues
Proven ability collaborating with cross-functional teams to align ETL migration tasks with project goals and deadlines
Experience in government sector data projects and compliance requirements (preferred)
Experience in HR domain including workforce analytics, payroll systems, and employee data management (preferred)
Experience providing technical mentorship to junior team members (preferred)
Certified in:
Senior Associate/Manager Data Engineer Consultant (Data Bricks) / Technology Consulting
SG, 048583Posted Today
Job Description
- AWS Certified Data Engineer - Associate (preferred)
- AWS Certified Solutions Architect or AWS Certified Big Data - Specialty (preferred)
- Databricks Certified Data Engineer Associate or Professional
- Amazon Redshift or Snowflake certifications
- Agile/Scrum Master certification (preferred)