Job Description
Job Description :
About the Role
We are looking for a Data Engineer with experience in analytical abilities in GCP BigQuery, ETL/BI, Python, Composer /Airflow, SQL, GCP Services - with the ability to operate in an agile environment
and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 2.5+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Experience in working with Front end technologies such as React, Angular, Flask, Javascript, HTML,
CSS is a plus.
➔ Domain knowledge on News, Media & Communications is an added advantage
Responsibilities
➔ Design, implement, and maintain the scalable and reliable GCP cloud-based data infrastructure and BI - ELT processes
➔ Collaborate with cross-functional teams to define data architecture and data warehouse requirements
➔ Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
● Google Cloud Platform is IaaS
● BigQuery, GCS, Python, SQL
● Composer / Airflow - orchestration tools
● Terraform, CircleCI, CI/CD, GIthub, Jira, Confluence
Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
Reasonable Accommodation
We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at [email protected]. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
This job is posted with NTS Technology Services Pvt. Ltd.