Azure Databricks

Data Engineer – Azure Databricks & SQL

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Azure Databricks and SQL to join our growing data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and supporting the migration of legacy data platforms into Azure Databricks.

The role requires hands-on experience in data warehousing, ETL development, data modeling, and Azure cloud technologies.

Key Responsibilities

• Design, develop, and maintain scalable ETL/data pipelines.
• Build and optimize batch and streaming data processing solutions using Databricks and Apache Spark.
• Support migration of legacy data platforms into Azure Databricks.
• Develop and maintain enterprise data warehouse solutions.
• Create and optimize SQL queries for large-scale datasets.
• Implement data models including dimensional modeling and star schema design.
• Work with Azure Data Factory (ADF), SSIS, and related ETL tools.
• Manage data governance, lineage, and security using Unity Catalog.
• Implement CI/CD pipelines using Git and Azure DevOps.
• Ensure data quality, reliability, performance, and compliance standards.
• Collaborate with cross-functional teams including BI, analytics, and business stakeholders.
• Stay updated with latest Databricks and Azure platform enhancements.

Required Skills

• 5–8 years of experience as a Data Engineer.
• Strong hands-on experience in SQL development and performance tuning.
• Extensive experience with Azure Databricks and Apache Spark.
• Strong experience in Data Warehousing and Data Modeling.
• Hands-on experience with:
  • Azure Data Factory (ADF)
  • Databricks
  • SSIS
  • ETL Development
• Experience with Unity Catalog for governance and security.
• Knowledge of Azure Data Lake and Azure Storage.
• Experience building both batch and streaming pipelines.
• Familiarity with Azure DevOps, Git, and CI/CD processes.
• Good understanding of data governance and security best practices.
• Power BI knowledge is an added advantage.
• Excellent communication and problem-solving skills.

Preferred Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related field.
• Experience working in enterprise-scale cloud data platforms.
• Exposure to Agile methodologies.

At Tech Vedika, we are looking for talented individuals who want to work with driven people. Attain success while working on interesting projects with a culturally diverse group of individuals.

Perks & Benefits: 

• Health Insurance
• Meal Vouchers
• Learning Aids
• Client/Customer Interactions
• Working with great minds 

If you want an exciting and dynamic career with unlimited growth potential, then Tech Vedika is the place for you!