Data Engineer

  DATA ENGINEER                                                 Position Summary The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization’s data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering.    Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization’s data infrastructure, aligning with the company’s commitment to excellence and innovation.    Essential Duties   Data Pipeline and Architecture  Design, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric.  Implement ETL processes to ensure data accuracy and availability.  Optimize and tune data workflows for performance and scalability.    Visualization and Guidance  Provide guidance on visualization tools, focusing on Power BI.  Contribute to guidelines and standards for visualization techniques and analytic dashboards.    Monitoring and Troubleshooting  Monitor and troubleshoot data pipeline issues, ensuring timely resolution.    Documentation and Best Practices  Develop and maintain documentation for data processes, architectures, and workflows.  Stay updated with the latest trends and best practices in data engineering and Microsoft Fabric.    Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization's success and efficiency.    Qualifications Education & Experience: Bachelor’s in computer science, data engineering, statistics, mathematics, or related fields.  5 years in data visualization, data mining, and analysis using Power BI   Proven experience as a Data Engineer, with a focus on Microsoft Fabric.  Ability to write complex SQL queries.  Experience with Azure DevOps Git for version control.  Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace.  Understanding of data governance and security best practices.    Tools & Systems: Proficiency in programming languages such as Python, Java, or Scala.  Familiarity with cloud platforms such as Azure.  Experience with CI/CD pipelines and automation tools. The role involves frequent use of standard office equipment, such as computers, phones, and printers.