The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

Lay down the foundation and model the data
Develop a platform for building and maintaining data pipelines that collect data from different sources
Create Data Warehouse
Analyze and prepare domain descriptions in collaboration with Business analytics
Create Data Marts
Design a permission model with flexible control over vertical and horizontal access to data

Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
Experience in database development and data modeling, ideally with Databricks/Spark
Experience with Python
Experience with Azure
Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
Experience debugging and optimizing Spark jobs
Strong written and verbal communication skills
At least an Upper-Intermediate level of English
BS in Computer Science or a related field

WOULD BE A PLUS

Data Engineer

Job Description