Job Description
Job Title: Sr. Data Engineer
Location: Remote with occasional work from our Colombo office
Working days and Hours: Monday to Friday 2PM - 11PM
Role Accountabilities & Responsibilities:
Position Summary
We are seeking a skilled and detail-oriented Sr. Data Engineer to design, build, maintain, and optimize scalable data pipelines and infrastructure. The Sr. Data Engineer will work closely with data analysts, data scientists, software engineers, and business stakeholders to ensure reliable access to high-quality data that supports analytics, reporting, machine learning, and operational systems.
This role requires strong technical expertise in data architecture, ETL/ELT development, cloud platforms, and database technologies, along with a passion for solving complex data challenges.
Key Responsibilities
Data Pipeline Development
- Design, develop, and maintain scalable ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize batch and real-time data processing systems.
- Ensure data accuracy, consistency, and integrity across platforms.
Data Infrastructure & Architecture
- Develop and maintain data warehouses, data lakes, and modern data platforms.
- Implement scalable data models and storage solutions.
- Optimize database performance, indexing, partitioning, and query execution.
Cloud & Platform Engineering
- Manage and support cloud-based data solutions using platforms such as Azure (must), AWS or Google Cloud (expertise would be an added advantage).
- Automate deployment and infrastructure management using CI/CD and Infrastructure as Code tools.
- Monitor and troubleshoot production data systems.
Collaboration & Analytics Support
- Partner with business analysts, data scientists, and stakeholders to understand data requirements.
- Enable self-service analytics through reliable datasets and documentation.
- Support machine learning and advanced analytics initiatives.
Data Governance & Security
- Implement data quality monitoring, validation, and governance practices.
- Ensure compliance with security, privacy, and regulatory standards.
- Maintain metadata, lineage, and documentation for data assets.
What You’ll Bring:
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field.
- 2+ years of experience in data engineering or related roles.
- Strong SQL skills and experience with relational and non-relational databases.
- Experience building DWH & ETL/ELT pipelines using tools such as:
- Apache NiFi/ Airflow
- dbt
- Snowflake
- PostgreSQL
- Proficiency in programming languages such as Python & Java.
- Experience with Azure cloud platform.
- Knowledge on supporting AI/ML workflows and feature engineering pipelines.
- Experience with DevOps and CI/CD practices.
- Familiarity with big data technologies such as Spark, Kafka, or Databricks.
Technical Proficiencies:
Key Skills
- Data modeling and database design
- ETL/ELT pipeline development
- Data warehousing
- Cloud computing
- Problem-solving and analytical thinking
- Performance tuning and optimization
- Communication and collaboration
- Attention to detail
Success Metrics
- Reliability and uptime of data pipelines
- Data quality and accuracy
- Pipeline performance and scalability
- Speed of data availability
- Stakeholder satisfaction and analytics enablement
Company Summary:
Horizon Group USA is an innovative creator of children’s craft & activity kits! Beginning in 1912 as a decorative trim supplier, Horizon Group has grown to become a popular resource for hands-on activity kits and crafting products for all ages.
At Horizon Group USA, we thoughtfully design a wide range or creative activity and craft kits, from STEM activities to classic crafts and jewelry kits. With over 5,000 fun products, our ultimate goal is to bring joy to children around the world! We strive to inspire children and parents of all ages to engage with their creativity as a way to grow and learn about themselves, and the world around them.
Monday - Friday - 2PM -11PM