Data Engineer II

Who we are:   Visual Comfort & Co. is the premier resource for decorative and architectural lighting, ceiling fans, system controls and automated shading solutions from the most influential designers in the world. We are proud to offer a market-leading range of premium products across categories, styles and price points, remaining committed to beautiful design and, above all, a world-class customer experience.   Reporting directly to the Director Data Platform within the Information Technology department, the Data Engineer II is responsible for collaborating with analytics, business intelligence, and IT teams to enable data-driven decision-making. Duties include designing, building, and maintaining scalable data pipelines and architectures within the Microsoft data stack, supporting the Microsoft Fabric ecosystem with robust data solutions, and ensuring high-quality, reliable, and accessible data across the organization.   Visual Comfort Offers:   Work-Life Balance: Monday – Friday, 8:00am – 5:00pm, Domestic Travel 25% Training & Development: A comprehensive and structured training program, complemented by ongoing education and opportunities for career advancement. Paid Time Off: Generous vacation accrual and paid time off policies. Holidays: 7 paid holidays per year, in addition to 2 floating holidays. Compensation: Competitive compensation plan Health Benefits: Visual Comfort covers the majority of employee medical premiums, and offers competitive vision and dental coverage available starting the first of the month following your start date. Insurance: Company-provided life insurance and short-term disability coverage. Retirement: 401(k) plan with company matching up to 4%, available beginning the first of the month following your hire date.   How success is defined:   Design, build, and own scalable data pipelines and ETL/ELT processes to support enterprise data needs Develop and maintain curated data products as trusted, reusable assets for downstream systems (e.g., website, Salesforce, marketing, analytics) Ensure data quality, integrity, governance, and reliability across all enterprise data platforms and curated datasets Architect and optimize data models to support analytics, reporting, and business intelligence requirements Implement and manage robust data ingestion frameworks for integrating internal and external data sources Develop and optimize distributed data processing workflows using PySpark and modern data engineering frameworks Design and deliver solutions leveraging the Microsoft data stack (Azure Data Factory, Azure Synapse, Microsoft Fabric) Integrate and transform data from enterprise systems, including Microsoft Dynamics 365 (D365) and JD Edwards (JDE) Implement and monitor data validation, observability, and documentation to ensure transparency, consistency, and trust in data assets Collaborate with business stakeholders, analysts, and application teams to gather requirements and deliver consumable, business-aligned datasets Monitor, troubleshoot, and optimize data workflows to ensure performance, scalability, and reliability Support and evolve lakehouse architecture within Microsoft Fabric Apply and enforce best practices for data security, compliance, and role-based access control Document and maintain data pipelines, processes, and architecture for operational clarity and knowledge sharing Works effectively with others in a team environment to accomplish organizational goals and to identify and resolve problems. Exhibits and adheres to the established Visual Comfort Company Values. Must demonstrate commitment, dependability, punctuality, and adherence to agreed-upon schedule while being present in the workplace to effectively collaborate and communicate amongst co-workers and teams.     What you will bring:   Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience) 3+ years of experience in data engineering or a related role Experience building and maintaining ETL/ELT pipelines and data integration solutions, including exposure to real-time or streaming data pipelines Proficiency in SQL (including T-SQL) and Python, with experience using PySpark and optimizing Spark workloads in distributed/cloud environments Hands-on experience with the Microsoft data stack, including Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Experience working with Microsoft Fabric and/or implementing lakehouse architectures using technologies such as Delta Lake or Spark Experience integrating and working with ERP data sources, including Microsoft Dynamics 365 (D365) and/or JD Edwards (JDE), with functional knowledge of finance, supply chain, or order management modules Strong understanding of data warehousing concepts, dimensional modeling, and semantic modeling (e.g., Power BI datasets) Experience using Power BI for reporting and semantic layer development Familiarity with data governance tools and practices, including data quality and data management principles Experience using version control systems (e.g., Git) and supporting CI/CD practices Experience working in retail, manufacturing, or e-commerce environments Exceptional organizational and time management skills, with a strong attention to detail Ability to prioritize and handle multiple tasks and changing priorities Ability to achieve results both independently and through others by fostering a spirit of teamwork and cooperation Demonstrate exceptional communication across all contact channels, including email, chat and phone Available to work a flexible schedule including weekends, early mornings, late evenings   Compensation Range: $91,000 - $96,000   #LI-Onsite