Back to jobs
Job Description
• Develop, optimize, and maintain scalable data pipelines using Python and PySpark. • Write complex queries and transformations using Spark SQL. • Integrate data from various sources and ensure high data quality and performance. • Collaborate with data engineers, analysts, and business teams to gather requirements. • Debug, monitor, and enhance existing ETL workflows and batch jobs. • Participate in code reviews and follow best practices for clean, maintainable code