Job Description
About the role_
We are looking for a Mid-Level Software Engineer to join our team and build scalable big data solutions. The ideal candidate will have strong experience in Python, PySpark, and AWS along with a solid understanding of distributed data processing systems. This role involves working on large-scale data pipelines, optimizing performance, and collaborating with cross-functional teams to deliver reliable data solutions. Exposure to Java Spring Boot–based applications is a plus.
A day in this role_
- Design, develop, and maintain scalable data pipelines using Python and PySpark
- Build and optimize big data solutions on AWS EMR
- Process and analyze large datasets in distributed environments
- Work with AWS services for data storage and processing
- Optimize Spark jobs for performance and cost efficiency
- Collaborate with product, analytics, and engineering teams to deliver data solutions
- Participate in code reviews, debugging, and performance tuning
- (Good to have) Contribute to backend services using Java Spring Boot
The expertise requested_
- 3-5 years of experience
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
- Strong experience in Python and PySpark
- Experience with AWS services (deployment, monitoring, or development)
- Solid understanding of distributed data processing frameworks
- Experience building and maintaining data pipelines (ETL/ELT)
- Strong SQL and data modeling skills
- Understanding of Spark performance tuning and optimization
- Familiarity with REST APIs and data integration patterns
Nice to have_
- Experience with Java and Spring Boot
- Exposure to AWS EMR, Lambda and Step Functions
- Experience with workflow orchestration tools (e.g., Airflow)
- Familiarity with CI/CD pipelines
- Understanding of cloud-native architectures
Our Core values are focus to inclusion and diversity, all qualified applicants will be considered for employment and will go thru a fair recruitment process regardless of their race, religion, gender identity, sexual orientation, national origin or disability status.