Senior Backend Spark Developer
Job Description
About the Role
We are looking for a Senior Backend Spark Developer to join the Client Contribution Platform team. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing solutions while driving technical decisions and ensuring the scalability, reliability, and performance of the platform.
As a senior team member, you will play a key role in mentoring other developers, collaborating with cross-functional teams, and contributing to the continuous improvement of the platform and its architecture.
Key Responsibilities
- Design, develop, and optimize scalable Big Data solutions using Apache Spark.
- Lead technical decisions and contribute to the architecture of data processing solutions.
- Develop, maintain, and optimize Big Data pipelines.
- Support data integration initiatives across multiple systems and workstreams.
- Ensure the performance, scalability, and reliability of data processing applications.
- Troubleshoot and resolve complex technical and performance issues.
- Collaborate with technical and functional stakeholders to define and implement solutions.
- Promote Agile development practices and contribute to CI/CD and DevOps processes.
- Mentor and support junior and mid-level developers, sharing best practices and technical knowledge.
- Explore and promote the adoption of emerging technologies, including AI-assisted development and automation.
Required Skills & Experience
- 5+ years of hands-on experience developing Big Data solutions with Apache Spark.
- Strong experience programming in Scala (preferred) or Python.
- Solid SQL skills and experience with data modeling.
- Experience working with Big Data platforms such as:
- Azure Databricks
- Apache Hive
- or similar Spark-based environments.
- Experience working in Agile environments and applying CI/CD and DevOps best practices.
- Hands-on experience with:
- Git
- GitHub
- SonarQube
- Nexus
- Strong analytical and problem-solving skills.
- Proactive mindset with the ability to work independently and take ownership of technical solutions.
- Experience mentoring and supporting other team members.
- English level B2+ or above.
Nice to Have
- Experience with workflow orchestration tools such as:
- Control-M
- Apache Airflow
- or similar solutions.
- Knowledge of Hadoop ecosystems.
- Experience using AI-assisted development tools or contributing to AI-driven initiatives within data platforms, software development, or process automation.
- Permanent, full-time contract with career development opportunities.
- Chance to work in a challenging, multicultural environment with international projects.
- Exposure to large-scale financial IT systems and cross-country operations.
- Training opportunities to develop new skills in finance, technology, and data management.
If you are passionate about development & tech, we want to meet you!
Talan Spain’s commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).