Big Data Developer

TL;DR

Big Data Developer (Spark/SQL): Development, maintenance, and optimization of data processing solutions for the Client Contribution platform, with an accent on building robust ETL/data transformation pipelines and ensuring data quality, reliability, and performance. Focus on Spark-based pipeline implementation, troubleshooting data issues, and supporting data integration in an Agile environment while contributing to CI/CD and DevOps practices.

Location: Hybrid position based in Málaga, Spain, or remote within Spain.

Company

International advisory group specializing in innovation and transformation through technology.

What you will do

• Design, develop, and maintain ETL and data transformation processes.
• Implement and support Spark-based data pipelines.
• Contribute to data integration initiatives across the platform.
• Analyze and troubleshoot data-related issues to ensure reliability and performance.
• Work with functional and technical stakeholders to gather and analyze requirements.
• Participate in Agile delivery and DevOps practices, including CI/CD processes.

Requirements

• Location: Must be based in Málaga, Spain, or work remotely within Spain.
• 3+ years of experience in data engineering or software development.
• Strong SQL skills (ANSI SQL, Hive SQL, Spark SQL).
• Hands-on experience with Spark.
• Programming experience in at least one of: Scala, Python, or Java.
• Experience with Big Data environments such as Azure Databricks, Amazon EMR, Hive, or Cloudera; familiarity with DevOps/CI-CD practices (Git, GitHub, Sonar, Nexus).
• English proficiency: B2 or higher.

Nice to have

• Experience leveraging AI-assisted tools to improve data engineering and automation.

Culture & Benefits

• Permanent, full-time contract with career development opportunities.
• Hybrid setup in Málaga or remote work within Spain.
• Work in a challenging, multicultural environment with international projects.
• Exposure to large-scale financial IT systems and cross-country operations.
• Training opportunities to develop skills in finance, technology, and data management.

Hiring process

• Interviews to assess technical fit for data engineering, Spark/SQL, and pipeline development.
• Discussion of Agile collaboration and DevOps/CI-CD experience.