Data Engineer (AI)

TL;DR

Data Engineer (Python/SQL): Designing and delivering end-to-end data platform architectures, including lakehouses and ETL/ELT pipelines, with an accent on data governance and scalability. Focus on optimizing data products for AI/agent workflows and implementing distributed processing frameworks.

Location: Hybrid in San Sebastian, Spain. Relocation package available.

Company

A deep-tech company and the largest quantum software provider in the EU, specializing in AI compression and quantum-inspired optimization platforms.

What you will do

• Own the end-to-end design and delivery of data platform architectures, including lakehouses, data catalogs, and governance.
• Implement and operate large-scale ETL/ELT pipelines and workflow orchestration to ensure data accuracy and accessibility.
• Define data modeling, partitioning, and schema evolution conventions for scalable and reproducible datasets.
• Establish authoritative data catalogs, managing metadata, lineage, and access policies.
• Collaborate with ML and AI Engineers to make data products directly consumable by AI/agent workflows.
• Mentor other data engineers and drive the adoption of emerging trends in data engineering.

Requirements

• Degree in Computer Science, Software Engineering, or a related field.
• 4+ years of professional experience in data engineering, specifically owning production platforms or pipelines.
• Expert programming skills in Python and strong command of SQL (both SQL and NoSQL).
• Hands-on experience with lakehouse architectures and open table formats (e.g., Parquet, Apache Iceberg, Delta Lake).
• Experience with Spark, workflow orchestrators (Airflow/Argo), and cloud platforms (Azure, AWS, or GCP).
• Fluency in English to lead technical discussions with clients and stakeholders.

Nice to have

• Experience with scientific or geospatial data formats (Zarr, NetCDF, GRIB2, xarray, H3).
• Experience preparing and serving data for LLM, RAG, or agent-based applications.
• Previous experience in consulting or client-facing delivery teams.

Culture & Benefits

• Indefinite contract with guaranteed equal pay and variable performance bonuses.
• Signing bonus and relocation package for eligible candidates.
• Private health insurance and flexible remuneration for hospitality and transport.
• Educational budget and language classes.
• Flexible working hours and a hybrid work model.
• Opportunity to work with cutting-edge quantum and AI technologies in a diverse, multicultural environment.