Vulnerability & Exposure Management Data Engineer

TL;DR

Vulnerability & Exposure Management Data Engineer: Design and develop scalable data pipelines and solutions for a Vulnerability Management Platform processing millions of data entries daily with an accent on big data frameworks, cloud data warehousing, and data modeling. Focus on building reliable data ingestion, ensuring data availability and integrity, and collaborating with backend and frontend teams in an international environment.

Location: Onsite in Barcelona, Spain

Company

hirify.global is the IT hub of Europe's largest retail group, serving Lidl, Kaufland, and other brands with high-value IT services across 32 countries.

What you will do

• Design and develop solutions processing millions of data entries daily for the Vulnerability Management Platform.
• Build and maintain scalable batch and real-time data pipelines to ingest high volumes of data into the data lake.
• Perform data modeling to optimize datasets and ease data consumption for stakeholders.
• Bring data analytics to production at scale and participate in architecture design.
• Collaborate with backend and frontend teams to implement and improve the product.
• Ensure data availability and integrity for business stakeholders.

Requirements

• Must be located in or able to work onsite in Barcelona, Spain
• 5+ years of experience in software development and big data frameworks.
• Strong proficiency in Python and advanced knowledge in PySpark.
• Experience building ELT data pipelines using Airflow, dbt, or Airbyte.
• Proficiency with cloud data warehousing solutions (STACKIT or AWS preferred).
• Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus.
• Strong English communication skills and ability to work in an international, collaborative environment.

Nice to have

• Knowledge or experience in cybersecurity and vulnerability management.
• Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
• Experience with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
• Contribution to open-source projects and passion for learning new tools.