Data Engineer JD (Azure)

Location: Lisbon, Portugal; hybrid working model.

Salary: €1,600–€1,900 gross per month, including fixed salary, variable compensation, meal allowance, remote work allowance, and benefits.

Company

IRIUM is a growing technology company focused on professional development, engineering quality, responsibility, and commitment.

What you will do

• Design, build, and operate large-scale data platforms and cloud-based data solutions.
• Develop and maintain batch and streaming data pipelines using Azure data services, Apache Spark, and Spark Streaming.
• Build Lakehouse architectures with Delta Lake and support data modelling and pipeline development.
• Develop infrastructure and delivery automation using Terraform, Infrastructure as Code, and CI/CD pipelines in Azure DevOps.
• Monitor, troubleshoot, perform root-cause analysis, and resolve production incidents.
• Apply cloud security, observability, reliability, and operational best practices.

Requirements

• At least 4 years of experience in Data Engineering, Software Engineering, or a comparable role.
• Proven experience designing, building, and operating large-scale data platforms or cloud-based data solutions.
• Strong knowledge of SQL, data modelling, and data pipeline development.
• Hands-on experience with Azure Databricks, Azure Data Lake Storage, Azure Event Hubs, Microsoft Azure infrastructure, and cloud-native data platforms.
• Strong knowledge of Apache Spark and Spark Streaming, with experience building and maintaining batch and streaming data pipelines.
• Experience with Delta Lake and Lakehouse architectures.
• Practical experience with Terraform and Infrastructure as Code, plus experience developing and maintaining CI/CD pipelines in Azure DevOps.
• Strong proficiency in Python and good software engineering practices.
• Experience with monitoring, troubleshooting, root-cause analysis, and production incident resolution.
• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Engineering, or a related field.
• Fluent English.

Nice to have

• Experience with Rust.
• Knowledge of Google Cloud Platform.
• Experience with Kubernetes and containerisation.
• Experience with data visualisation tools.
• Knowledge of Data Governance, Data Management, and Data Quality.
• Experience with metadata management and data quality controls.
• Experience working in Agile and cross-functional teams.
• Proactive, autonomous, and ownership-driven mindset.
• Strong ability to solve complex technical problems.
• Strong focus on automation, continuous improvement, and engineering excellence.

Culture & Benefits

• Innovative and growing work environment with professional development opportunities.
• Compensation according to experience and performance.
• Flexible compensation and health insurance as a social benefit.
• Unlimited access to self-paced technology training.
• Values focused on responsibility, commitment, equality, and quality of work.