Senior Data Engineer (Fintech)

TL;DR

Senior Data Engineer (Fintech): Re-architecting and scaling big data processing components for a RiskOps platform with an accent on distributed systems, data ingestion pipelines, and developer experience. Focus on optimizing Spark workloads, evolving Hadoop ecosystem components, and ensuring stability and performance of the data science framework.

Location: Remote from Portugal

Company

hirify.global is a market leader in financial risk management, providing a cloud-based RiskOps platform powered by machine learning and artificial intelligence.

What you will do

• Re-architect and scale existing big data processing components powering the Data Science Framework (DSF).
• Analyze workload patterns (Spark jobs, notebook activity, DS API usage) to drive performance, reliability, and cost improvements.
• Ensure stability of Spark jobs running on EMR or Kubernetes clusters and evolve Hadoop ecosystem components (HDFS, YARN).
• Maintain and improve data ingestion pipelines between Runtime and DSF (Firehose, Glue → S3).
• Improve the developer and power-user experience across JupyterLabs and the DS API.
• Own services throughout their lifecycle following DevOps practices.

Requirements

• 5+ years of experience building and operating distributed big data systems.
• Strong experience with Apache Spark, including tuning, debugging, and orchestration.
• Strong programming fundamentals in Java (Scala or Python a plus).
• Solid knowledge of the Hadoop ecosystem (HDFS, YARN).
• Experience operating Linux-based systems in cloud environments.
• Familiarity with JupyterHub/JupyterLabs workflows and experience designing and operating ETL/ELT pipelines.
• Comfort with continuous delivery, monitoring, and on-call responsibilities.

Nice to have

• Experience running Spark on EMR or Kubernetes.
• Experience with AWS S3, AWS Glue, Nessie, Trino, Spark, Kafka, Iceberg and Airflow.
• Experience building data pipelines or automation for data-heavy workflows.
• Contributions to OSS, especially in the Big Data ecosystem.

Culture & Benefits

• Fast-paced, safe, open, and collaborative environment that encourages continuous learning.
• Teams operate with a “you build it, you run it” DevOps mindset, taking end-to-end ownership.
• Architecture evolves towards a decoupled, microservice-based, cloud-native environment.
• Opportunity to have a voice in planning, strategizing, and challenging the status quo.
• Support through training, connections, and one-on-one time with your manager.

Hiring process

• First 30 days: immersion in brand, training, connections, and one-on-one time with manager.
• Shadow colleagues virtually or onsite as supported through your hirify.global journey.
• Start working on projects and collaborating on current work.