Senior Data Engineer - Financial Flows

Location: United Kingdom; Workplace: Hybrid

Company

hirify.global provides commodity finance analytics and real-time insights across global commodities markets.

What you will do

• Own end-to-end batch and real-time streaming data pipelines integrating external financial market data through APIs and WebSockets.
• Lead the migration of legacy backend infrastructure to AWS and refactor CTA positioning indicator calculations from PHP to Python while preserving mathematical output parity.
• Ingest and model futures pricing, open interest, and trading-volume datasets across QuestDB, Elasticsearch, and other data stores.
• Deploy, maintain, and scale containerized services with Docker, Kubernetes, CI/CD, and GitOps workflows.
• Implement data validation, monitoring, alerting, and root-cause troubleshooting for accurate and fault-tolerant market data feeds.
• Collaborate with quantitative researchers, commodity analysts, and product managers while mentoring engineers through reviews, design guidance, and documentation.

Requirements

• 5+ years of professional experience building, operating, and scaling production-grade data pipelines and backend infrastructure.
• Advanced Python expertise, including refactoring and rewriting production-critical code for performance and testability.
• Hands-on experience building and maintaining real-time or streaming REST and WebSocket API ingestion pipelines for time-series datasets.
• Production experience deploying and managing containerized applications on AWS using Docker, Kubernetes, and modern CI/CD practices.
• Strong SQL fundamentals and experience with distributed search or time-series databases such as Elasticsearch, QuestDB, or ClickHouse.
• Deep experience with automated data quality frameworks, observability, monitoring, alerting, and production troubleshooting.

Nice to have

• Knowledge of financial market structures, futures contracts, open interest, commodities trading symbology, and financial market data vendors such as Bloomberg, LSEG, Enverus, or Trading Technologies.
• Experience migrating legacy PHP code or translating PHP algorithms into Python.
• Practical familiarity with GitOps frameworks and infrastructure-as-code tooling.

Culture & Benefits

• Hybrid work arrangement in the United Kingdom.
• Collaborative work with quantitative researchers, commodity analysts, product managers, and peer engineers.
• Technical mentorship, thoughtful code reviews, system design guidance, and architectural documentation are part of the engineering environment.