Principal Engineer (Project Manager - Data Engineering)

TL;DR

Principal Engineer (Project Manager - Data Engineering): Design, build, and manage real-time, near real-time, and batch data architectures for cyber data platforms supporting threat detection, incident response, and reporting with an accent on advanced analytics, machine learning, and GenAI capabilities. Focus on technical leadership, automation, DevOps practices, and ensuring data security and compliance.

Location: London, United Kingdom

Company

hirify.global is a global IT and digital product engineering firm with 18,000+ experts across 37+ countries, helping customers transform through agile solutions.

What you will do

• Lead design, development, and delivery of cyber data platform solutions, providing technical guidance and mentorship to teams.
• Design and manage data architectures for real-time, near real-time, and batch processing to support threat detection, incident response, and analytics.
• Contribute high-quality code, conduct peer reviews, and provide constructive feedback to elevate team codebase standards.
• Implement data security standards and ensure compliance with regulations for sensitive information protection.
• Apply automation and DevOps practices to streamline deployment, configuration, and management of data platform components.

Requirements

• Proven experience leading teams to deliver resilient systems and providing technical guidance for optimal solutions.
• Experience building data platforms on cloud services like Databricks on Azure or GCP BigQuery for self-service data access.
• Proficiency in Python and SQL, architectural patterns, coding standards, code reviews, version control, and CI/CD.
• Expertise in ETL/ELT frameworks for large-scale real-time and batch processing (Kafka, Flink, Airflow, dbt), Docker, and Kubernetes.
• Knowledge of cybersecurity principles and practices; strong stakeholder management, communication, and collaboration skills.
• Location: London, United Kingdom (onsite)

Nice to have

• Experience with ETL and ELT frameworks.