Senior Data Engineer - Infra

TL;DR

Senior Data Engineer - Infra (ClickHouse): Design and optimize ClickHouse data pipelines and clusters for real-time ingestion and T+1 batch workloads at billions-of-events scale with an accent on ClickHouse table engines, partitioning, replication, and query optimization. Focus on building reliable, deduplicated, and fully monitored data infrastructure while partnering with downstream analytics, ML, and product consumers.

Location: New York

Company

hirify.global builds trade surveillance technology for financial markets, helping detect, investigate, and report market manipulation, financial crime, and fraud.

What you will do

• Design and optimize the ClickHouse data layer (table engines, partition strategies, materialized views, storage policies) for high performance at massive event volumes.
• Own ClickHouse cluster sizing, topology, and capacity planning across real-time ingestion and T+1 batch workloads.
• Implement data reliability and deduplication strategies using ClickHouse engine features and pipeline-level controls.
• Establish and continuously improve monitoring, alerting, and observability for replication health, merge performance, query latency, and resource utilization.
• Act as the internal ClickHouse authority: coach teams on query optimization and data modeling best practices.
• Collaborate with downstream analytics/ML/product consumers to refine storage and serving patterns; define schema versioning and governance.

Requirements

• BSc in Computer Sciences.
• 5+ years of hands-on software engineering experience with Java, Rust, or Python.
• 8+ years in data engineering and data pipeline development in high-volume, low-latency production environments.
• Deep, hands-on ClickHouse expertise (cluster architecture, table engine selection, replication, sharding, query optimization).
• Proficiency with the data engineering stack: Apache Kafka, Spark, Airflow, Kubernetes, Redis, Snowflake, and caching technologies.
• Expert SQL and query optimization skills, including ClickHouse-specific patterns (materialized views, projections, TTLs, merge tree tuning) and observability tools (Prometheus, Grafana or similar).

Culture & Benefits

• Startup environment with independence, accountability, and an organized self-starter mindset.
• Hands-on ownership of day-to-day work, including tasks that may extend beyond the formal scope.
• Collaboration across teams, including coaching and influencing engineers in a remote environment.