Lead Data Engineer (ClickHouse)

TL;DR

Lead Data Engineer (ClickHouse): Leading the migration of large-scale telemetry data to ClickHouse and architecting high-throughput ingestion pipelines with an accent on distributed system design and performance tuning. Focus on establishing robust observability, optimizing schemas for high-cardinality datasets, and ensuring production readiness on Kubernetes.

Location: Must be based in Canada

Company

hirify.global is a global custom product engineering company that partners with multinational organizations and startups to solve complex business challenges through innovative technology.

What you will do

• Lead the migration of large-scale distributed traces and logs to ClickHouse clusters.
• Architect scalable schemas and high-throughput ingestion pipelines for real-time telemetry.
• Design and tune distributed ClickHouse clusters for sharding, replication, and storage optimization.
• Collaborate with platform and SRE teams to ensure system security and production reliability.
• Establish monitoring, alerting, and operational best practices for data platforms.
• Document architecture decisions, performance tuning strategies, and operational runbooks.

Requirements

• 12+ years of experience in backend, infrastructure, or data platform engineering.
• Hands-on production experience with ClickHouse engines, indexing, and compression.
• Expertise in operating stateful systems on Kubernetes using Terraform and Helm.
• Strong background in designing high-ingestion telemetry architectures and billion-row-scale datasets.
• Proficiency in at least one major cloud provider (Azure, AWS, or GCP).
• Must be based in Canada.

Nice to have

• Familiarity with Kafka, Azure Event Hub, or Azure Data Explorer.
• Practical experience with OpenTelemetry standards.
• Proven ability to optimize query latency for high-cardinality datasets.

Culture & Benefits

• Access to global projects and diverse domains through internal mobility.
• Tailored learning programs including Udemy access, language courses, and certifications.
• Participation in internal events like meetups, conferences, and workshops.
• Comprehensive benefits including healthcare, life insurance, and disability insurance.
• Friendly, collaborative environment that values progress and innovation.