ETL Engineer (ClickHouse)

TL;DR

ETL Engineer (ClickHouse): Building and optimizing scalable data pipelines for analytics and business intelligence with an accent on ClickHouse ingestion and SQL performance. Focus on developing end-to-end pipeline ownership, integrating diverse data sources, and ensuring low-latency reliability.

Location: Hybrid (On-site Monday - Thursday, remote Fridays). Candidates must be able to consistently work on-site. No exceptions.

Salary: $120,000–$130,000

What you will do

• Design and develop ETL pipelines using SSIS, Azure Data Factory, and Databricks.
• Build and optimize ClickHouse ingestion pipelines for both batch and streaming data.
• Develop transformations for structured and semi-structured data.
• Optimize SQL Server and ClickHouse queries for performance and scalability.
• Integrate data from multiple sources including APIs, SQL Server, cloud storage, and Kafka/Event Hubs.
• Implement data quality checks, error handling, and lineage tracking.

Requirements

• Strong hands-on experience with Azure Data Factory, SSIS, and Databricks.
• Expertise in writing, optimizing, and troubleshooting complex SQL queries.
• Experience with ClickHouse schema design, ingestion, and optimization.
• Experience with cloud environments, preferably Azure.
• Proficiency in Python or Scala for data processing.
• Ability to work on-site from Monday to Thursday.

Nice to have

• Experience with streaming data using Kafka or Event Hubs.
• Exposure to big data frameworks.
• Understanding of DevOps and data pipeline deployment practices.
• Experience supporting BI tools such as Power BI or Tableau.