Data Engineer II (Lakehouse)

TL;DR

Data Engineer II (Lakehouse/Python): Designing and scaling a modern data platform for analytics and AI-powered insights with an accent on Lakehouse architecture and streaming data pipelines. Focus on implementing scalable workflows with Airflow and DBT, optimizing Databricks processing, and enabling GenAI use cases.

Location: Remote (US or Canada). Must be eligible to work without sponsorship.

Salary: $120,000 – $140,000 USD per year

Company

A leading service commerce platform providing tailored SaaS solutions for Home & Field Services, Health, and Wellness industries.

What you will do

• Design, build, and operate scalable batch and streaming data pipelines using Kafka.
• Develop and orchestrate workflows with Apache Airflow and implement transformations using DBT.
• Leverage Databricks and Apache Iceberg to maintain a modern Lakehouse architecture.
• Ingest data from diverse sources using Fivetran and build a trusted semantic layer.
• Implement data quality frameworks, monitoring, and unit test automation.
• Optimize performance and costs across AWS services including Athena and EC2.

Requirements

• 5+ years of experience in a Data Engineering role.
• Strong proficiency in Python and SQL.
• Hands-on experience with Databricks, DBT, and Apache Airflow.
• Proven expertise in building streaming pipelines with Kafka.
• Experience with Apache Iceberg and modern Lakehouse architectures.
• Must be based in the US or Canada and eligible to work without sponsorship.

Nice to have

• Experience enabling AI or GenAI use cases (e.g., Databricks Genie).
• Experience delivering self-service BI solutions such as ThoughtSpot.
• Knowledge of data governance, metadata management, and data catalogs.
• Experience supporting SaaS or multi-product platforms.

Culture & Benefits

• Flexible work arrangements: remote, hybrid, or in-office options.
• 401k with up to 4% match and immediate vesting.
• Comprehensive health and wellness package with an annual stipend.
• Flexible and generous Time-Off (FTO) policy.
• Employee Stock Purchase Program.