Sr. Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Sr. Data Engineer (AI): Build and scale high-throughput streaming pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg with an accent on reliability, performance, and data correctness. Focus on modeling production-grade real estate datasets, strengthening data quality and observability, and leveraging AI to improve data operations.
Location: Remote (Canada)
Company
is building the AI growth platform for real estate, a Series C company backed by top investors like Bessemer Venture Partners, serving over 87,000 real estate professionals.
What you will do
- Build and scale high-throughput streaming pipelines using Airflow, Spark Streaming, Kafka, and Iceberg for 400M+ monthly MLS updates across 350+ integrations.
- Model and deliver high-quality, production-grade real estate datasets, balancing freshness, accuracy, and cost.
- Strengthen data quality and observability with checks, monitoring, and alerting.
- Leverage AI to improve data operations, including triage, debugging, and resolving issues.
- Shape platform architecture and drive AI-powered product delivery as a technical leader.
Requirements
- Located in Canada for remote work.
- 6+ years of professional data engineering or software engineering experience.
- Strong experience with distributed data processing and streaming systems (Spark/PySpark, Kafka).
- Proficiency in Python (Pydantic preferred); familiarity with Node/TypeScript a plus.
- Experience building data pipelines on AWS using Airflow, Spark Streaming, and Iceberg.
- Solid understanding of data modeling, large-scale datasets, event-driven systems (Kafka, SQS), data quality checks, and monitoring.
- Proven track record leading high-impact initiatives in a SaaS environment; expert in software design and multi-tenant architectures.
Culture & Benefits
- AI-first engineering culture: unlimited budget for AI tools like Anthropic tokens; use AI agents for code writing, review, and shipping.
- Fast-paced, ambiguous environment in a high-growth Series C company with real ownership.
- Collaborative team that communicates clearly, celebrates wins, and enjoys building together.
- Ranked on Inc. 5000 and BuiltIn Best Places to Work lists; innovative proptech leader.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →