5 дней назад
Senior Data Engineer (AI Systems)
144 000 - 188 000CAD
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI Systems) (Spark/Python): Building and scaling production data pipelines, ML data lakes, and data infrastructure that power AI-driven personalization and recommender systems with an accent on large-scale processing, data quality, and performance optimization. Focus on tuning Spark batch pipelines on GCP Dataproc, supporting model development and evaluation, and improving the scalability and reliability of ML data systems.
Location: Toronto, Canada
Salary: CAD 144,000–188,000 per year, plus a potential bonus and benefits.
Company
provides content personalization for marketers through data-activated content generation and AI decisioning.
What you will do
- Build, maintain, and optimize production data pipelines for AI-driven personalization, including content selection, send-time optimization, subject line personalization, and frequency capping.
- Own and scale Spark-based batch pipelines on GCP Dataproc, including cluster configuration, tuning, and performance optimization.
- Build and maintain the ML Data Lake with strong data quality, accessibility, and storage efficiency.
- Support ML engineers and scientists with data for model development, training, and evaluation.
- Identify performance bottlenecks and scaling limitations across data pipelines and infrastructure.
- Collaborate with distributed systems engineers to evolve the platform architecture and deliver reliable data products.
Requirements
- 5+ years of data engineering experience.
- Deep expertise with Apache Spark and the PySpark DataFrame API, including solving complex scaling problems.
- Experience with large-scale data processing, cluster configuration, optimization, and tuning on GCP Dataproc.
- Strong Python software development skills, including unit testing, Git, code review, and CI/CD.
- Experience with Parquet, Delta Lake, Kafka, and Google Cloud Platform.
- Familiarity with advanced query optimization, Docker, Kubernetes, GitHub Actions, and automated deployment.
Culture & Benefits
- Collaborative work with ML engineers, scientists, distributed systems engineers, and other technical teams.
- Opportunity to work on large-scale systems powering billions of AI-driven marketing decisions.
- Medical, financial, and other benefits are provided.
- Commitment to an inclusive and diverse workplace.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
AI/ML Ops Engineer (AI)
131 000 - 164 250CAD
4 дня назад
Applied Data Scientist (AI)
160 000 - 200 000$
3 дня назад
Senior Data Engineer (Databricks)
2 дня назад
Senior Machine Learning Engineer (Azure)
105 392 - 125 088$
5 дней назад
Senior Data Engineer (AI)
145 000 - 190 000$
5 дней назад
Senior Staff Data Engineer (ML Platform)
240 000 - 360 000$