Назад
Company hidden
5 дней назад

Senior Data Engineer (AI Systems)

144 000 - 188 000CAD
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US/Canada
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (AI Systems) (Spark/Python): Building and scaling production data pipelines, ML data lakes, and data infrastructure that power AI-driven personalization and recommender systems with an accent on large-scale processing, data quality, and performance optimization. Focus on tuning Spark batch pipelines on GCP Dataproc, supporting model development and evaluation, and improving the scalability and reliability of ML data systems.

Location: Toronto, Canada

Salary: CAD 144,000–188,000 per year, plus a potential bonus and benefits.

Company

hirify.global provides content personalization for marketers through data-activated content generation and AI decisioning.

What you will do

  • Build, maintain, and optimize production data pipelines for AI-driven personalization, including content selection, send-time optimization, subject line personalization, and frequency capping.
  • Own and scale Spark-based batch pipelines on GCP Dataproc, including cluster configuration, tuning, and performance optimization.
  • Build and maintain the ML Data Lake with strong data quality, accessibility, and storage efficiency.
  • Support ML engineers and scientists with data for model development, training, and evaluation.
  • Identify performance bottlenecks and scaling limitations across data pipelines and infrastructure.
  • Collaborate with distributed systems engineers to evolve the platform architecture and deliver reliable data products.

Requirements

  • 5+ years of data engineering experience.
  • Deep expertise with Apache Spark and the PySpark DataFrame API, including solving complex scaling problems.
  • Experience with large-scale data processing, cluster configuration, optimization, and tuning on GCP Dataproc.
  • Strong Python software development skills, including unit testing, Git, code review, and CI/CD.
  • Experience with Parquet, Delta Lake, Kafka, and Google Cloud Platform.
  • Familiarity with advanced query optimization, Docker, Kubernetes, GitHub Actions, and automated deployment.

Culture & Benefits

  • Collaborative work with ML engineers, scientists, distributed systems engineers, and other technical teams.
  • Opportunity to work on large-scale systems powering billions of AI-driven marketing decisions.
  • Medical, financial, and other benefits are provided.
  • Commitment to an inclusive and diverse workplace.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →