8 дней назад
Consultant, Application Developer (Data Engineer) (Azure Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Consultant, Application Developer (Data Engineer) (Azure Databricks): Building and delivering enterprise-scale data pipelines, reusable frameworks, and governed lakehouse products with an accent on Azure Databricks, Spark/PySpark, Delta Lake, batch and streaming ingestion. Focus on designing production-grade data solutions, implementing automated testing and CI/CD, optimizing platform performance, and resolving complex production issues.
Location: Toronto, ON; full-time on-site work is required for successful performance, with a hybrid arrangement involving 1–3 days per week on-site and the remaining days remote.
Company
is a relationship-oriented bank focused on delivering modern financial services and enterprise technology solutions.
What you will do
- Lead the end-to-end technical design and delivery of enterprise data pipelines, reusable frameworks, and governed data products on Azure Databricks.
- Architect, build, test, deploy, and support production-grade batch and streaming pipelines using Spark/PySpark, SQL, Delta Lake, Auto Loader, Structured Streaming, and Lakeflow.
- Define engineering standards covering code quality, testing, version control, deployment, documentation, security, monitoring, and supportability.
- Establish automated testing and CI/CD practices for repeatable promotion across development, test, and production environments.
- Lead impact analysis and design reviews, make technical decisions, optimize platform cost and performance, and resolve complex production issues.
- Partner with architecture, governance, security, business, delivery, data-owner, client, and vendor stakeholders.
Requirements
- 5–8 years of progressive data engineering experience, including technical leadership of data solutions.
- Recent hands-on experience delivering and supporting production-grade Databricks and Spark pipelines.
- Strong expertise in governed lakehouse solutions, Delta Lake, Unity Catalog, batch and streaming ingestion, orchestration, monitoring, and performance optimization.
- Experience implementing automated testing and CI/CD for Databricks workloads across multiple environments.
- Knowledge of Azure data services, enterprise production support, Agile delivery, and modernization from legacy ETL platforms such as Informatica.
- Computer Science degree or a related field; must be legally eligible to work in Canada and hold a valid work or study permit where applicable.
Culture & Benefits
- Competitive salary and incentive pay.
- Banking benefits, a benefits program, defined benefit pension plan, and employee share purchase plan.
- Vacation offering, wellbeing support, and a social points-based recognition program.
- Professional growth opportunities and a paid Purpose Day for personal development.
- Inclusive and accessible candidate and employee experience.
Hiring process
- Possible attribute-based assessments and skills tests, including simulation, coding, or French proficiency assessments.
- Artificial intelligence tools may be used during the recruitment process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
14 дней назад
Staff Data Engineer (AI)
195 000 - 273 000$
9 дней назад
Senior Data Engineer (AI)
14 дней назад
Staff Data Engineer (AWS)
169 200 - 199 100CAD
8 дней назад
Software Engineer (Data Platform)
9 дней назад
Software Developer Intern, Analytics (AI)
Morningstar
10 дней назад
Senior Software Engineer (Python/AWS)
90 489 - 132 711CAD