Senior DataOps Engineer

TL;DR

Senior DataOps Engineer (Spark/Data Platforms): Owning data analytics infrastructure from build and deployment pipelines to large-scale Spark-based processing environments with an accent on cloud provisioning, CI/CD automation, and distributed systems operations. Focus on designing scalable infrastructure templates, resolving pipeline issues, monitoring performance, and fostering DataOps best practices.

Location: Remote US

Salary: $130,000 - $160,000 a year

Company

Leading FHIR-based health data platform enabling collection and exchange of structured healthcare data across 20+ countries, ranked #19 on Deloitte's Technology Fast 50 for 2024.

What you will do

• Build, maintain, and operate CI/CD pipelines and infrastructure-as-code for the platform and services.
• Provision and manage cloud-based Spark clusters and distributed data processing with tools like Airflow, Databricks, or EMR.
• Develop, test, and monitor data pipelines from setup to production.
• Design scalable, secure infrastructure templates across AWS, Azure, GCP, or OCI.
• Investigate issues, perform root-cause analysis, and implement fixes for pipelines and integrations.
• Monitor systems, respond to incidents, optimize performance, and control cloud costs.

Requirements

• 6+ years in DevOps, DataOps, or data platform engineering
• Hands-on with Apache Spark and managed platforms (Databricks, AWS EMR, GCP Dataproc)
• Proficiency in Python; knowledge of Java or Scala
• Experience with orchestration tools (Apache Airflow, Prefect)
• Strong CI/CD with GitLab CI, Jenkins, or GitHub Actions
• IaC with Terraform, Ansible (CloudFormation, ARM Templates a plus)
• Operating Linux and public clouds (AWS, Azure, GCP, OCI)
• Familiarity with Kubernetes for data workloads
• Ability to manage multiple workstreams and meet timelines
• Customer-first mindset and strong communication skills

Culture & Benefits

• Remote work environment
• Flexible time away policy including PTO, personal, and sick days
• Competitive salary and health/medical benefits
• RRSP/TFSA/401K contributions
• Life and disability insurance, employee assistance program
• FHIR study program, Skillsoft learning, Super HAPI Fun Club
• Core values of respect, inclusion, diversity, equity, and belonging