Senior DataOps Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior DataOps Engineer (Databricks): Support the evolution of the Enterprise Data Foundation operating model with an accent on automating data ingestion pipelines and enforcing governance policies. Focus on implementing Medallion Architecture, designing CI/CD pipelines in Azure DevOps, and optimizing Databricks environments for scalability.
Location: Must be based in Brazil (Remote)
Company
Tech transformation specialists uniting human expertise with AI to create scalable tech solutions for a global client base.
What you will do
- Partner with local development teams to ensure adherence to engineering standards and DataOps best practices.
- Define and enforce Medallion Architecture (Bronze, Silver, Gold layers) within Databricks.
- Lead the migration from manual data loads to automated, scalable ingestion pipelines.
- Review and validate PySpark and SQL code, providing technical guidance to Data Engineers.
- Design and manage CI/CD pipelines in Azure DevOps for Databricks resource provisioning.
- Monitor and optimize Databricks environments for performance, scalability, and cost-efficiency.
Requirements
- Proven experience as a DataOps Engineer with a strong focus on Databricks.
- Solid hands-on expertise with PySpark and SQL, including code review practices.
- Experience building and managing CI/CD pipelines using Azure DevOps.
- Advanced English proficiency (C1 or higher) is mandatory.
- Must be based in Brazil.
Nice to have
- Databricks or cloud certifications.
- Experience with data visualization tools, specifically Power BI.
Culture & Benefits
- Comprehensive health and dental insurance.
- Meal and food allowance.
- Profit Sharing and Results Participation (PLR).
- Continuous learning via University and partnerships with online learning platforms.
- Wellness perks including Wellhub (Gympass), TotalPass, and mental health support platforms.
- Inclusive culture with dedicated support and accommodations for people with disabilities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →