Эта вакансия в архиве
Посмотреть похожие вакансии ↓обновлено 1 месяц назад
Databricks Engineer (AI)
Описание вакансии
Текст:
TL;DR
Databricks Engineer (AI): Design, build, and optimize large-scale data pipelines on Azure using Spark and Databricks with an accent on distributed data processing and modern data ingestion patterns. Focus on building fault-tolerant data computational pipelines, tuning queries, and performing root cause analysis.
Location: Aguascalientes, Guadalajara, Mexico City
Company
is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
What you will do
- Build and support highly available data and data pipeline capabilities.
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.
- Provide consultation and lead the implementation of complex programs.
- Develop and maintain documentation relating to assigned systems and projects.
- Tune queries running over billions of rows of data.
- Perform root cause analysis to identify resolutions to software or business process issues.
Requirements
- 6+ years of experience in Big Data and Data Engineering.
- Strong expertise in Spark (PySpark) and Azure Databricks for large‑scale distributed data processing.
- Hands-on experience developing data pipelines and applying data ingestion patterns within Azure ecosystems.
- Proficiency with orchestration tools such as Azure Data Factory (ADF) or Apache Airflow.
- Advanced SQL skills, including performance tuning for large datasets.
- Fluent English communication skills, both written and verbal.
Culture & Benefits
- Encouragement for flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment.
- Game-changing programs to accelerate the growth of people and the development of their expertise.
- Excellent compensation and benefits.
- Career path, trainings and real growth opportunities.
- Excellent work environment and culture.
- Highly professional and collaborative teams.