12 дней назад
Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building and maintaining Databricks data pipelines and reusable transformations with an accent on PySpark, SQL, Delta Lake, and medallion architecture. Focus on optimizing pipeline performance and cost, validating data quality, troubleshooting production issues, and transitioning Alteryx workflows to Databricks.
Location: Tlaquepaque, Jalisco, Mexico
Employment: Full time
Company
is a global Fortune 500 technology distributor and solutions company providing design, supply chain, and logistics expertise.
What you will do
- Design, build, maintain, and enhance data pipelines in Databricks using PySpark, SQL, and Delta Lake.
- Develop reusable data transformations following bronze, silver, and gold medallion architecture patterns.
- Validate data accuracy, completeness, and consistency across datasets and pipeline stages.
- Optimize data jobs for performance, scalability, and cost efficiency.
- Collaborate with business analysts and stakeholders to translate requirements into data models and analytics datasets.
- Troubleshoot production pipeline issues, perform root-cause analysis, and document lineage and transformation logic.
Requirements
- Typically 3+ years of relevant work experience with a bachelor's degree or equivalent.
- Bachelor's degree or comparable experience.
- Experience with Databricks, PySpark, SQL, and Delta Lake.
- Knowledge of version control, testing, deployment, and data pipeline reliability practices.
- Experience transitioning Alteryx workflows to Databricks.
- Experience with Power BI visualizations.
Culture & Benefits
- Collaborative, integrity-driven environment within a global team.
- Generous paid time off, paid holidays, and a savings fund.
- Medical, dental, vision, and life insurance.
- Education assistance and employee development resources.
- Wellness, leadership development, and mentorship programs.
- Year-end bonus and food coupons.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →