3 дня назад
Lead Data Engineer (Azure)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (Azure): Design and deliver scalable ETL pipelines and data integration solutions across Azure environments with an accent on SQL, Python, Spark, PySpark, workflow orchestration, and data quality. Focus on optimizing distributed data processing, developing business-aligned data models, and providing technical guidance throughout client solution delivery.
Location: Mexico, Colombia, or Chile. Work type: Remote/Office.
Company
delivers engineering and technology solutions for clients across international projects.
What you will do
- Design and develop scalable ETL and data integration pipelines across Azure data environments.
- Build and optimize data processing workflows using SQL, Python, Spark, PySpark, Azure Data Factory, and Apache Airflow.
- Develop data models and schemas aligned with business requirements, architecture standards, and downstream consumption needs.
- Implement data quality and validation controls to maintain data integrity across platforms.
- Optimize SQL queries, ETL processes, and data workflows for performance and reliability.
- Guide engineering teams on technical decisions, troubleshooting, engineering practices, and solution delivery.
Requirements
- 5+ years of experience in Data Engineering, including hands-on ETL pipeline and data integration development.
- Advanced SQL and Python skills for data processing, transformation, and optimization.
- Strong experience with Spark and PySpark for distributed data processing.
- Hands-on experience with Azure data technologies and cloud-based data platforms, including Azure Data Factory and/or Apache Airflow.
- Strong knowledge of data architecture, data modeling, data quality, data integration, and SQL and ETL performance optimization.
- Strong working proficiency in English is required for daily communication with international clients and teams.
Nice to have
- Exposure to Microsoft Fabric, Hadoop, Hive, Kafka, Power BI, or Tableau.
- Experience with healthcare or pharmaceutical data environments.
Culture & Benefits
- Work in remote or office format.
- Collaborate with international clients, Solution Architects, and engineering teams.
- Participate across the full delivery lifecycle, from business requirements to reliable data solutions.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →