2 дня назад
Senior Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Databricks/AWS): Designing and operating a unified data platform to power analytics and AI initiatives with an accent on scalable data infrastructure and AI-ready datasets. Focus on building production-grade ETL/ELT pipelines, implementing medallion architecture, and ensuring high data quality and governance.
Location: Remote (Global)
Company
is the leading digital accessibility solutions company helping organizations build products that work for everyone.
What you will do
- Design and maintain a scalable data platform on Databricks and AWS using Medallion architecture principles.
- Develop ETL/ELT pipelines from core business systems to ensure data quality, reliability, and performance.
- Implement automated data quality monitoring for freshness, completeness, and anomaly detection.
- Manage metadata, lineage, and permissions via Databricks Unity Catalog.
- Collaborate with cross-functional teams to deliver analytics- and AI-ready datasets.
- Apply IaC, CI/CD, and version control best practices for all data pipelines.
Requirements
- 8+ years of experience building production-grade ETL/ELT pipelines at scale.
- Strong proficiency in Python, PySpark, and API integrations.
- Hands-on experience with Databricks (Unity Catalog, Workflows) and AWS (Lambda, S3, Glue, Athena, DynamoDB).
- Expertise in Lakehouse architectures, Delta Lake, and data modeling.
- Proficiency in SQL and dbt for building modular, tested, and documented models.
- Experience with REST API integration and entity resolution strategies.
Nice to have
- Experience with Delta Live Tables and MLflow integration.
- Salesforce API experience (Bulk API 2.0, REST API, SOQL).
Culture & Benefits
- Comprehensive and inclusive benefits tailored to local regulations worldwide.
- US and Canada employees receive medical, dental, vision, and retirement match.
- Flexible paid time off and paid parental leave.
- Remote work stipend and professional development reimbursement.
- Commitment to workforce diversity and equal opportunity employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →