6 минут назад
Data Engineer (Python/SQL/AWS/Iceberg)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Python/SQL/AWS/Iceberg): Developing and maintaining scalable data pipelines and analytical data models for silver and gold layers with an accent on data quality, governance, and performance optimization. Focus on building automated validation checks, optimizing Iceberg, Athena, and Spark workloads, and delivering reliable AWS-based data processing.
Location: Remote or office, with workation available according to company policy.
Company
is an ethical, diversity-driven organization focused on equal opportunities and a safe, inclusive workplace.
What you will do
- Modify Lambda functions, SQL queries, and processing jobs to deliver new data pipeline features.
- Refactor code for ingesting and processing external data.
- Design data models for Iceberg-based silver and gold layers.
- Apply validation rules and build automated data quality checks.
- Optimize queries, Iceberg tables, Athena queries, and Spark workloads for performance and cost efficiency.
- Document data preparation processes, transformations, code decisions, and dataset versioning in GitLab.
Requirements
- 4–6 years of experience as a Data Engineer and proven experience building scalable, reliable, and maintainable data pipelines.
- Strong Python-based pipeline development skills, including Test-Driven Development and AI-assisted coding practices.
- Strong SQL, data modeling, and schema design expertise, including analytical data models.
- Familiarity with DBT, Airflow, CI/CD, automated testing, Infrastructure as Code, data observability, monitoring, and failure recovery.
- Hands-on AWS experience with Athena, Lambda, Aurora, EventBridge, Glue, and SageMaker, plus knowledge of Iceberg and Spark optimization.
- Fluent English and clear communication with engineering, product, and data stakeholders are required.
Culture & Benefits
- Stable employment at a company operating since 2008 with more than 1,800 talents across 7 global sites.
- Choice of remote work or office-based work, with flexible working hours and contract options.
- Workation policy and autonomy in choosing how to work.
- Online onboarding with a buddy, collaboration with experienced engineers, and access to Udemy from day one.
- Certificate training, upskilling programs, competency centers, webinars, and more than 110 annual training opportunities.
- Inclusive community with well-being initiatives, modern office equipment, charity activities, and environmental support.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Senior Data Engineer
105 700 - 149 275$
3 дня назад
Staff Software Engineer (Data Engineering)
126 090 - 151 615CAD
2 дня назад
Software Engineer (Python/Data)
127 800 - 135 900$
Flowwow
2 дня назад
Senior Data Engineer (AI)
17 часов назад
Lead Python Software Engineer
2 дня назад