Эта вакансия в архиве
Посмотреть похожие вакансии ↓1 час назад
AWS Glue Data Engineer (Fintech)
Описание вакансии
Текст:
TL;DR
AWS Glue Data Engineer (AWS Glue/PySpark): Building and optimizing scalable ingestion pipelines for a Lakehouse architecture within the financial services sector with an accent on Bronze layer ingestion and performance optimization. Focus on migrating source systems using CDC and delta loads, ensuring data assurance, and automating deployments via Terraform.
Location: Hybrid (Dubai or Abu Dhabi, UAE)
Company
is a specialist AI and data consultancy focusing on implementing intelligent enterprise systems, particularly for the banking and financial services industries.
What you will do
- Develop and implement AWS Glue jobs for Bronze layer ingestion using defined standards and templates.
- Implement various loading methods including CDC, full load, delta, and snapshot based on source requirements.
- Optimize Glue job performance through DPU allocation, parallelization, and partitioning.
- Automate production deployments using Git and Terraform.
- Ensure jobs comply with data contracts and collaborate with Data Assurance leads for quality checks.
- Prepare technical documentation and coordinate handovers to operational support teams.
Requirements
- 5+ years of experience in data engineering roles with hands-on AWS Glue expertise.
- Proficiency in PySpark and ETL pipeline development.
- Strong knowledge of Lakehouse architecture and Medallion design principles.
- Experience with AWS ecosystem: S3, Athena, and Lambda.
- Familiarity with Git and Terraform for CI/CD automation.
- Must be based in or able to work in Dubai or Abu Dhabi under a hybrid model.
Nice to have
- Experience with data quality frameworks such as Soda Core.
- Ability to automate repetitive tasks and thrive in a fast-paced environment.
- Proficiency with Jira and Agile methodologies.
Culture & Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive health insurance.
- Professional development and certification support.
- Opportunity to work on cutting-edge AI projects in a rapidly growing firm.
- Flexible working arrangements.
Похожие вакансии
4 дня назад
Quant Developer (Fintech)
arcus search
4 дня назад
Senior/Mid-Level C++ Engineer (Fintech)
nfint
7 дней назад
Senior Product Engineer (Calypso)
14 часов назад
Smart Contract Engineer (Web3)
Order Capital
4 дня назад
Senior C++ Engineer (HFT)
10 000 - 30 000$
SellAnyCar
4 дня назад