20 дней назад
Data Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AI) (AWS/Lakehouse): Design and optimize scalable Lakehouse data solutions and high-throughput pipelines for enterprise analytics and machine learning in banking environments with an accent on AWS, Databricks, Delta Lake, PySpark, Kafka, and SQL. Focus on enforcing banking-grade security and governance, reducing cloud costs, automating infrastructure and CI/CD, and supporting production MLOps workflows.
Location: On-site in Dubai or Abu Dhabi, United Arab Emirates
Company
is an AI and data consultancy that builds secure, scalable data foundations and intelligent systems for corporate and financial-services clients.
What you will do
- Design, build, and optimize AWS-based Lakehouse architectures using Databricks and Delta Lake.
- Develop batch and real-time ETL/ELT pipelines with PySpark, Apache Kafka, and SQL for complex financial datasets.
- Improve query performance, storage efficiency, latency, and cloud compute costs across AWS data services.
- Build feature engineering pipelines and support experiment tracking, containerized workflows, and model deployment with MLflow, Docker, EKS, and SageMaker.
- Implement encryption, access controls, audit trails, and data governance for banking and Central Bank compliance.
- Automate infrastructure and delivery with Terraform, GitHub Actions or CodePipeline, and well-tested Python.
Requirements
- Hands-on data engineering experience in banking, financial services, or fintech.
- Strong knowledge of AWS S3, Glue, EMR, and Redshift, plus Apache Spark, PySpark, and Apache Kafka.
- Experience building Lakehouse architectures with Databricks and Delta Lake, including data modeling, schema evolution, and ACID principles.
- High proficiency in Python and SQL; practical experience with Docker, Kubernetes/EKS, Terraform, and Git.
- Strong analytical and communication skills for explaining technical decisions to cross-functional teams and client stakeholders.
Nice to have
- AWS Data Engineer, AWS Solutions Architect, or Databricks Data Engineer certification.
- Experience with Apache Flink or Spark Streaming for fraud detection or trade-processing pipelines.
- Production experience with Apache Airflow or Prefect.
Culture & Benefits
- Individual visa sponsorship and comprehensive Gold Level personal health insurance.
- Professional development, certification support, and role-related subscription reimbursement.
- Work on cutting-edge AI projects with opportunities for career advancement.
- Monthly employee incentive program.
- Inclusive, accessible, predictable, and fair application and interview process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →