обновлено 3 дня назад
Lead Big Data Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Big Data Engineer (AWS/Python/PySpark): Designing and implementing data migration workflows, scalable data pipelines, and cloud-native solutions on AWS with an accent on distributed processing, data quality, and AI-assisted engineering. Focus on modernizing legacy platforms, building validation and automation frameworks, and guiding technical delivery across engineering teams.
Location: Poland, Bulgaria, or Romania; remote or office work
Company
delivers engineering and technology services focused on data, cloud transformation, and modernization initiatives.
What you will do
- Lead complex data migration and modernization programs from legacy platforms to scalable cloud-native environments.
- Design AWS-based data migration workflows and scalable batch and streaming pipelines with Python and PySpark.
- Analyze legacy applications, databases, and processing workflows to define migration strategies and implementation plans.
- Build data quality, reconciliation, validation, and migration governance frameworks.
- Develop automation solutions using Step Functions, Lambda, CloudWatch, and AI-assisted or LLM-powered tools.
- Provide technical guidance, participate in architecture discussions, and collaborate with stakeholders and engineering teams.
Requirements
- 7+ years of experience in data engineering, big data, or data migration projects.
- Strong Python and SQL skills, with advanced experience in PySpark and distributed data processing frameworks.
- Hands-on experience with AWS services including Step Functions, S3, Lambda, and CloudWatch.
- Knowledge of ETL, scalable data pipeline development, migration strategies, legacy modernization, and cloud transformation.
- Experience with AI-assisted workflows, LLMs, data validation, quality assurance, and migration governance.
- Upper-intermediate English or higher required.
Nice to have
- Experience with video, image, or audio processing pipelines for AI applications.
- Experience with IoT data platforms and data processing solutions.
- Familiarity with NVIDIA technologies, GPU-accelerated computing, or AI infrastructure.
- Knowledge of Infrastructure as Code tools such as Terraform or CloudFormation.
Culture & Benefits
- Remote or office work arrangements are available.
- Work on large-scale cloud transformation and modernization initiatives.
- Collaborate across engineering teams and contribute to technical reviews and continuous improvement.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →