Senior Data Engineer (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (AWS): Building and scaling robust data pipelines for collecting and structuring large volumes of legal and financial data with an accent on ETL/ELT workflows and AI-driven enrichment. Focus on designing scalable ingestion pipelines using AWS Batch and S3, implementing complex text extraction logic, and ensuring high data quality across raw and enriched layers.
Location: Must be based in one of the specified office locations (Almaty, Astana, Belgrade, Cluj-Napoca, Dnipro, Kharkiv, Krakow, Kyiv, Larnaca, Lodz, Lublin, Lviv, Odesa, Riga, Sofia, Tbilisi, Varna, Warsaw, Wroclaw, Yerevan) or work remotely from Bulgaria, Georgia, Kazakhstan, or Poland
Company
is a global IT consultancy that provides software engineering and AI-driven solutions for complex business ecosystems.
What you will do
- Design and implement data ingestion pipelines to collect structured and unstructured data via web scraping, APIs, and feeds.
- Develop and optimize ETL/ELT workflows using Python and SQL.
- Build and orchestrate scalable data workflows leveraging AWS Batch and S3.
- Deploy internal data APIs and utilities to support platform data access and manipulation.
- Implement robust text extraction and parsing logic to handle diverse data formats.
- Ensure data quality through validation, deduplication, normalization, and lineage tracking.
Requirements
- Strong experience with AWS (Batch, S3, Step Functions, and SQS).
- Proficiency in Python for data processing and backend development.
- Hands-on experience with PostgreSQL and SQL querying.
- Experience with Master Data Management (MDM) and data quality practices.
- Practical experience with Docker and containerized development workflows.
- Experience with web scraping and data ingestion techniques from diverse online sources.
Nice to have
- Hands-on experience with Apache Spark for distributed data processing.
- Experience with AWS EMR and SageMaker.
Culture & Benefits
- Vacation and sick pay provided according to the laws of your country.
- Support for health insurance policies for employees and their loved ones.
- Paid time off for state holidays regardless of the client's schedule.
- Access to corporate parties and regular team get-togethers.
- Financial support for IT certifications and access to top-tier learning platforms.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →