Lead Data Engineer with AWS, Python (FastAPI)

TL;DR

Lead Data Engineer (AWS, Python, FastAPI): Designing and scaling robust data pipelines for a data-driven legal platform with an accent on handling large volumes of legal and financial data collected via scrapers. Focus on developing and optimizing ETL/ELT workflows, building scalable data workflows with AWS services, and ensuring high-quality data through validation and lineage tracking.

Location: Remote from Bulgaria, Georgia, Kazakhstan, Poland, Serbia, Romania, Ukraine, Cyprus, Latvia, or Armenia. The company also has offices in Almaty, Astana, Belgrade, Cluj-Napoca, Dnipro, Kharkiv, Krakow, Kyiv, Larnaca, Lodz, Lublin, Lviv, Odesa, Riga, Sofia, Tbilisi, Varna, Warsaw, Wroclaw, and Yerevan.

Company

Our client is a leading legal recruiting company building a data-driven platform designed specifically for lawyers and law firms.

What you will do

• Lead and mentor a team of data engineers, providing technical guidance and support.
• Design and implement data ingestion pipelines for structured and unstructured data from multiple online sources.
• Develop and optimize ETL/ELT workflows using Python and SQL.
• Build and orchestrate scalable data workflows using AWS services like Batch and S3.
• Develop and deploy internal data APIs and implement robust text extraction and parsing logic.
• Ensure data quality through validation, deduplication, normalization, and lineage tracking.

Requirements

• Proven experience leading and mentoring a data engineering team.
• Strong experience with AWS (AWS Batch, S3, Step Functions, SQS).
• Experience in Python for data processing and backend development.
• Hands-on experience with relational databases (PostgreSQL) and strong SQL skills.
• Experience with Master Data Management (MDM) and data quality practices.
• Practical experience with Docker and containerized development workflows.

Nice to have

• Hands-on experience with Apache Spark and SQL for distributed data processing.
• Experience with EMR or SageMaker.

Culture & Benefits

• Vacation as per local laws, with encouragement for proper rest.
• Health insurance assistance for you and your loved ones.
• 10 days of sick pay without a doctor's note.
• Time off for state holidays according to the official calendar.
• Pleasant environment with corporate parties and team gatherings.
• Comfort service for technical and everyday work problems.
• Opportunities to work on global projects and grow your career in a supportive, flexible, and innovative tech environment.