Senior Data Engineer (ADB + Python)

TL;DR

Senior Data Engineer (ADB + Python): Designing and maintaining scalable Spark applications and data pipelines for enterprise tax services with an accent on high-performance data processing and microservices architecture. Focus on optimizing code for scalability, implementing Delta Tables, and collaborating with cross-functional teams to deliver AI-driven tools.

Location: Remote from Bulgaria, Georgia, Poland, Romania, or Uzbekistan

Company

A world-leading professional services network (Big Four) specializing in audit, tax, consulting, and advisory services.

What you will do

• Design, develop, and maintain robust and scalable Spark applications using Databricks or Azure Synapse/Fabric.
• Define and enforce coding standards and conduct thorough code reviews to maintain high quality.
• Write efficient Python code for complex data manipulation using Pandas and Polars.
• Optimize data handling and system performance for scalability.
• Collaborate with cross-functional teams to deliver high-quality software and AI-driven tools.
• Create and maintain comprehensive documentation for code, processes, and workflows.

Requirements

• 5+ years of hands-on experience in software development.
• Extensive experience with Apache Spark, Databricks, and/or Azure Synapse/Fabric.
• Proficiency in Python and data manipulation libraries (Pandas, Polars).
• Solid understanding of columnar storage (Parquet) and Delta Tables.
• Experience with microservices architecture in scalable systems.
• English: Intermediate+ proficiency required.

Nice to have

• Experience with Azure Cloud services (Service Bus, Data Lake, Blob Storage, Redis).
• Familiarity with FastAPI.
• Expertise in Docker and Kubernetes for containerization and orchestration.

Culture & Benefits

• Fully remote work arrangement.
• Opportunity to work with a global professional services leader.
• Exposure to cutting-edge technologies including LangChain, LangGraph, and RAG pipelines.