Middle/Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Middle/Senior Data Engineer (Python/Databricks): Developing and maintaining data pipelines and governance systems for a global mobility platform with an accent on data access, PII detection, and Infrastructure-as-Code. Focus on designing scalable data products, automating grant/rollback processes via Terraform, and optimizing lakehouse architecture.
Location: Must be based in Poland, Kazakhstan, EU, Georgia, Armenia, or Serbia. Working time zone: CET
Company
is a recruitment and staffing agency providing technical talent for global mobility and transportation platforms.
What you will do
- Develop and maintain data pipelines and governance systems on Databricks using Unity Catalog and Delta Lake.
- Conduct in-depth data analysis and profiling to classify data by domain and detect personal data (PII).
- Design data access systems and automate grant/rollback processes as Infrastructure-as-Code with Terraform.
- Review access architectures and contracts to ensure flexibility and reusability across the platform.
- Monitor and support deployed pipelines and quality checks to ensure performance expectations are met.
- Maintain technical documentation for data contracts, access models, and governance processes.
Requirements
- 3+ years of professional experience in Data Engineering.
- Strong proficiency in Python and SQL.
- Experience with Spark/PySpark for streaming, batch, and asynchronous data processing.
- Knowledge of data warehouse/lakehouse architecture and data modeling.
- Hands-on experience with Databricks, GCP, or AWS.
- Proficiency with Terraform for infrastructure automation.
- English: Upper-Intermediate (B2) required.
Culture & Benefits
- Fully remote work arrangement.
- Opportunity to work with a global mobility platform.
- Provision of client equipment or access via virtual workstations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →