TL;DR
Data Engineer (Scala): Designing and optimizing large-scale batch data pipelines for a global telecommunication enabler with an accent on Scala Spark, Databricks, and AWS cloud services. Focus on implementing optimized ETL/ELT processes, ensuring pipeline reliability and performance, and managing data architectures leveraging infrastructure-as-code.
Location: Remote, based in Ukraine (Kyiv)
Company
hirify.global is a leading software and digital engineering services company with global market reach, providing mission-critical solutions across various industries through its specialized software businesses and tech consulting.
What you will do
- Design, develop, and maintain scalable batch data pipelines using Scala, Databricks Spark, and Airflow.
- Implement optimized ETL/ELT processes to ingest, cleanse, transform, and enrich large volumes of telecom data.
- Ensure pipeline reliability, observability, and performance tuning of Spark workloads.
- Build and manage data architectures leveraging AWS services (S3, Lambda, IAM, CloudWatch).
- Implement infrastructure-as-code using Terraform.
- Collaborate with cross-functional teams (Architecture, DevOps, Network Engineering, Business Intelligence).
Requirements
- 4+ years of experience as a Data Engineer or Big Data Developer.
- Strong proficiency in Scala and functional programming concepts.
- Advanced experience with Apache Spark (batch processing, performance tuning, cluster optimization).
- Hands-on experience with Databricks including notebooks, jobs, Delta Lake, Unity Catalog.
- Strong AWS skills: S3, Lambda, IAM, CloudWatch, and related services.
- Experience with Airflow integration with AWS services for end-to-end orchestration across cloud data pipelines.
- Experience with IaC tools: Terraform or CloudFormation.
- English proficiency required.
Nice to have
- Experience with MLflow, Python, DBT, or Snowflake.
- Experience in the telecom sector.
- Experience with an agile way of working.
Culture & Benefits
- Commitment to diversity, equity, and inclusion.
- Inspiring workplace and innovation-driven environment.
- Focus on openness, trust, and diversity.
- Mission to create digital futures benefiting businesses, societies, and humanity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →