TL;DR
Senior Data Engineer (Scala): Designing, building, and optimizing large-scale data pipelines within the telecom domain with an accent on Scala Spark, Databricks, and AWS cloud services. Focus on developing high-performance data platforms, ensuring pipeline reliability and observability, and implementing infrastructure-as-code.
Location: Remote from Kyiv, Ukraine
Company
hirify.global is a leading software and digital engineering services company with global market reach and capabilities, providing mission-critical solutions across various industries.
What you will do
- Design, develop, and maintain scalable batch data pipelines using Scala, Databricks Spark, Databricks SQL, and Airflow.
- Implement optimized ETL/ELT processes to ingest, cleanse, transform, and enrich large volumes of telecom network, usage, and operational data.
- Ensure pipeline reliability, observability, and performance tuning of Spark workloads.
- Build and manage data architectures leveraging AWS services (S3, Lambda, IAM, CloudWatch).
- Implement infrastructure-as-code using Terraform and ensure security best practices and compliance.
- Collaborate with cross-functional teams (Architecture, DevOps, Network Engineering, Business Intelligence) and document system designs.
Requirements
- 4+ years of experience as a Data Engineer or Big Data Developer.
- Strong proficiency in Scala and functional programming concepts.
- Advanced experience with Apache Spark (batch processing, performance tuning, cluster optimization).
- Hands-on experience with Databricks including notebooks, jobs, and Delta Lake.
- Strong AWS skills: S3, Lambda, IAM, CloudWatch, and related services.
- Experience with Airflow integration and IaC tools like Terraform.
- English: B2 required.
Nice to have
- Experience with MLflow, Unity Catalog, Python, DBT, or Snowflake.
- Knowledge of distributed systems, data governance, and security best practices.
- Experience in the telecom sector or with an agile way of working.
Culture & Benefits
- Belief in the power of diversity, equity, and inclusion, fostering an inspiring workplace.
- Commitment to openness, trust, and diversity to create digital futures that benefit businesses, societies, and humanity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →