Data Engineer (Scala)

TL;DR

Data Engineer (Scala): Designing, building, and optimizing large-scale data pipelines within the telecom domain with an accent on Scala Spark, Databricks, and AWS cloud services. Focus on developing high-performance data platforms that enable network analytics, customer insights, real-time monitoring, and regulatory reporting.

Location: Remote from Ukraine

Company

hirify.global is a leading software and digital engineering services company providing mission-critical solutions across various industries through specialized software businesses and consulting services.

What you will do

• Design, develop, and maintain scalable batch data pipelines using Scala, Databricks Spark, Databricks SQL, and Airflow.
• Implement optimized ETL/ELT processes to ingest, cleanse, transform, and enrich large volumes of telecom network, usage, and operational data.
• Ensure pipeline reliability, observability, and performance tuning of Spark workloads.
• Build and manage data architectures leveraging AWS services like S3, Lambda, IAM, and CloudWatch.
• Implement infrastructure-as-code using Terraform, ensuring security best practices and compliance with telecom regulatory requirements.
• Collaborate with cross-functional teams and document system designs, data flows, and best practices.

Requirements

• 4+ years of experience as a Data Engineer or Big Data Developer.
• Strong proficiency in Scala and functional programming concepts.
• Advanced experience with Apache Spark (batch processing, performance tuning, cluster optimization).
• Experience with optimized SQL-based data transformations for analytics and Databricks (notebooks, jobs, Delta Lake, Unity Catalog).
• Strong AWS skills (S3, Lambda, IAM, CloudWatch) and experience with Airflow integration.
• Experience with IaC tools like Terraform and a solid understanding of CI/CD practices (Git, Jenkins/Gitlab Actions).
• English proficiency required.

Nice to have

• Experience with MLflow, Python, DBT, and Snowflake.
• Experience in the telecom sector and with an agile way of working.

Culture & Benefits

• Believes in the power of diversity, equity, and inclusion, encouraging applicants of all backgrounds and genders.
• Committed to openness, trust, and diversity to foster an inspiring workplace.
• Aims to create digital futures that benefit businesses, societies, and humanity.