TL;DR
Data Engineer (Telecom): Designing, building, and optimizing large-scale data pipelines for a global telecommunication enabler with an accent on Scala Spark, Databricks, and AWS cloud services. Focus on developing high-performance data platforms for network analytics, customer insights, real-time monitoring, and regulatory reporting.
Location: Hybrid in Varna, Bulgaria
Company
hirify.global Create is a leading software and digital engineering services company with global market reach, providing specialized software solutions and consulting across various industries.
What you will do
- Design, develop, and maintain scalable batch data pipelines using Scala, Databricks Spark, Databricks SQL, and Airflow.
- Implement optimized ETL/ELT processes to ingest, cleanse, transform, and enrich large volumes of telecom data.
- Ensure pipeline reliability, observability, and performance tuning of Spark workloads.
- Build and manage data architectures leveraging AWS services such as S3, Lambda, IAM, and CloudWatch.
- Implement infrastructure-as-code using Terraform.
- Collaborate with cross-functional teams (Architecture, DevOps, Network Engineering, Business Intelligence) and ensure security best practices and compliance.
Requirements
- 4+ years of experience as a Data Engineer or Big Data Developer.
- Strong proficiency in Scala and functional programming concepts.
- Advanced experience with Apache Spark (batch processing, Data Frame API, low-level Spark APIs, performance tuning, cluster optimization).
- Experience with optimized SQL-based data transformations for analytics and machine learning workloads.
- Solid understanding of CI/CD practices with Git, Jenkins/Gitlab Actions.
- Strong AWS skills: S3, Lambda, IAM, CloudWatch, and related services.
- English proficiency required.
Nice to have
- Hands-on experience with Databricks including notebooks, jobs, Delta Lake, Unity Catalog, and MLflow.
- Experience with Airflow integration with AWS services for end-to-end orchestration.
- Experience with IaC tools like Terraform or CloudFormation.
- Experience with Python, DBT, and Snowflake.
- Experience in the telecom sector and agile methodologies.
Culture & Benefits
- Believes in the power of diversity, equity, and inclusion for an inspiring workplace and innovation.
- Committed to openness, trust, and diversity.
- Opportunity to contribute to digital futures that benefit businesses, societies, and humanity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →