TL;DR
Senior Data Engineer (GCP): Building and optimizing scalable data infrastructure and pipelines with an accent on handling massive datasets and real-time/batch processing. Focus on deploying and managing data clusters, efficient storage formats, and robust automated pipeline development leveraging Google Cloud services.
Location: Multiple locations including Skopje, Belgrade, Bitola, Kragujevac, Nis, Novi Sad, Ohrid
Company
Avenga, a global company of 6000+ specialists, provides a full spectrum of services including business and tech advisory, enterprise solutions, and software development, believing in human creativity empowering technology that matters.
What you will do
- Deploy and manage clusters for data exploration using tools like PySpark, Dask, and Dataproc.
- Handle massive datasets stored in Cloud Storage (e.g., Parquet files) and BigQuery, tailoring storage formats to workload requirements.
- Build and maintain scalable, automated pipelines using Dataflow, Cloud Composer, and Pub/Sub for real-time and batch processing.
Requirements
- Experience in deploying and managing clusters for data exploration using tools like PySpark, Dask, and Dataproc.
- Proficiency in handling massive datasets stored in Cloud Storage (e.g., Parquet files) and BigQuery.
- Expertise in building and maintaining scalable, automated pipelines using Dataflow, Cloud Composer, and Pub/Sub.
- English: B2 required.
Culture & Benefits
- Commitment to equal opportunities in recruitment, career development, and leadership, regardless of background.
- Fostering a work environment where a diverse community of employees, candidates, and business partners actively shapes growth.
- Building a workplace where everyone feels free to be themselves while honoring the boundaries of others.
Hiring process
- Send your application for review.
- Meet the Talent team for an acquisition interview.
- Participate in a technical interview to discuss expertise and problem-solving.
- Potentially have a customer interview for certain roles.
- Receive a job offer if it's the right match.
Будьте осторожны: если вас просят войти в iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →