обновлено 1 месяц назад
Lead Big Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Big Data Engineer (GCP, Databricks): Building scalable batch and streaming data pipelines and cloud-native data platforms on Google Cloud Platform with an accent on Python, SQL, Apache Spark, Databricks, and modern data modeling. Focus on designing reliable processing architectures, implementing orchestration and streaming workflows, and delivering data solutions from PoCs and MVPs through production.
Location: Bulgaria, Poland, or Romania; remote or office work
Company
provides engineering and technology services focused on data and analytics solutions.
What you will do
- Design, develop, and maintain scalable data pipelines for batch and streaming workloads.
- Build and optimize data processing solutions with Python, SQL, Java, Apache Spark, and Databricks.
- Create cloud-native data architectures using GCP services including BigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Storage.
- Implement data transformation, modeling, and analytics engineering practices with dbt and Dataform.
- Translate data requirements into technical solutions in collaboration with stakeholders, architects, and engineering teams.
- Support the full delivery lifecycle from PoCs and MVPs to production deployments and platform enhancements.
Requirements
- 5+ years of professional experience in Big Data or Data Engineering.
- Advanced Python and SQL skills for large-scale data processing and transformation.
- Hands-on experience with Google Cloud Platform, Apache Spark, Cloud Dataflow or Apache Beam, and Databricks Lakehouse concepts.
- Experience with orchestration tools such as Apache Airflow or Cloud Composer, and streaming technologies such as Apache Kafka or Google Cloud Pub/Sub.
- Strong knowledge of BigQuery, cloud data architectures, dbt, and Dataform.
- Upper-intermediate or higher English proficiency required. Strong analytical, troubleshooting, problem-solving, and communication skills are expected.
Culture & Benefits
- Remote or office work arrangement.
- Collaborative engineering environment.
- Participation in technical design discussions, architecture decisions, and continuous improvement initiatives.
- Work across the full project lifecycle, from discovery and solution design to implementation and production deployment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →