обновлено 15 часов назад
Senior Big Data Engineer (Python + GCP)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Big Data Engineer (Python + GCP): Building scalable and reliable batch and streaming data pipelines and cloud-native data platforms on Google Cloud Platform with an accent on Python, SQL, Spark, Databricks, and GCP services. Focus on designing data architectures, optimizing large-scale processing, implementing transformation and orchestration workflows, and ensuring data quality and reliability.
Location: Ukraine; work format: remote or office
Company
delivers engineering and technology solutions, including cloud-based data platforms and analytics systems.
What you will do
- Design, develop, and maintain scalable batch and streaming data pipelines.
- Build and optimize data processing solutions with Python, SQL, Java, Apache Spark, and Databricks.
- Create cloud-native data architectures using BigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Storage.
- Implement data transformation, modeling, and analytics engineering practices with dbt and Dataform.
- Collaborate with stakeholders, architects, and engineering teams to translate data requirements into technical solutions.
- Support end-to-end delivery from proofs of concept and MVPs through production deployments and platform enhancements.
Requirements
- 5+ years of professional experience in Big Data or Data Engineering.
- Advanced Python and SQL skills for large-scale data processing and transformation.
- Hands-on experience with Google Cloud Platform, Apache Spark, Cloud Dataflow or Apache Beam, and Databricks Lakehouse concepts.
- Experience with Apache Airflow or Cloud Composer, Apache Kafka or Google Cloud Pub/Sub, BigQuery, and modern cloud data architectures.
- Experience with dbt and Dataform, plus strong analytical, troubleshooting, and problem-solving skills.
- Upper-intermediate or higher English proficiency required.
Culture & Benefits
- Choice of remote or office work format.
- Collaborative engineering environment with interaction across technical and non-technical teams.
- Participation in technical design discussions, architecture decisions, and continuous improvement initiatives.
- Equal opportunity employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →