2 часа назад
Senior Data Engineer (Python/SQL)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Python/SQL): Designing and building scalable batch and streaming data pipelines, transformation layers, and data models for an enterprise lakehouse with an accent on Apache Spark, Kafka, Flink, and medallion architecture. Focus on optimizing large-scale PySpark and SQL transformations, implementing data quality monitoring and infrastructure as code, and mentoring data engineers.
Location: Remote - Hungary
Company
is committed to building an inclusive and accessible work environment that supports employees and customers from diverse communities.
What you will do
- Design and implement scalable batch and streaming data pipelines using Apache Spark, Kafka, and Flink.
- Build and maintain Bronze, Silver, and Gold medallion architecture in the enterprise lakehouse using Delta Lake or Iceberg.
- Develop and optimize complex SQL and PySpark transformations for large-scale structured, semi-structured, and unstructured datasets.
- Collaborate with data architects on physical and logical data models, data quality checks, monitoring, and transformation layers.
- Write infrastructure as code, participate in code reviews, troubleshoot data incidents, and mentor junior and mid-level data engineers.
Requirements
- 6+ years of data engineering experience with a record of enterprise-scale delivery.
- Expert proficiency in Python and SQL, with required hands-on PySpark experience.
- Experience with Apache Spark, Delta Lake, or Apache Iceberg.
- Experience with Apache Airflow, Prefect, or Dagster, plus cloud data services such as AWS Glue, Azure Data Factory, or GCP Dataflow.
- Proficiency with Git, CI/CD pipelines, Docker, Kubernetes, dbt, and related engineering practices.
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
Nice to have
- Experience with Databricks, Snowflake, or Apache Hudi.
- Knowledge of streaming architectures and Apache Kafka.
- Databricks Certified Data Engineer or AWS Data Analytics Specialty certification.
Culture & Benefits
- Inclusive and accessible work culture focused on respect and support.
- Commitment to a workforce that reflects the diversity of customers and communities.
- Accommodations are available by request throughout the selection process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 часов назад
Senior Big Data Software Engineer (Databricks + AWS)
1 день назад
Data Engineer (Senior) (AI)
3 дня назад
Principal Data Engineer (Enterprise Data & Analytics)
155 501 - 225 493$
20 часов назад
Senior Data Engineer (AWS/dbt)
4 дня назад
Senior Data Engineer (AWS)
2 дня назад