6 дней назад
Lead Big Data Engineer (Databricks and AWS)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Big Data Engineer (Databricks and AWS): Building scalable batch and real-time data platforms, pipelines, and processing solutions on AWS with an accent on hands-on engineering, technical leadership, and production readiness. Focus on designing streaming and ingestion architectures, orchestrating workflows, integrating data sources, and optimizing data warehouse and analytics solutions.
Location: Remote, Bulgaria
Company
operates in Engineering & Technology, with this role focused on Data & Analytics.
What you will do
- Lead the design and implementation of scalable data pipelines and platform components on AWS.
- Drive end-to-end delivery of reliable, high-performance, maintainable data engineering solutions.
- Build and maintain batch and streaming data processing solutions using modern big data technologies.
- Develop data ingestion processes, source-to-target mappings, and integrations with new data sources.
- Orchestrate workflows with Apache Airflow or MWAA and implement real-time processing with Apache Kafka, Amazon MSK, or Kinesis.
- Collaborate with architects, engineers, and business stakeholders while promoting engineering best practices and continuous improvement.
Requirements
- Strong hands-on experience in Big Data and Data Engineering, including scalable data pipelines and platforms.
- Proven technical leadership experience and the ability to guide engineering teams.
- Strong expertise with AWS data engineering and analytics services.
- Proficiency in Python, Scala, or Java, with strong SQL skills.
- Hands-on experience with Apache Spark, Databricks, Flink, or similar technologies, plus Apache Airflow or MWAA.
- Experience with Apache Kafka, Amazon MSK, Kinesis, Snowflake, or Amazon Redshift; strong problem-solving, collaboration, communication, and performance optimization skills.
Culture & Benefits
- Remote work format in Bulgaria.
- Collaboration with engineers, architects, and business stakeholders.
- Focus on production-grade development, code quality, maintainability, and continuous improvement.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →