5 дней назад
Lead BigData Engineer (Databricks and AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead BigData Engineer (Databricks and AWS) (AWS/Databricks): Leading the development of scalable batch and real-time data platforms, pipelines, and processing solutions with an accent on AWS, Databricks, Apache Spark, Airflow, Kafka, and data warehousing. Focus on designing production-grade architectures, orchestrating streaming workflows, optimizing performance, and providing technical guidance to data engineers.
Location: Remote from Bulgaria
Company
is an engineering and technology company delivering data and software engineering solutions.
What you will do
- Lead the design and implementation of scalable data pipelines and AWS platform components.
- Drive end-to-end delivery of reliable, maintainable, and high-performance data engineering solutions.
- Build batch and streaming data processing solutions using modern big data technologies.
- Develop data ingestion processes, source-to-target mappings, integrations, and orchestrated workflows with Apache Airflow or MWAA.
- Implement real-time processing with Apache Kafka, Amazon MSK, or Kinesis, and contribute to Snowflake or Amazon Redshift solutions.
- Guide data engineers, collaborate with architects and stakeholders, and promote engineering best practices.
Requirements
- Strong hands-on experience in Big Data and data engineering, including scalable pipelines and platforms.
- Proven technical leadership experience and the ability to guide engineering teams.
- Strong expertise with AWS services for data engineering and analytics.
- Proficiency in Python, Scala, or Java, together with strong SQL skills.
- Experience with Apache Spark, Databricks, Flink, Apache Airflow or MWAA, and streaming technologies such as Kafka, Amazon MSK, or Kinesis.
- Upper-intermediate or higher English proficiency, along with strong problem-solving, stakeholder collaboration, and communication skills.
Culture & Benefits
- Remote work arrangement for candidates based in Bulgaria.
- Equal opportunity employment.
- Focus on engineering quality, continuous improvement, and production-ready solutions.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →