обновлено 18 часов назад
BigData Architect (Databricks + AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
BigData Architect (Databricks + AWS): Designing and implementing scalable batch and streaming data platforms on AWS with a focus on Databricks Lakehouse architectures. with an accent on data ingestion, orchestration, real-time processing, and data warehousing. Focus on scaling data platforms, integrating new data sources, and delivering solutions from PoC and MVP stages through production.
Location: Poland; remote or office work
Company
delivers engineering and technology projects involving scalable data platforms and analytics solutions.
What you will do
- Design and support scalable data solutions using Databricks on AWS.
- Develop batch and streaming data pipelines and Lakehouse architectures.
- Gather stakeholder requirements and translate them into technical solutions and implementation plans.
- Support data ingestion, source-to-target mappings, and integration of new data sources.
- Manage workflows with Databricks Workflows, Apache Airflow, or MWAA, and implement real-time processing with Apache Kafka, Amazon MSK, or Kinesis.
- Contribute to architecture discussions, technical documentation, prototypes, and delivery from PoC and MVP stages through production.
Requirements
- Proven experience designing scalable data platforms and data pipeline architectures.
- Hands-on experience with batch and streaming data processing.
- Strong expertise in AWS and Databricks, including Delta Lake, Unity Catalog, Workflows, and Jobs.
- Proficiency in Python, Scala, or Java, preferably Python, and strong SQL skills.
- Knowledge of Apache Spark or Flink, orchestration tools, streaming technologies, and data warehousing solutions such as Snowflake or Amazon Redshift.
- Experience with customer-facing and pre-sales activities, including workshops, architecture discussions, and solution presentations; upper-intermediate or higher English required.
Culture & Benefits
- Work in a collaborative, innovation-driven engineering environment.
- Contribute to knowledge sharing within the engineering community.
- Explore new technologies and build prototypes.
- Choose between remote and office work in Poland.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →