Big Data Architect (Databricks + AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Big Data Architect (Databricks + AWS): Design and deliver scalable data platforms on AWS with a strong focus on the Databricks ecosystem. Own the development of batch and streaming data pipelines and Lakehouse architectures that enable analytics and data-driven decision making. Focus on data modeling, governance practices, real-time processing, and orchestrating complex workflows.
Location: Ukraine (Remote/Office)
Company
Global IT consulting and services company focused on engineering and technology solutions.
What you will do
- Design and implement scalable data solutions using Databricks on AWS for performance, reliability, and scalability
- Develop batch and streaming data pipelines and Lakehouse architectures
- Collaborate with stakeholders to gather requirements and define architecture designs and implementation plans
- Support data ingestion, source-to-target mappings, and onboarding new data sources
- Participate in architecture discussions, platform evolution, data modeling, and governance
- Manage workflows with Databricks Workflows, Apache Airflow, or MWAA; implement real-time processing with Kafka, MSK, or Kinesis
Requirements
- Proven experience designing scalable data platforms and pipelines in cloud environments
- Strong expertise with AWS services and Databricks (Delta Lake, Unity Catalog, Workflows, Jobs)
- Hands-on with batch/streaming processing using Apache Spark or similar
- Proficiency in Python (preferred), Scala, or Java, and solid SQL skills
- Experience with orchestration tools (Databricks Workflows, Airflow, MWAA) and streaming tech (Kafka, MSK, Kinesis)
- Familiarity with data warehousing (Snowflake, Redshift)
- Experience in customer-facing activities, workshops, architecture discussions
- Upper-intermediate or higher English for international teams
Culture & Benefits
- Collaborative, innovation-driven environment
- Equal Opportunity Employer
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →