10 дней назад
Big Data Solutions Architect (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Big Data Solutions Architect (Databricks): Designing and delivering a migration from a custom reporting platform to a Databricks lakehouse with an accent on migration sequencing, regression protection, external data acquisition, and architecture ownership. Focus on optimizing LLM processing costs, ensuring crawl reliability and compliance, evaluating build-versus-buy options, and communicating technical decisions to client stakeholders.
Location: Poland; work setup: Remote/Office
Company
delivers engineering and technology services focused on data and analytics solutions.
What you will do
- Design the migration from a custom reporting platform to a Databricks lakehouse.
- Define migration sequencing, regression testing, rollback planning, and delivery with no functional regression.
- Design architecture for acquiring and processing external data, including crawling reliability, rate governance, and compliance with source terms of use.
- Optimize LLM-related costs through model selection, processing deduplication, and right-sizing.
- Conduct technical and commercial build-versus-buy assessments with external data providers.
- Work hands-on with engineering teams and communicate architecture decisions to client stakeholders.
Requirements
- Strong experience architecting reporting products built on custom platforms rather than traditional BI stacks.
- Experience designing migrations from legacy replication solutions to lakehouse architectures, ideally Databricks.
- Experience defining migration strategies with strict functional-regression requirements.
- Strong knowledge of external data acquisition, crawling, rate governance, reliability, and data-processing optimization.
- Experience with LLM cost optimization, model selection, right-sizing, and processing deduplication.
- Excellent client-facing English communication skills and willingness and ability to travel.
Nice to have
- Knowledge of SAP procurement data.
- Exposure to commodity or market-index data.
Culture & Benefits
- Remote/office work setup in Poland.
- Close collaboration with engineering teams and client stakeholders.
- Equal opportunity employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →