3 дня назад
Senior Data Engineer (Fintech)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Fintech): Building batch and streaming lakehouse pipelines, feature stores, and agentic workflows for credit origination, underwriting, and portfolio reporting with an accent on Databricks, Spark, point-in-time correctness, and data observability. Focus on designing reliable agent loops with tools, evaluations, and guardrails, governing financial data, and solving freshness, quality, lineage, and reproducibility challenges.
Location: Hybrid in Warsaw or Krakow, Poland
Company
is building a fintech scale-up inside InPost focused on AI-enabled financial products and data engineering.
What you will do
- Design, build, and operate batch and streaming data pipelines on Databricks and Spark for credit origination, underwriting, and portfolio reporting.
- Build and maintain a feature store with point-in-time correctness, freshness SLAs, reproducibility, and tracing.
- Design agentic workflows and harnesses for feature creation, freshness monitoring, and data-quality checks, including context, tools, state, evaluations, and guardrails.
- Model governed financial and behavioural datasets with ownership, lineage, access controls, and GDPR alignment.
- Implement data-quality and observability checks for freshness, completeness, distributions, and schema drift.
- Own production operations, including monitoring, incident response, root-cause analysis, and continuous improvement.
Requirements
- 5+ years of experience in data engineering, pipelines, and data modelling.
- 3+ years with Spark, Databricks, or an equivalent lakehouse, plus 5+ years with SQL, Python, and data modelling.
- 2+ years of advanced agentic coding tools and loop engineering, including context and tool design, evaluations, guardrails, and iteration.
- Experience with batch and streaming lakehouse architectures, dimensional and event-based modelling, orchestration, SQL performance tuning, and large-table partitioning.
- Working knowledge of LLMs, data lineage, cataloguing, governance, and GDPR-aware data practices.
- English proficiency at B2 or above and a university degree in Computer Science, Data Engineering, Mathematics, or a related field.
Nice to have
- Experience with feature stores, ML data serving, payments, fintech, lending, credit-risk features, or scoring pipelines.
- Streaming and CDC experience with Kafka or Structured Streaming.
- Experience with dbt or equivalent transformation frameworks.
- Cost and performance optimisation on Databricks.
Culture & Benefits
- Work in a diverse, international, and cross-functional environment with experienced specialists.
- Collaborate with senior data and ML leadership while gaining exposure to e-commerce and logistics.
- Flexible working hours and an environment focused on training and professional development.
- Opportunity to contribute to sustainability, convenient delivery, and circular-economy initiatives.
- B2B contract available.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →