обновлено 1 день назад
Lead Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (AI): Building and leading scalable data infrastructure for an intelligent AI assistant platform with an accent on real-time pipelines, analytics systems, vector search, and machine learning data workflows. Focus on architecting distributed data systems, optimising large-scale datasets, and establishing reliability, governance, and engineering standards as the founding data hire.
Location: Remote, Greater London / London, UK
Company
A remote-first organisation connecting skilled professionals with global teams and products through long-term roles.
What you will do
- Architect and build scalable data pipelines and infrastructure for AI and product systems.
- Design ingestion, transformation, storage, batch, and real-time processing architectures.
- Build vector search, retrieval, machine learning data workflows, monitoring, observability, and data quality frameworks.
- Ensure data reliability, security, governance, and performance across large-scale datasets and query systems.
- Collaborate with AI, backend, and product teams to support training, inference, product features, and data-driven decisions.
- Act as the founding data hire by defining architecture, engineering standards, team culture, and the future data function.
Requirements
- 7+ years of professional experience, primarily in dedicated data engineering roles.
- Strong experience designing data pipelines, distributed systems, data models, storage architectures, and scalable backend systems.
- Strong Python programming experience and knowledge of relational and NoSQL databases.
- Experience with PostgreSQL or comparable relational databases, with knowledge of data-processing performance and optimisation.
- Ability to make and justify architectural decisions rather than only implement them.
- Desirable experience with Apache Spark, Apache Airflow, Kafka, Elasticsearch or OpenSearch, MongoDB, vector databases, Pandas, or Polars.
Nice to have
- Experience with AI or machine learning platforms and vector databases used in modern AI systems.
- Familiarity with stream processing and event-driven architectures.
- Experience with GCP, AWS, or Azure cloud infrastructure.
- Experience in high-growth startups or early-stage companies.
Culture & Benefits
- Remote-first work environment.
- Full-time, long-term opportunities with global teams and products.
- Community-oriented culture focused on professional growth and well-being.
- Opportunity to work directly with founders and product leadership.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →