4 часа назад
Senior Data Engineer (AI Platform)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI Platform) (Python/SQL): Building scalable batch and streaming data systems, vector data pipelines, and retrieval infrastructure for production-grade AI and Generative AI applications with an accent on RAG, LLM systems, and distributed data processing. Focus on designing hybrid BM25 and vector retrieval, optimizing latency and cost, and enabling reliable training, evaluation, and inference workflows.
Location: San Jose, California, United States
Company
is an AI cybersecurity company building an agentic AI platform for enterprise security workflows.
What you will do
- Design and build scalable batch and real-time data pipelines.
- Develop data infrastructure for AI/ML and Generative AI training, evaluation, and inference.
- Build retrieval pipelines for RAG and LLM-powered applications.
- Design vector data pipelines covering embedding generation, indexing, storage, and retrieval.
- Develop data models and storage systems for large-scale AI applications while ensuring data quality and reliability.
- Optimize performance, latency, scalability, and cost, collaborating with product, engineering, and AI teams.
Requirements
- 4+ years of experience in data engineering or a related field.
- Strong experience building large-scale distributed data pipelines.
- Proficiency in Python and SQL, with experience using Spark or similar frameworks.
- Experience with batch and streaming systems such as Kafka, Flink, or Spark Streaming.
- Experience with AWS, GCP, or Azure cloud data platforms.
- Understanding of data modeling, storage systems, distributed systems, and AI/ML data infrastructure.
Nice to have
- Experience with LLM-powered systems, RAG pipelines, vector databases, and ANN search.
- Experience with AI platform or ML infrastructure data systems.
- Background in search, recommendation systems, or information retrieval.
- Familiarity with Kubernetes or Ray.
Culture & Benefits
- Work on frontier agentic AI research applied to enterprise cybersecurity.
- Well-funded company with $125M raised and Fortune 500 customers.
- Competitive salary, equity options, and a supportive work environment.
- Mentorship from experienced cybersecurity, AI, engineering, and product leaders.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 часов назад
Data Engineer (AI)
180 000 - 350 000$
7 дней назад
Senior Data Engineer
241 000 - 255 000$
8 часов назад
Senior Staff Data Engineer (ML Platform)
240 000 - 360 000$
3 часа назад
Staff Data Engineer (AI)
5 часов назад
Data Platform Engineer (AI)
200 000 - 400 000$
1 час назад