12 часов назад
Senior Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI): Building scalable batch and real-time data pipelines and high-volume infrastructure for Kai's agentic AI cybersecurity platform with an accent on distributed processing, data modeling, and cloud-agnostic deployment. Focus on handling hundreds of millions of entries, reducing processing bottlenecks, and ensuring reliable cross-cloud data services across Azure, AWS, and GCP.
Location: San Jose, CA, United States
Company
is an AI cybersecurity company building an agentic AI platform that continuously contextualizes, assesses, reasons about, and executes security work for enterprise customers.
What you will do
- Design and build scalable batch and real-time data pipelines for the agentic AI security platform.
- Own and optimize high-volume data infrastructure processing hundreds of millions of entries with low latency and high reliability.
- Build data models and storage systems for large-scale, high-throughput security workloads.
- Identify architectural bottlenecks and improve processing time, reliability, and customer experience.
- Lead the Terraformization of data pipelines for cloud-agnostic deployment across Azure, AWS, and GCP.
- Integrate cloud data services, maintain secure permissions and connectivity, and collaborate with Backend Engineering on data ingestion and consumption.
Requirements
- 7+ years of experience in data engineering or data platform engineering.
- Hands-on experience handling 200M+ entries in asynchronous materialized views.
- Strong Python, SQL, data modeling, and large-scale distributed pipeline development skills.
- Experience with NoSQL databases such as CosmosDB or MongoDB, plus batch and streaming frameworks such as Flink, Kafka, or Spark.
- Experience with Airflow, Temporal, or equivalent orchestration tools, as well as Terraform, Kubernetes, and Docker.
- Deep hands-on expertise in Azure, AWS, or GCP; Azure experience is strongly preferred.
Nice to have
- DataOps experience and the ability to independently own pipeline deployment, permissions, and service integration decisions.
- Experience with AI/ML data systems, including feature stores, ML pipelines, or dataset versioning.
- Experience with Delta Lake, Apache Iceberg, or similar open table formats.
- Startup or high-growth company experience.
Culture & Benefits
- Well-funded company with $125M raised and enterprise customers including Fortune 500 and Global 1000 organizations.
- Hands-on, high-ownership role with significant influence over the development of the data function.
- Collaboration with experienced cybersecurity founders, engineering and product leadership, and a frontier AI applied research team.
- Competitive salary, equity options, and a supportive work environment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →