3 дня назад
Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AI): Building scalable data infrastructure and resilient ETL/ELT pipelines for an enterprise AI reasoning platform processing billions of structured and unstructured data rows weekly with an accent on distributed systems, cloud data platforms, and agentic workflows. Focus on designing reliable ingestion and transformation systems, automating monitoring and compliance checks, and enabling secure data delivery for machine learning and product features.
Location: Remote, associated with New York
Company
Venture-backed AI startup building an enterprise reasoning platform that combines AI reasoning, data activation, and agentic workflows to help large organizations make and execute growth decisions.
What you will do
- Build and maintain scalable data infrastructure and resilient ETL/ELT pipelines processing billions of structured and unstructured data rows weekly.
- Extract and ingest data from web sources and develop tools, abstractions, and frameworks for managing data pipelines.
- Use Snowflake, Databricks, Airflow, Snowpark, Cloud Run, and Apache Beam for data processing, sharing, and access control.
- Collaborate with Forward Deployed Engineers, Data Scientists, Backend Engineers, client IT teams, and business stakeholders to deliver production-ready data workflows.
- Create monitoring systems, automate security and compliance checks, and resolve issues affecting reliability and data integrity.
- Define, deploy, and maintain infrastructure using Infrastructure as Code principles.
Requirements
- 2–5 years of experience in Data Engineering or Data Infrastructure roles.
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Experience building reliable data pipelines with automated unit and integration tests.
- Strong understanding of ETL/ELT architecture, data modeling, distributed systems, and distributed computing frameworks such as Apache Beam or Spark.
- Hands-on experience with agentic systems and AI-driven tooling for data extraction, validation, workflow automation, or software engineering.
- Strong debugging, analytical, problem-solving, and cross-functional communication skills.
Nice to have
- Experience delivering enterprise software for Fortune 500 clients in Financial Services, Industrials, or Consumer Products.
- Startup experience and familiarity with Trino, Starburst, Presto, Terraform, graph databases, or graph query languages.
- Experience with APIs, modern web scraping, custom Agent Skills, or Model Context Protocol integrations.
Culture & Benefits
- Work in a rapidly growing, venture-backed startup environment.
- Competitive compensation and equity.
- Unlimited vacation.
- 100% company-paid health, dental, and vision insurance.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →