3 дня назад
Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AI): Building data pipelines, lakehouse solutions, and real-time streaming systems that transform petabytes of video and event data for model training, evaluation, and inference with an accent on Snowflake, Databricks, data modeling, and low-latency processing. Focus on designing scalable data platforms, optimizing storage and query performance, and ensuring data quality, lineage, and observability for live AI systems across thousands of stores.
Location: Herndon, VA; hybrid workplace
Company
develops vision AI solutions for leading retailers, including platforms that process large-scale video and event data.
What you will do
- Design and build data pipelines and platform components for model training, evaluation, and real-time inference.
- Own conceptual, logical, and physical data modeling for analytical and operational use cases.
- Implement cloud-based data lakehouse solutions with product and engineering teams.
- Build low-latency streaming applications that move event and video-derived data from stores to the platform.
- Model, store, and serve large data volumes with Snowflake and Databricks while optimizing reliability, cost, and query performance.
- Establish data quality, lineage, observability, shared tooling, and engineering standards in collaboration with platform, MLOps, analytics, and operations teams.
Requirements
- 3–5 years of experience building production data platforms or pipelines, ideally at scale.
- Strong experience with Snowflake, Databricks, data modeling, performance tuning, and cost management.
- Experience building streaming and real-time data applications with Kafka, Spark Structured Streaming, or Flink.
- Strong Python and SQL programming skills, including data transformations and automation.
- Understanding of distributed systems, data warehousing, lakehouse patterns, and maintainable software engineering practices.
- Experience with cloud platforms, Docker, Kubernetes, CI/CD, data quality, reliability, and observability; a degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Nice to have
- Experience with large-scale video, event, or other high-volume data sources.
- Familiarity with the broader stack, including C/C++, CUDA, PyTorch, OpenCV, TensorRT, ONNX, Linux, and real-time video processing.
Culture & Benefits
- Full-time permanent employment in a hybrid work environment.
- Opportunity to work with industry experts while scaling a global organization.
- Fast-paced, iterative, delivery-focused environment with independent problem-solving.
- Cross-functional collaboration with applied science, platform, infrastructure, MLOps, product, analytics, and operations teams.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
Data Engineering Manager, Commercial US
148 500 - 214 500$
3 дня назад
Principal Data Engineer (Data Platform)
220 000 - 260 000$
5 дней назад
Data Engineer Lead
125 000 - 135 000$
4 дня назад
Data Engineering Architect, Senior (Databricks)
180 000 - 220 000$
5 дней назад
Data Engineer II (Fintech)
129 000 - 156 000$
5 дней назад