TL;DR
Senior Data Engineer (AI): Building the data foundation that powers search and ML systems with an accent on corpus ingestion, processing, enrichment, and index refresh. Focus on data quality monitoring, validation, and alerting across the search data stack.
Location: Hybrid in New York City
Salary: $128,500 - $231,500 USD
Company
hirify.global is a design-driven platform helping entrepreneurs build brands and businesses online.
What you will do
- Build and own the data pipelines that power the search system, including corpus ingestion, processing, enrichment, and index refresh.
- Design and maintain feature pipelines for ML models, partnering with Ranking MLE on feature engineering and computation.
- Own the embedding pipeline infrastructure to run models at scale.
- Integrate with and extend feature store infrastructure to serve features at training and inference time.
- Establish data quality monitoring, validation, and alerting across the search data stack.
- Partner with Machine Learning Engineering on index refresh strategies and schema evolution.
Requirements
- 6+ years of professional experience in data engineering, including 2-3+ years supporting ML or search systems.
- Experience building and operating batch and streaming data pipelines at scale on a major cloud platform (AWS, GCP, or Azure).
- Strong SQL skills with modern data tooling (Spark, Airflow, dbt, or similar).
- Familiarity with ML infrastructure, such as feature stores, vector databases, embedding pipelines and ideally search systems (Elasticsearch, Solr, Vespa, or similar)
- Data ownership to drive quality end-to-end, including schema design, validation, monitoring, and debugging.
Culture & Benefits
- Choice between medical plans with an option for 100% covered premiums.
- Flexible paid time off.
- Retirement benefits with employer match.
- Free lunch and snacks.
- Dog-friendly workplace.
Будьте осторожны: если вас просят войти в iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →