обновлено 5 дней назад
Senior Software Engineer (Data Infrastructure)
150 000 - 350 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Software Engineer (Data Infrastructure): Building robust data pipelines and infrastructure for evaluating real-world AI performance with an accent on processing and analyzing massive volumes of human vote data. Focus on designing scalable systems, ensuring data integrity, and collaborating with researchers to derive actionable insights from user feedback.
Location: SF Bay Area, United States; on-site
Salary: $150K–$350K annually, with the base range depending on permanent work location, experience, skills, and team position.
Company
develops a platform and open datasets for rigorous, human-centered evaluation of real-world AI models.
What you will do
- Design and build robust data pipelines to ingest, process, and transform user vote data into features for AI model performance evaluation.
- Collaborate with researchers, engineers, and product leadership to identify valuable data and insights from human votes and feedback.
- Develop dashboards and reports for the public, model providers, and researchers.
- Ensure pipeline integrity, data quality, and operational reliability.
- Scale data infrastructure for growing data volumes and evolving analytical requirements.
Requirements
- 5+ years of software engineering experience with a dedicated focus on data engineering and big data technologies.
- Proficiency in SQL and at least one data analysis programming language, including Python, Scala, or R.
- Hands-on experience with Apache Spark, Ray Data, or similar data processing and pipeline frameworks.
- Experience with a big data analytics platform such as Databricks or Snowflake.
- Experience designing, implementing, optimizing, and debugging production data pipelines and data lake platforms.
- Experience with advanced data analysis tools such as Delta Lake and streaming tables.
Nice to have
- Exposure to machine learning.
Culture & Benefits
- Work on AI evaluation products with a small, mission-driven team.
- Collaborate with researchers, academics, engineers, and product leaders.
- Culture focused on transparency, trust, craftsmanship, curiosity, and community impact.
- Competitive compensation and equity aligned with the team member’s market.
- Medical, dental, vision, and additional health and wellness benefits.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 дней назад
Senior Data Engineer (AI)
173 100 - 259 700$
8 дней назад
Senior Data Engineer (AI)
200 000 - 250 000$
NDA
10 дней назад
Senior Data Engineer (AI/ML)
99 000 - 139 000$
6 дней назад
Sr./Staff Data Engineer
160 000 - 180 000$
11 дней назад
Data Engineer (AI)
198 000 - 297 000$
5 дней назад
Senior Analytics Engineer (Finance)
120 000 - 190 000$