обновлено 2 дня назад
Staff Software Engineer (Data Infrastructure)
200 000 - 275 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Software Engineer (Data Infrastructure) (Apache Iceberg/Spark/Kafka): Architecting and operating real-time data infrastructure that ingests, stores, and serves massive volumes of operational data with an accent on petabyte-scale storage, distributed processing, and high-throughput integrations. Focus on designing resilient data platforms, optimizing performance and cost, and establishing data contracts and infrastructure patterns across the organization.
Location: San Francisco, CA; applicants must be located in San Francisco and open to working in office
Salary: $200,000–$275,000 USD annually, plus benefits, equity if applicable, and bonus if applicable
Company
builds an AI-enabled platform that turns siloed data into operational intelligence for public safety organizations, government agencies, and private-sector institutions.
What you will do
- Design and operate a high-throughput, real-time data integration platform across diverse customer environments.
- Architect scalable open table format infrastructure for reliable petabyte-scale data storage.
- Build and optimize distributed batch and streaming data processing pipelines.
- Improve performance, reliability, and cost efficiency across the data infrastructure stack.
- Define data contracts, schemas, and integration patterns with platform and product engineering teams.
- Establish best practices, tooling, and reusable patterns for data infrastructure.
Requirements
- 8+ years of experience architecting and operating large-scale data infrastructure systems in production.
- Deep expertise in Apache Iceberg, including schema evolution, partitioning, compaction, and time travel.
- Extensive hands-on experience with Apache Spark for batch and streaming processing at scale.
- Strong experience with Apache Kafka, Apache Flink, or equivalent stream-processing technologies, plus Airflow or similar orchestration tools.
- Production software engineering experience with Python and/or Scala, AWS or comparable cloud platforms, S3-based data lakes, and Kubernetes.
- Located in San Francisco and open to working in office. A degree in Computer Science, Engineering, or a related field, or equivalent practical experience, is required.
Nice to have
- Experience working across the full data stack, from ingestion through serving.
- Experience defining durable infrastructure solutions for ambiguous, open-ended technical problems.
Culture & Benefits
- Annual salary plus benefits, equity if applicable, and bonus if applicable.
- Ownership of major features and foundational infrastructure decisions.
- Close collaboration with deployment teams, users, platform engineers, and product engineers.
- Emphasis on empathy, humility, perseverance, creativity, and operational excellence.
- Inclusive workplace and equal employment opportunity.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Senior Data Platform Engineer
145 000 - 190 000$
Airbnb
4 дня назад
Staff Software Engineer (Data Infrastructure)
212 000 - 265 000$
3 дня назад
Senior Software Engineer II (Data Pipelines)
155 000 - 180 000$
Plaid
3 дня назад
Senior Data Engineer
191 000 - 239 000$
3 дня назад
Senior Database Engineer (AWS)
100 000 - 200 000$
7 дней назад
Staff Data Engineer (AI)
202 500 - 274 000$