3 дня назад
Principal Software Architect - Data Platform (Cybersecurity)
240 000 - 300 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Software Architect - Data Platform (Cybersecurity) (Kafka/Flink/Spark): Designing and setting direction for an internet-scale cybersecurity ratings data platform spanning ingestion, lakehouse storage, analytical serving, and customer-facing risk analytics with an accent on correctness, data contracts, quality, lineage, and reproducibility. Focus on architecting isolated serving paths, designing streaming and batch systems, managing schema evolution and backfills, and influencing engineering teams through technical design reviews.
Location: Hybrid in Austin, Texas, United States
Total compensation: $240,000–$300,000 per year, including base salary and bonus.
Company
provides cybersecurity ratings and risk management technology used to monitor companies, manage third-party risk, support board reporting, and inform cyber insurance underwriting.
What you will do
- Own the end-to-end system design of the data platform, from internet-scale ingestion through analytical serving.
- Define service boundaries, data contracts, schema ownership, compatibility rules, and breaking-change processes.
- Design the lakehouse, including table formats, partitioning, schema evolution, compaction, and metadata management.
- Architect isolated serving paths for customer-facing low-latency queries, internal analytics and Data Science exploration, and bulk partner feeds.
- Build data quality, observability, validation, quarantine, freshness, completeness, drift detection, lineage, and metadata into the platform.
- Set architectural direction through prototypes, Technical Design Reviews, design documentation, standards, cross-team reviews, and mentorship.
Requirements
- 10+ years of software or data engineering experience, including significant large-scale data platform architecture work.
- Deep experience with stream and batch processing using Kafka, Flink, Spark, or comparable technologies.
- Strong Python and PySpark, solid Java for Flink, and enough Scala to reason about Spark codebases.
- Production lakehouse experience with Parquet, Iceberg, partitioning, compaction, and schema evolution.
- Experience with OLAP and analytical serving systems such as ClickHouse, Druid, Pinot, BigQuery, or Snowflake.
- Strong distributed systems fundamentals, data quality and observability practices, large-scale migrations, technical writing, design reviews, and mentorship.
Nice to have
- Experience building data layers for ML or LLM systems, including feature stores, vector stores, or retrieval pipelines.
- Experience with internet-scale scan, telemetry, observability data, or cybersecurity.
- Experience reducing platform costs through storage tiering, query governance, or compute right-sizing.
Culture & Benefits
- Hybrid work arrangement with country-specific compensation and benefits.
- Stock options and health benefits.
- Unlimited paid time off and parental leave.
- Tuition reimbursement and additional company benefits.
- Immigration sponsorship is not provided for this position.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 дней назад
Data Platform Architect
140 000 - 180 000$
5 дней назад
Data Platform Architect
100 000 - 175 000$
6 дней назад
Data Architecture Technical Principal (Insurance)
115 000 - 213 000$
Databricks
4 дня назад
Senior Solutions Architect (Fintech)
219 100 - 301 300$
Databricks
4 дня назад
Sr. Solutions Architect - Financial Services (Fintech / Data Providers)
219 100 - 301 300$
Databricks
4 дня назад
Solutions Architect (Data and AI)
180 000 - 247 500$